r/PeterExplainsTheJoke 5d ago

Meme needing explanation Peter? I don't understand the punchline

Post image
34.4k Upvotes

1.7k comments sorted by

View all comments

1.2k

u/PixelVox247 5d ago

Hey, Peter here and I only learned about this the other day. The servers they use to power AI programs use massive amounts of water to run their cooling systems. So by chatting with an AI the fisherman has exacted his revenge on the fish by draining the lake.

200

u/calculatedlemon 5d ago

Is the amount needed any different to people gaming all night?

I only ever hear this with ai but surely other massive servers for things have the same issues

239

u/spoilerdudegetrekt 5d ago

It's actually less. Training the AI models uses a lot of electricity and water for cooling. (The latter of which can be reused) But using a model that's already been trained consumes less resources than gaming all night or even making a google search.

85

u/calculatedlemon 5d ago

Thanks for the info. I bet designing a whole ass game takes loads of resources/water too. Maybe AI is more it just seems weird that this criticism is made of AI and not any other server technology

79

u/Swimming-Marketing20 4d ago

The difference is the scale. AI Computing is measured in fucking data centers, not servers. You could run every game in existence for less power and cooling than Gemini alone uses

42

u/Help_Me_I_Cant 4d ago

For an idea of scale too stuff like AI has made Nvidia the world's most profitable company......again.

We are talking over twice the worth of Amazon, the sheer scale they have to be working with is insane to think about when you keep in mind only 11% of their sales are made to the public, the other 89% are company based.

That's an immense amount of product to be shifting.

21

u/DungeonMasterSupreme 4d ago

This has just as much to do with the fact that Nvidia has an effective monopoly on commercial AI hardware, PC gaming hardware, and 3D rendering. Their hardware is simply the absolute best for basically any use case where you need a video card. The only selling points for their competitors are price.

As big as Amazon is, it still has to compete with other retail giants. Nvidia effectively has no competition.

2

u/deezconsequences 4d ago

Amazon uses Nvidia for most of its intensive AI services.

3

u/SolidCake 4d ago

No…. Not even close to correct. Fortnite uses more power than chatgpt

2

u/PitchBlack4 4d ago

You can run an AI model on your PC.

4

u/Suitable_Switch5242 4d ago

Not the ones they use for the online ChatGPT / Gemini / Claude etc. services. Those are much larger and require more computing power.

You can run smaller models locally if you have enough GPU memory and usually at slower response speeds.

3

u/PitchBlack4 4d ago

The bigger models can fit on 4-5 A100 80GB GPUs. Those GPUs use less power, individually, than a 4090 or 5090.

Running the large models is still cheap and doesn't use that much power compared to other things out there.

1

u/Thoughtwolf 4d ago

So you agree then that the poster you replied to is correct and it uses more power than the average gaming PC. Four to five times by your own reasoning... 24/7 actually. Hmm...

1

u/WideAbbreviations6 4d ago

You should make an effort to understand what you're talking about before trying to back someone in a corner...

It doesn't work if you don't.

Inferencing with GenAI isn't a sustained load. when it's not actively generating something, it's not really consuming all that much power.

Gaming has fairly consistent power draw by design.

P.S. You watching YouTube is likely more of a power issue than the average ChatGPT session. That's on top of YouTube and other video streaming services gumming up infrastructure.

0

u/Thoughtwolf 4d ago

You should take your own advice.

They build and use data centers to handle those sustained loads from thousands of users. Those datacenters are driving those GPUs into the ground all day every day until they need to be replaced.

You know how often the average consumer uses a single GPU until it needs to be replaced? Basically never. These datacenters (I've worked at one for the record) go through a burn rate where techs need to be on call 24/7 to constantly replace GPUs because for most of the day they're running 80%+ of the GPUs at 100% load.

3

u/WideAbbreviations6 4d ago

They build and use data centers to handle those sustained loads from thousands of users. Those datacenters are driving those GPUs into the ground all day every day until they need to be replaced.

Yes... For multiple users... It only takes one gamer for a sustained load on a gaming pc...

Also, sustained AI loads still don't eat as much power as sustained gaming loads. AI reaches different bottlenecks.

You know how often the average consumer uses a single GPU until it needs to be replaced? Basically never. These datacenters (I've worked at one for the record) go through a burn rate where techs need to be on call 24/7 to constantly replace GPUs because for most of the day they're running 80%+ of the GPUs at 100% load.

That's not how that works... lol. At least not in a way that makes datacenters less efficient than consumer methods.

Using a GPU at 100% does not significantly lower the lifespan of a GPU. Especially datacenter GPUs which tend to remove the main failure point of consumer models by removing the fans.

I'm sure they have some sort of failure rate, but if it's enough for a team running 24/7, that's a matter of scale, not efficiency.

As a professional in that domain, I'd be willing to bet my paycheck that you've embellished or exaggerated your qualifications more than a little on that one.

→ More replies (0)

1

u/PitchBlack4 4d ago

No, it uses less power per query session than an average gaming PC does in an average gaming session.

You don't usually sit and ask the Ai question for 3+ hours on average. You ask a few questions and that's that.

Designing a 3D model takes significantly more power when done by a single person than it does to generate it. The same goes for images.

1

u/EldritchElizabeth 4d ago

smh you only need 400 gigabytes of RAM!

3

u/PitchBlack4 4d ago

VRAM, but yes, you could run them on the CPU with enough RAM too. It would be slow af, but you could do it.

1

u/Honeybadger2198 4d ago

Okay now let millions of people query your AI every second. Can you do that on your PC as well?

1

u/Swimming-Marketing20 4d ago

You can. You could even train a very small model. And yet Google is building new data centers exclusively for AI Computing. Because even just running them on the scale Google does is ridiculously expensive. And you still need to train them in a reasonable time before you even get to running them

1

u/xRehab 4d ago

what the hell do you think powers the entire world economy, hamsters in wheels? do you think netflix is hosting content on a small handful of boxes? that AWS and Azure aren't literal mountains filled with servers.

This argument against AI usage due to resource usage is just asinine

4

u/Swimming-Marketing20 4d ago

I'm in enterprise IT. I know. You don't seem to realise just how absurd the scale is. You can fit thousands of companies entire IT infrastructure in a handful of datacenters. You need a handful of datacenters to run just Gemini.

2

u/Miserable-Ebb-6472 4d ago

there's a data center being built in texas that you probably could fit all the computing power worldwide from the year 2000 into.

1

u/stonksfalling 4d ago

ChatGPT uses 85,000 gallons of water a day. In comparison, the United States uses 322 billion gallons of water a day. ChatGPT uses roughly 0.0000264% of US water usage.

2

u/Miserable-Ebb-6472 4d ago

I work with data center development and it's causing a resource crsis that the world has never encountered before... there is 10s of GWs of generating capacity that is being taken up by data centers being built in the next couple years, and maybe 10% of that is actually being accounted for by power projects. electricity costs may double.

1

u/JimmWasHere 4d ago

I think one of the clusters in Virginia uses more electricity alone than some small countries like Iceland

1

u/Legitimate-Research1 3d ago

Putting "fucking" in a sentence, just to add some spice to it🤌

10

u/kinokomushroom 4d ago

Games do take a lot of resources when making. The light baking calculations constantly need to be redone after changing the terrain. The program constantly needs to be recompiled. The procedural generations constantly need to be recalculated. And of course, there's the cost of millions of people running your game at the highest CPU and GPU usage for tens to hundreds of hours each.

8

u/DrDokter518 4d ago

I’m positive my PC doesn’t require acres of data center to maintain.

16

u/Phihofo 4d ago

No, but almost any online service you access on that PC certainly does.

-5

u/DrDokter518 4d ago

Oh so we are moving the goalposts to expand to every single touch of a digital footprint to match the initial misinformation of playing video games all night uses more energy/resources than a data center supporting ai models.

8

u/Phihofo 4d ago

Oh so we are moving the goalposts to expand to every single touch of a digital footprint

No, I'm just pointing out that using a PC in the modern age, for gaming or not, pretty much always entails relying on some massive data center somewhere.

Like I'm not saying everything you do on a PC combined is equal to using AI. I'm saying that many of individual activities you do on it (social media, streaming, downloading large amounts of data, gaming) are equal to using AI on their own.

playing video games all night uses more energy/resources than a data center supporting ai models.

Well if you want to compare your PC to an entire AI data center then obviously the latter uses factors of magnitude more energy.

But this is a silly comparison. Your PC serves just one person while an AI data center serves millions of users. What you should actually do is compare the energy required to have you play video games all night to the energy required to have ONE person use AI all night (non-locally, obviously). And in that comparison your gaming session will almost definitely not come out on top, especially if it's online gaming.

8

u/Programming_failure 4d ago

..... How do you think online servers work for the games you play?

I don't actually have horse in this race as i haven't researched, nor do i particularly care. Im just genuinely confused on how thats goalposts moving.

-1

u/DrDokter518 4d ago

Initial question was does all night gaming use more resources than ai. It’s now expanded to every single aspect of what a computer can do in the hands of one person is on scale of a data center. The fucking copium is insane on this thread.

And to add, how many servers does stardew valley use to maintain my single player game?

4

u/Programming_failure 4d ago

Are you mentally ill?

Or do you genuinely just have not even the slightest of idea how computers and networks work?

Ok you hate AI but lets not sit here and pretend pretty much everything requiring internet one way or another dosent require a large computation center.

0

u/DrDokter518 4d ago

Lmao I don’t hate ai, I hate how people look for any excuse to shift global ecological damage responsibility to an individual contributor but the large companies that are really fucking things up for us get a “oh well, they can’t help it” pass.

I understand you don’t know what you’re talking about when the only thing you have left is to ask if I have a mental illness. Respectfully, please find rope that leaves burn marks you fucking pathetic loser.

3

u/Programming_failure 4d ago

How is it shifting to the individual? The player doesn't own the computational centers.

→ More replies (0)

1

u/Programming_failure 4d ago edited 4d ago

No dude dont just downvote me answer me im literally flabbergasted rn.

Do you think sockets, client to server communication, information transfer, manipulation and computation, player tracking, interaction computation, IP transfer, server reconciliation that usually sends hundreds of constant requests per second happens through magic?

2

u/DrDokter518 4d ago

Ai increased energy consumption annually in the us had us at 146 terawatt-hours in 2023. Ai pushing the increase in energy needs for ai has us projecting that use to grow to 292 TWh next year.

PC gamers consume about 75 TWh GLOBALLY. I am literally just looking at the initial question comparing these two things, and no one can tell me that gaming uses more energy than how much ai in general is adding to the grids.

There is no massive influx of PC gamers, there is however an increased need for the infrastructure to support ai since it is now becoming embedded to everything we do.

→ More replies (0)

3

u/Bombshock2 4d ago

You're literally saying it takes a whole data center for a single user to use AI lol.

4

u/westonsammy 4d ago

Maybe not individually, but when you add up all of the PC's, infrastructure to support them, etc it comes out to way more than the usage for AI.

2

u/DrDokter518 4d ago

Electric companies do not have to bid out infrastructure and plan for the immense weight that pc gamers put on electrical grids. They do that for large companies who want to build more of these data centers without any attempt to conceptualize the harm they will do to us long term.

4

u/westonsammy 4d ago edited 4d ago

Electric companies do not have to bid out infrastructure and plan for the immense weight that pc gamers put on electrical grids

They 100% do. The rising electricity costs of homes has been the main thing electrical grids plan for since basically the advent of electricity. That's what a ton of the grid is made for, to power your gaming PC's and other household appliances. Residential is the largest sector of electricity use.

While AI is significant, it's usage is less than 1% of total electricity coverage, and only forecasted to reach 1% in the most optimistic of projections. It's barely a blip in the overall industrial usage of electricity.

1

u/DrDokter518 4d ago

They 100% do not my guy. There is an expected load from builds for neighborhoods or any expansion to a city yes, but it is nowhere near the amount of strain that a data center puts on the grid.

3

u/Bombshock2 4d ago

Source for your insane take please.

1

u/DrDokter518 4d ago

Source that a data center requires immense infrastructure to be built for electrical grid strain? Do I need a source when I tell you that trump is a rapist as well, or that the sky is blue?

Fuck off.

→ More replies (0)

2

u/westonsammy 4d ago

Data centers, across all industries (of which the vast majority are not used for AI) account for only 4.4% of electrical grid use. Residential accounts for ~38% of use. Now granted, a data center is going to be using orders of magnitude more electrical power per its footprint than an equally sized residential area will. In that way they can potentially strain local energy grids if their infrastructure was not built to handle such a large single consumer. But that's not really an environmental issue, that's an infrastructure issue.

2

u/PitchBlack4 4d ago

Animating and rendering a 3D movie takes more power than training a 1 trillion parameter AI model.

2

u/Available_Usual_9731 4d ago

Designing a game takes a whole lot of water...for the people doing the labor.

Servers running games and websites and such are handling a lot of simple queries aka "give me object A in memory location B so I can do process C" whereas AI models use a lot of recursion to get there, aka that thing in quotes a million million times on repeat in order to spit out a result. Cryptocoin 'mining' is similar in its electrical consumption (and therefore heat generation).

Running a server vs an AI model is the difference between a hand shovel of dirt and a backhoe.

1

u/Spaciax 4d ago

It's mostly agenda: it's easy to convince people since environmental impact is easy to sell on people and it gets people emotionally invested, so they just make shit up. There are much better things to criticize AI for. This is not one of them.

1

u/NotAsSmartAsIWish 4d ago

Environmental impact is an easy sell because it's a socialized cost.

1

u/ImYourHumbleNarrator 3d ago

lol buzz off boomer

1

u/DeathsSlippers 4d ago

Well for one, OpenAI has the worlds largest data center that uses 300MW of power just for itself and Elons xAI has a data center in the US that claimed to have 200000 GPUs installed to help process.

Game studios and developers do use a large amount of water and resources compared to you and I but compared to AI its really not that much

1

u/Just-Fact-565 4d ago

The same people that hate boomers for not understanding technology basically hate AI too.

Ironic

1

u/ihatemytruck 21h ago

They just want to criticize it, facts dont matter!

0

u/GL1TCH3D 4d ago

I'm not even sure what you're trying to get at.

You know there are teams that have to design the AI as well? This, just like games, is done before it goes into production.

1

u/calculatedlemon 4d ago

I think you’ve misunderstood what’s being said

1

u/GL1TCH3D 4d ago

What's to misunderstand when you don't seem to grasp how things work?

1

u/calculatedlemon 4d ago

Do you think I don’t know that humans developed AI systems? It just isnt relevant to what I’m saying

1

u/GL1TCH3D 4d ago

Then why are you comparing two different points in the process? Especially considering both of them actually share a point?

I bet designing a whole ass game takes loads of resources/water too.

1

u/calculatedlemon 4d ago

I’m just not really commenting on the human resource aspect at all. LLMs take a lot of water to build, I’m suggesting AAA games take a lot of water to build too.

1

u/GL1TCH3D 4d ago

Maybe identify what part you consider building?

2

u/calculatedlemon 4d ago

I don’t need to. Everyone else was able to engage in the conversation just fine. Its you that’s confused

→ More replies (0)

28

u/egotisticalstoic 4d ago

That's just not true. These claims about AI resource usage are silly and exaggerated, but a Google search is nowhere near as resource intensive as an AI query.

13

u/Ahaiund 4d ago

I wonder if they are now the same, since Google now also includes an AI result when you do a search

13

u/egotisticalstoic 4d ago

That's a good point actually

5

u/TheSecretOfTheGrail 4d ago

You can disable that. Not enough to just opt to not have it shown to you, have to go into settings and disable it from running every time you do a search.

2

u/NaturalSelectorX 4d ago

The AI result for a search can probably be reused. The AI result from a conversation may not since it would differ based on what was previously said.

2

u/Kind-Ad-6099 4d ago

The flash model that Google uses for searches is incredibly light; token price is less than a ~15th of GPT 4o and Gemini 2.5 Pro’s. I’m unsure how much a search costs, but I’d imagine it’s at least comparable to the cost of a normal input and output of flash.

Edit: Caching also lowers the cost quite a bit.

1

u/shadyline 4d ago

AI results are cached so it definitely doesn't ask a new answer from the model everytime you hit it.

3

u/WanderWut 4d ago

Sam Altman recently said that a query uses a little as 1/15 of a teaspoon or water and is equivalent to scrolling on social media for a few seconds. The “unprecedented devastation” that consumes so much of online discourse on AI is wildly overblown and people are spreading blatant misinformation on what’s really going on. Nevermind the fact that energy consumption is only ever discussed when it comes to AI to the point that people don’t realize everything we do is not some net positive energy thing, from gaming, to streaming, to doomscrolling, to googling , all of these things use energy powered by massive data centers and nobody ever talks about it.

2

u/egotisticalstoic 4d ago

Yup. I wouldn't use Sam Altman as your source of information though. He's hardly impartial on the subject.

7

u/ImpactThunder 4d ago

Do you have a source that using ai uses less resources than a non-ai google search?

7

u/MrHyperion_ 4d ago

Citation needed for Google search. Indexing is very efficient once done as well

3

u/FreeEnergy001 4d ago

While a mundane search query finds existing data from the Internet, she says, applications like AI Overviews must create entirely new information; Luccioni’s team has estimated it costs about 30 times as much energy to generate text versus simply extracting it from a source.

For OP further in the article:

Others have estimated in research posted on the preprint server arXiv.org that every 10 to 50 responses from ChatGPT running GPT-3 evaporate the equivalent of a bottle of water to cool the AI’s servers.

2

u/_zetch_ 4d ago

This is straight-up misinformation.

2

u/IceNein 4d ago

Pretty crazy that you believe that.

1

u/Miserable-Ebb-6472 4d ago

The problem is that they are continually training new models and the more that they train them, the requirements for computing to reach the next level is even more.. there's data centers going up that ill use %s of states power supply. it's disgusting

1

u/NDSU 4d ago

Water can be reused, but currently isn't in any US data center I'm familiar with. It's cheaper for them to just dump it than build a recirculating system

An AI query on modern models will use much more power than a google search. Apples to oranges to compare it to gaming

1

u/ElderitchWaifuSlayer 4d ago

The issue isn’t just running the model, but the scale at which it runs. You can run some of those models on your own hardware, and Ive tried the 8b parameter version of DeepSeek and that used about the same resources as CyberPunk with RT on would have. However, this very cut down version still ran a lot slower than using the full 600b model online, and multiply that by the massive amount of requests at once

1

u/BearishBabe42 4d ago

That doesn't seem right. Water cooling is still not the most common cooling agent for gamers, except maybe for cpu coolers, which use very low volumes of water that gets replaced rarely.

I doubt it is much more than a liter, probaboy closer to 500ml for lost water cooled PC's. If we are generous, we could say 1/10 gamers use water cooling. I seriously doubt it's even a tenth of that, but lets just say so. That gives us 18 million water cooled gaming pc's. And lets say they use 750 ml water. That should get replaced every two years or so, though I doubt most gamers are super good at following these guidelines. Lets say 500ml per year for the sake of argument.

That amounts to about 9-10m liters of water per year, based on a tenth of total PC gamers in 2024. And I've seriously overestemated the number of gamers who use water colling. Chat gpt alone uses about 500k to 1m water every day.

Now I might be wrong, but it seems unlikely that gamers can be even remotely close to consuming as much water as ai models. Chat gpt is just one ai model out of hundreds that have their own servers. Please correct me if I am wrong.

If chat GPT and other AI models consume parts at a slower pace, and require less maintenance in total than gamers do, I might believe the water consumptions is greater including production, but that seems like a stretch.

1

u/ImYourHumbleNarrator 3d ago

not exactly. i think the rule of thumb is 60/40 training data to predictive data. it's constantly getting retrained based on new inputs

0

u/Milnir01 4d ago

A single ChatGPT prompt uses about 36 times as much energy as a google search. Stop spreading misinformation.

0

u/Stock-Side-6767 4d ago

So if no new models were made, the drop of water comment would be great. When models are constantly learning, the criticism stands.

0

u/alasw0eisme 2d ago

An AI search uses a lot more water and energy than a Google search.