Current estimates say that every prompt you give a generative "AI" system— not each session, every PROMPT— is like pouring a 16 oz bottle of water onto the ground.
This is a fact that goes somewhere in every talk i give, now, & i always see audience members looking it up… and then looking horrified
Now for ChatGPT in specific it can range anywhere from 5 questions to 50 to hit that level of water consumption; depends on the density of representation of associated tokens in the training data (how much it's been trained on stuff connected to your prompt); but before you think "maybe not so bad"…
I deeply resent that I can't just not use it, I have to go out of my way to not use it, because if I'm not careful typing shit into a search engine now, it'll vomit up some AI prompt response NO MATTER WHAT, EVERY TIME, just reiterating what the first couple of search responses say.
But if it's not broken up into its molecular components, doesn't this water then simply go back into the water cycle?
(I keep seeing this emphasis on water consumption; it's easier for me to understand that generative ""AI"" consumes a shitton of power)
That estimate doesn't pass the smell test to me: EG, following bloomberg to a power/query estimate places each query at ~4 watt-hours per query. archive.is/if7hf There is no way it takes half a kg of water to cool both the computers and the power plants for the generation.
I remember being outraged when I learned that the Google's of legal research (Lexis and Westlaw) charged every time you clicked search. There was no technical basis for such charges, just greed. For LLMs though it would make sense for every click to cost real $$$. It must once the VC cash runs out.
Incredulous how some people, who consider themselves smart, proclaim that AI is the best thing that happen to the environment because "what else could drive development of green renewable energy than its biggest consumer."
Humans are naturally bad at scales. Agriculture across the world uses 2 quadrillion gallons of water annually, and about 40% of that is straight up wasted. How does this compare to agriculture?
The big trouble with the environmental impact of cloud technology —AI being part of it— is precisely its invisibility to the masses, which only see “magic” happening.
Summer in my corner of the world has felt hotter and longer this year than it’s ever been. How’s that for invisibility…
At first thought I was like "So I'm watering the plants by using AI?" Because honestly that was my first idea because I grow plants, even though you didn't mean it that way. Just a possibility of perspective difference for your analysis
Yipes.
I - as an analogue word merchant - only drink half that, and can run from about 8am until midnight on 16 ounces. Give me your wordless masses, longing for verbosity!
I may not be up to speed on all of this, but this is the first time I've seen the energy demands of a technology put in terms of *specifically* water instead of electricity in general. Is that normal these days?
Minor nit - the water used for cooling and electricity production isn’t potable water. It’s not as though it robbing people of drinking water, it’s literally just used to move heat around and doesn’t interrupt the earths water cycle.
I do agree with you about energy consumption tho, excessive.
My brain immediately thought of that ground becoming swampland, then becoming populated with mosquitoes, then becoming a breeding ground for malaria. I’m sure that still works for the metaphor somehow but I’m trying not to go there.
Is that the best example? Water is not destroyed by pouring it on the ground, it either soaks into the land, runs off into a body of water, and / or evaporates into the atmosphere. The bottle is waste but the water stays in the ecosystem.
I have a hard time understanding that. Once used for cooling, isn't the water just hot ? Or does it evaporate ? (Which would make more sense seeing what you are saying about wasting water)
It's all fun and games until the utility companies ratchet up these companies' water bills... and the tech companies use this (or even just the threat of it) to ratchet up the cost to the user.