University libraries are being swarmed by AI bots, putting public access at risk

[ownedbycats]

https://www.cbc.ca/news/world/univer...bots-9.7408287

Eric Hellman, executive director of Project Gutenberg — a U.S.-based volunteer organization that digitizes and archives cultural works and distributes eBooks — wrote in a blog last year that these bots, which he characterizes as poorly programmed "monstrosities," are "destroying open access" on the internet.

He tells CBC News that "everything's gotten worse" since he wrote that.

Hellman says the problem comes down to good bots and bad bots.

He explains that search engines like Google, and archiving sites like Internet Archive, use bots that follow robots.txt — voluntary sets of instructions on websites that tell them what they can and can't do, so they don't disrupt the site's functioning while gathering information.

AI scraping bots, on the other hand, sometimes ignore these rules and overwhelm websites — in some cases requesting thousands of documents a second and downloading them in every available format. [...]

He says Project Gutenberg is happy for its materials to be used as AI training data and even offers a one-click download of its entire library of books, "but the bots are too stupid to use it."

[Gormagon]

The bots just do what some coders told them to do...or if LLMs were used the LLMs produced rubbish when bots aren't following the restrictions of the robots.txt. There's also the possibilty that the bots were designed the way they act, i.e., not to obey any restrictions on websites.

[DNSB]

Originally Posted by Gormagon

There's also the possibilty that the bots were designed the way they act, i.e., not to obey any restrictions on websites.

Personally, I would vote for the bots being designed that way. My honeypot has been hit by multiple bots that basically wanted to download the entire site including a bunch of relatively small zip files that were designed to expand to multiple terabytes of output files. Do a search on 'decompression bomb' or 'zip bomb' for more on these files. Most utilities these days will detect some of these but still a PITA to deal with.

[nana77]

The even worse (imho, heard it this evening on broadcast) is that all of those server infrastructures in construction (there are quite a bunch in here too) are going to use ALOT of water, too.

[Gormagon]

And the problem is? The water is still there or do these servers use electrolysis to produce H₂ and O₂?

[DNSB]

Originally Posted by Gormagon

And the problem is? The water is still there or do these servers use electrolysis to produce H₂ and O₂?

And after the water is used to cool the servers, is it dumped into a river, sewer, whatever or is it cycled through a cooler and re-used?

[j.p.s]

Originally Posted by Gormagon

And the problem is? The water is still there or do these servers use electrolysis to produce H₂ and O₂?

The water problem is that some of these centers are being built in areas that are already using water faster than it is being replenished, such as Arizona, USA. (And really any area using Colorado River water. This is just an obvious example, there are many areas that do not have extra water available.)

Just because the water still exists on Earth doesn not mean water use is not a problem.

Note that even the recirculating systems still lose water.

[Karellen]

I've always found it strange that most of the data centres on the planet are built in the hottest part of the country which, of course, increases water consumption and energy use for cooling.

https://www.tomshardware.com/tech-in...-wrong-climate

https://restofworld.org/2025/data-center-heat-map/

[DNSB]

Perhaps datacenters should be built in locations such as Greenland. Add a compact nuclear reactor for the power.

[ownedbycats]

Originally Posted by Gormagon

And the problem is? The water is still there or do these servers use electrolysis to produce H₂ and O₂?

By this logic, droughts shouldn't ever happen.

[Sarmat89]

I find such 'news' hilarious. It is people pretending to do something worthwhile for the people(tm), but as it turns out, the AI is the only visitor who was ever interested in what they are doing. Their incapability to handle even a meager demand is so telling.

[rjwse@aol.com]

regarding industrial water. My father managed a plastics manufacturing plant in Germany (Ticona, Hostaform, Celcon) where water discharge from the plant (by law) had to be upstream of the plant's intake. Furthermore, the discharge water from the plant was used as the cafeteria's water source for cooking and drinking. All this worrisome blather about data centers using water and electricity never considers that eventually some kind of better computers in the future will become more efficient. Perhaps quantum computers? They might run on a nine volt battery.

[DiapDealer]

I don't dismiss concerns about data-center water consumption outright. But I do tend to notice that the same people who worry about it enough for the both of us, don't usually seem to be quite as distraught over golf courses' massive water consumption (especially those in arid locations).

Save a datacenter: RELOCATE VEGAS!!

[theducks]

Originally Posted by DiapDealer

I don't dismiss concerns about data-center water consumption outright. But I do tend to notice that the same people who worry about it enough for the both of us, don't usually seem to be quite as distraught over golf courses' massive water consumption (especially those in arid locations).

Save a datacenter: RELOCATE VEGAS!!

It always irked me all that warmed waters HEAT being discarded. There are so many processes that need heated water or warm air. We need more colocation of these kinds of industries. Crunch data, dry cloths or paint.

[ownedbycats]

Originally Posted by DiapDealer

I don't dismiss concerns about data-center water consumption outright. But I do tend to notice that the same people who worry about it enough for the both of us, don't usually seem to be quite as distraught over golf courses' massive water consumption (especially those in arid locations).

Save a datacenter: RELOCATE VEGAS!!

My province there's currently a deal going down for an AI datacenter. The same segment of population against that were also against a developer putting a golf course on prtected lands.