Thread: University libraries are being swarmed by AI bots, putting public access at risk
View Single Post
Old Yesterday, 08:42 AM   #23
DiapDealer
Grand Sorcerer
DiapDealer ought to be getting tired of karma fortunes by now.DiapDealer ought to be getting tired of karma fortunes by now.DiapDealer ought to be getting tired of karma fortunes by now.DiapDealer ought to be getting tired of karma fortunes by now.DiapDealer ought to be getting tired of karma fortunes by now.DiapDealer ought to be getting tired of karma fortunes by now.DiapDealer ought to be getting tired of karma fortunes by now.DiapDealer ought to be getting tired of karma fortunes by now.DiapDealer ought to be getting tired of karma fortunes by now.DiapDealer ought to be getting tired of karma fortunes by now.DiapDealer ought to be getting tired of karma fortunes by now.
 
DiapDealer's Avatar
 
Posts: 29,915
Karma: 212736631
Join Date: Jan 2010
Device: Nexus 7, Kindle Fire HD
I've never really understood why anyone relied upon voluntary adherence to the robots.txt file in the first place. It's not as if bad actors were hard to predict.
DiapDealer is offline   Reply With Quote