MobileRead Forums
Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Library Management
Reload this Page Why is "Download Metadata" slow? And how can I speed it up?

Notices

Reply
 
Thread Tools Search this Thread
Old 07-09-2020, 08:31 PM   #1
droopy
Guru
droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.
 
Posts: 834
Karma: 2912460
Join Date: Apr 2009
Device: Kobo Forma
Why is "Download Metadata" slow? And how can I speed it up?
Why is "Download Metadata" slow? And how can I speed it up? I haven't changed anything much in the "Configure Metadata" dialog, aside from removing the check mark beside the box for downloading ratings.
droopy is offline   Reply With Quote
Old 07-09-2020, 10:17 PM   #2
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 45,355
Karma: 27182818
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Because it has to scrape websites and scraping websites fast gets yor ip banned.
kovidgoyal is offline   Reply With Quote
Advert
Old 08-16-2020, 08:00 PM   #3
droopy
Guru
droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.
 
Posts: 834
Karma: 2912460
Join Date: Apr 2009
Device: Kobo Forma
Quote:
Originally Posted by kovidgoyal View Post
Because it has to scrape websites and scraping websites fast gets yor ip banned.
I don't see anything to adjust this in Preferences>Tweaks. How can I make "Download Metadata" do 2 books at a time?
If I can open 2 Firefox tabs to point to 2 different books in Amazon, surely using Calibre to get info for 2 books at a time doesn't warrant a ban, yes?
droopy is offline   Reply With Quote
Old 08-16-2020, 08:07 PM   #4
theducks
Well trained by Cats
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 31,059
Karma: 60358908
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
Quote:
Originally Posted by droopy View Post
I don't see anything to adjust this in Preferences>Tweaks. How can I make "Download Metadata" do 2 books at a time?
If I can open 2 Firefox tabs to point to 2 different books in Amazon, surely using Calibre to get info for 2 books at a time doesn't warrant a ban, yes?
These are not Kovids rules. We make use of OTHER FOLKS resources without payment. WE WANT TO BE A GOOD NEIGHBOR so they let us visit.
2 books might not be an issue IF they both don't hit the same site, BUT... code so that does NOT happen takes a lot of effort
theducks is offline   Reply With Quote
Old 08-16-2020, 08:25 PM   #5
droopy
Guru
droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.droopy ought to be getting tired of karma fortunes by now.
 
Posts: 834
Karma: 2912460
Join Date: Apr 2009
Device: Kobo Forma
Quote:
Originally Posted by theducks View Post
These are not Kovids rules. We make use of OTHER FOLKS resources without payment. WE WANT TO BE A GOOD NEIGHBOR so they let us visit.
2 books might not be an issue IF they both don't hit the same site, BUT... code so that does NOT happen takes a lot of effort
Are we being bad neighbors when we open multiple tabs to, say, Amazon product pages?
Or multiple Firefox tabs to Goodreads books?
Or to Kobobooks?
droopy is offline   Reply With Quote
Advert
Old 08-16-2020, 08:43 PM   #6
theducks
Well trained by Cats
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 31,059
Karma: 60358908
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
Quote:
Originally Posted by droopy View Post
Are we being bad neighbors when we open multiple tabs to, say, Amazon product pages?
Or multiple Firefox tabs to Goodreads books?
Or to Kobobooks?
Tabs are mostly static, except when opening (ignoring all the ADS, which do not mostly hit that sites servers. besides, they get PAID for those ads)
But the are also NOT a BOT (or bot behavior). Calibre is a BOT for that purpose.
theducks is offline   Reply With Quote
Old 08-16-2020, 10:22 PM   #7
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 45,355
Karma: 27182818
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Quote:
Originally Posted by droopy View Post
I don't see anything to adjust this in Preferences>Tweaks. How can I make "Download Metadata" do 2 books at a time?
If I can open 2 Firefox tabs to point to 2 different books in Amazon, surely using Calibre to get info for 2 books at a time doesn't warrant a ban, yes?
No. I suggest you read up on how sites try to do bot detection.
kovidgoyal is offline   Reply With Quote
Old 02-19-2023, 04:20 PM   #8
Dullahir
Zealot
Dullahir can differentiate black from dark navy blueDullahir can differentiate black from dark navy blueDullahir can differentiate black from dark navy blueDullahir can differentiate black from dark navy blueDullahir can differentiate black from dark navy blueDullahir can differentiate black from dark navy blueDullahir can differentiate black from dark navy blueDullahir can differentiate black from dark navy blueDullahir can differentiate black from dark navy blueDullahir can differentiate black from dark navy blueDullahir can differentiate black from dark navy blue
 
Dullahir's Avatar
 
Posts: 146
Karma: 13316
Join Date: Nov 2010
Location: Deva, Romania
Device: Android
Sorry to necro this, but this is a perfect example of how ungrateful people are.
Dullahir is offline   Reply With Quote
Reply

« Previous Thread | Next Thread »

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
A warning for Linux users: slow "Add Books", "Unknown" title and Author rolgiati Library Management 8 07-24-2013 04:36 PM
Why tags download only after second click on "Download metadata"? fufu42 Library Management 2 12-08-2012 12:08 PM
How to speed up "Downloading Metadata/Covers"? butterbescotch Calibre 4 05-04-2011 09:58 PM
Does "Download Metadata & Covers" also download social metadata? iridius Library Management 3 02-22-2011 12:50 PM
Real download speed of Kindle "3G"? travfar Amazon Kindle 10 01-10-2011 01:09 PM


All times are GMT -4. The time now is 12:14 PM.

Contact Us - FAQ - Guidelines - Privacy - Top

MobileRead.com is a privately owned, operated and funded community.