|
|
#1 |
|
Zealot
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 125
Karma: 2137668
Join Date: Mar 2015
Location: Groton, MA
Device: Kindle app on Samsung Tab
|
Batch Metadata Download Broken 9.2(?)
I can download metadata manually but the batch download, which I use a lot, is failing in multiple ways:
|
|
|
|
|
|
#2 |
|
Well trained by Cats
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 31,512
Karma: 62503986
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
|
What sites are enabled?
More and more sites are now protected by Cloudflare and the block filter kicks in when traffic gets high. |
|
|
|
| Advert | |
|
|
|
|
#3 |
|
Bibliophagist
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 50,286
Karma: 178402650
Join Date: Jul 2010
Location: Vancouver
Device: Kobo Sage, Libra Colour, Lenovo M8 FHD, Paperwhite 4, Tolino epos
|
I've seen that for longer than I care to think about. It seems the batch downloads are a great way to trigger DOS protection. One recent test with Amazon got me 2 good returns and then nothing. After ~2 hours, that repeated. If I did each of the books as a individual download, there were no issues likely because of my delays checking metadata and choosing covers.
|
|
|
|
|
|
#4 |
|
Zealot
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 125
Karma: 2137668
Join Date: Mar 2015
Location: Groton, MA
Device: Kindle app on Samsung Tab
|
I tried the obvious VPN solution and I got another timeout on 137 metadata download. A may try a different node, but I'm all out of ideas. Any other suggestions?
Does it help to disable probing any particular service? Amazon being the most suspect. |
|
|
|
|
|
#5 |
|
Zealot
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 125
Karma: 2137668
Join Date: Mar 2015
Location: Groton, MA
Device: Kindle app on Samsung Tab
|
I tried a Canada node and things are just as bad if not worse. Looks like batch download is no longer an option for me unless somebody has another idea.
|
|
|
|
| Advert | |
|
|
|
|
#6 |
|
null operator (he/him)
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 22,341
Karma: 30621608
Join Date: Mar 2012
Location: Sydney Australia
Device: none
|
Every calibre metadata download represents a potential loss of revenue for Amazon, Google, etc, etc. It is in their interest to put a guard at their gate.
BR |
|
|
|
|
|
#7 |
|
Bibliophagist
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 50,286
Karma: 178402650
Join Date: Jul 2010
Location: Vancouver
Device: Kobo Sage, Libra Colour, Lenovo M8 FHD, Paperwhite 4, Tolino epos
|
I think it is more of what appears to Amazon and other vendors' to be a denial of service attack. For my uses, the last large batch of books I got was a Humble Bundle which was large enough I tried the batch download and it stalled very rapidly. With the timeout required for the DOS block to expire, it was simply faster and easier to do individual updates.
During my testing on Amazon, I once triggered a simultaneous download of 17 Kindle and Fire firmware updates. The total download speed dropped from ~750Mbps to <1Mbps within 30 seconds and eventually all 17 downloads timed out. |
|
|
|
|
|
#8 |
|
Zealot
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 125
Karma: 2137668
Join Date: Mar 2015
Location: Groton, MA
Device: Kindle app on Samsung Tab
|
Yeah I have been experimenting over the last few days. Unchecking Amazon as a source actually causes the batch system to never start the downloads. Things are a little better without the VPN but it still hangs about 50%. The only way I have had a batch job complete is to select a tiny number (1-5) with Amazon turned on. Not really useable for me anymore. ISP is Verizon (US Fiber Connection). VPN is PIA.
|
|
|
|
![]() |
| Tags |
| batch, metadata download |
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Batch download pdf's ? | bobodude | General Discussions | 25 | 09-04-2015 07:32 AM |
| Broken "Download Metadata and Covers" | OldLincoln | Calibre | 9 | 11-14-2014 04:46 PM |
| 0.8.46 - Download Metadata broken! | Elric667 | Calibre | 2 | 04-07-2012 08:35 AM |
| batch updating metadata | webwizard | Library Management | 5 | 04-15-2011 05:40 PM |
| Classic Batch download of B&N eBooks? | mgmueller | Barnes & Noble NOOK | 5 | 02-08-2010 01:01 PM |