Calibre 3.15 not downloading some book metadata from Amazon

shauntih · 01-07-2018, 04:11 PM

I've been having a problem with Calibre not downloading metadata for some books from Amazon. The book is on Amazon and can easily be found with a search of their site, but Calibre cannot find it. This is happening with version 3.15, and also happened with the previous version. Sometimes, but not always when this happens, Calibre can find it on Goodreads, but I want the Amazon data. I've tried with and without the Ids, and it makes no difference. Why is this happening, when the book is easily found on the Amazon site?

An example of the error details, when restricted to just Amazon download metadata, is listed below. This book is for Awaken by G.R. Thomas.

Thanks in advance for any help!
----------------------------------------------------------------------------------
calibre, version 3.15.0
ERROR: No matches found: <p>Failed to find any books that match your search. Try making the search <b>less specific</b>. For example, use only the author's last name and a single distinctive word from the title.<p>To see the full log, click "Show details".

Running identify query with parameters:
{u'timeout': 30, u'title': u'Awaken', u'authors': [u'G.R. Thomas'], u'identifiers': {}}
Using plugins: Amazon.com (1, 2, 0)
The log from individual plugins is below

****************************** Amazon.com (1, 2, 0) ******************************
Found 0 results
Downloading from Amazon.com took 4.41700005531
User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_2) AppleWebKit/602.3.12 (KHTML, like Gecko) Version/10.0.2 Safari/602.3.12
Server: auto
Making google query: https://www.google.com/search?q=Awak...www.amazon.com
Ignoring u'Amazon.com: Customer reviews: Awaken (Thomas Gold Remix)' as it has no cached page
Getting details from: https://webcache.googleusercontent.c...&ct=clnk&gl=us
Failed to make details query: 'https://webcache.googleusercontent.com/search?q=cache:z4vuaULvgoEJ:https://www.amazon.com/Awaken-Musica...&ct=clnk&gl=us'
Traceback (most recent call last):
File "site-packages\calibre\ebooks\metadata\sources\amazon.py ", line 50, in parse_details_page
File "site-packages\mechanize\_mechanize.py", line 239, in open_novisit
File "site-packages\mechanize\_mechanize.py", line 310, in _mech_open
httperror_seek_wrapper: HTTP Error 503: Service Unavailable

get_details failed for url: 'https://webcache.googleusercontent.com/search?q=cache:z4vuaULvgoEJ:https://www.amazon.com/Awaken-Musica...&ct=clnk&gl=us'
Traceback (most recent call last):
File "site-packages\calibre\ebooks\metadata\sources\amazon.py ", line 321, in run
File "site-packages\calibre\ebooks\metadata\sources\amazon.py ", line 328, in get_details
TypeError: 'NoneType' object is not iterable

Getting details from: https://webcache.googleusercontent.c...&ct=clnk&gl=us
Failed to make details query: 'https://webcache.googleusercontent.com/search?q=cache:3zeE5hQvnrEJ:https://www.amazon.com/Awaken-Thomas...&ct=clnk&gl=us'
Traceback (most recent call last):
File "site-packages\calibre\ebooks\metadata\sources\amazon.py ", line 50, in parse_details_page
File "site-packages\mechanize\_mechanize.py", line 239, in open_novisit
File "site-packages\mechanize\_mechanize.py", line 310, in _mech_open
httperror_seek_wrapper: HTTP Error 503: Service Unavailable

get_details failed for url: 'https://webcache.googleusercontent.com/search?q=cache:3zeE5hQvnrEJ:https://www.amazon.com/Awaken-Thomas...&ct=clnk&gl=us'
Traceback (most recent call last):
File "site-packages\calibre\ebooks\metadata\sources\amazon.py ", line 321, in run
File "site-packages\calibre\ebooks\metadata\sources\amazon.py ", line 328, in get_details
TypeError: 'NoneType' object is not iterable

Getting details from: https://webcache.googleusercontent.c...&ct=clnk&gl=us
Failed to make details query: 'https://webcache.googleusercontent.com/search?q=cache:TNm1t1TMVGYJ:https://www.amazon.com/Awaken-Thomas...&ct=clnk&gl=us'
Traceback (most recent call last):
File "site-packages\calibre\ebooks\metadata\sources\amazon.py ", line 50, in parse_details_page
File "site-packages\mechanize\_mechanize.py", line 239, in open_novisit
File "site-packages\mechanize\_mechanize.py", line 310, in _mech_open
httperror_seek_wrapper: HTTP Error 503: Service Unavailable

get_details failed for url: 'https://webcache.googleusercontent.com/search?q=cache:TNm1t1TMVGYJ:https://www.amazon.com/Awaken-Thomas...&ct=clnk&gl=us'
Traceback (most recent call last):
File "site-packages\calibre\ebooks\metadata\sources\amazon.py ", line 321, in run
File "site-packages\calibre\ebooks\metadata\sources\amazon.py ", line 328, in get_details
TypeError: 'NoneType' object is not iterable

************************************************** ******************************
The identify phase took 4.60 seconds
The longest time (4.417000) was taken by: Amazon.com
Merging results from different sources and finding earliest publication dates from the worldcat.org service
We have 0 merged results, merging took: 0.00 seconds

kovidgoyal · 01-07-2018, 09:26 PM

Google is throttling you, see the "Service unavailable errors" in the log. I suggest changing the servers from which amazon metadata is downloaded in Preferences->Downloading metadata to either bing or amazon itself.

shauntih · 01-08-2018, 04:51 PM

I saw that Google was causing an issue, but I didn't know what to do about it. I had no idea that could even be modified. Thank you so much for the suggestion! Hopefully that will fix my problem!

PetrusV · 03-20-2018, 06:43 AM

Quote:

Originally Posted by kovidgoyal

Google is throttling you, see the "Service unavailable errors" in the log. I suggest changing the servers from which amazon metadata is downloaded in Preferences->Downloading metadata to either bing or amazon itself.

Kovid! You are a legend!!! I've been having endless problems with downloading metadata info from Amazon. This totally fixed my problem!!!!!!!!

seacity1 · 06-06-2018, 12:10 PM

Unable to find metadata even with ISDN. This just started today. Happening on all searches. Have tried about 10 Using 3.17. Overdrive plug in finds book at 3 libraries.

Running identify query with parameters:
{u'timeout': 30, u'title': u'What Truth Sounds Like', u'identifiers': {}, u'authors': [u'Michael Eric Dyson']}
Using plugins: Google (1, 0, 0), Amazon.com (1, 2, 2), Overdrive (1, 0, 0)
The log from individual plugins is below

****************************** Overdrive (1, 0, 0) ******************************
Found 0 results
Downloading from Overdrive took 2.15100002289
Initial query is Michael Eric Dyson
Cross reference query is Sounds

************************************************** ******************************

****************************** Google (1, 0, 0) ******************************
Found 0 results
Downloading from Google took 1.17199993134
Making query: https://books.google.com/books/feeds...ewability=none

************************************************** ******************************

****************************** Amazon.com (1, 2, 2) ******************************
Found 0 results
Downloading from Amazon.com took 0.473000049591
User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.95 Safari/537.36
Server: auto
Plugin Amazon.com failed
Traceback (most recent call last):
File "site-packages\calibre\ebooks\metadata\sources\identify. py", line 48, in run
File "<string>", line 1350, in identify
File "<string>", line 1279, in search_search_engine
AttributeError: 'dict' object has no attribute 'google_url_processor'

************************************************** ******************************
The identify phase took 2.23 seconds
The longest time (2.151000) was taken by: Overdrive
Merging results from different sources and finding earliest publication dates from the worldcat.org service
We have 0 merged results, merging took: 0.00 seconds

kovidgoyal · 06-06-2018, 12:25 PM

update calibre

seacity1 · 06-06-2018, 12:57 PM

Thanks! I just did. It seems to be working now.

chabietdatgi · 06-06-2018, 01:36 PM

I had the same problem, Goodread and Google still worked. I tried to change source, and it didn't work.
Update: Now it's work.

"calibre, version 3.25.0
ERROR: Download failed: Failed to download metadata or cover for the selected book.

Walden Or Life In The Woods (Failed metadata) (Failed cover)"

seacity1 · 06-06-2018, 03:08 PM

I just realized the only source for metadata it is finding is Amazon. It is also searching Google, Open Library & Overdrive (per settings in preferences ) but has found 0 books in 15 searches. I removed the ISDN as I thought that might be throwing it off but that made no difference. I am using 3.25. In the past I sometimes did not get an Overdrive result but consistently always got Google in addition to Amazon.

01-07-2018, 04:11 PM	#1
shauntih Junior Member Posts: 8 Karma: 10 Join Date: Sep 2013 Device: Kindle	Calibre 3.15 not downloading some book metadata from Amazon I've been having a problem with Calibre not downloading metadata for some books from Amazon. The book is on Amazon and can easily be found with a search of their site, but Calibre cannot find it. This is happening with version 3.15, and also happened with the previous version. Sometimes, but not always when this happens, Calibre can find it on Goodreads, but I want the Amazon data. I've tried with and without the Ids, and it makes no difference. Why is this happening, when the book is easily found on the Amazon site? An example of the error details, when restricted to just Amazon download metadata, is listed below. This book is for Awaken by G.R. Thomas. Thanks in advance for any help! ---------------------------------------------------------------------------------- calibre, version 3.15.0 ERROR: No matches found: <p>Failed to find any books that match your search. Try making the search <b>less specific</b>. For example, use only the author's last name and a single distinctive word from the title.<p>To see the full log, click "Show details". Running identify query with parameters: {u'timeout': 30, u'title': u'Awaken', u'authors': [u'G.R. Thomas'], u'identifiers': {}} Using plugins: Amazon.com (1, 2, 0) The log from individual plugins is below **************************** Amazon.com (1, 2, 0) ************************** Found 0 results Downloading from Amazon.com took 4.41700005531 User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_2) AppleWebKit/602.3.12 (KHTML, like Gecko) Version/10.0.2 Safari/602.3.12 Server: auto Making google query: https://www.google.com/search?q=Awak...www.amazon.com Ignoring u'Amazon.com: Customer reviews: Awaken (Thomas Gold Remix)' as it has no cached page Getting details from: https://webcache.googleusercontent.c...&ct=clnk&gl=us Failed to make details query: 'https://webcache.googleusercontent.com/search?q=cache:z4vuaULvgoEJ:https://www.amazon.com/Awaken-Musica...&ct=clnk&gl=us' Traceback (most recent call last): File "site-packages\calibre\ebooks\metadata\sources\amazon.py ", line 50, in parse_details_page File "site-packages\mechanize\_mechanize.py", line 239, in open_novisit File "site-packages\mechanize\_mechanize.py", line 310, in _mech_open httperror_seek_wrapper: HTTP Error 503: Service Unavailable get_details failed for url: 'https://webcache.googleusercontent.com/search?q=cache:z4vuaULvgoEJ:https://www.amazon.com/Awaken-Musica...&ct=clnk&gl=us' Traceback (most recent call last): File "site-packages\calibre\ebooks\metadata\sources\amazon.py ", line 321, in run File "site-packages\calibre\ebooks\metadata\sources\amazon.py ", line 328, in get_details TypeError: 'NoneType' object is not iterable Getting details from: https://webcache.googleusercontent.c...&ct=clnk&gl=us Failed to make details query: 'https://webcache.googleusercontent.com/search?q=cache:3zeE5hQvnrEJ:https://www.amazon.com/Awaken-Thomas...&ct=clnk&gl=us' Traceback (most recent call last): File "site-packages\calibre\ebooks\metadata\sources\amazon.py ", line 50, in parse_details_page File "site-packages\mechanize\_mechanize.py", line 239, in open_novisit File "site-packages\mechanize\_mechanize.py", line 310, in _mech_open httperror_seek_wrapper: HTTP Error 503: Service Unavailable get_details failed for url: 'https://webcache.googleusercontent.com/search?q=cache:3zeE5hQvnrEJ:https://www.amazon.com/Awaken-Thomas...&ct=clnk&gl=us' Traceback (most recent call last): File "site-packages\calibre\ebooks\metadata\sources\amazon.py ", line 321, in run File "site-packages\calibre\ebooks\metadata\sources\amazon.py ", line 328, in get_details TypeError: 'NoneType' object is not iterable Getting details from: https://webcache.googleusercontent.c...&ct=clnk&gl=us Failed to make details query: 'https://webcache.googleusercontent.com/search?q=cache:TNm1t1TMVGYJ:https://www.amazon.com/Awaken-Thomas...&ct=clnk&gl=us' Traceback (most recent call last): File "site-packages\calibre\ebooks\metadata\sources\amazon.py ", line 50, in parse_details_page File "site-packages\mechanize\_mechanize.py", line 239, in open_novisit File "site-packages\mechanize\_mechanize.py", line 310, in _mech_open httperror_seek_wrapper: HTTP Error 503: Service Unavailable get_details failed for url: 'https://webcache.googleusercontent.com/search?q=cache:TNm1t1TMVGYJ:https://www.amazon.com/Awaken-Thomas...&ct=clnk&gl=us' Traceback (most recent call last): File "site-packages\calibre\ebooks\metadata\sources\amazon.py ", line 321, in run File "site-packages\calibre\ebooks\metadata\sources\amazon.py ", line 328, in get_details TypeError: 'NoneType' object is not iterable ********************************************** **************************** The identify phase took 4.60 seconds The longest time (4.417000) was taken by: Amazon.com Merging results from different sources and finding earliest publication dates from the worldcat.org service We have 0 merged results, merging took: 0.00 seconds

06-06-2018, 01:36 PM	#8
chabietdatgi Junior Member Posts: 3 Karma: 10 Join Date: May 2018 Device: Kindle PPW2	I had the same problem, Goodread and Google still worked. I tried to change source, and it didn't work. Update: Now it's work. "calibre, version 3.25.0 ERROR: Download failed: Failed to download metadata or cover for the selected book. Walden Or Life In The Woods (Failed metadata) (Failed cover)" Last edited by chabietdatgi; 06-07-2018 at 12:57 AM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Calibre not downloading metadata from Amazon	newkindlefun	Library Management	5	04-12-2016 12:17 PM
Metadata not downloading from Amazon?	bauerhjb	Library Management	3	09-23-2013 11:15 PM
Calibre not downloading metadata or cover images from Amazon?	bgalbrecht	Calibre	2	04-27-2013 11:14 PM
Calibre not downloading metadata	Japes	Calibre	11	10-20-2011 06:55 AM
Calibre Hangs when downloading Metadata	Rudyman	Library Management	9	08-19-2011 11:17 AM

01-07-2018, 09:26 PM	#2
kovidgoyal creator of calibre Posts: 43,843 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Google is throttling you, see the "Service unavailable errors" in the log. I suggest changing the servers from which amazon metadata is downloaded in Preferences->Downloading metadata to either bing or amazon itself.

01-08-2018, 04:51 PM	#3
shauntih Junior Member Posts: 8 Karma: 10 Join Date: Sep 2013 Device: Kindle	I saw that Google was causing an issue, but I didn't know what to do about it. I had no idea that could even be modified. Thank you so much for the suggestion! Hopefully that will fix my problem!

06-06-2018, 12:10 PM	#5
seacity1 Zealot Posts: 139 Karma: 84296 Join Date: Nov 2012 Location: Florida Device: Samsung Galaxy 10.1 2014 Edition,Nook HD+, Nook Color, Nook ST & Ipad3	Unable to find metadata even with ISDN. This just started today. Happening on all searches. Have tried about 10 Using 3.17. Overdrive plug in finds book at 3 libraries. Running identify query with parameters: {u'timeout': 30, u'title': u'What Truth Sounds Like', u'identifiers': {}, u'authors': [u'Michael Eric Dyson']} Using plugins: Google (1, 0, 0), Amazon.com (1, 2, 2), Overdrive (1, 0, 0) The log from individual plugins is below **************************** Overdrive (1, 0, 0) ************************** Found 0 results Downloading from Overdrive took 2.15100002289 Initial query is Michael Eric Dyson Cross reference query is Sounds ********************************************** ************************** ************************** Google (1, 0, 0) ************************** Found 0 results Downloading from Google took 1.17199993134 Making query: https://books.google.com/books/feeds...ewability=none ********************************************** ************************** ************************** Amazon.com (1, 2, 2) ************************** Found 0 results Downloading from Amazon.com took 0.473000049591 User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.95 Safari/537.36 Server: auto Plugin Amazon.com failed Traceback (most recent call last): File "site-packages\calibre\ebooks\metadata\sources\identify. py", line 48, in run File "<string>", line 1350, in identify File "<string>", line 1279, in search_search_engine AttributeError: 'dict' object has no attribute 'google_url_processor' ********************************************** **************************** The identify phase took 2.23 seconds The longest time (2.151000) was taken by: Overdrive Merging results from different sources and finding earliest publication dates from the worldcat.org service We have 0 merged results, merging took: 0.00 seconds

06-06-2018, 12:25 PM	#6
kovidgoyal creator of calibre Posts: 43,843 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	update calibre

06-06-2018, 12:57 PM	#7
seacity1 Zealot Posts: 139 Karma: 84296 Join Date: Nov 2012 Location: Florida Device: Samsung Galaxy 10.1 2014 Edition,Nook HD+, Nook Color, Nook ST & Ipad3	Thanks! I just did. It seems to be working now.

06-06-2018, 03:08 PM	#9
seacity1 Zealot Posts: 139 Karma: 84296 Join Date: Nov 2012 Location: Florida Device: Samsung Galaxy 10.1 2014 Edition,Nook HD+, Nook Color, Nook ST & Ipad3	I just realized the only source for metadata it is finding is Amazon. It is also searching Google, Open Library & Overdrive (per settings in preferences ) but has found 0 books in 15 searches. I removed the ISDN as I thought that might be throwing it off but that made no difference. I am using 3.25. In the past I sometimes did not get an Overdrive result but consistently always got Google in addition to Amazon.