Download metadata from Amazon broke with last version?

[squeebook]

I haven't been able to download any metadata from Amazon in the last version and would be grateful for ideas to try.

I am using Windows 10 and Caliber 2.81 (32 bit).

Clicking on Download metadata in the Edit Metadata dialog shows at the top: "calibre is downloading metadata from: Google, Amazon.com, Edelweiss" but then it times out saying no matches are found.

Here are the details reported:

Running identify query with parameters:
{u'timeout': 30, u'title': u'Into the Fire', u'identifiers': {u'mobi-asin': u'c2f3930a-78cc-4c5f-9ac2-57ff5e29d8d1', u'isbn': u'9781494956202', u'amazon': u'1494956209'}, u'authors': [u'Cheree Alsop']}
Using plugins: Google (1, 0, 0), Edelweiss (1, 0, 0)
The log from individual plugins is below

****************************** Edelweiss (1, 0, 0) ******************************
Found 0 results
Downloading from Edelweiss took 2.63300013542
Using query URL: https://edelweiss.abovethetreeline.c...tle&secSord=20
Using query URL: https://edelweiss.abovethetreeline.c...tle&secSord=20

************************************************** ******************************

****************************** Google (1, 0, 0) ******************************
Found 0 results
Downloading from Google took 1.25999999046
Making query: https://books.google.com/books/feeds...&start-index=1
No results found, retrying without identifiers
Making query: https://books.google.com/books/feeds...&start-index=1

************************************************** ******************************
The identify phase took 2.81 seconds
The longest time (2.633000) was taken by: Edelweiss
Merging results from different sources and finding earliest publication dates from the worldcat.org service
We have 0 merged results, merging took: 0.00 seconds

I noticed that in the details it doesn't include Amazon in the "Using plugins" section. Should it?

I have checked and in the configure metadata section Amazon is selected, and in the configure source it shows US and Choose server automatically. I tried using all the other servers to get data from but nothing worked. I tried unchecking Amazon, saving, then rechecking Amazon.

I did try a reinstall of Calibre, and I am not using Avast. I disabled Kaspersky but this didn't help.

Any ideas?

[theducks]

I don't see Amazon in that list.
Is that enabled, configured. There were changes recently.

[kovidgoyal]

It was caused by a stupid typo I made. Go to Preferences->Miscellaneous click the Open calibre configuration directory and delete the file metadata-sources-cache.json in that directory. Then restart calibre and you should be fine.

[gbm]

Originally Posted by kovidgoyal

It was caused by a stupid typo I made. Go to Preferences->Miscellaneous click the Open calibre configuration directory and delete the file metadata-sources-cache.json in that directory. Then restart calibre and you should be fine.

That fixed Amazon metadata on my Linux Mint system, I was gonna do more testing before asking about it.

bernie

[squeebook]

That did it, thank you Kovid!

[dhdurgee]

I have not been able to retrieve metadata since the end of February. I just installed 2.82 and this is still a problem. I even tried manually adding the ASIN to a story to see if that would solve it to no avail. Here is the log for that attempt:

Spoiler:

#################### Log for "Cosmic Balances Inc." ####################
Running identify query with parameters:
{u'timeout': 30, u'title': u'"Cosmic Balances Inc."', u'authors': [u'Kristine Grayson'], u'identifiers': {u'asin': u'B004HW6JD4'}}
Using plugins: Google (1, 0, 0), Amazon.com (1, 1, 0), Overdrive (1, 0, 0)
The log from individual plugins is below

****************************** Google (1, 0, 0) ******************************
Found 0 results
Downloading from Google took 0.711779117584
Making query: https://books.google.com/books/feeds...max-results=20
No results found, retrying without identifiers
Making query: https://books.google.com/books/feeds...max-results=20

************************************************** ******************************

****************************** Amazon.com (1, 1, 0) ******************************
Found 0 results
Downloading from Amazon.com took 9.52026200294
User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:51.0) Gecko/20100101 Firefox/51.0
Making bing query: https://www.bing.com/search?q=B004HW...www.amazon.com
Failed to find any results on results page, with title: B004HW6JD4 site:www.amazon.com - Bing
No search engine results for terms: B004HW6JD4
No matches found with identifiers, retrying using only title and authors. Query: [u'B004HW6JD4']
User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:51.0) Gecko/20100101 Firefox/51.0
Making bing query: https://www.bing.com/search?q=Cosmic...www.amazon.com
Getting details from: http://cc.bingj.com/cache.aspx?q=Cos...3dJ7dOgId3xdnl
Error parsing title for url: u'http://cc.bingj.com/cache.aspx?q=Cosmic+Balances+Inc+Kristine+Grayson+ site%3Awww.amazon.com&d=144426092248648140&mkt=en-US&setlang=en-US&w=8RmbzcryOUaNYmtKPa3dJ7dOgId3xdnl'
Traceback (most recent call last):
File "site-packages/calibre/ebooks/metadata/sources/amazon.py", line 341, in parse_details
File "site-packages/calibre/ebooks/metadata/sources/amazon.py", line 466, in parse_title
IndexError: list index out of range

Could not find title/authors/asin for u'http://cc.bingj.com/cache.aspx?q=Cosmic+Balances+Inc+Kristine+Grayson+ site%3Awww.amazon.com&d=144426092248648140&mkt=en-US&setlang=en-US&w=8RmbzcryOUaNYmtKPa3dJ7dOgId3xdnl'
ASIN: None Title: None Authors: []
Getting details from: http://cc.bingj.com/cache.aspx?q=Cos...smCwjWjZLZI9C6
Getting details from: http://cc.bingj.com/cache.aspx?q=Cos...-OWtKCk5CkaA0n
Ignoring result: Into the Open Economy: How Everything You Know About the World Is About to Change as its title does not match
Ignoring result: Gray Wolf Security: Wyoming as its title does not match

************************************************** ******************************

****************************** Overdrive (1, 0, 0) ******************************
Found 0 results
Downloading from Overdrive took 0.558588027954
Initial query is Kristine Grayson
Cross reference query is Balances

************************************************** ******************************
The identify phase took 9.64 seconds
The longest time (9.520262) was taken by: Amazon.com
Merging results from different sources and finding earliest publication dates from the worldcat.org service
We have 0 merged results, merging took: 0.00 seconds
Failed to download metadata for "Cosmic Balances Inc."

****************************** Google Covers ******************************
Request extra headers: [('User-agent', u'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.2924.76 Safari/537.36')]
Failed to download valid cover
Took 0.652356147766 seconds
No cached cover found, running identify
Making query: https://books.google.com/books/feeds...max-results=20
No results found, retrying without identifiers
Making query: https://books.google.com/books/feeds...max-results=20
No cover found

************************************************** ******************************

****************************** Google Images Covers ******************************
Request extra headers: [('User-agent', u'Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Firefox/45.0')]
Downloaded cover: 600x900
Took 2.69911503792 seconds
Search URL: https://www.google.com/search?as_st=...,iar:t,ift:jpg
Downloading 1 covers
Downloaded cover from: https://i1.wp.com/www.wmgpublishingi...-cover-web.jpg

************************************************** ******************************

****************************** Amazon.com Covers ******************************
Request extra headers: [('User-agent', u'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:51.0) Gecko/20100101 Firefox/51.0'), (u'Accept', u'text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8'), (u'Upgrade-insecure-requests', u'1'), (u'Referer', u'https://www.bing.com/search?q=Cosmic+Balances+Inc+Kristine+Grayson+site %3Awww.amazon.com')]
Failed to download valid cover
Took 9.2583899498 seconds
No cached cover found, running identify
User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:51.0) Gecko/20100101 Firefox/51.0
Making bing query: https://www.bing.com/search?q=B004HW...www.amazon.com
Failed to find any results on results page, with title: B004HW6JD4 site:www.amazon.com - Bing
No search engine results for terms: B004HW6JD4
No matches found with identifiers, retrying using only title and authors. Query: [u'B004HW6JD4']
User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:51.0) Gecko/20100101 Firefox/51.0
Making bing query: https://www.bing.com/search?q=Cosmic...www.amazon.com
Getting details from: http://cc.bingj.com/cache.aspx?q=Cos...3dJ7dOgId3xdnl
Error parsing title for url: u'http://cc.bingj.com/cache.aspx?q=Cosmic+Balances+Inc+Kristine+Grayson+ site%3Awww.amazon.com&d=144426092248648140&mkt=en-US&setlang=en-US&w=8RmbzcryOUaNYmtKPa3dJ7dOgId3xdnl'
Traceback (most recent call last):
File "site-packages/calibre/ebooks/metadata/sources/amazon.py", line 341, in parse_details
File "site-packages/calibre/ebooks/metadata/sources/amazon.py", line 466, in parse_title
IndexError: list index out of range

Could not find title/authors/asin for u'http://cc.bingj.com/cache.aspx?q=Cosmic+Balances+Inc+Kristine+Grayson+ site%3Awww.amazon.com&d=144426092248648140&mkt=en-US&setlang=en-US&w=8RmbzcryOUaNYmtKPa3dJ7dOgId3xdnl'
ASIN: None Title: None Authors: []
Getting details from: http://cc.bingj.com/cache.aspx?q=Cos...smCwjWjZLZI9C6
Getting details from: http://cc.bingj.com/cache.aspx?q=Cos...-OWtKCk5CkaA0n
Ignoring result: Into the Open Economy: How Everything You Know About the World Is About to Change as its title does not match
Ignoring result: Gray Wolf Security: Wyoming as its title does not match
No cover found

************************************************** ******************************

****************************** Open Library Covers ******************************
Request extra headers: [('User-agent', u'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.95 Safari/537.36')]
Failed to download valid cover
Took 1.8835067749e-05 seconds

************************************************** ******************************

****************************** Overdrive Covers ******************************
Request extra headers: [('User-agent', u'Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Firefox/45.0')]
Failed to download valid cover
Took 0.465620040894 seconds
No cached cover found, running identify
Initial query is Kristine Grayson
Cross reference query is Balances
No cover found

************************************************** ******************************

[kovidgoyal]

That's because bing has not indexed that particualr book on the amazon website, go to https://www.bing.com/search?q=Cosmic...www.amazon.com for yourself to check. You can get it to work by changing the server used to either amazon or google in Preferences->metadata download->customize the amazon plugin