Calibre 3.20: no metadata download from amazon

[login_ms]

It seems that metadata download from amazon is broken.
I suspect Amazon has changed somethcos Calibre 3.18 also gives no results.
My plugin is configured for Amazon.com site Germany and download from Amazon servers.
Example for an output shows that data is found but not downloaded. Also seems that authors value is not taken for the query even if the field is filled in calibre metadata dialog:

Running identify query with parameters:
{u'title': u'Nebelbr\xfccke', u'timeout': 30, u'identifiers': {}, u'authors': [u'Bomm, Manfred']}
Using plugins: Google (1, 0, 0), Amazon.com (1, 2, 0)
The log from individual plugins is below

****************************** Amazon.com (1, 2, 0) ******************************
Found 0 results
Downloading from Amazon.com took 3.97699999809
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704 Safari/537.36
Server: amazon
Getting details from: https://www.amazon.de/Nebelbr%C3%BCc...1905882&sr=1-1
Could not find title/authors/asin for 'https://www.amazon.de/Nebelbr%C3%BCcke-achtzehnte-H%C3%A4berle-Kriminalromane-GMEINER-Verlag/dp/3839222397/ref=sr_1_1/260-0608862-7896637?s=books&ie=UTF8&qid=1521905882&sr=1-1'
ASIN: u'3839222397' Title: u'Nebelbr\xfccke: Der achtzehnte Fall f\xfcr August H\xe4berle (Kriminalromane im GMEINER-Verlag)' Authors: []

Thx in advance
Martin

[DNSB]

I found changing the download server to Bing search cache helped. Preferences => Metadata Download = Amazon =>Configure selected source.

[login_ms]

Hi DNSB,

thx for advice. I already tried all different server configurations. They give slightly different results looking at the log but as a final result no real link to Amazon results (the hyperlinks to the found sources).
Maybe it has to do something with the special book, but with another one I have similar problems.
Sometimes the log shows the right Amazon ASIN but nevertheless it doesn't download and provides the data...mysterious for me

Martin

[theodore1982]

I have the same problem with version 3.20.

Changing to the Bing server helps for a few books. But most of them can‘t download the data from Amazon.

[kovidgoyal]

It's quite possible that amazon.de changed their markup. Post the ASIN for a few books that dont work and I will take a look when I have a moment.

[Terisa de morgan]

This coming from amazon.com (it happens with all the books I've tested):

Spoiler:

Getting details from: https://translate.google.com/transla...32&prev=search
Ignoring result: First Case (Writers Retreat Southern Mystery Book 1) (Writers Retreat Southern Seashore Mystery) (Volume 1) as its title does not match
Error parsing title for url: 'https://translate.google.com/translate?hl=es&sl=en&u=https://www.amazon.com/Road-Christmas-Past-Kathi-Daley/dp/1494249332&prev=search'
Traceback (most recent call last):
File "site-packages\calibre\ebooks\metadata\sources\amazon.py ", line 350, in parse_details
File "site-packages\calibre\ebooks\metadata\sources\amazon.py ", line 475, in parse_title
IndexError: list index out of range

In this case, the book is Finding Answers by Kathi Daley, but the same has happened by other book I had open in Firefox. The first error has been with amazon as server and the second one with server selected automatically and it happens again if I use Google cache as server.

[Terisa de morgan]

And this is the error when I've added the ASIN and the server is Amazon:

Spoiler:

Found 0 results
Downloading from Amazon.com took 5.44799995422
User-agent: Mozilla/5.0 (Windows NT 5.1; rv:43.0) Gecko/20100101 Firefox/43.0
Server: amazon
Getting details from: https://www.amazon.com/Desperate-Gir...1965414&sr=8-1
Could not find title/authors/asin for 'https://www.amazon.com/Desperate-Girls-Laura-Griffin-ebook/dp/B075RS5N9C/ref=sr_1_1/146-1021266-0232100?ie=UTF8&qid=1521965414&sr=8-1'
ASIN: u'B075RS5N9C' Title: u'Desperate Girls' Authors: []

BTW, the link opens the book page.

[kovidgoyal]

Works for me with that ASIN. Looking at the log, for some reason the google URLs seem to be based on google translate? Is google redirecting all your requests to google translate? Try using either amazon or bing as the server isntead.

[Terisa de morgan]

Originally Posted by kovidgoyal

Works for me with that ASIN. Looking at the log, for some reason the google URLs seem to be based on google translate? Is google redirecting all your requests to google translate? Try using either amazon or bing as the server isntead.

Look the post over yours, that's the answer with the amazon server.

[kovidgoyal]

That does indeed show a markup change. https://github.com/kovidgoyal/calibr...46381420b10f76

[Terisa de morgan]

Thank you very much, kovid

[Terisa de morgan]

Thank you , it works now (I've downloaded the changed file).

[login_ms]

Hi Kovid,

thank you very much - quick and perfect work as always.
I also updated the file and tried the problematic entries. They now work again with metadata download from amazon

Thx
Martin

[TGPB]

I changed to the Amazon server and it fixed my problem. Thanks