Amazon.com Metadata Not Working

[Vampi2009]

Can someone help me why the metadownload works anymore? see my log above. It worked always like a charm but not anymore what happend? What can I do to fix it and make it work again?
Any help is appreciated - thanks

[kovidgoyal]

Change the server the amazon plugin is using. Try google or amazon instead of auto.

[Vampi2009]

Same result with any Server.
Auto, google, bing, Duckduck, wayback
Any other idea?

[Vampi2009]

Running identify query with parameters:
{'title': 'Dragon Games - Flügel aus Stahl: Die spannende Fortsetzung der erfolgreichen Drachen-Romantasy (Dragon Knights 2)', 'authors': ['Jaumann, Ursa'], 'identifiers': {'isbn': '9783988670243', 'amazon': '3988670243', 'goodreads': '227761539', 'google': 'XB-s0AEACAAJ', 'mobi-asin': 'B0CW7PX2Q1'}, 'timeout': 30}
Using plugins: Amazon.com Multiple Countries (1, 0, 0), DNB_DE (3, 2, 5), Goodreads (1, 8, 3), Kobo Metadata (1, 10, 1), Google (1, 1, 2), Amazon.com (1, 3, 13)
The log from individual plugins is below

Spoiler:

****************************** Amazon.com Multiple Countries (1, 0, 0) ******************************
Found 0 results
Downloading from Amazon.com Multiple Countries took 3.2497479915618896
User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/111.0.0.0 Safari/537.36
Server: auto
Making bing query: https://www.bing.com/search?q=398867...www.amazon.com
Plugin Amazon.com Multiple Countries failed
Traceback (most recent call last):
File "calibre\ebooks\metadata\sources\identify.py", line 47, in run
File "calibre\ebooks\metadata\sources\amazon.py", line 1646, in identify
File "calibre\ebooks\metadata\sources\amazon.py", line 1574, in search_search_engine
File "<string>", line 248, in bing_search
File "<string>", line 103, in query
File "calibre\scraper\simple.py", line 32, in read_url
File "calibre\scraper\qt.py", line 57, in read
File "calibre\scraper\qt.py", line 52, in _wait
urllib.error.URLError: <urlopen error Failed to fetch>

************************************************** ******************************

****************************** DNB_DE (3, 2, 5) ******************************
Found 0 results
Downloading from DNB_DE took 1.1986794471740723
Query String: num=9783988670243 AND num=9783988670243 NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Query URL: https://services.dnb.de/sru/dnb?vers...%20cod%3Dtt%29
ERROR: Got invalid response:
Plugin DNB_DE failed
Traceback (most recent call last):
File "mechanize\_urllib2_fork.py", line 1236, in do_open
File "http\client.py", line 1303, in request
File "http\client.py", line 1349, in _send_request
File "http\client.py", line 1298, in endheaders
File "http\client.py", line 1058, in _send_output
File "http\client.py", line 996, in send
File "http\client.py", line 1475, in connect
File "ssl.py", line 517, in wrap_socket
File "ssl.py", line 1104, in _create
File "ssl.py", line 1382, in do_handshake
ConnectionResetError: [WinError 10054] Eine vorhandene Verbindung wurde vom Remotehost geschlossen

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "calibre_plugins.DNB_DE.__init__", line 962, in execute_query
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 287, in _mech_open
File "mechanize\_opener.py", line 193, in open
File "mechanize\_urllib2_fork.py", line 425, in _open
File "mechanize\_urllib2_fork.py", line 414, in _call_chain
File "calibre\utils\browser.py", line 29, in https_open
File "mechanize\_urllib2_fork.py", line 1240, in do_open
urllib.error.URLError: <urlopen error [WinError 10054] Eine vorhandene Verbindung wurde vom Remotehost geschlossen>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "calibre_plugins.DNB_DE.__init__", line 981, in execute_query
AttributeError: 'NoneType' object has no attribute 'find'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "calibre\ebooks\metadata\sources\identify.py", line 47, in run
File "calibre_plugins.DNB_DE.__init__", line 120, in identify
File "calibre_plugins.DNB_DE.__init__", line 990, in execute_query
UnboundLocalError: cannot access local variable 'data' where it is not associated with a value

************************************************** ******************************

****************************** Goodreads (1, 8, 3) ******************************
Found 0 results
Downloading from Goodreads took 3.2627313137054443
identify - start. title=Dragon Games - Flügel aus Stahl: Die spannende Fortsetzung der erfolgreichen Drachen-Romantasy (Dragon Knights 2), authors=['Jaumann, Ursa'], identifiers={'isbn': '9783988670243', 'amazon': '3988670243', 'goodreads': '227761539', 'google': 'XB-s0AEACAAJ', 'mobi-asin': 'B0CW7PX2Q1'}
Get details attempt #1
Goodreads book url: 'https://www.goodreads.com/book/show/227761539'
Failed to make details query: 'https://www.goodreads.com/book/show/227761539'
Traceback (most recent call last):
File "mechanize\_urllib2_fork.py", line 1236, in do_open
File "http\client.py", line 1303, in request
File "http\client.py", line 1349, in _send_request
File "http\client.py", line 1298, in endheaders
File "http\client.py", line 1058, in _send_output
File "http\client.py", line 996, in send
File "http\client.py", line 1475, in connect
File "ssl.py", line 517, in wrap_socket
File "ssl.py", line 1104, in _create
File "ssl.py", line 1382, in do_handshake
ConnectionResetError: [WinError 10054] Eine vorhandene Verbindung wurde vom Remotehost geschlossen

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "calibre_plugins.goodreads.worker", line 81, in get_details
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 287, in _mech_open
File "mechanize\_opener.py", line 193, in open
File "mechanize\_urllib2_fork.py", line 425, in _open
File "mechanize\_urllib2_fork.py", line 414, in _call_chain
File "calibre\utils\browser.py", line 29, in https_open
File "mechanize\_urllib2_fork.py", line 1240, in do_open
urllib.error.URLError: <urlopen error [WinError 10054] Eine vorhandene Verbindung wurde vom Remotehost geschlossen>

************************************************** ******************************

****************************** Kobo Metadata (1, 10, 1) ******************************
Found 0 results
Downloading from Kobo Metadata took 1.1067588329315186
KoboMetadata::identify: title: Dragon Games - Flügel aus Stahl: Die spannende Fortsetzung der erfolgreichen Drachen-Romantasy (Dragon Knights 2), authors: ['Jaumann, Ursa'], identifiers: {'isbn': '9783988670243', 'amazon': '3988670243', 'goodreads': '227761539', 'google': 'XB-s0AEACAAJ', 'mobi-asin': 'B0CW7PX2Q1'}
KoboMetadata:erform_isbn_search: Getting metadata with isbn: 9783988670243
KoboMetadata:erform_query: Searching for book with url: https://www.kobo.com/de/de/search?qu...fclanguages=de
KoboMetadata::get_webpage: Got exception while opening url: ('Connection aborted.', ConnectionResetError(10054, 'Eine vorhandene Verbindung wurde vom Remotehost geschlossen', None, 10054, None))
KoboMetadata:erform_query: Could not get url: https://www.kobo.com/de/de/search?qu...fclanguages=de
KoboMetadata:erform_search: Searching with query: Dragon Games Flügel aus Stahl: Die spannende Fortsetzung der erfolgreichen Drachen-Romantasy (Dragon Knights 2) Ursa Jaumann
KoboMetadata:erform_query: Searching for book with url: https://www.kobo.com/de/de/search?qu...fclanguages=de
KoboMetadata::get_webpage: Got exception while opening url: ('Connection aborted.', ConnectionResetError(10054, 'Eine vorhandene Verbindung wurde vom Remotehost geschlossen', None, 10054, None))
KoboMetadata:erform_query: Could not get url: https://www.kobo.com/de/de/search?qu...fclanguages=de

************************************************** ******************************

****************************** Google (1, 1, 2) ******************************
Found 0 results
Downloading from Google took 1.4653773307800293
Failed to get metadata for Google identifier: XB-s0AEACAAJ
Traceback (most recent call last):
File "mechanize\_urllib2_fork.py", line 1236, in do_open
File "http\client.py", line 1303, in request
File "http\client.py", line 1349, in _send_request
File "http\client.py", line 1298, in endheaders
File "http\client.py", line 1058, in _send_output
File "http\client.py", line 996, in send
File "http\client.py", line 1475, in connect
File "ssl.py", line 517, in wrap_socket
File "ssl.py", line 1104, in _create
File "ssl.py", line 1382, in do_handshake
ConnectionResetError: [WinError 10054] Eine vorhandene Verbindung wurde vom Remotehost geschlossen

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "<string>", line 496, in identify
File "<string>", line 123, in to_metadata
File "<string>", line 109, in get_extra_details
File "<string>", line 53, in get_details
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 287, in _mech_open
File "mechanize\_opener.py", line 193, in open
File "mechanize\_urllib2_fork.py", line 425, in _open
File "mechanize\_urllib2_fork.py", line 414, in _call_chain
File "calibre\utils\browser.py", line 29, in https_open
File "mechanize\_urllib2_fork.py", line 1240, in do_open
urllib.error.URLError: <urlopen error [WinError 10054] Eine vorhandene Verbindung wurde vom Remotehost geschlossen>

Making query: https://books.google.com/books/feeds...ewability=none
Failed to make identify query: 'https://books.google.com/books/feeds/volumes?q=isbn%3A9783988670243&max-results=20&start-index=1&min-viewability=none'
Traceback (most recent call last):
File "mechanize\_urllib2_fork.py", line 1236, in do_open
File "http\client.py", line 1303, in request
File "http\client.py", line 1349, in _send_request
File "http\client.py", line 1298, in endheaders
File "http\client.py", line 1058, in _send_output
File "http\client.py", line 996, in send
File "http\client.py", line 1475, in connect
File "ssl.py", line 517, in wrap_socket
File "ssl.py", line 1104, in _create
File "ssl.py", line 1382, in do_handshake
ConnectionResetError: [WinError 10054] Eine vorhandene Verbindung wurde vom Remotehost geschlossen

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "<string>", line 515, in make_query
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 287, in _mech_open
File "mechanize\_opener.py", line 193, in open
File "mechanize\_urllib2_fork.py", line 425, in _open
File "mechanize\_urllib2_fork.py", line 414, in _call_chain
File "calibre\utils\browser.py", line 29, in https_open
File "mechanize\_urllib2_fork.py", line 1240, in do_open
urllib.error.URLError: <urlopen error [WinError 10054] Eine vorhandene Verbindung wurde vom Remotehost geschlossen>

************************************************** ******************************

****************************** Amazon.com (1, 3, 13) ******************************
Found 0 results
Downloading from Amazon.com took 0.857029914855957
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/132.0.0.0 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=3988...zon.com&nfpr=1
Plugin Amazon.com failed
Traceback (most recent call last):
File "mechanize\_urllib2_fork.py", line 1236, in do_open
File "http\client.py", line 1303, in request
File "http\client.py", line 1349, in _send_request
File "http\client.py", line 1298, in endheaders
File "http\client.py", line 1058, in _send_output
File "http\client.py", line 996, in send
File "http\client.py", line 1475, in connect
File "ssl.py", line 517, in wrap_socket
File "ssl.py", line 1104, in _create
File "ssl.py", line 1382, in do_handshake
ConnectionResetError: [WinError 10054] Eine vorhandene Verbindung wurde vom Remotehost geschlossen

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "calibre\ebooks\metadata\sources\identify.py", line 47, in run
File "<string>", line 1646, in identify
File "<string>", line 1574, in search_search_engine
File "<string>", line 415, in google_search
File "<string>", line 100, in query
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 287, in _mech_open
File "mechanize\_opener.py", line 193, in open
File "mechanize\_urllib2_fork.py", line 425, in _open
File "mechanize\_urllib2_fork.py", line 414, in _call_chain
File "calibre\utils\browser.py", line 29, in https_open
File "mechanize\_urllib2_fork.py", line 1240, in do_open
urllib.error.URLError: <urlopen error [WinError 10054] Eine vorhandene Verbindung wurde vom Remotehost geschlossen>

************************************************** ******************************
The identify phase took 3.36 seconds
The longest time (3.262731) was taken by: Goodreads
Merging results from different sources
We have 0 merged results, merging took: 0.00 secondsR]

[kovidgoyal]

reboot in safe mode with networking and see if it works

[Comfy.n]

The other day I noticed Yandex has a "Saved copy" feature

[JSWolf]

Looks like you have has been blacklisted.

[Vampi2009]

Same problem.
And why should they blacklist me? I dont think so, then there would be something like forbidden or so.
Any other idea what I could try?

[JSWolf]

Originally Posted by Vampi2009

Same problem.
And why should they blacklist me? I dont think so, then there would be something like forbidden or so.
Any other idea what I could try?

The error message is "An existing connection has been closed by the remote host". That means the host shut you down. That could either be blacklisted or you've tried too many times in too short a time span.

I don't download metadata because most of the time there is something i have to fix manually. In most cases, the eBook's metadata is correct except for the description.

[Vampi2009]

I just download the metadata because of the Book description. Well now have to do it manually, its not a big deal but I loved how easy it was. Thanks anyway

[PeterT]

Do you have any tools like anti-virus, vpn, firewall or proxy active on your PC? If so does disabling them make any change?

[Vampi2009]

Good idea but no, same problem. Anyway, I download it by hand now and thats it. Thanks all for your help.

[kevinp]

I'm in the same boat, but I'm getting a "CaptchaError" in the logs.

[kovidgoyal]

Originally Posted by Comfy.n

The other day I noticed Yandex has a "Saved copy" feature

Yes, but yandex itself aggressively CAPTCHAs so it doesnt really work for the amazon plugin.

[Comfy.n]

Originally Posted by kovidgoyal

Yes, but yandex itself aggressively CAPTCHAs so it doesnt really work for the amazon plugin.

I've been using it more often lately and I noticed that upon first use in a day I always get the "simple" captcha, which is just a checkbox similar to Cloudflare's. I'm glad that, at least, they are not throwing the puzzle type/letter captchas which lead me to use other search engines!