Error downloading metadata on OS X

igorius · 12-06-2021, 06:43 AM

Hello, since some time (begun with an update of calibre 5.x) downloading metadata gets worse every update. So if i have a book which isbn begins with 979, metadata gets never found. If i enter the isbn manually, it finds the corresponding books - sometimes.
With the latest update metadata download only works with old books, not with new books. Even when entering the mobi-asin, it doesnt find any book.
BOL and DNB (both german) stopped working too since an older calibre 5.x update. So book-covers generally are better quality from BOL and DNB, but...

Here an example of a non-working metadata-download. Book was found directly on amazon!

Code:

calibre, version 5.33.2
FEHLER: Keine Übereinstimmungen gefunden: <p>Es wurden keine Bücher für die aktuelle Suche gefunden. Versuchen Sie, die Suche <b>weniger spezifisch</b> zu formulieren. Verwenden Sie beispielsweise nur den Nachnamen des Autors und ein einzelnes, prägnantes Wort aus dem Titel.<p>Um den gesamten Protokoll zu lesen, klicken Sie auf "Details anzeigen".

Running identify query with parameters: 
{'title': 'Bergungstitel', 'authors': ['Kevin Steverson'], 'identifiers': {'mobi-asin': 'B09MDVS98K'}, 'timeout': 30} 
Using plugins: Amazon.com Multiple Countries (1, 0, 0), BOL_DE (0, 9, 2), DNB_DE (3, 1, 2), Google (1, 0, 3), Amazon.com (1, 2, 21), Edelweiss (2, 0, 1) 
The log from individual plugins is below 

****************************** Amazon.com Multiple Countries (1, 0, 0) ****************************** 
Found 0 results 
Downloading from Amazon.com Multiple Countries took 4.557096004486084 
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=Bergungstitel+Kevin+Steverson+site%3Awww.amazon.de
Skipping non-book result: Result(url='https://www.amazon.de/Kevin-Steverson/e/B07H8S7GRX/ref=dp_byline_cont_book_2', title='Kevin Steverson: Bücher, Hörbücher, Bibliografie - Amazon.dehttps://www.amazon.de › Kevin-Steverson', cached_url='https://webcache.googleusercontent.com/search?q=cache:_1bFKoTm-HUJ:https://www.amazon.de/Kevin-Steverson/e/B07H8S7GRX/ref%3Ddp_byline_cont_book_2+&cd=1&hl=de&ct=clnk&gl=de')
Skipping non-book result: Result(url='https://www.amazon.de/gp/new-releases/digital-text/8421157031', title='Neuerscheinungen in Militärische Science Fiction - Amazonhttps://www.amazon.de › new-releases › digital-text', cached_url='https://webcache.googleusercontent.com/search?q=cache:MPlPz7qrPVoJ:https://www.amazon.de/gp/new-releases/digital-text/8421157031+&cd=13&hl=de&ct=clnk&gl=de')
Getting details from: https://webcache.googleusercontent.com/search?q=cache:A2lSf4ro270J:https://www.amazon.de/Die-Bresche-Eine-Pforte-Galaxie-ebook/dp/B09MH76T13+&cd=12&hl=de&ct=clnk&gl=de
Ignoring result: In Die Bresche: Eine Pforte zur Galaxie as its title does not match
Getting details from: https://webcache.googleusercontent.com/search?q=cache:244czzU0logJ:https://www.amazon.de/Das-Laaren-Projekt-Zone-Stille-ebook/dp/B09JT15BNW+&cd=14&hl=de&ct=clnk&gl=de
Ignoring result: Das Laaren - Projekt - Zone der Stille as its title does not match
Getting details from: https://webcache.googleusercontent.com/search?q=cache:LbFFP6lRcGYJ:https://www.amazon.de/Stargazer-Fremde-Welten-After-Terra-ebook/dp/B09MM9PQBF+&cd=15&hl=de&ct=clnk&gl=de
Ignoring result: Stargazer: Fremde Welten as its title does not match 

******************************************************************************** 

****************************** BOL_DE (0, 9, 2) ****************************** 
Found 0 results 
Downloading from BOL_DE took 0.31577110290527344 
authors: ['Kevin Steverson']
NoneType: None

authors2: ['Kevin Steverson']
NoneType: None

au1: Kevin+Steverson
NoneType: None

Querying title based: https://www.bol.de/shop/home/suche/?sq=Bergungstitel+Kevin+Steverson&sswg=ANY
Plugin BOL_DE failed
Traceback (most recent call last):
  File "calibre/ebooks/metadata/sources/identify.py", line 46, in run
  File "calibre_plugins.BOL_DE.__init__", line 200, in identify
    response = br.open_novisit(query, timeout=timeout)
  File "mechanize/_mechanize.py", line 241, in open_novisit
  File "mechanize/_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class.<locals>.httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 

****************************** DNB_DE (3, 1, 2) ****************************** 
Found 0 results 
Downloading from DNB_DE took 0.8517067432403564 
tst="Bergungstitel" AND per="Kevin Steverson" NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Querying: tst="Bergungstitel" AND per="Kevin Steverson" NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Query URL: https://services.dnb.de/sru/dnb?version=1.1&maximumRecords=100&operation=searchRetrieve&recordSchema=MARC21-xml&query=tst%3D%22Bergungstitel%22%20AND%20per%3D%22Kevin%20Steverson%22%20NOT%20%28mat%3Dfilm%20OR%20mat%3Dmusic%20OR%20mat%3Dmicrofiches%20OR%20cod%3Dtt%29
Got records: 0
tit="Bergungstitel" AND per="Kevin Steverson" NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Querying: tit="Bergungstitel" AND per="Kevin Steverson" NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Query URL: https://services.dnb.de/sru/dnb?version=1.1&maximumRecords=100&operation=searchRetrieve&recordSchema=MARC21-xml&query=tit%3D%22Bergungstitel%22%20AND%20per%3D%22Kevin%20Steverson%22%20NOT%20%28mat%3Dfilm%20OR%20mat%3Dmusic%20OR%20mat%3Dmicrofiches%20OR%20cod%3Dtt%29
Got records: 0
per="Bergungstitel" AND tit="Kevin Steverson" NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Querying: per="Bergungstitel" AND tit="Kevin Steverson" NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Query URL: https://services.dnb.de/sru/dnb?version=1.1&maximumRecords=100&operation=searchRetrieve&recordSchema=MARC21-xml&query=per%3D%22Bergungstitel%22%20AND%20tit%3D%22Kevin%20Steverson%22%20NOT%20%28mat%3Dfilm%20OR%20mat%3Dmusic%20OR%20mat%3Dmicrofiches%20OR%20cod%3Dtt%29
Got records: 0
"Bergungstitel" AND "Kevin Steverson" NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Querying: "Bergungstitel" AND "Kevin Steverson" NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Query URL: https://services.dnb.de/sru/dnb?version=1.1&maximumRecords=100&operation=searchRetrieve&recordSchema=MARC21-xml&query=%22Bergungstitel%22%20AND%20%22Kevin%20Steverson%22%20NOT%20%28mat%3Dfilm%20OR%20mat%3Dmusic%20OR%20mat%3Dmicrofiches%20OR%20cod%3Dtt%29
Got records: 0
"Bergungstitel" AND "Kevin" AND "Steverson" NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Querying: "Bergungstitel" AND "Kevin" AND "Steverson" NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Query URL: https://services.dnb.de/sru/dnb?version=1.1&maximumRecords=100&operation=searchRetrieve&recordSchema=MARC21-xml&query=%22Bergungstitel%22%20AND%20%22Kevin%22%20AND%20%22Steverson%22%20NOT%20%28mat%3Dfilm%20OR%20mat%3Dmusic%20OR%20mat%3Dmicrofiches%20OR%20cod%3Dtt%29
Got records: 0 

******************************************************************************** 

****************************** Google (1, 0, 3) ****************************** 
Found 0 results 
Downloading from Google took 1.0778281688690186 
Making query: https://books.google.com/books/feeds/volumes?q=intitle%3ABergungstitel%2Binauthor%3AKevin+inauthor%3ASteverson&max-results=20&start-index=1&min-viewability=none
No results found, retrying without identifiers
Making query: https://books.google.com/books/feeds/volumes?q=intitle%3ABergungstitel%2Binauthor%3AKevin+inauthor%3ASteverson&max-results=20&start-index=1&min-viewability=none 

******************************************************************************** 

****************************** Amazon.com (1, 2, 21) ****************************** 
Found 0 results 
Downloading from Amazon.com took 4.534517049789429 
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=Bergungstitel+Kevin+Steverson+site%3Awww.amazon.de
Skipping non-book result: Result(url='https://www.amazon.de/Kevin-Steverson/e/B07H8S7GRX/ref=dp_byline_cont_book_2', title='Kevin Steverson: Bücher, Hörbücher, Bibliografie - Amazon.dehttps://www.amazon.de › Kevin-Steverson', cached_url='https://webcache.googleusercontent.com/search?q=cache:_1bFKoTm-HUJ:https://www.amazon.de/Kevin-Steverson/e/B07H8S7GRX/ref%3Ddp_byline_cont_book_2+&cd=1&hl=de&ct=clnk&gl=de')
Skipping non-book result: Result(url='https://www.amazon.de/gp/new-releases/digital-text/8421157031', title='Neuerscheinungen in Militärische Science Fiction - Amazonhttps://www.amazon.de › new-releases › digital-text', cached_url='https://webcache.googleusercontent.com/search?q=cache:MPlPz7qrPVoJ:https://www.amazon.de/gp/new-releases/digital-text/8421157031+&cd=13&hl=de&ct=clnk&gl=de')
Getting details from: https://webcache.googleusercontent.com/search?q=cache:A2lSf4ro270J:https://www.amazon.de/Die-Bresche-Eine-Pforte-Galaxie-ebook/dp/B09MH76T13+&cd=12&hl=de&ct=clnk&gl=de
Ignoring result: In Die Bresche: Eine Pforte zur Galaxie as its title does not match
Getting details from: https://webcache.googleusercontent.com/search?q=cache:244czzU0logJ:https://www.amazon.de/Das-Laaren-Projekt-Zone-Stille-ebook/dp/B09JT15BNW+&cd=14&hl=de&ct=clnk&gl=de
Ignoring result: Das Laaren - Projekt - Zone der Stille as its title does not match
Getting details from: https://webcache.googleusercontent.com/search?q=cache:LbFFP6lRcGYJ:https://www.amazon.de/Stargazer-Fremde-Welten-After-Terra-ebook/dp/B09MM9PQBF+&cd=15&hl=de&ct=clnk&gl=de
Ignoring result: Stargazer: Fremde Welten as its title does not match 

******************************************************************************** 

****************************** Edelweiss (2, 0, 1) ****************************** 
Found 0 results 
Downloading from Edelweiss took 0.15996217727661133 
Currently Edelweiss returns random books for search queries 

******************************************************************************** 
The identify phase took 4.58 seconds 
The longest time (4.557096) was taken by: Amazon.com Multiple Countries 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds

Example of a book with isbn entered in metadata:

Code:

Running identify query with parameters: 
{'title': 'Der Raketenadmiral', 'authors': ['Johannes Siemers'], 'identifiers': {'isbn': '9798575542025'}, 'timeout': 30} 
Using plugins: Amazon.com Multiple Countries (1, 0, 0), BOL_DE (0, 9, 2), DNB_DE (3, 1, 2), Google (1, 0, 3), Amazon.com (1, 2, 21), Edelweiss (2, 0, 1) 
The log from individual plugins is below 

****************************** Amazon.com Multiple Countries (1, 0, 0) ****************************** 
Found 1 results 
Downloading from Amazon.com Multiple Countries took 6.403738260269165 


--- 
Title               : Der Raketenadmiral
Author(s)           : Johannes Siemers
Rating              : 2.4
Identifiers         : amazon_de:B08P9PN8DP
Comments            : 
Ben und Benji reisen auf der Solarius zur geheimen Forschungsstation Zeta-Basis. Was sie dort finden, könnte den Krieg entscheidend beeinflussen. Doch es braucht den Offizier und Kommandeur in Ben Curtis, um dies zu ermöglichen. Ist er bereit, wieder in seine alte Rolle zu schlüpfen?  
Juliana, Gonak, Lorek und Tarek trauern um ihre verlorengeglaubten Kameraden. Auf der Suche nach Rache stürzen sie sich wieder in den Kampf gegen das Kaiserreich. 
 
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=%289798575542025+or+979-8575542025%29+site%3Awww.amazon.de
Failed to find any results on results page, with title: (9798575542025 or 979-8575542025) site:www.amazon.de - Google Suche
No search engine results for terms: (9798575542025 OR 979-8575542025)
Trying the bing search engine instead
Making bing query: https://www.bing.com/search?q=%289798575542025+or+979-8575542025%29+site%3Awww.amazon.de
Failed to find any results on results page, with title: (9798575542025 or 979-8575542025) site:www.amazon.de - Bing
No search engine results for terms: (9798575542025 OR 979-8575542025)
No matches found with identifiers, retrying using only title and authors. Query: ['(9798575542025', 'OR', '979-8575542025)']
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=Der+Raketenadmiral+Johannes+Siemers+site%3Awww.amazon.de
Getting details from: https://webcache.googleusercontent.com/search?q=cache:OACa8QmEHZsJ:https://www.amazon.de/Raketenadmiral-Die-Curtis-Legende-4-ebook/dp/B08P9PN8DP+&cd=1&hl=de&ct=clnk&gl=de
Getting details from: https://webcache.googleusercontent.com/search?q=cache:P2fuTqol70kJ:https://www.amazon.de/Raketenadmiral-Die-Curtis-Legende-4/dp/B095N6B3PM+&cd=2&hl=de&ct=clnk&gl=de
Getting details from: https://webcache.googleusercontent.com/search?q=cache:zlmX3iuI-j8J:https://www.amazon.de/Piratenadmiral-Die-Curtis-Legende-3-ebook/dp/B088PYDBLY+&cd=3&hl=de&ct=clnk&gl=de
Ignoring result: Der Piratenadmiral as its title does not match 

******************************************************************************** 

****************************** BOL_DE (0, 9, 2) ****************************** 
Found 0 results 
Downloading from BOL_DE took 0.3419220447540283 
Querying: https://www.bol.de/shop/home/suche/?&sq=9798575542025&sswg=ANY
Plugin BOL_DE failed
Traceback (most recent call last):
  File "calibre/ebooks/metadata/sources/identify.py", line 46, in run
  File "calibre_plugins.BOL_DE.__init__", line 164, in identify
    response = br.open_novisit(query, timeout=timeout)
  File "mechanize/_mechanize.py", line 241, in open_novisit
  File "mechanize/_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 

****************************** DNB_DE (3, 1, 2) ****************************** 
Found 0 results 
Downloading from DNB_DE took 0.4038209915161133 
num=9798575542025 NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Querying: num=9798575542025 NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Query URL: https://services.dnb.de/sru/dnb?version=1.1&maximumRecords=100&operation=searchRetrieve&recordSchema=MARC21-xml&query=num%3D9798575542025%20NOT%20%28mat%3Dfilm%20OR%20mat%3Dmusic%20OR%20mat%3Dmicrofiches%20OR%20cod%3Dtt%29
Got records: 0 

******************************************************************************** 

****************************** Google (1, 0, 3) ****************************** 
Found 0 results 
Downloading from Google took 1.277209758758545 
Making query: https://books.google.com/books/feeds/volumes?q=isbn%3A9798575542025&max-results=20&start-index=1&min-viewability=none
No results found, retrying with capitalized ISBN
Making query: https://books.google.com/books/feeds/volumes?q=ISBN%3A9798575542025&max-results=20&start-index=1&min-viewability=none
No results found, retrying without identifiers
Making query: https://books.google.com/books/feeds/volumes?q=intitle%3ADer+intitle%3ARaketenadmiral%2Binauthor%3AJohannes+inauthor%3ASiemers&max-results=20&start-index=1&min-viewability=none 

******************************************************************************** 

****************************** Amazon.com (1, 2, 21) ****************************** 
Found 1 results 
Downloading from Amazon.com took 6.416965007781982 


--- 
Title               : Der Raketenadmiral
Author(s)           : Johannes Siemers
Rating              : 2.4
Identifiers         : amazon_de:B08P9PN8DP
Comments            : 
Ben und Benji reisen auf der Solarius zur geheimen Forschungsstation Zeta-Basis. Was sie dort finden, könnte den Krieg entscheidend beeinflussen. Doch es braucht den Offizier und Kommandeur in Ben Curtis, um dies zu ermöglichen. Ist er bereit, wieder in seine alte Rolle zu schlüpfen?  
Juliana, Gonak, Lorek und Tarek trauern um ihre verlorengeglaubten Kameraden. Auf der Suche nach Rache stürzen sie sich wieder in den Kampf gegen das Kaiserreich. 
 
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.93 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=%289798575542025+or+979-8575542025%29+site%3Awww.amazon.de
Failed to find any results on results page, with title: (9798575542025 or 979-8575542025) site:www.amazon.de - Google Suche
No search engine results for terms: (9798575542025 OR 979-8575542025)
Trying the bing search engine instead
Making bing query: https://www.bing.com/search?q=%289798575542025+or+979-8575542025%29+site%3Awww.amazon.de
Failed to find any results on results page, with title: (9798575542025 or 979-8575542025) site:www.amazon.de - Bing
No search engine results for terms: (9798575542025 OR 979-8575542025)
No matches found with identifiers, retrying using only title and authors. Query: ['(9798575542025', 'OR', '979-8575542025)']
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.93 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=Der+Raketenadmiral+Johannes+Siemers+site%3Awww.amazon.de
Getting details from: https://webcache.googleusercontent.com/search?q=cache:OACa8QmEHZsJ:https://www.amazon.de/Raketenadmiral-Die-Curtis-Legende-4-ebook/dp/B08P9PN8DP+&cd=1&hl=de&ct=clnk&gl=de
Getting details from: https://webcache.googleusercontent.com/search?q=cache:P2fuTqol70kJ:https://www.amazon.de/Raketenadmiral-Die-Curtis-Legende-4/dp/B095N6B3PM+&cd=2&hl=de&ct=clnk&gl=de
Getting details from: https://webcache.googleusercontent.com/search?q=cache:XCBPDYzHvbYJ:https://www.amazon.de/-/en/Johannes-Siemers-ebook/dp/B08P9PN8DP+&cd=3&hl=de&ct=clnk&gl=de 

******************************************************************************** 

****************************** Edelweiss (2, 0, 1) ****************************** 
Found 0 results 
Downloading from Edelweiss took 0.199052095413208 
Currently Edelweiss returns random books for search queries 

******************************************************************************** 
The identify phase took 6.51 seconds 
The longest time (6.416965) was taken by: Amazon.com 
Merging results from different sources 
We have 1 merged results, merging took: 0.00 seconds

Same book without isbn:

Code:

calibre, version 5.33.2
FEHLER: Keine Übereinstimmungen gefunden: <p>Es wurden keine Bücher für die aktuelle Suche gefunden. Versuchen Sie, die Suche <b>weniger spezifisch</b> zu formulieren. Verwenden Sie beispielsweise nur den Nachnamen des Autors und ein einzelnes, prägnantes Wort aus dem Titel.<p>Um den gesamten Protokoll zu lesen, klicken Sie auf "Details anzeigen".

Running identify query with parameters: 
{'title': 'Der Raketenadmiral', 'authors': ['Johannes Siemers'], 'identifiers': {}, 'timeout': 30} 
Using plugins: Amazon.com Multiple Countries (1, 0, 0), BOL_DE (0, 9, 2), DNB_DE (3, 1, 2), Google (1, 0, 3), Amazon.com (1, 2, 21), Edelweiss (2, 0, 1) 
The log from individual plugins is below 

****************************** Amazon.com Multiple Countries (1, 0, 0) ****************************** 
Found 0 results 
Downloading from Amazon.com Multiple Countries took 4.821439027786255 
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=Der+Raketenadmiral+Johannes+Siemers+site%3Awww.amazon.de
Getting details from: https://webcache.googleusercontent.com/search?q=cache:OACa8QmEHZsJ:https://www.amazon.de/Raketenadmiral-Die-Curtis-Legende-4-ebook/dp/B08P9PN8DP+&cd=1&hl=de&ct=clnk&gl=de
Failed to make details query: 'https://webcache.googleusercontent.com/search?q=cache:OACa8QmEHZsJ:https://www.amazon.de/Raketenadmiral-Die-Curtis-Legende-4-ebook/dp/B08P9PN8DP+&cd=1&hl=de&ct=clnk&gl=de'
Traceback (most recent call last):
  File "calibre/ebooks/metadata/sources/amazon.py", line 65, in parse_details_page
  File "mechanize/_mechanize.py", line 241, in open_novisit
  File "mechanize/_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class.<locals>.httperror_seek_wrapper: HTTP Error 429: Too Many Requests

get_details failed for url: 'https://webcache.googleusercontent.com/search?q=cache:OACa8QmEHZsJ:https://www.amazon.de/Raketenadmiral-Die-Curtis-Legende-4-ebook/dp/B08P9PN8DP+&cd=1&hl=de&ct=clnk&gl=de'
Traceback (most recent call last):
  File "calibre/ebooks/metadata/sources/amazon.py", line 363, in run
  File "calibre/ebooks/metadata/sources/amazon.py", line 369, in get_details
TypeError: cannot unpack non-iterable NoneType object

Getting details from: https://webcache.googleusercontent.com/search?q=cache:P2fuTqol70kJ:https://www.amazon.de/Raketenadmiral-Die-Curtis-Legende-4/dp/B095N6B3PM+&cd=2&hl=de&ct=clnk&gl=de
Failed to make details query: 'https://webcache.googleusercontent.com/search?q=cache:P2fuTqol70kJ:https://www.amazon.de/Raketenadmiral-Die-Curtis-Legende-4/dp/B095N6B3PM+&cd=2&hl=de&ct=clnk&gl=de'
Traceback (most recent call last):
  File "calibre/ebooks/metadata/sources/amazon.py", line 65, in parse_details_page
  File "mechanize/_mechanize.py", line 241, in open_novisit
  File "mechanize/_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class.<locals>.httperror_seek_wrapper: HTTP Error 429: Too Many Requests

get_details failed for url: 'https://webcache.googleusercontent.com/search?q=cache:P2fuTqol70kJ:https://www.amazon.de/Raketenadmiral-Die-Curtis-Legende-4/dp/B095N6B3PM+&cd=2&hl=de&ct=clnk&gl=de'
Traceback (most recent call last):
  File "calibre/ebooks/metadata/sources/amazon.py", line 363, in run
  File "calibre/ebooks/metadata/sources/amazon.py", line 369, in get_details
TypeError: cannot unpack non-iterable NoneType object

Getting details from: https://webcache.googleusercontent.com/search?q=cache:XCBPDYzHvbYJ:https://www.amazon.de/-/en/Johannes-Siemers-ebook/dp/B08P9PN8DP+&cd=3&hl=de&ct=clnk&gl=de
Failed to make details query: 'https://webcache.googleusercontent.com/search?q=cache:XCBPDYzHvbYJ:https://www.amazon.de/-/en/Johannes-Siemers-ebook/dp/B08P9PN8DP+&cd=3&hl=de&ct=clnk&gl=de'
Traceback (most recent call last):
  File "calibre/ebooks/metadata/sources/amazon.py", line 65, in parse_details_page
  File "mechanize/_mechanize.py", line 241, in open_novisit
  File "mechanize/_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class.<locals>.httperror_seek_wrapper: HTTP Error 429: Too Many Requests

get_details failed for url: 'https://webcache.googleusercontent.com/search?q=cache:XCBPDYzHvbYJ:https://www.amazon.de/-/en/Johannes-Siemers-ebook/dp/B08P9PN8DP+&cd=3&hl=de&ct=clnk&gl=de'
Traceback (most recent call last):
  File "calibre/ebooks/metadata/sources/amazon.py", line 363, in run
  File "calibre/ebooks/metadata/sources/amazon.py", line 369, in get_details
TypeError: cannot unpack non-iterable NoneType object 

******************************************************************************** 

****************************** BOL_DE (0, 9, 2) ****************************** 
Found 0 results 
Downloading from BOL_DE took 0.31472015380859375 
authors: ['Johannes Siemers']
NoneType: None

authors2: ['Johannes Siemers']
NoneType: None

au1: Johannes+Siemers
NoneType: None

Querying title based: https://www.bol.de/shop/home/suche/?sq=Der+Raketenadmiral+Johannes+Siemers&sswg=ANY
Plugin BOL_DE failed
Traceback (most recent call last):
  File "calibre/ebooks/metadata/sources/identify.py", line 46, in run
  File "calibre_plugins.BOL_DE.__init__", line 200, in identify
    response = br.open_novisit(query, timeout=timeout)
  File "mechanize/_mechanize.py", line 241, in open_novisit
  File "mechanize/_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class.<locals>.httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 

****************************** DNB_DE (3, 1, 2) ****************************** 
Found 0 results 
Downloading from DNB_DE took 0.7592508792877197 
tst="Der Raketenadmiral" AND per="Johannes Siemers" NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Querying: tst="Der Raketenadmiral" AND per="Johannes Siemers" NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Query URL: https://services.dnb.de/sru/dnb?version=1.1&maximumRecords=100&operation=searchRetrieve&recordSchema=MARC21-xml&query=tst%3D%22Der%20Raketenadmiral%22%20AND%20per%3D%22Johannes%20Siemers%22%20NOT%20%28mat%3Dfilm%20OR%20mat%3Dmusic%20OR%20mat%3Dmicrofiches%20OR%20cod%3Dtt%29
Got records: 0
tit="Der Raketenadmiral" AND per="Johannes Siemers" NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Querying: tit="Der Raketenadmiral" AND per="Johannes Siemers" NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Query URL: https://services.dnb.de/sru/dnb?version=1.1&maximumRecords=100&operation=searchRetrieve&recordSchema=MARC21-xml&query=tit%3D%22Der%20Raketenadmiral%22%20AND%20per%3D%22Johannes%20Siemers%22%20NOT%20%28mat%3Dfilm%20OR%20mat%3Dmusic%20OR%20mat%3Dmicrofiches%20OR%20cod%3Dtt%29
Got records: 0
tit="Raketenadmiral" AND per="Johannes Siemers" NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Querying: tit="Raketenadmiral" AND per="Johannes Siemers" NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Query URL: https://services.dnb.de/sru/dnb?version=1.1&maximumRecords=100&operation=searchRetrieve&recordSchema=MARC21-xml&query=tit%3D%22Raketenadmiral%22%20AND%20per%3D%22Johannes%20Siemers%22%20NOT%20%28mat%3Dfilm%20OR%20mat%3Dmusic%20OR%20mat%3Dmicrofiches%20OR%20cod%3Dtt%29
Got records: 0
per="Der Raketenadmiral" AND tit="Johannes Siemers" NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Querying: per="Der Raketenadmiral" AND tit="Johannes Siemers" NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Query URL: https://services.dnb.de/sru/dnb?version=1.1&maximumRecords=100&operation=searchRetrieve&recordSchema=MARC21-xml&query=per%3D%22Der%20Raketenadmiral%22%20AND%20tit%3D%22Johannes%20Siemers%22%20NOT%20%28mat%3Dfilm%20OR%20mat%3Dmusic%20OR%20mat%3Dmicrofiches%20OR%20cod%3Dtt%29
Got records: 0
"Der Raketenadmiral" AND "Johannes Siemers" NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Querying: "Der Raketenadmiral" AND "Johannes Siemers" NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Query URL: https://services.dnb.de/sru/dnb?version=1.1&maximumRecords=100&operation=searchRetrieve&recordSchema=MARC21-xml&query=%22Der%20Raketenadmiral%22%20AND%20%22Johannes%20Siemers%22%20NOT%20%28mat%3Dfilm%20OR%20mat%3Dmusic%20OR%20mat%3Dmicrofiches%20OR%20cod%3Dtt%29
Got records: 0
"Raketenadmiral" AND "Johannes" AND "Siemers" NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Querying: "Raketenadmiral" AND "Johannes" AND "Siemers" NOT (mat=film OR mat=music OR mat=microfiches OR cod=tt)
Query URL: https://services.dnb.de/sru/dnb?version=1.1&maximumRecords=100&operation=searchRetrieve&recordSchema=MARC21-xml&query=%22Raketenadmiral%22%20AND%20%22Johannes%22%20AND%20%22Siemers%22%20NOT%20%28mat%3Dfilm%20OR%20mat%3Dmusic%20OR%20mat%3Dmicrofiches%20OR%20cod%3Dtt%29
Got records: 0 

******************************************************************************** 

****************************** Google (1, 0, 3) ****************************** 
Found 0 results 
Downloading from Google took 0.6186747550964355 
Making query: https://books.google.com/books/feeds/volumes?q=intitle%3ADer+intitle%3ARaketenadmiral%2Binauthor%3AJohannes+inauthor%3ASiemers&max-results=20&start-index=1&min-viewability=none 

******************************************************************************** 

****************************** Amazon.com (1, 2, 21) ****************************** 
Found 0 results 
Downloading from Amazon.com took 4.697399139404297 
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.93 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=Der+Raketenadmiral+Johannes+Siemers+site%3Awww.amazon.de
Getting details from: https://webcache.googleusercontent.com/search?q=cache:OACa8QmEHZsJ:https://www.amazon.de/Raketenadmiral-Die-Curtis-Legende-4-ebook/dp/B08P9PN8DP+&cd=1&hl=de&ct=clnk&gl=de
Failed to make details query: 'https://webcache.googleusercontent.com/search?q=cache:OACa8QmEHZsJ:https://www.amazon.de/Raketenadmiral-Die-Curtis-Legende-4-ebook/dp/B08P9PN8DP+&cd=1&hl=de&ct=clnk&gl=de'
Traceback (most recent call last):
  File "calibre/ebooks/metadata/sources/amazon.py", line 65, in parse_details_page
  File "mechanize/_mechanize.py", line 241, in open_novisit
  File "mechanize/_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class.<locals>.httperror_seek_wrapper: HTTP Error 429: Too Many Requests

get_details failed for url: 'https://webcache.googleusercontent.com/search?q=cache:OACa8QmEHZsJ:https://www.amazon.de/Raketenadmiral-Die-Curtis-Legende-4-ebook/dp/B08P9PN8DP+&cd=1&hl=de&ct=clnk&gl=de'
Traceback (most recent call last):
  File "calibre/ebooks/metadata/sources/amazon.py", line 363, in run
  File "calibre/ebooks/metadata/sources/amazon.py", line 369, in get_details
TypeError: cannot unpack non-iterable NoneType object

Getting details from: https://webcache.googleusercontent.com/search?q=cache:P2fuTqol70kJ:https://www.amazon.de/Raketenadmiral-Die-Curtis-Legende-4/dp/B095N6B3PM+&cd=2&hl=de&ct=clnk&gl=de
Failed to make details query: 'https://webcache.googleusercontent.com/search?q=cache:P2fuTqol70kJ:https://www.amazon.de/Raketenadmiral-Die-Curtis-Legende-4/dp/B095N6B3PM+&cd=2&hl=de&ct=clnk&gl=de'
Traceback (most recent call last):
  File "calibre/ebooks/metadata/sources/amazon.py", line 65, in parse_details_page
  File "mechanize/_mechanize.py", line 241, in open_novisit
  File "mechanize/_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class.<locals>.httperror_seek_wrapper: HTTP Error 429: Too Many Requests

get_details failed for url: 'https://webcache.googleusercontent.com/search?q=cache:P2fuTqol70kJ:https://www.amazon.de/Raketenadmiral-Die-Curtis-Legende-4/dp/B095N6B3PM+&cd=2&hl=de&ct=clnk&gl=de'
Traceback (most recent call last):
  File "calibre/ebooks/metadata/sources/amazon.py", line 363, in run
  File "calibre/ebooks/metadata/sources/amazon.py", line 369, in get_details
TypeError: cannot unpack non-iterable NoneType object

Getting details from: https://webcache.googleusercontent.com/search?q=cache:XCBPDYzHvbYJ:https://www.amazon.de/-/en/Johannes-Siemers-ebook/dp/B08P9PN8DP+&cd=3&hl=de&ct=clnk&gl=de
Failed to make details query: 'https://webcache.googleusercontent.com/search?q=cache:XCBPDYzHvbYJ:https://www.amazon.de/-/en/Johannes-Siemers-ebook/dp/B08P9PN8DP+&cd=3&hl=de&ct=clnk&gl=de'
Traceback (most recent call last):
  File "calibre/ebooks/metadata/sources/amazon.py", line 65, in parse_details_page
  File "mechanize/_mechanize.py", line 241, in open_novisit
  File "mechanize/_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class.<locals>.httperror_seek_wrapper: HTTP Error 429: Too Many Requests

get_details failed for url: 'https://webcache.googleusercontent.com/search?q=cache:XCBPDYzHvbYJ:https://www.amazon.de/-/en/Johannes-Siemers-ebook/dp/B08P9PN8DP+&cd=3&hl=de&ct=clnk&gl=de'
Traceback (most recent call last):
  File "calibre/ebooks/metadata/sources/amazon.py", line 363, in run
  File "calibre/ebooks/metadata/sources/amazon.py", line 369, in get_details
TypeError: cannot unpack non-iterable NoneType object 

******************************************************************************** 

****************************** Edelweiss (2, 0, 1) ****************************** 
Found 0 results 
Downloading from Edelweiss took 0.1445307731628418 
Currently Edelweiss returns random books for search queries 

******************************************************************************** 
The identify phase took 4.92 seconds 
The longest time (4.821439) was taken by: Amazon.com Multiple Countries 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds

Metadata-download is set to "More than one entry from source"
Hope, that helps to get the error.

igorius · 12-08-2021, 08:21 AM

Is that behaviour known? Or am i the only one seeing that thing? I tried with reinstalling calibre, but nothing changed.
I didnt reset my prefs, they didnt change since looooong time, so i hope, thats not the problem. I think, first use of calibre is from 0.x, say several years ago (5-6 years i think).

theducks · 12-08-2021, 11:00 AM

Quote:

Originally Posted by igorius

Is that behaviour known? Or am i the only one seeing that thing? I tried with reinstalling calibre, but nothing changed.
I didnt reset my prefs, they didnt change since looooong time, so i hope, thats not the problem. I think, first use of calibre is from 0.x, say several years ago (5-6 years i think).

Re-installs DO NOT change previous settings nor the Library. You would need to wipe the configuration folder (not really recommended) or select files.

kovidgoyal · 12-08-2021, 11:14 AM

Amazon has been blocking calibre for years now. Nowadays, the metadata plugin searches amazon via google and for that title and author, the google search results for amazon.de dont contain anything useful, only links to new releases/authors page, see:

https://www.google.com/search?q=Berg...Awww.amazon.de

igorius · 12-10-2021, 03:47 AM

Hello again,

i tried your link with the google search and the first result was exactly that book. So here algorithms for search and country kick in i think.
But strange all the way, because that calibre-search worked before like a charm, even BOL and DNB worked great, but now not, which is a mess, because covers from BOL and DNB are constantly big in size, say yyy x 1600; where the amazon and google-covers are normally yyy x 500.
But again, thank you for your help!

PS: One of the big reasons i dont use google... A metasearch maybe would be an alternative in the future.

kovidgoyal · 12-10-2021, 04:25 AM

as for BOL and DNB you should post in those plugins threads.

12-10-2021, 03:47 AM	#5
igorius Zealot Posts: 124 Karma: 34 Join Date: Jun 2015 Device: ipad & inkpad X	Hello again, i tried your link with the google search and the first result was exactly that book. So here algorithms for search and country kick in i think. But strange all the way, because that calibre-search worked before like a charm, even BOL and DNB worked great, but now not, which is a mess, because covers from BOL and DNB are constantly big in size, say yyy x 1600; where the amazon and google-covers are normally yyy x 500. But again, thank you for your help! PS: One of the big reasons i dont use google... A metasearch maybe would be an alternative in the future. Last edited by igorius; 12-10-2021 at 04:26 AM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
[Kobo] Error When Downloading Metadata	Librarian X-ray	Library Management	2	04-06-2021 07:30 AM
Error in log downloading metadata	Terisa de morgan	Calibre	2	03-16-2017 09:21 AM
Metadata priority when re-downloading metadata	truth1ness	Library Management	20	04-12-2015 02:02 PM
Metadata not downloading	Veight	Calibre	4	03-05-2013 10:09 PM
Metadata not downloading	Jay955528	Calibre	4	07-10-2011 03:26 AM

12-08-2021, 08:21 AM	#2
igorius Zealot Posts: 124 Karma: 34 Join Date: Jun 2015 Device: ipad & inkpad X	Is that behaviour known? Or am i the only one seeing that thing? I tried with reinstalling calibre, but nothing changed. I didnt reset my prefs, they didnt change since looooong time, so i hope, thats not the problem. I think, first use of calibre is from 0.x, say several years ago (5-6 years i think).

12-08-2021, 11:14 AM	#4
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Amazon has been blocking calibre for years now. Nowadays, the metadata plugin searches amazon via google and for that title and author, the google search results for amazon.de dont contain anything useful, only links to new releases/authors page, see: https://www.google.com/search?q=Berg...Awww.amazon.de

12-10-2021, 04:25 AM	#6
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	as for BOL and DNB you should post in those plugins threads.

Advert

Advert