Calibre not downloading metadata from Amazon or FF

[pugsley1]

I've noticed recently when downloading metadata, that I'm not getting anything from Amazon (US) or fantasticfiction.com. Has something changed?

[pugsley1]

Can anyone please help? Is this a bug?

[DNSB]

It would help if you could run calibre in debug mode and post the log file here. I haven't use Fantastic Fiction as a metadata source in quite a while so can't comment on that. For Amazon, I use the configuration in the attached image and haven't seen any issues other than being blocked if I make too many requests. One reason that I long ago gave up on Bulk metadata download.

[pugsley1]

Reported as bug #2137195 to Calibre.

[pugsley1]

I just tried changing the Amazon plug-in, country US, to use the Amazon servers, and DuckDuckGo and Google cache - no luck. I'll try again with those option boxes checked.

[pugsley1]

Originally Posted by DNSB

It would help if you could run calibre in debug mode and post the log file here. I haven't use Fantastic Fiction as a metadata source in quite a while so can't comment on that. For Amazon, I use the configuration in the attached image and haven't seen any issues other than being blocked if I make too many requests. One reason that I long ago gave up on Bulk metadata download.

Tried running boxes ticked and country set to Canada. Still no luck. Ran Calibre in debug mode, not sure if I did it correctly. Attached the command line output - is this the log file?

[DNSB]

Sorry, I should have made it clear that I wanted the debug log file to see if there were any issues with calibre but also to include the log file after attempting to download metadata using the View log button and then Copy to Clipboard button. Once you have pasted the log files into a message, please wrap them in Spoiler (select the text and click the Xed eyeball icon).

Spoiler:

Running identify query with parameters:
{'title': 'Three Men in a Boat', 'authors': ['Jerome K. Jerome'], 'identifiers': {'uri': 'zelda@mobileread.com:2010040720'}, 'timeout': 30}
Using plugins: Baen (1, 1, 0), Kobo Metadata (1, 12, 0), Smashwords Metadata (1, 0, 2), Amazon.com (1, 3, 15)
The log from individual plugins is below

****************************** Baen (1, 1, 0) ******************************
Found 0 results
Downloading from Baen took 1.6671509742736816
Querying: https://www.baen.com/allbooks?q=Three+Men+in+a+Boat
Rejecting as not close enough match: Men of Bretton
Rejecting as not close enough match: Men of Bretton - eARC
Rejecting as not close enough match: Little Green Men - Attack!
Rejecting as not close enough match: Three Quarters
Rejecting as not close enough match: Down Among the Dead Men
Rejecting as not close enough match: Eclipse Three
Rejecting as not close enough match: Variations Three
Rejecting as not close enough match: The Three-Cornered War
Rejecting as not close enough match: Three Go Back
Rejecting as not close enough match: The Sleeper Awakes and Men Like Gods
Rejecting as not close enough match: Three Faces of Asprin
Rejecting as not close enough match: Three Military SF Novellas
Rejecting as not close enough match: Doctor Alien: Three Tales
Rejecting as not close enough match: The Three Imposters: Or, the Transmutations
Rejecting as not close enough match: Three Flags and Two Brothers
Rejecting as not close enough match: A Company of Heroes Book Three: The Princess
Rejecting as not close enough match: The Sacerdotal Owl and Three Other Long Tales
Rejecting as not close enough match: NS200911 November 2009 Night Shade Books
Rejecting as not close enough match: September 2016 Pinbeam Books
Rejecting as not close enough match: WF201903 March 2019 Wordfire Press Books
No matches found with query: 'https://www.baen.com/allbooks?q=Three+Men+in+a+Boat'

************************************************** ******************************

****************************** Kobo Metadata (1, 12, 0) ******************************
Found 1 results
Downloading from Kobo Metadata took 4.585642576217651


---
Title : Three Men in a Boat
Author(s) : Jerome K. Jerome
Publisher : anboco
Tags : Fiction & Literature
Languages : English
Published : 2016-08-26T00:00:00+00:00
Identifiers : isbn:9783736411005
Comments :
Three Men in a Boat (To Say Nothing of the Dog) is a humorous account by English writer Jerome K. Jerome of a two-week boating holiday on the Thames from Kingston upon Thames to Oxford and back to Kingston. The book was initially intended to be a serious travel guide, with accounts of local history along the route, but the humorous elements took over to the point where the serious and somewhat sentimental passages seem a distraction to the comic novel. One of the most praised things about Three Men in a Boat is how undated it appears to modern readers – the jokes seem fresh and witty even today. The three men are based on Jerome himself (the narrator Jerome K. Jerome) and two real-life friends, George Wingrave (who would become a senior manager at Barclays Bank) and Carl Hentschel (the founder of a London printing business, called Harris in the book), with whom Jerome often took boating trips.


KoboMetadata::identify: title: Three Men in a Boat, authors: ['Jerome K. Jerome'], identifiers: {'uri': 'zelda@mobileread.com:2010040720'}
No matches found with identifiers, falling back to general search.
KoboMetadata:erform_search: Searching with query: Three Men in a Boat Jerome Jerome
KoboMetadata:erform_query: Searching for book with url: https://www.kobo.com/ca/en/search?qu...fclanguages=en
KoboMetadata:arse_search_page: Detected new search page
KoboMetadata::fetch_metadata: Looking up metadata with url: https://www.kobo.com/ca/en/ebook/thr...VvLQek7&cPos=1
KoboMetadata:arse_book_page: Got title: Three Men in a Boat
KoboMetadata:arse_book_page: Got authors: ['Jerome K. Jerome']
KoboMetadata:arse_book_page: Got publisher: E-BOOKARAMA
KoboMetadata:arse_book_page: Got pubdate: 2019-08-04 00:00:00+00:00
KoboMetadata:arse_book_page: Got isbn: 9788834165355
KoboMetadata:arse_book_page: Got language: English
KoboMetadata:arse_book_page: Got tags: {'Nonfiction', 'Great Britain', 'Europe', 'Travel', 'General Humour', 'Entertainment', 'Adventure & Literary Travel', 'Humour & Comedy'}
KoboMetadata:arse_book_page: Got comments:
The novel "Three Men in a Boat," written by English author Jerome K. Jerome and published in 1889, is a humorous story about a boat trip in the Thames River that J. takes with his friends George and William Samuel Harris. Jerome’s prose is long-winding and digresses into anecdotes or observational passages quite often.
"Three Men in a Boat" was initially intended to be a serious travel guide, with accounts of local history along the route, but the humorous elements took over to the point where the serious and somewhat sentimental passages seem a distraction to the comic novel. One of the most praised things about "Three Men in a Boat" is how undated it appears to modern readers, the jokes seem fresh and witty even today.
The three men are based on Jerome himself (the narrator J.) and two real-life friends.


KoboMetadata:arse_book_page_for_cover: Got cover: https://cdn.kobo.com/book-images/05a...a-boat-139.jpg
KoboMetadata::fetch_metadata: Looking up metadata with url: https://www.kobo.com/ca/en/ebook/thr...VvLQek7&cPos=2
KoboMetadata:arse_book_page: Got title: Three Men in a Boat
KoboMetadata:arse_book_page: Got authors: ['Jerome K. Jerome']
KoboMetadata:arse_book_page: Got publisher: anboco
KoboMetadata:arse_book_page: Got pubdate: 2016-08-26 00:00:00+00:00
KoboMetadata:arse_book_page: Got isbn: 9783736411005
KoboMetadata:arse_book_page: Got language: English
KoboMetadata:arse_book_page: Got tags: {'Fiction & Literature'}
KoboMetadata:arse_book_page: Got comments:
Three Men in a Boat (To Say Nothing of the Dog) is a humorous account by English writer Jerome K. Jerome of a two-week boating holiday on the Thames from Kingston upon Thames to Oxford and back to Kingston. The book was initially intended to be a serious travel guide, with accounts of local history along the route, but the humorous elements took over to the point where the serious and somewhat sentimental passages seem a distraction to the comic novel. One of the most praised things about Three Men in a Boat is how undated it appears to modern readers – the jokes seem fresh and witty even today. The three men are based on Jerome himself (the narrator Jerome K. Jerome) and two real-life friends, George Wingrave (who would become a senior manager at Barclays Bank) and Carl Hentschel (the founder of a London printing business, called Harris in the book), with whom Jerome often took boating trips.


KoboMetadata:arse_book_page_for_cover: Got cover: https://cdn.kobo.com/book-images/21f...-a-boat-70.jpg
Found 2 match(es) using general search.

************************************************** ******************************

****************************** Smashwords Metadata (1, 0, 2) ******************************
Found 0 results
Downloading from Smashwords Metadata took 3.9459621906280518
Querying: https://www.smashwords.com/books/sea...+Men+in+a+Boat
No Full Search section. Has the page changed?
Building match list from found_ids: []
Matches: []
No matches found with identifiers, retrying using title and authors. Query: 'https://www.smashwords.com/books/search?query=Three+Men+in+a+Boat'
Querying: https://www.smashwords.com/books/sea...+Men+in+a+Boat
No Full Search section. Has the page changed?
Building match list from found_ids: []
Matches: []
No matches found with query: 'https://www.smashwords.com/books/search?query=Three+Men+in+a+Boat'

************************************************** ******************************

****************************** Amazon.com (1, 3, 15) ******************************
Found 3 results
Downloading from Amazon.com took 6.646566867828369


---
Title : Three Men in a Boat
Author(s) : Jerome K. Jerome
Publisher : CreateSpace Independent Publishing Platform
Languages : eng
Rating : 2.1
Published : 2017-05-08T00:00:00+00:00
Identifiers : amazon_ca:1546580999, isbn:9781546580997
Comments : <p>Three Men in a Boat by Jerome K. Jerome. Martyrs to hypochondria and general seediness, J. and his friends George and Harris decide that a jaunt up the Thames would suit them to a ‘T’. But when they set off, they can hardly predict the troubles that lie ahead with tow-ropes, unreliable weather forecasts and tins of pineapple chunks—not to mention the devastation left in the wake of J.’s small fox-terrier Montmorency. Three Men in a Boat was an instant success when it appeared in 1889, and, with its benign escapism, authorial discursions and wonderful evocation of the late-Victorian ‘clerking classes’, it hilariously captured the spirit of its age. Three Men in a Boat (To Say Nothing of the Dog), published in 1889, is a humorous account by English writer Jerome K. Jerome of a two-week boating holiday on the Thames from Kingston upon Thames to Oxford and back to Kingston. The book was initially intended to be a serious travel guide, with accounts of local history along the route, but the humorous elements took over to the point where the serious and somewhat sentimental passages seem a distraction to the comic novel. One of the most praised things about Three Men in a Boat is how undated it appears to modern readers – the jokes seem fresh and witty even today. The three men are based on Jerome himself (the narrator Jerome K. Jerome) and two real-life friends, George Wingrave (who would become a senior manager at Barclays Bank) and Carl Hentschel (the founder of a London printing business, called Harris in the book), with whom Jerome often took boating trips. The dog, Montmorency, is entirely fictional but, "as Jerome admits, developed out of that area of inner consciousness which, in all Englishmen, contains an element of the dog." The trip is a typical boating holiday of the time in a Thames camping skiff. This was just after commercial boat traffic on the Upper Thames had died out, replaced by the 1880s craze for boating as a leisure activity. Jerome Klapka Jerome (1859-1927) was an English writer and humourist, best known for the comic travelogue Three Men in a Boat (1887). Other works include the essay collections Idle Thoughts of an Idle Fellow (1886) and Second Thoughts of an Idle Fellow; Three Men on the Bummel, a sequel to Three Men in a Boat, and several other novels.</p>


---
Title : Three Men in a Boat
Author(s) : Jerome K Jerome
Publisher : CreateSpace Independent Publishing Platform
Languages : eng
Rating : 2.1
Published : 2016-03-22T00:00:00+00:00
Identifiers : amazon_ca:1530680360, isbn:9781530680368
Comments : <p>Three Men in a Boat by Jerome K Jerome is a humorous account of a two-week boating holiday on the Thames from Kingston upon Thames to Oxford and back to Kingston.</p>


---
Title : Three Men in a Boat and Three Men on the Bummel
Author(s) : Jerome K. Jerome & Jeremy Lewis
Publisher : Penguin Classics
Languages : eng
Rating : 2.2
Published : 2000-05-02T00:00:00+00:00
Identifiers : amazon_ca:0140437509, isbn:9780140437508
Comments : <p>When J. the narrator, George, Harris and Montmorency the dog set off on their hilarious misadventures, they can hardly predict the troubles that lie ahead with tow-ropes, unreliable weather-forecasts, imaginary illnesses, butter pats and tins of pineapple chunks. Denounced as vulgar by the literary establishment, <strong>Three Men in a Boat</strong> nevertheless caught the spirit of the times. The expansion of education and the increase in office workers created a new mass readership, and Jerome's book was especially popular among the 'clerking classes' who longed to be 'free from that fretful haste, that vehement striving, that is every day becoming more and more the bane of nineteenth-century life.'</p>
<p>So popular did it prove that Jerome reunited his heroes for a bicycle tour of Germany. Despite some sharp, and with hindsight, prophetic observations of the country, <strong>Three Men on the Bummel</strong> describes an equally picaresque journey constrained only 'by the necessity of getting back within a given time to the point from which one started'. </p>
<p>For more than seventy years, Penguin has been the leading publisher of classic literature in the English-speaking world. With more than 1,700 titles, Penguin Classics represents a global bookshelf of the best works throughout history and across genres and disciplines. Readers trust the series to provide authoritative texts enhanced by introductions and notes by distinguished scholars and contemporary authors, as well as up-to-date translations by award-winning translators.</p>
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36
Server: amazon
Downloading details from: https://www.amazon.ca/Three-Men-Boat...1&unfiltered=1
Downloading details from: https://www.amazon.ca/Three-Men-Boat...2&unfiltered=1
Failed to parse pubdate: CreateSpace Independent Publishing Platform
Traceback (most recent call last):
File "d:\calibre\calibre-master\src\calibre\ebooks\metadata\sources\amazon. py", line 1037, in parse_detail_cells
File "d:\calibre\calibre-master\src\calibre\utils\date.py", line 137, in parse_only_date
File "d:\calibre\calibre-master\src\calibre\utils\date.py", line 113, in parse_date
File "dateutil\parser\_parser.py", line 1368, in parse
File "dateutil\parser\_parser.py", line 643, in parse
dateutil.parser._parser.ParserError: Unknown string format: CreateSpace Independent Publishing Platform

Downloading details from: https://www.amazon.ca/Three-Men-Boat...3&unfiltered=1
Failed to parse pubdate: CreateSpace Independent Publishing Platform
Traceback (most recent call last):
File "d:\calibre\calibre-master\src\calibre\ebooks\metadata\sources\amazon. py", line 1037, in parse_detail_cells
File "d:\calibre\calibre-master\src\calibre\utils\date.py", line 137, in parse_only_date
File "d:\calibre\calibre-master\src\calibre\utils\date.py", line 113, in parse_date
File "dateutil\parser\_parser.py", line 1368, in parse
File "dateutil\parser\_parser.py", line 643, in parse
dateutil.parser._parser.ParserError: Unknown string format: CreateSpace Independent Publishing Platform

Failed to parse pubdate: Penguin Classics
Traceback (most recent call last):
File "d:\calibre\calibre-master\src\calibre\ebooks\metadata\sources\amazon. py", line 1037, in parse_detail_cells
File "d:\calibre\calibre-master\src\calibre\utils\date.py", line 137, in parse_only_date
File "d:\calibre\calibre-master\src\calibre\utils\date.py", line 113, in parse_date
File "dateutil\parser\_parser.py", line 1368, in parse
File "dateutil\parser\_parser.py", line 643, in parse
dateutil.parser._parser.ParserError: Unknown string format: Penguin Classics

************************************************** ******************************
The identify phase took 6.84 seconds
The longest time (6.646567) was taken by: Amazon.com
Merging results from different sources
We have 3 merged results, merging took: 0.00 seconds

[JohnnyBook]

FF does not appear to be working which should probably be reported in the FF metadata plugin.

Amazon does appear to be working. BUT it can block you if you try to do to many metadata searches. Normally they will block you for a few hours. BUT, I did have a couple times where I was blocked for 4-5 DAYS (Might have been up to a week).

Troubleshooting the problem really needs the metadata download log David mentioned.

After doing the "download metadata" in Edit Metadata" screen before accepting the results ("OK") press the "View Log" button beside it, and then "copy to clipboard" and paste that info here.

[pugsley1]

Spoiler:

Running identify query with parameters:
{'title': 'Middle Ages: Almanac', 'authors': ['Judson Knight', 'Judy Galens'], 'identifiers': {'isbn': '9780787648565', 'goodreads': '1602612', 'google': 'XOYCAAAACAAJ'}, 'timeout': 30}
Using plugins: Amazon.com Multiple Countries (1, 0, 0), Barnes & Noble (1, 5, 7), Fantastic Fiction (1, 7, 2), Goodreads (1, 8, 3), Smashwords Metadata (1, 0, 2), Wikidata (2, 0, 0), Google (1, 1, 3), Amazon.com (1, 3, 15)
The log from individual plugins is below

****************************** Amazon.com Multiple Countries (1, 0, 0) ******************************
Found 0 results
Downloading from Amazon.com Multiple Countries took 13.300638914108276
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:135.0) Gecko/20100101 Firefox/135.0
Server: auto
Making google query: https://www.google.com/search?q=%289...n.co.uk&nfpr=1
Failed to find any results on results page, with title: (9780787648565 or 978-0787648565) site:www.amazon.co.uk - Google Search
No search engine results for terms: (9780787648565 OR 978-0787648565)
Trying the bing search engine instead
Making bing query: https://www.bing.com/search?q=%28978...w.amazon.co.uk
Bing returned no results
No search engine results for terms: (9780787648565 OR 978-0787648565)
No matches found with identifiers, retrying using only title and authors. Query: ['(9780787648565', 'OR', '978-0787648565)']
User-agent: Lynx/2.8.6rel.5 libwww-FM/2.14
Server: auto
Making google query: https://www.google.com/search?q=Midd...w.amazon.co.uk
Failed to find any results on results page, with title: Middle Ages: Almanac Judson Knight site:www.amazon.co.uk - Google Search
No search engine results for terms: Middle Ages: Almanac Judson Knight
Trying the bing search engine instead
Making bing query: https://www.bing.com/search?q=Middle...w.amazon.co.uk
Bing returned no results
No search engine results for terms: Middle Ages: Almanac Judson Knight
No matches found with query: ['Middle', 'Ages:', 'Almanac', 'Judson', 'Knight']

************************************************** ******************************

****************************** Barnes & Noble (1, 5, 7) ******************************
Found 0 results
Downloading from Barnes & Noble took 43.46030020713806
Querying: https://www.barnesandnoble.com/s/978...=9780787648565
Failed to make identify query
Traceback (most recent call last):
File "mechanize\_urllib2_fork.py", line 1238, in do_open
File "http\client.py", line 1395, in getresponse
File "http\client.py", line 325, in begin
File "http\client.py", line 286, in _read_status
File "socket.py", line 718, in readinto
File "ssl.py", line 1314, in recv_into
File "ssl.py", line 1166, in read
TimeoutError: The read operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "calibre_plugins.barnes_noble.__init__", line 164, in identify
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 287, in _mech_open
File "mechanize\_opener.py", line 193, in open
File "mechanize\_urllib2_fork.py", line 425, in _open
File "mechanize\_urllib2_fork.py", line 414, in _call_chain
File "calibre\utils\browser.py", line 28, in https_open
File "mechanize\_urllib2_fork.py", line 1240, in do_open
urllib.error.URLError: <urlopen error The read operation timed out>

************************************************** ******************************

****************************** Fantastic Fiction (1, 7, 2) ******************************
Found 0 results
Downloading from Fantastic Fiction took 14.195766925811768
Querying: https://www.fantasticfiction.com/dbs...Cdb%2Cimageloc
Failed to make identify query
Traceback (most recent call last):
File "calibre_plugins.fantastic_fiction.__init__", line 193, in identify
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class.<locals >.httperror_seek_wrapper: HTTP Error 403: Forbidden

************************************************** ******************************

****************************** Goodreads (1, 8, 3) ******************************
Found 1 results
Downloading from Goodreads took 18.57247018814087


---
Title : Middle Ages Almanac
Author(s) : Judson Knight & Judy Galens
Publisher : U-X-L
Tags : History
Series : Middle Ages Reference Library #1
Languages : eng
Rating : 2.5
Published : 2000-10-10T07:00:00+00:00
Identifiers : goodreads:1602612, isbn:9780787648565
Comments : <p>"Middle Ages: Almanac" includes 19 chapters arranged by geographic location and dedicated to a different civilization, their origins, conflicts and struggles for power in the Middle Ages. From the Arab and Muslim worlds to the European Crusades, "Middle Ages: Almanac" presents the phases of history that defined the era. Each chapter begins with a map displaying the geographic location of the civilization followed by a description of its origins, history and importance. Also included are sidebars containing lists of unfamiliar words and suggestions for classroom activities as well as 100 photographs and illustrations, sidebars, timeline, glossary, and a subject index.</p>
identify - start. title=Middle Ages: Almanac, authors=['Judson Knight', 'Judy Galens'], identifiers={'isbn': '9780787648565', 'goodreads': '1602612', 'google': 'XOYCAAAACAAJ'}
Get details attempt #1
Goodreads book url: 'https://www.goodreads.com/book/show/1602612'
Trying to parse book json for 2022 web page format
Json script node found, page in 2022+ html format
parse_title: Middle Ages Almanac
parse_authors - author=Judson Knight
parse_authors - author=Judy Galens
parse_details - goodreads_id: 1602612, mi: Title : Middle Ages Almanac
Author(s) : Judson Knight & Judy Galens
parse_series: series_name='Middle Ages Reference Library', series_index='1.0'
parse_isbn: 9780787648565
parse_rating: 5.0
parse_comments: <p>"Middle Ages: Almanac" includes 19 chapters arranged by geographic location and dedicated to a different civilization, their origins, conflicts and struggles for power in the Middle Ages. From the Arab and Muslim worlds to the European Crusades, "Middle Ages: Almanac" presents the phases of history that defined the era. Each chapter begins with a map displaying the geographic location of the civilization followed by a description of its origins, history and importance. Also included are sidebars containing lists of unfamiliar words and suggestions for classroom activities as well as 100 photographs and illustrations, sidebars, timeline, glossary, and a subject index.</p>
Visiting image url: https://m.media-amazon.com/images/S/...6i/1602612.jpg
parse_tags: History
parse_publisher: U-X-L
parse_publish_date: 2000-10-10 07:00:00+00:00 (First published)
parse_language: eng

************************************************** ******************************

****************************** Smashwords Metadata (1, 0, 2) ******************************
Found 0 results
Downloading from Smashwords Metadata took 19.257733821868896
Querying: https://www.smashwords.com/books/sea...=9780787648565
No Full Search section. Has the page changed?
Building match list from found_ids: []
Matches: []
No matches found with identifiers, retrying using title and authors. Query: 'https://www.smashwords.com/books/search?query=9780787648565'
Querying: https://www.smashwords.com/books/sea...ry=Middle+Ages
No Full Search section. Has the page changed?
Building match list from found_ids: []
Matches: []
No matches found with query: 'https://www.smashwords.com/books/search?query=Middle+Ages'

************************************************** ******************************

****************************** Wikidata (2, 0, 0) ******************************
Found 0 results
Downloading from Wikidata took 13.92506456375122
****************
Starting search:

Searching for split ISBN13 = 9780787648565
Author = Judson Knight
Searching for author='Judson Knight' title='Middle Ages: Almanac'
Found no matches
matches=None

************************************************** ******************************

****************************** Google (1, 1, 3) ******************************
Found 1 results
Downloading from Google took 14.131076335906982


---
Title : Middle Ages: Almanac
Author(s) : Judson Knight
Publisher : UXL
Tags : History, Reference, Europe, Medieval, Juvenile Nonfiction, General, Social Science, Politics & Government
Languages : eng
Published : 2001-12-15T04:48:26.840275+00:00
Identifiers : google:XOYCAAAACAAJ, isbn:9780787648565
Comments : <p>Middle Ages: Almanac includes 19 chapters arranged by geographic location and dedicated to a different civilization, their origins, conflicts and struggles for power in the Middle Ages. From the Arab and Muslim worlds to the European Crusades, Middle Ages: Almanac presents the phases of history that defined the era. Each chapter begins with a map displaying the geographic location of the civilization followed by a description of its origins, history and importance. Also included are sidebars containing lists of unfamiliar words and suggestions for classroom activities as well as 100 photographs and illustrations, sidebars, timeline, glossary, and a subject index.</p>

************************************************** ******************************

****************************** Amazon.com (1, 3, 15) ******************************
Found 0 results
Downloading from Amazon.com took 14.200718402862549
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.0.0 Safari/537.36
Server: ddg
Making ddg query: https://duckduckgo.com/html/?q=%2897...mazon.ca&kp=-1
Skipping non-book result: Result(url='https://duckduckgo.com/y.js?ad_domain=amazon.com&ad_provider=bingv7aa&ad_ type=txad&click_metadata=I39%2DWNshPx7NJ5UaTl6LykT gLe4OSnEoMZDNr3AEUD2gHmsuIcgahRqtbt92o4NT%2DC2PN_c nZQxNV6d2Z87peDVn710VnNPEF684zk8BiCbb42wrJuKCx6F8q yw2b1Oh%2DJuYCn2um4%2Dg_BbB0r_4ugZcz2E0yJC5INbaaGH gpv0.Xx5FyQaenZ9LrcaL86jRAA&rut=c2fb3d1a0291ec81e6 8b023b8dc364ec67714262b7cef5780622c38625a8729e&u3= https%3A%2F%2Fwww.bing.com%2Faclick%3Fld%3De8unwNh OpczRZ1k3DEh%2D8cDTVUCUwnc9beerctqYFzsKQxKQ7uelM7R Jf1co7%2DzaGxDN_T_RT0jk%2DATuNnwIjFE1XhX16xHLzs8W8 spryKsAvKG6r5r4uWPrYt5rwTiVdaO9YFuJBnzkZBuY_FWahMg A3SfZj%2DVKKPUPG20lC7QEm4kXh%2D1u5Aa4co%2DA0%2D49M XrKiOPoIh77xuvOmqa6OAne_zjkg%26u%3DaHR0cHMlM2ElMmY lMmZ3d3cuYW1hem9uLmNvbSUyZnMlMmYlM2ZpZSUzZFVURjglM jZrZXl3b3JkcyUzZGJvb2tzJTI2aW5kZXglM2RzdHJpcGJvb2t zJTI2dGFnJTNkdHh0c3RkYmdkdC0yMCUyNnJlZiUzZHBkX3NsX zRwcHF6YjltcnVfcCUyNmFkZ3JwaWQlM2QxMjMxNDUzMzMzMzQ 0MDIyJTI2aHZhZGlkJTNkNzY5NjU5OTk4MzAyNjclMjZodm5ld HclM2RzJTI2aHZxbXQlM2RwJTI2aHZibXQlM2RicCUyNmh2ZGV 2JTNkYyUyNmh2bG9jaW50JTNkJTI2aHZsb2NwaHklM2Q4NjQzN yUyNmh2dGFyZ2lkJTNka3dkLTc2OTY2MDY2OTE4NzM0JTNhbG9 jLTE5MCUyNmh5ZGFkY3IlM2Q0MTM4XzEzMjk5MDE2JTI2bWNpZ CUzZDMwMzRkYmMzYzBmYzNmMTI4YjNjZjIwMDIwOTAxZTcyJTI 2bGFuZ3VhZ2UlM2Rlbl9VUyUyNm1zY2xraWQlM2RhYmU2YmI3M GVkNmIxNDYzMjQxOGQyMjNiNGZjYTQxNw%26rlid%3Dabe6bb7 0ed6b14632418d223b4fca417&vqd=4-325229488503086980489319595008486800179&iurl=%7B1% 7DIG%3D65E0F2E136974C5C9A6AB94951FFF626%26CID%3D36 905BBB7E6367830EBD4D697FB66648%26ID%3DDevEx%2C5045 .1', title='Huge selection and top brands - Amazon.com Official Site', cached_url=None)
Skipping non-book result: Result(url='https://www.amazon.ca/Best-Sellers-Books/zgbs/books', title='Amazon.ca Best Sellers: The most popular items in Books', cached_url=None)
Skipping non-book result: Result(url='https://www.amazon.ca/advanced-search/books', title='Advanced Search - Amazon.ca', cached_url=None)
Downloading details from: https://www.amazon.ca/Book-Ultimate-.../dp/B0CJCKGRW1
get_details failed for url: 'https://www.amazon.ca/Book-Ultimate-Guide-Rebuilding-Civilization/dp/B0CJCKGRW1'
Traceback (most recent call last):
File "calibre\ebooks\metadata\sources\amazon.py", line 412, in run
File "calibre\ebooks\metadata\sources\amazon.py", line 425, in get_details
File "calibre\ebooks\metadata\sources\amazon.py", line 430, in parse_details
calibre.ebooks.metadata.sources.amazon.CaptchaErro r: Amazon returned a CAPTCHA page, probably because you downloaded too many books. Wait for some time and try again.

Downloading details from: https://www.amazon.ca/Middle-Ages-Re.../dp/0787648566
get_details failed for url: 'https://www.amazon.ca/Middle-Ages-Reference-Library-Almanac/dp/0787648566'
Traceback (most recent call last):
File "calibre\ebooks\metadata\sources\amazon.py", line 412, in run
File "calibre\ebooks\metadata\sources\amazon.py", line 425, in get_details
File "calibre\ebooks\metadata\sources\amazon.py", line 430, in parse_details
calibre.ebooks.metadata.sources.amazon.CaptchaErro r: Amazon returned a CAPTCHA page, probably because you downloaded too many books. Wait for some time and try again.

Downloading details from: https://www.amazon.ca/Lightlark-Saga.../dp/1419782665
get_details failed for url: 'https://www.amazon.ca/Lightlark-Saga-Ultimate-Box-Books/dp/1419782665'
Traceback (most recent call last):
File "calibre\ebooks\metadata\sources\amazon.py", line 412, in run
File "calibre\ebooks\metadata\sources\amazon.py", line 425, in get_details
File "calibre\ebooks\metadata\sources\amazon.py", line 430, in parse_details
calibre.ebooks.metadata.sources.amazon.CaptchaErro r: Amazon returned a CAPTCHA page, probably because you downloaded too many books. Wait for some time and try again.

************************************************** ******************************
The identify phase took 43.55 seconds
The longest time (43.460300) was taken by: Barnes & Noble
Merging results from different sources
We have 1 merged results, merging took: 0.00 seconds

[pugsley1]

Ok, I think I was able to do what you requested. If not, please let me know, thanks!

[pugsley1]

Originally Posted by pugsley1

Reported as bug #2137195 to Calibre.

Looks like my bug report has been deleted.

[pugsley1]

Tried another book and noticed this: "calibre.ebooks.metadata.sources.amazon.CaptchaErr or: Amazon returned a CAPTCHA page, probably because you downloaded too many books. Wait for some time and try again. "

Not sure what I'm supposed to do about this Amazon hasn't been working for me for weeks.

[pugsley1]

Spoiler:

Running identify query with parameters:
{'title': 'The Water Lies', 'authors': ['Amy Meyerson'], 'identifiers': {'isbn': '9781662531989', 'goodreads': '228673345', 'google': 'rV8d0QEACAAJ', 'mobi-asin': 'B0DXGP7GVC'}, 'timeout': 30}
Using plugins: Amazon.com Multiple Countries (1, 0, 0), Barnes & Noble (1, 5, 7), Fantastic Fiction (1, 7, 2), Goodreads (1, 8, 3), Smashwords Metadata (1, 0, 2), Wikidata (2, 0, 0), Google (1, 1, 3), Amazon.com (1, 3, 15)
The log from individual plugins is below

****************************** Amazon.com Multiple Countries (1, 0, 0) ******************************
Found 0 results
Downloading from Amazon.com Multiple Countries took 14.595892906188965
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36 Edg/134.0.0.0
Server: auto
Making google query: https://www.google.com/search?q=%289...n.co.uk&nfpr=1
Failed to find any results on results page, with title: (9781662531989 or 978-1662531989) site:www.amazon.co.uk - Google Search
No search engine results for terms: (9781662531989 OR 978-1662531989)
Trying the bing search engine instead
Making bing query: https://www.bing.com/search?q=%28978...w.amazon.co.uk
Bing returned no results
No search engine results for terms: (9781662531989 OR 978-1662531989)
No matches found with identifiers, retrying using only title and authors. Query: ['(9781662531989', 'OR', '978-1662531989)']
User-agent: Lynx/2.8.6rel.5 libwww-FM/2.14
Server: auto
Making google query: https://www.google.com/search?q=Wate...w.amazon.co.uk
Failed to find any results on results page, with title: Water Lies Amy Meyerson site:www.amazon.co.uk - Google Search
No search engine results for terms: Water Lies Amy Meyerson
Trying the bing search engine instead
Making bing query: https://www.bing.com/search?q=Water+...w.amazon.co.uk
Bing returned no results
No search engine results for terms: Water Lies Amy Meyerson
No matches found with query: ['Water', 'Lies', 'Amy', 'Meyerson']

************************************************** ******************************

****************************** Barnes & Noble (1, 5, 7) ******************************
Found 0 results
Downloading from Barnes & Noble took 43.6282377243042
Querying: https://www.barnesandnoble.com/s/978...=9781662531989
Failed to make identify query
Traceback (most recent call last):
File "mechanize\_urllib2_fork.py", line 1238, in do_open
File "http\client.py", line 1395, in getresponse
File "http\client.py", line 325, in begin
File "http\client.py", line 286, in _read_status
File "socket.py", line 718, in readinto
File "ssl.py", line 1314, in recv_into
File "ssl.py", line 1166, in read
TimeoutError: The read operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "calibre_plugins.barnes_noble.__init__", line 164, in identify
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 287, in _mech_open
File "mechanize\_opener.py", line 193, in open
File "mechanize\_urllib2_fork.py", line 425, in _open
File "mechanize\_urllib2_fork.py", line 414, in _call_chain
File "calibre\utils\browser.py", line 28, in https_open
File "mechanize\_urllib2_fork.py", line 1240, in do_open
urllib.error.URLError: <urlopen error The read operation timed out>

************************************************** ******************************

****************************** Fantastic Fiction (1, 7, 2) ******************************
Found 0 results
Downloading from Fantastic Fiction took 13.589935064315796
Querying: https://www.fantasticfiction.com/dbs...Cdb%2Cimageloc
Failed to make identify query
Traceback (most recent call last):
File "calibre_plugins.fantastic_fiction.__init__", line 193, in identify
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class.<locals >.httperror_seek_wrapper: HTTP Error 403: Forbidden

************************************************** ******************************

****************************** Goodreads (1, 8, 3) ******************************
Found 1 results
Downloading from Goodreads took 19.63275957107544


---
Title : The Water Lies
Author(s) : Amy Meyerson
Publisher : Thomas & Mercer
Tags : Mystery, Thriller, Suspense, Adult
Languages : eng
Rating : 2
Published : 2026-01-01T08:00:00+00:00
Identifiers : goodreads:228673345, isbn:9781662531392
Comments : <p><strong>Internationally bestselling author Amy Meyerson takes readers on a harrowing journey where two mothers—one of a woman who drowned and the other of a toddler who might know what happened to her—are the only ones searching for the truth.</strong> </p>
<p>Heavily pregnant with her second child, Tessa Irons has enough on her mind without her toddler throwing tantrums at the local coffee shop. The boy is inconsolable, shouting “Gigi!” to a woman Tessa’s never seen before—and never will again. The next morning, the woman’s body is dredged up from the canal outside the Ironses’ posh Venice Beach home, and Tessa’s gut tells her it’s no coincidence. </p>
<p>Barb Geller refuses to believe that her daughter’s death was just some drunken accident. She heads to California for answers, where she crosses paths with Tessa. Together they hunt for the truth, certain they’ll find a connection between their children. </p>
<p>But the police don’t believe them. Tessa’s husband dismisses her worries as pregnancy jitters, and even though people are always watching along the canals, no one saw a thing. Tessa and Barb only have each other, their intuition, and the creeping sense of danger that grows with every shocking revelation.</p>
identify - start. title=The Water Lies, authors=['Amy Meyerson'], identifiers={'isbn': '9781662531989', 'goodreads': '228673345', 'google': 'rV8d0QEACAAJ', 'mobi-asin': 'B0DXGP7GVC'}
Get details attempt #1
Goodreads book url: 'https://www.goodreads.com/book/show/228673345'
Trying to parse book json for 2022 web page format
Json script node found, page in 2022+ html format
parse_title: The Water Lies
parse_authors - author=Amy Meyerson
parse_details - goodreads_id: 228673345, mi: Title : The Water Lies
Author(s) : Amy Meyerson
parse_isbn: 9781662531392
parse_rating: 4.1
parse_comments: <p><strong>Internationally bestselling author Amy Meyerson takes readers on a harrowing journey where two mothers—one of a woman who drowned and the other of a toddler who might know what happened to her—are the only ones searching for the truth.</strong> </p>
<p>Heavily pregnant with her second child, Tessa Irons has enough on her mind without her toddler throwing tantrums at the local coffee shop. The boy is inconsolable, shouting “Gigi!” to a woman Tessa’s never seen before—and never will again. The next morning, the woman’s body is dredged up from the canal outside the Ironses’ posh Venice Beach home, and Tessa’s gut tells her it’s no coincidence. </p>
<p>Barb Geller refuses to believe that her daughter’s death was just some drunken accident. She heads to California for answers, where she crosses paths with Tessa. Together they hunt for the truth, certain they’ll find a connection between their children. </p>
<p>But the police don’t believe them. Tessa’s husband dismisses her worries as pregnancy jitters, and even though people are always watching along the canals, no one saw a thing. Tessa and Barb only have each other, their intuition, and the creeping sense of danger that grows with every shocking revelation.</p>
Visiting image url: https://m.media-amazon.com/images/S/.../228673345.jpg
parse_tags: Mystery,Thriller,Suspense,Adult
parse_publisher: Thomas & Mercer
parse_publish_date: 2026-01-01 08:00:00+00:00 (First published)
parse_language: eng

************************************************** ******************************

****************************** Smashwords Metadata (1, 0, 2) ******************************
Found 0 results
Downloading from Smashwords Metadata took 18.957393884658813
Querying: https://www.smashwords.com/books/sea...=9781662531989
No Full Search section. Has the page changed?
Building match list from found_ids: []
Matches: []
No matches found with identifiers, retrying using title and authors. Query: 'https://www.smashwords.com/books/search?query=9781662531989'
Querying: https://www.smashwords.com/books/sea...The+Water+Lies
No Full Search section. Has the page changed?
Building match list from found_ids: []
Matches: []
No matches found with query: 'https://www.smashwords.com/books/search?query=The+Water+Lies'

************************************************** ******************************

****************************** Wikidata (2, 0, 0) ******************************
Found 0 results
Downloading from Wikidata took 14.218010902404785
****************
Starting search:

Searching for split ISBN13 = 9781662531989
Author = Amy Meyerson
Searching for author='Amy Meyerson' title='The Water Lies'
Found no matches
matches=None

************************************************** ******************************

****************************** Google (1, 1, 3) ******************************
Found 1 results
Downloading from Google took 14.20624041557312


---
Title : The Water Lies
Author(s) : Amy Meyerson
Publisher : Amazon Publishing
Tags : Fiction, Thrillers, Psychological, Domestic, Women
Languages : eng
Published : 2026-12-15T23:56:45.351716+00:00
Identifiers : google:rV8d0QEACAAJ, isbn:9781662531989
Comments : <p>Internationally bestselling author Amy Meyerson takes readers on a harrowing journey where two mothers--one of a woman who drowned and the other of a toddler who might know what happened to her--are the only ones searching for the truth. Heavily pregnant with her second child, Tessa Irons has enough on her mind without her toddler throwing tantrums at the local coffee shop. The boy is inconsolable, shouting "Gigi!" to a woman Tessa's never seen before--and never will again. The next morning, the woman's body is dredged up from the canal outside the Ironses' posh Venice Beach home, and Tessa's gut tells her it's no coincidence. Barb Geller refuses to believe that her daughter's death was just some drunken accident. She heads to California for answers, where she crosses paths with Tessa. Together they hunt for the truth, certain they'll find a connection between their children. But the police don't believe them. Tessa's husband dismisses her worries as pregnancy jitters, and even though people are always watching along the Canals, no one saw a thing. Tessa and Barb only have each other, their intuition, and the creeping sense of danger that grows with every shocking revelation.</p>

************************************************** ******************************

****************************** Amazon.com (1, 3, 15) ******************************
Found 0 results
Downloading from Amazon.com took 13.263340950012207
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36
Server: ddg
Making ddg query: https://duckduckgo.com/html/?q=B0DXG...mazon.ca&kp=-1
Downloading details from: https://www.amazon.ca/Water-Lies-Amy.../dp/B0DXGP7GVC
get_details failed for url: 'https://www.amazon.ca/Water-Lies-Amy-Meyerson-ebook/dp/B0DXGP7GVC'
Traceback (most recent call last):
File "calibre\ebooks\metadata\sources\amazon.py", line 412, in run
File "calibre\ebooks\metadata\sources\amazon.py", line 425, in get_details
File "calibre\ebooks\metadata\sources\amazon.py", line 430, in parse_details
calibre.ebooks.metadata.sources.amazon.CaptchaErro r: Amazon returned a CAPTCHA page, probably because you downloaded too many books. Wait for some time and try again.

************************************************** ******************************
The identify phase took 43.70 seconds
The longest time (43.628238) was taken by: Barnes & Noble
Merging results from different sources
We have 1 merged results, merging took: 0.00

Moderator Notice
You clicked Spoiler then added text. Wrap the text in a Spoiler tag pair

[pugsley1]

Originally Posted by JohnnyBook

FF does not appear to be working which should probably be reported in the FF metadata plugin.

Reported the error, but the author knows about the problem, but is unfortunately too busy to fix it at the moment.

Still broken version for someone to try to get working
I have taken a look at this now. It appears FF have wound up their anti-scraping measures, and I don't have the time to figure out a workaround at this point. If someone else wants to take a look at it I will happily except a fix.

[PeterT]

Originally Posted by pugsley1

Looks like my bug report has been deleted.

It's still there; just marked as Status: Invalid

See https://bugs.launchpad.net/calibre/+bug/2137195