MobileRead Forums - View Single Post - Problems downloading metadata from Amazon (5.7.2 & 4.23.0, Win 10 64-bit)

timnz · 12-24-2020, 12:12 AM

I tried copying what you did, DNSB - empty book with title/author, and set the metadata sources to Kobo and Amazon. Still no Amazon results:

Spoiler:

Code:

Running identify query with parameters: 
{'title': 'Enlightenment Now', 'authors': ['Steven Pinker'], 'identifiers': {}, 'timeout': 30} 
Using plugins: Kobo Books (1, 8, 0), Amazon.com (1, 2, 14) 
The log from individual plugins is below 

****************************** Kobo Books (1, 8, 0) ****************************** 
Found 1 results 
Downloading from Kobo Books took 13.868917226791382 


--- 
Title               : Enlightenment Now
Author(s)           : Steven Pinker
Publisher           : Penguin Books Ltd
Tags                : Nonfiction, Religion & Spirituality, Philosophy, Humanism, Political
Rating              : 2.2
Published           : 2018-02-12T16:00:00+00:00
Identifiers         : kobo:enlightenment-now-4, isbn:9780141979106
Comments            : b'
\'My new favourite book of all time\' Bill Gates
\n**TOP TEN SUNDAY TIMES BESTSELLER
\n
Is modernity really failing? Or have we failed to appreciate progress and the ideals that** make it possible?
\n
If you follow the headlines, the world in the 21st century appears to be sinking into chaos, hatred, and irrationality. Yet Steven Pinker shows that this is an illusion - a symptom of historical amnesia and statistical fallacies. If you follow the trendlines rather than the headlines, you discover that our lives have become longer, healthier, safer, happier, more peaceful, more stimulating and more prosperous - not just in the West, but worldwide. Such progress is no accident: it\'s the gift of a coherent and inspiring value system that many of us embrace without even realizing it. These are the values of the Enlightenment: of reason, science, humanism and progress.
\n
The challenges we face today are formidable, including inequality, climate change, Artificial Intelligence and nuclear weapons. But the way to deal with them is not to sink into despair or try to lurch back to a mythical idyllic past; it\'s to treat them as problems we can solve, as we have solved other problems in the past. In making the case for an Enlightenment newly recharged for the 21st century, Pinker shows how we can use our faculties of reason and sympathy to solve the problems that inevitably come with being products of evolution in an indifferent universe. We will never have a perfect world, but - defying the chorus of fatalism and reaction - we can continue to make it a better one.
\n
 \r\n    ' 
identify - title: "Enlightenment Now" authors= "['Steven Pinker']"
create_query - title: "Enlightenment Now"
create_query - after decode title: "Enlightenment Now"
create_query - title_tokens: "['Enlightenment', 'Now']"
Querying: https://www.kobo.com/search?Query=Enlightenment+Now+Steven+Pinker&fcmedia=Book&fclanguages=all
failed using three divs
Have close enough match - title='Enlightenment Now', id='enlightenment-now-4'
failed using three divs
Have close enough match - title='Enlightenment Now - Summarized for Busy People: The Case for Reason, Science, Humanism, and Progress: Based on the Book by Steven Pinker', id='enlightenment-now-summarized-for-busy-people-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
failed using three divs
Have close enough match - title='Extended Summary Of Enlightenment Now: The Case for Reason, Science, Humanism and Progress - By Steven Pinker', id='extended-summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker'
failed using three divs
Have close enough match - title='Summary of Enlightenment Now: The Case for Reason, Science, Humanism, and Progress by Steven Pinker (Discussion Prompts)', id='summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker-discussion-prompts'
failed using three divs
Have close enough match - title='Extended Summary | Enlightenment Now: The Case For Reason, Science, Humanism And Progress - Based On The Book By Steven Pinker', id='extended-summary-enlightenment-now-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
KoboBooks url: 'https://www.kobo.com/ebook/enlightenment-now-4'
KoboBooks url: 'https://www.kobo.com/ebook/enlightenment-now-summarized-for-busy-people-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
KoboBooks url: 'https://www.kobo.com/ebook/extended-summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker'
KoboBooks url: 'https://www.kobo.com/ebook/summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker-discussion-prompts'
KoboBooks url: 'https://www.kobo.com/ebook/extended-summary-enlightenment-now-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
parse_authors - author: "Sapiens Editorial,Sapiens Editorial"
parse_authors - authors: "['Sapiens Editorial', 'Sapiens Editorial']"
Rejecting authors as not a close match:  Sapiens Editorial,Sapiens Editorial
Could not find title/authors/KoboBooks id for 'https://www.kobo.com/ebook/extended-summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker'
Kobo Books: 'extended-summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker' Title: 'Extended Summary Of Enlightenment Now: The Case for Reason, Science, Humanism and Progress - By Steven Pinker' Authors: None
parse_authors - author: "Steven Pinker"
parse_authors - authors: "['Steven Pinker']"
Script page_metadata= {'@context': 'http://schema.org', '@type': 'Product', 'name': 'Enlightenment Now', 'description': 'Read "Enlightenment Now The Case for Reason, Science, Humanism, and Progress" by Steven Pinker available from Rakuten Kobo. \'My new favourite book of all time\' Bill Gates\n**TOP TEN SUNDAY TIMES BESTSELLER\nIs modernity really failing? Or have we...', 'image': 'https://kbimages1-a.akamaihd.net/90d573bc-bf50-45a4-b2ab-bde54f94b03a/180/1000/False/enlightenment-now-4.jpg', 'releasedate': '2018-02-13T05:00:00', 'sku': '9780141979106', 'gtin13': '9780141979106', 'offers': {'@type': 'Offer', 'price': 31.89, 'priceCurrency': 'NZD', 'availability': 'http://schema.org/InStock', 'url': 'https://www.kobo.com/nz/en/ebook/enlightenment-now-4'}, 'aggregateRating': {'@type': 'AggregateRating', 'bestRating': '4', 'ratingValue': '4.33', 'reviewCount': '2', 'ratingCount': '54'}, 'review': {'@type': 'Review', 'reviewRating': {'@type': 'Rating', 'ratingValue': '5.0'}, 'name': 'Enlightenment Now exudes the positive.', 'author': {'@type': 'Person', 'name': 'Jon S.'}, 'datePublished': 'August 4, 2019', 'reviewBody': 'I found this book the perfect antidote to the contemporary journalistic attitude of reporting bad news stories only. In a nutshell Enlightenment Now gives the incredibly well researched evidence that most of the world's societies are improving at every level. After reading this book you will come away with a new found faith in the positiveness of human society.'}, 'brand': 'Penguin Books Ltd'}
pubdate from JSON: 2018-02-13 05:00:00
parse_series - no series info
parse_rating - rating: "4.33"
parse_authors - author: "Sarah Fields"
parse_authors - authors: "['Sarah Fields']"
Rejecting authors as not a close match:  Sarah Fields
Could not find title/authors/KoboBooks id for 'https://www.kobo.com/ebook/summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker-discussion-prompts'
Kobo Books: 'summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker-discussion-prompts' Title: 'Summary of Enlightenment Now: The Case for Reason, Science, Humanism, and Progress by Steven Pinker (Discussion Prompts)' Authors: None
parse_authors - author: "Mentors Library"
parse_authors - authors: "['Mentors Library']"
Rejecting authors as not a close match:  Mentors Library
Could not find title/authors/KoboBooks id for 'https://www.kobo.com/ebook/extended-summary-enlightenment-now-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
Kobo Books: 'extended-summary-enlightenment-now-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker' Title: 'Extended Summary | Enlightenment Now: The Case For Reason, Science, Humanism And Progress - Based On The Book By Steven Pinker' Authors: None
parse_authors - author: "Goldmine Reads"
parse_authors - authors: "['Goldmine Reads']"
Rejecting authors as not a close match:  Goldmine Reads
Could not find title/authors/KoboBooks id for 'https://www.kobo.com/ebook/enlightenment-now-summarized-for-busy-people-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
Kobo Books: 'enlightenment-now-summarized-for-busy-people-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker' Title: 'Enlightenment Now - Summarized for Busy People: The Case for Reason, Science, Humanism, and Progress: Based on the Book by Steven Pinker' Authors: None 

******************************************************************************** 

****************************** Amazon.com (1, 2, 14) ****************************** 
Found 0 results 
Downloading from Amazon.com took 5.4232447147369385 
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=Enlightenment+Now+Steven+Pinker+site%3Awww.amazon.com
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Failed to find any results on results page, with title: Enlightenment Now Steven Pinker site:www.amazon.com - Google Search
No search engine results for terms: Enlightenment Now Steven Pinker
Trying the bing search engine instead
Making bing query: https://www.bing.com/search?q=Enlightenment+Now+Steven+Pinker+site%3Awww.amazon.com
Failed to find any results on results page, with title: Enlightenment Now Steven Pinker site:www.amazon.com - Bing
No search engine results for terms: Enlightenment Now Steven Pinker
No matches found with query: ['Enlightenment', 'Now', 'Steven', 'Pinker'] 

******************************************************************************** 
The identify phase took 13.92 seconds 
The longest time (13.868917) was taken by: Kobo Books 
Merging results from different sources 
We have 1 merged results, merging took: 0.00 seconds

Interestingly, it's still showing a different ISBN to your results. I tried manually adding the one you got, but it replaced it with the same ISBN again:

Spoiler:

Code:

Running identify query with parameters: 
{'title': 'Enlightenment Now', 'authors': ['Steven Pinker'], 'identifiers': {'isbn': '9780698177888'}, 'timeout': 30} 
Using plugins: Kobo Books (1, 8, 0), Amazon.com (1, 2, 14) 
The log from individual plugins is below 

****************************** Kobo Books (1, 8, 0) ****************************** 
Found 1 results 
Downloading from Kobo Books took 26.95359516143799 


--- 
Title               : Enlightenment Now
Author(s)           : Steven Pinker
Publisher           : Penguin Books Ltd
Tags                : Nonfiction, Religion & Spirituality, Philosophy, Humanism, Political
Rating              : 2.2
Published           : 2018-02-12T16:00:00+00:00
Identifiers         : kobo:enlightenment-now-4, isbn:9780141979106
Comments            : b'<div class="synopsis-description" translate="no"><p><strong>\'My new favourite book of all time\' Bill Gates</strong><br>\n**TOP TEN <em>SUNDAY TIMES</em> BESTSELLER</p>\n<p>Is modernity really failing? Or have we failed to appreciate progress and the ideals that** <strong>make it possible?</strong></p>\n<p>If you follow the headlines, the world in the 21st century appears to be sinking into chaos, hatred, and irrationality. Yet Steven Pinker shows that this is an illusion - a symptom of historical amnesia and statistical fallacies. If you follow the trendlines rather than the headlines, you discover that our lives have become longer, healthier, safer, happier, more peaceful, more stimulating and more prosperous - not just in the West, but worldwide. Such progress is no accident: it\'s the gift of a coherent and inspiring value system that many of us embrace without even realizing it. These are the values of the Enlightenment: of reason, science, humanism and progress.</p>\n<p>The challenges we face today are formidable, including inequality, climate change, Artificial Intelligence and nuclear weapons. But the way to deal with them is not to sink into despair or try to lurch back to a mythical idyllic past; it\'s to treat them as problems we can solve, as we have solved other problems in the past. In making the case for an Enlightenment newly recharged for the 21st century, Pinker shows how we can use our faculties of reason and sympathy to solve the problems that inevitably come with being products of evolution in an indifferent universe. We will never have a perfect world, but - defying the chorus of fatalism and reaction - we can continue to make it a better one.</p>\n</div> \r\n    ' 
identify - title: "Enlightenment Now" authors= "['Steven Pinker']"
Querying: https://www.kobo.com/search?Query=9780698177888&fcmedia=Book&fclanguages=all
No matches found with identifiers, retrying using only title and authors. Query: 'https://www.kobo.com/search?Query=9780698177888&fcmedia=Book&fclanguages=all'
identify - title: "Enlightenment Now" authors= "['Steven Pinker']"
create_query - title: "Enlightenment Now"
create_query - after decode title: "Enlightenment Now"
create_query - title_tokens: "['Enlightenment', 'Now']"
Querying: https://www.kobo.com/search?Query=Enlightenment+Now+Steven+Pinker&fcmedia=Book&fclanguages=all
failed using three divs
Have close enough match - title='Enlightenment Now', id='enlightenment-now-4'
failed using three divs
Have close enough match - title='Enlightenment Now - Summarized for Busy People: The Case for Reason, Science, Humanism, and Progress: Based on the Book by Steven Pinker', id='enlightenment-now-summarized-for-busy-people-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
failed using three divs
Have close enough match - title='Extended Summary Of Enlightenment Now: The Case for Reason, Science, Humanism and Progress - By Steven Pinker', id='extended-summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker'
failed using three divs
Have close enough match - title='Summary of Enlightenment Now: The Case for Reason, Science, Humanism, and Progress by Steven Pinker (Discussion Prompts)', id='summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker-discussion-prompts'
failed using three divs
Have close enough match - title='Extended Summary | Enlightenment Now: The Case For Reason, Science, Humanism And Progress - Based On The Book By Steven Pinker', id='extended-summary-enlightenment-now-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
KoboBooks url: 'https://www.kobo.com/ebook/enlightenment-now-4'
KoboBooks url: 'https://www.kobo.com/ebook/enlightenment-now-summarized-for-busy-people-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
KoboBooks url: 'https://www.kobo.com/ebook/extended-summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker'
KoboBooks url: 'https://www.kobo.com/ebook/summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker-discussion-prompts'
KoboBooks url: 'https://www.kobo.com/ebook/extended-summary-enlightenment-now-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
parse_authors - author: "Mentors Library"
parse_authors - authors: "['Mentors Library']"
Rejecting authors as not a close match:  Mentors Library
Could not find title/authors/KoboBooks id for 'https://www.kobo.com/ebook/extended-summary-enlightenment-now-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
Kobo Books: 'extended-summary-enlightenment-now-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker' Title: 'Extended Summary | Enlightenment Now: The Case For Reason, Science, Humanism And Progress - Based On The Book By Steven Pinker' Authors: None
parse_authors - author: "Steven Pinker"
parse_authors - authors: "['Steven Pinker']"
Script page_metadata= {'@context': 'http://schema.org', '@type': 'Product', 'name': 'Enlightenment Now', 'description': 'Read "Enlightenment Now The Case for Reason, Science, Humanism, and Progress" by Steven Pinker available from Rakuten Kobo. \'My new favourite book of all time\' Bill Gates\n**TOP TEN SUNDAY TIMES BESTSELLER\nIs modernity really failing? Or have we...', 'image': 'https://kbimages1-a.akamaihd.net/90d573bc-bf50-45a4-b2ab-bde54f94b03a/180/1000/False/enlightenment-now-4.jpg', 'releasedate': '2018-02-13T05:00:00', 'sku': '9780141979106', 'gtin13': '9780141979106', 'offers': {'@type': 'Offer', 'price': 31.89, 'priceCurrency': 'NZD', 'availability': 'http://schema.org/InStock', 'url': 'https://www.kobo.com/nz/en/ebook/enlightenment-now-4'}, 'aggregateRating': {'@type': 'AggregateRating', 'bestRating': '4', 'ratingValue': '4.33', 'reviewCount': '2', 'ratingCount': '54'}, 'review': {'@type': 'Review', 'reviewRating': {'@type': 'Rating', 'ratingValue': '5.0'}, 'name': 'Enlightenment Now exudes the positive.', 'author': {'@type': 'Person', 'name': 'Jon S.'}, 'datePublished': 'August 4, 2019', 'reviewBody': 'I found this book the perfect antidote to the contemporary journalistic attitude of reporting bad news stories only. In a nutshell Enlightenment Now gives the incredibly well researched evidence that most of the world's societies are improving at every level. After reading this book you will come away with a new found faith in the positiveness of human society.'}, 'brand': 'Penguin Books Ltd'}
pubdate from JSON: 2018-02-13 05:00:00
parse_series - no series info
parse_rating - rating: "4.33"
parse_authors - author: "Goldmine Reads"
parse_authors - authors: "['Goldmine Reads']"
Rejecting authors as not a close match:  Goldmine Reads
Could not find title/authors/KoboBooks id for 'https://www.kobo.com/ebook/enlightenment-now-summarized-for-busy-people-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
Kobo Books: 'enlightenment-now-summarized-for-busy-people-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker' Title: 'Enlightenment Now - Summarized for Busy People: The Case for Reason, Science, Humanism, and Progress: Based on the Book by Steven Pinker' Authors: None
Kobo Books timed out. Try again later.
Kobo Books timed out. Try again later. 

******************************************************************************** 

****************************** Amazon.com (1, 2, 14) ****************************** 
Found 0 results 
Downloading from Amazon.com took 23.877245664596558 
User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=%289780698177888+or+978-0698177888%29+site%3Awww.amazon.com
Failed to find any results on results page, with title: (9780698177888 or 978-0698177888) site:www.amazon.com - Google Search
No search engine results for terms: (9780698177888 OR 978-0698177888)
Trying the bing search engine instead
Making bing query: https://www.bing.com/search?q=%289780698177888+or+978-0698177888%29+site%3Awww.amazon.com
Failed to find any results on results page, with title: (9780698177888 or 978-0698177888) site:www.amazon.com - Bing
No search engine results for terms: (9780698177888 OR 978-0698177888)
No matches found with identifiers, retrying using only title and authors. Query: ['(9780698177888', 'OR', '978-0698177888)']
User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=Enlightenment+Now+Steven+Pinker+site%3Awww.amazon.com
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Failed to find any results on results page, with title: Enlightenment Now Steven Pinker site:www.amazon.com - Google Search
No search engine results for terms: Enlightenment Now Steven Pinker
Trying the bing search engine instead
Making bing query: https://www.bing.com/search?q=Enlightenment+Now+Steven+Pinker+site%3Awww.amazon.com
Failed to find any results on results page, with title: Enlightenment Now Steven Pinker site:www.amazon.com - Bing
No search engine results for terms: Enlightenment Now Steven Pinker
No matches found with query: ['Enlightenment', 'Now', 'Steven', 'Pinker'] 

******************************************************************************** 
The identify phase took 27.03 seconds 
The longest time (26.953595) was taken by: Kobo Books 
Merging results from different sources 
We have 1 merged results, merging took: 0.00 seconds

By the way, I didn't realise a Kobo metadata plugin existed until your comment, thanks a lot!