Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Library Management

Notices

Reply
 
Thread Tools Search this Thread
Old 12-23-2020, 10:43 PM   #1
timnz
Junior Member
timnz began at the beginning.
 
timnz's Avatar
 
Posts: 8
Karma: 10
Join Date: Sep 2020
Device: Kobo Aura
Question Problems downloading metadata from Amazon (5.7.2 & 4.23.0, Win 10 64-bit)

Hey everybody

I hope someone can help me. I've recently been unable to download Amazon metadata on any books at all. It shows no results, even for very popular books. For example, this is the log for a 2018 bestseller:

Spoiler:
Code:
Running identify query with parameters: 
{'title': 'Enlightenment Now', 'authors': ['Steven Pinker'], 'identifiers': {}, 'timeout': 30} 
Using plugins: Google (1, 0, 1), Amazon.com (1, 2, 14) 
The log from individual plugins is below 

****************************** Google (1, 0, 1) ****************************** 
Found 1 results 
Downloading from Google took 11.703894138336182 


--- 
Title               : Enlightenment Now: The Case for Reason, Science, Humanism, and Progress
Author(s)           : Steven Pinker
Publisher           : Penguin UK
Tags                : Philosophy, Movements, Humanism, Political, Social, Science, Philosophy & Social Aspects, History, Modern, 21st Century, Ethics & Moral Philosophy, History & Surveys
Languages           : eng
Published           : 2018-02-13T03:02:49.293091+00:00
Identifiers         : google:xn83DwAAQBAJ, isbn:9780141979106
Comments            : 'My new favourite book of all time' Bill GatesTOP TEN SUNDAY TIMES BESTSELLERIs modernity really failing? Or have we failed to appreciate progress and the ideals that make it possible?If you follow the headlines, the world in the 21st century appears to be sinking into chaos, hatred, and irrationality. Yet Steven Pinker shows that this is an illusion - a symptom of historical amnesia and statistical fallacies. If you follow the trendlines rather than the headlines, you discover that our lives have become longer, healthier, safer, happier, more peaceful, more stimulating and more prosperous - not just in the West, but worldwide. Such progress is no accident: it's the gift of a coherent and inspiring value system that many of us embrace without even realizing it. These are the values of the Enlightenment: of reason, science, humanism and progress.The challenges we face today are formidable, including inequality, climate change, Artificial Intelligence and nuclear weapons. But the way to deal with them is not to sink into despair or try to lurch back to a mythical idyllic past; it's to treat them as problems we can solve, as we have solved other problems in the past. In making the case for an Enlightenment newly recharged for the 21st century, Pinker shows how we can use our faculties of reason and sympathy to solve the problems that inevitably come with being products of evolution in an indifferent universe. We will never have a perfect world, but - defying the chorus of fatalism and reaction - we can continue to make it a better one. 
Making query: https://books.google.com/books/feeds/volumes?q=intitle%3AEnlightenment+intitle%3ANow%2Binauthor%3ASteven+inauthor%3APinker&max-results=20&start-index=1&min-viewability=none 

******************************************************************************** 

****************************** Amazon.com (1, 2, 14) ****************************** 
Found 0 results 
Downloading from Amazon.com took 5.160733699798584 
User-agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.120 Safari/537.36 Vivaldi/2.3.1440.57
Server: auto
Making google query: https://www.google.com/search?q=Enlightenment+Now+Steven+Pinker+site%3Awww.amazon.com
Failed to find any results on results page, with title: Enlightenment Now Steven Pinker site:www.amazon.com - Google Search
No search engine results for terms: Enlightenment Now Steven Pinker
Trying the bing search engine instead
Making bing query: https://www.bing.com/search?q=Enlightenment+Now+Steven+Pinker+site%3Awww.amazon.com
Failed to find any results on results page, with title: Enlightenment Now Steven Pinker site:www.amazon.com - Bing
No search engine results for terms: Enlightenment Now Steven Pinker
No matches found with query: ['Enlightenment', 'Now', 'Steven', 'Pinker'] 

******************************************************************************** 
The identify phase took 11.88 seconds 
The longest time (11.703894) was taken by: Google 
Merging results from different sources 
We have 1 merged results, merging took: 0.00 seconds


I could almost always load metadata from Amazon before. If it didn't work, I'd add the Amazon ID manually in the metadata and that would sort it out. But that doesn't work now either:

Spoiler:
Code:
Running identify query with parameters: 
{'title': 'Enlightenment Now', 'authors': ['Steven Pinker'], 'identifiers': {'amazon': 'B073TJBYTB'}, 'timeout': 30} 
Using plugins: Google (1, 0, 1), Amazon.com (1, 2, 14) 
The log from individual plugins is below 

****************************** Google (1, 0, 1) ****************************** 
Found 1 results 
Downloading from Google took 4.99798846244812 


--- 
Title               : Enlightenment Now: The Case for Reason, Science, Humanism, and Progress
Author(s)           : Steven Pinker
Publisher           : Penguin UK
Tags                : Philosophy, Movements, Humanism, Political, Social, Science, Philosophy & Social Aspects, History, Modern, 21st Century, Ethics & Moral Philosophy, History & Surveys
Languages           : eng
Published           : 2018-02-13T03:05:57.061089+00:00
Identifiers         : google:xn83DwAAQBAJ, isbn:9780141979106
Comments            : 'My new favourite book of all time' Bill GatesTOP TEN SUNDAY TIMES BESTSELLERIs modernity really failing? Or have we failed to appreciate progress and the ideals that make it possible?If you follow the headlines, the world in the 21st century appears to be sinking into chaos, hatred, and irrationality. Yet Steven Pinker shows that this is an illusion - a symptom of historical amnesia and statistical fallacies. If you follow the trendlines rather than the headlines, you discover that our lives have become longer, healthier, safer, happier, more peaceful, more stimulating and more prosperous - not just in the West, but worldwide. Such progress is no accident: it's the gift of a coherent and inspiring value system that many of us embrace without even realizing it. These are the values of the Enlightenment: of reason, science, humanism and progress.The challenges we face today are formidable, including inequality, climate change, Artificial Intelligence and nuclear weapons. But the way to deal with them is not to sink into despair or try to lurch back to a mythical idyllic past; it's to treat them as problems we can solve, as we have solved other problems in the past. In making the case for an Enlightenment newly recharged for the 21st century, Pinker shows how we can use our faculties of reason and sympathy to solve the problems that inevitably come with being products of evolution in an indifferent universe. We will never have a perfect world, but - defying the chorus of fatalism and reaction - we can continue to make it a better one. 
Making query: https://books.google.com/books/feeds/volumes?q=intitle%3AEnlightenment+intitle%3ANow%2Binauthor%3ASteven+inauthor%3APinker&max-results=20&start-index=1&min-viewability=none 

******************************************************************************** 

****************************** Amazon.com (1, 2, 14) ****************************** 
Found 0 results 
Downloading from Amazon.com took 15.930984735488892 
User-agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=B073TJBYTB+site%3Awww.amazon.com
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Failed to find any results on results page, with title: B073TJBYTB site:www.amazon.com - Google Search
No search engine results for terms: B073TJBYTB
Trying the bing search engine instead
Making bing query: https://www.bing.com/search?q=B073TJBYTB+site%3Awww.amazon.com
Failed to find any results on results page, with title: B073TJBYTB site:www.amazon.com - Bing
No search engine results for terms: B073TJBYTB
No matches found with identifiers, retrying using only title and authors. Query: ['B073TJBYTB']
User-agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=Enlightenment+Now+Steven+Pinker+site%3Awww.amazon.com
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Failed to find any results on results page, with title: Enlightenment Now Steven Pinker site:www.amazon.com - Google Search
No search engine results for terms: Enlightenment Now Steven Pinker
Trying the bing search engine instead
Making bing query: https://www.bing.com/search?q=Enlightenment+Now+Steven+Pinker+site%3Awww.amazon.com
Failed to find any results on results page, with title: Enlightenment Now Steven Pinker site:www.amazon.com - Bing
No search engine results for terms: Enlightenment Now Steven Pinker
No matches found with query: ['Enlightenment', 'Now', 'Steven', 'Pinker'] 

******************************************************************************** 
The identify phase took 15.95 seconds 
The longest time (15.930985) was taken by: Amazon.com 
Merging results from different sources 
We have 1 merged results, merging took: 0.00 seconds


I'm using 5.7.2, but it's also happening on my portable 4.23.0 copy (Windows 10, 64-bit).
timnz is offline   Reply With Quote
Old 12-23-2020, 11:03 PM   #2
DNSB
Bibliophagist
DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.
 
DNSB's Avatar
 
Posts: 45,107
Karma: 168808721
Join Date: Jul 2010
Location: Vancouver
Device: Kobo Sage, Libra Colour, Lenovo M8 FHD, Paperwhite 4, Tolino epos
Interesting. I added an empty ebook with the title and author and downloaded the metadata individually. My main metadata sources are Kobo and Amazon. Amazon gave the same results whether the country was configured to Canada or US and the server to get data from to Amazon servers. See attached image. I did notice the ISBN returned by my search was the one from the Kobo search and did not match the one you showed though both seem to match editions of the book.

Spoiler:
Running identify query with parameters:
{'title': 'Enlightenment Now: The Case for Reason, Science, Humanism, and Progress', 'authors': ['Steven Pinker'], 'identifiers': {}, 'timeout': 30}
Using plugins: Kobo Books (1, 8, 0), Amazon.com (1, 2, 14)
The log from individual plugins is below


****************************** Kobo Books (1, 8, 0) ******************************
Found 1 results
Downloading from Kobo Books took 3.5316619873046875


---
Title : Enlightenment Now
Author(s) : Steven Pinker
Publisher : Penguin Publishing Group
Tags : Nonfiction, Science & Nature, Science, Other Sciences, Philosophy & Social Aspects, Health & Well Being, Psychology, Social Psychology, Social & Cultural Studies, Social Science
Rating : 2.2
Published : 2018-02-13T13:00:00+00:00
Identifiers : kobo:enlightenment-now-2, isbn:9780698177888
Comments : b'
**INSTANT NEW YORK TIMES BESTSELLER
\nA NEW YORK TIMES NOTABLE BOOK OF 2018
\nONE OF THE ECONOMIST\'S BOOKS OF THE YEAR
\n
"My new favorite book of all time." --Bill Gates
\n
If you think the world is coming to an end, think again: people are living longer, healthier, freer, and happier lives, and while our problems are formidable, the solutions lie in the Enlightenment ideal of using reason and science.**
\n
Is the world really falling apart? Is the ideal of progress obsolete? In this elegant assessment of the human condition in the third millennium, cognitive scientist and public intellectual Steven Pinker urges us to step back from the gory headlines and prophecies of doom, which play to our psychological biases. Instead, follow the data: In seventy-five jaw-dropping graphs, Pinker shows that life, health, prosperity, safety, peace, knowledge, and happiness are on the rise, not just in the West, but worldwide. This progress is not the result of some cosmic force. It is a gift of the Enlightenment: the conviction that reason and science can enhance human flourishing.
\n
Far from being a naïve hope, the Enlightenment, we now know, has worked. But more than ever, it needs a vigorous defense. The Enlightenment project swims against currents of human nature--tribalism, authoritarianism, demonization, magical thinking--which demagogues are all too willing to exploit. Many commentators, committed to political, religious, or romantic ideologies, fight a rearguard action against it. The result is a corrosive fatalism and a willingness to wreck the precious institutions of liberal democracy and global cooperation.
\n
With intellectual depth and literary flair, Enlightenment Now makes the case for reason, science, and humanism: the ideals we need to confront our problems and continue our progress.
\n
\r\n '
identify - title: "Enlightenment Now: The Case for Reason, Science, Humanism, and Progress" authors= "['Steven Pinker']"
create_query - title: "Enlightenment Now: The Case for Reason, Science, Humanism, and Progress"
create_query - after decode title: "Enlightenment Now: The Case for Reason, Science, Humanism, and Progress"
create_query - title_tokens: "['Enlightenment', 'Now']"
Querying: https://www.kobo.com/search?Query=En...clanguages=all
failed using three divs
Have close enough match - title='Enlightenment Now', id='enlightenment-now-2'
failed using three divs
Have close enough match - title='Extended Summary Of Enlightenment Now: The Case for Reason, Science, Humanism and Progress - By Steven Pinker', id='extended-summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker'
failed using three divs
Have close enough match - title='Summary of Enlightenment Now: The Case for Reason, Science, Humanism, and Progress by Steven Pinker (Discussion Prompts)', id='summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker-discussion-prompts'
failed using three divs
Have close enough match - title='Enlightenment Now - Summarized for Busy People: The Case for Reason, Science, Humanism, and Progress: Based on the Book by Steven Pinker', id='enlightenment-now-summarized-for-busy-people-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
failed using three divs
Have close enough match - title='Extended Summary | Enlightenment Now: The Case For Reason, Science, Humanism And Progress - Based On The Book By Steven Pinker', id='extended-summary-enlightenment-now-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
KoboBooks url: 'https://www.kobo.com/ebook/enlightenment-now-2'
KoboBooks url: 'https://www.kobo.com/ebook/extended-summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker'
KoboBooks url: 'https://www.kobo.com/ebook/summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker-discussion-prompts'
KoboBooks url: 'https://www.kobo.com/ebook/enlightenment-now-summarized-for-busy-people-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
KoboBooks url: 'https://www.kobo.com/ebook/extended-summary-enlightenment-now-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
parse_authors - author: "Steven Pinker"
parse_authors - authors: "['Steven Pinker']"
Script page_metadata= {'@context': 'http://schema.org', '@type': 'Product', 'name': 'Enlightenment Now', 'description': 'Read "Enlightenment Now The Case for Reason, Science, Humanism, and Progress" by Steven Pinker available from Rakuten Kobo. **INSTANT NEW YORK TIMES BESTSELLER\nA NEW YORK TIMES NOTABLE BOOK OF 2018\nONE OF THE ECONOMIST\'S BOOKS OF THE YEAR\n"My n...', 'image': 'https://kbimages1-a.akamaihd.net/a733202e-a7f7-4d1a-b830-620ab94640da/180/1000/False/enlightenment-now-2.jpg', 'releasedate': '2018-02-13T05:00:00', 'sku': '9780698177888', 'gtin13': '9780698177888', 'offers': {'@type': 'Offer', 'price': 13.99, 'priceCurrency': 'CAD', 'availability': 'http://schema.org/InStock', 'url': 'https://www.kobo.com/ca/en/ebook/enlightenment-now-2'}, 'aggregateRating': {'@type': 'AggregateRating', 'bestRating': '4', 'ratingValue': '4.50', 'reviewCount': '7', 'ratingCount': '54'}, 'review': {'@type': 'Review', 'reviewRating': {'@type': 'Rating', 'ratingValue': '5.0'}, 'name': 'Great and informative', 'author': {'@type': 'Person', 'name': 'Robert Matthews'}, 'datePublished': '18 August, 2018', 'reviewBody': 'This book should be required reading for every politician and journalist. What a fantastic book for establishing in a succinct way the amazing human progress over the last 200 years as opposed to the dramatic negative image portrayed by media and politicians'}, 'brand': 'Penguin Publishing Group'}
pubdate from JSON: 2018-02-13 05:00:00
parse_series - no series info
parse_rating - rating: "4.5"
parse_authors - author: "Sapiens Editorial,Sapiens Editorial"
parse_authors - authors: "['Sapiens Editorial', 'Sapiens Editorial']"
Rejecting authors as not a close match: Sapiens Editorial,Sapiens Editorial
Could not find title/authors/KoboBooks id for 'https://www.kobo.com/ebook/extended-summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker'
Kobo Books: 'extended-summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker' Title: 'Extended Summary Of Enlightenment Now: The Case for Reason, Science, Humanism and Progress - By Steven Pinker' Authors: None
parse_authors - author: "Mentors Library"
parse_authors - authors: "['Mentors Library']"
Rejecting authors as not a close match: Mentors Library
Could not find title/authors/KoboBooks id for 'https://www.kobo.com/ebook/extended-summary-enlightenment-now-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
Kobo Books: 'extended-summary-enlightenment-now-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker' Title: 'Extended Summary | Enlightenment Now: The Case For Reason, Science, Humanism And Progress - Based On The Book By Steven Pinker' Authors: None
parse_authors - author: "Goldmine Reads"
parse_authors - authors: "['Goldmine Reads']"
Rejecting authors as not a close match: Goldmine Reads
Could not find title/authors/KoboBooks id for 'https://www.kobo.com/ebook/enlightenment-now-summarized-for-busy-people-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
Kobo Books: 'enlightenment-now-summarized-for-busy-people-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker' Title: 'Enlightenment Now - Summarized for Busy People: The Case for Reason, Science, Humanism, and Progress: Based on the Book by Steven Pinker' Authors: None
parse_authors - author: "Sarah Fields"
parse_authors - authors: "['Sarah Fields']"
Rejecting authors as not a close match: Sarah Fields
Could not find title/authors/KoboBooks id for 'https://www.kobo.com/ebook/summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker-discussion-prompts'
Kobo Books: 'summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker-discussion-prompts' Title: 'Summary of Enlightenment Now: The Case for Reason, Science, Humanism, and Progress by Steven Pinker (Discussion Prompts)' Authors: None

************************************************** ******************************

****************************** Amazon.com (1, 2, 14) ******************************
Found 1 results
Downloading from Amazon.com took 4.369584560394287


---
Title : Enlightenment Now: The Case for Reason, Science, Humanism, and Progress
Author(s) : Steven Pinker
Rating : 2.2
Identifiers : amazon:0143111388
Comments :
*INSTANT NEW YORK TIMES BESTSELLER

A NEW YORK TIMES NOTABLE BOOK OF 2018

ONE OF THE ECONOMIST'S* BOOKS OF THE YEAR



"My new favorite book of all time." --Bill Gates
If you think the world is coming to an end, think again: people are living longer, healthier, freer, and happier lives, and while our problems are formidable, the solutions lie in the Enlightenment ideal of using reason and science.**
Is the world really falling apart? Is the ideal of progress obsolete? In this elegant assessment of the human condition in the third millennium, cognitive scientist and public intellectual Steven Pinker urges us to step back from the gory headlines and prophecies of doom, which play to our psychological biases. Instead, follow the data: In seventy-five jaw-dropping graphs, Pinker shows that life, health, prosperity, safety, peace, knowledge, and happiness are on the rise, not just in the West, but worldwide. This progress is not the result of some cosmic force. It is a gift of the Enlightenment: the conviction that reason and science can enhance human flourishing.
Far from being a naïve hope, the Enlightenment, we now know, has worked. But more than ever, it needs a vigorous defense. The Enlightenment project swims against currents of human nature--tribalism, authoritarianism, demonization, magical thinking--which demagogues are all too willing to exploit. Many commentators, committed to political, religious, or romantic ideologies, fight a rearguard action against it. The result is a corrosive fatalism and a willingness to wreck the precious institutions of liberal democracy and global cooperation.
With intellectual depth and literary flair, Enlightenment Now makes the case for reason, science, and humanism: the ideals we need to confront our problems and continue our progress.
**

User-agent: Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.77 Safari/537.36
Server: amazon
Getting details from: https://www.amazon.com/Enlightenment...1&unfiltered=1
Failed to find product description for url: 'https://www.amazon.com/Enlightenment-Now-Science-Humanism-Progress/dp/0143111388/ref=sr_1_1?dchild=1&qid=1608781814&refinements=p_2 8%3A+Humanism%5Cc+Progress%5Cc+Science%5CcEnlighte nment+Now%3A+Case+for+Reason%2Cp_27%3ASteven+Pinke r&s=books&sr=1-1&unfiltered=1'

************************************************** ******************************
The identify phase took 4.54 seconds
The longest time (4.369585) was taken by: Amazon.com
Merging results from different sources
We have 2 merged results, merging took: 0.00 seconds
Attached Thumbnails
Click image for larger version

Name:	metadata.png
Views:	66
Size:	303.1 KB
ID:	184235  

Last edited by DNSB; 12-23-2020 at 11:10 PM. Reason: Added ISBN comment, added log file
DNSB is offline   Reply With Quote
Advert
Old 12-24-2020, 12:12 AM   #3
timnz
Junior Member
timnz began at the beginning.
 
timnz's Avatar
 
Posts: 8
Karma: 10
Join Date: Sep 2020
Device: Kobo Aura
I tried copying what you did, DNSB - empty book with title/author, and set the metadata sources to Kobo and Amazon. Still no Amazon results:

Spoiler:
Code:
Running identify query with parameters: 
{'title': 'Enlightenment Now', 'authors': ['Steven Pinker'], 'identifiers': {}, 'timeout': 30} 
Using plugins: Kobo Books (1, 8, 0), Amazon.com (1, 2, 14) 
The log from individual plugins is below 

****************************** Kobo Books (1, 8, 0) ****************************** 
Found 1 results 
Downloading from Kobo Books took 13.868917226791382 


--- 
Title               : Enlightenment Now
Author(s)           : Steven Pinker
Publisher           : Penguin Books Ltd
Tags                : Nonfiction, Religion & Spirituality, Philosophy, Humanism, Political
Rating              : 2.2
Published           : 2018-02-12T16:00:00+00:00
Identifiers         : kobo:enlightenment-now-4, isbn:9780141979106
Comments            : b'
\'My new favourite book of all time\' Bill Gates
\n**TOP TEN SUNDAY TIMES BESTSELLER
\n
Is modernity really failing? Or have we failed to appreciate progress and the ideals that** make it possible?
\n
If you follow the headlines, the world in the 21st century appears to be sinking into chaos, hatred, and irrationality. Yet Steven Pinker shows that this is an illusion - a symptom of historical amnesia and statistical fallacies. If you follow the trendlines rather than the headlines, you discover that our lives have become longer, healthier, safer, happier, more peaceful, more stimulating and more prosperous - not just in the West, but worldwide. Such progress is no accident: it\'s the gift of a coherent and inspiring value system that many of us embrace without even realizing it. These are the values of the Enlightenment: of reason, science, humanism and progress.
\n
The challenges we face today are formidable, including inequality, climate change, Artificial Intelligence and nuclear weapons. But the way to deal with them is not to sink into despair or try to lurch back to a mythical idyllic past; it\'s to treat them as problems we can solve, as we have solved other problems in the past. In making the case for an Enlightenment newly recharged for the 21st century, Pinker shows how we can use our faculties of reason and sympathy to solve the problems that inevitably come with being products of evolution in an indifferent universe. We will never have a perfect world, but - defying the chorus of fatalism and reaction - we can continue to make it a better one.
\n
 \r\n    ' 
identify - title: "Enlightenment Now" authors= "['Steven Pinker']"
create_query - title: "Enlightenment Now"
create_query - after decode title: "Enlightenment Now"
create_query - title_tokens: "['Enlightenment', 'Now']"
Querying: https://www.kobo.com/search?Query=Enlightenment+Now+Steven+Pinker&fcmedia=Book&fclanguages=all
failed using three divs
Have close enough match - title='Enlightenment Now', id='enlightenment-now-4'
failed using three divs
Have close enough match - title='Enlightenment Now - Summarized for Busy People: The Case for Reason, Science, Humanism, and Progress: Based on the Book by Steven Pinker', id='enlightenment-now-summarized-for-busy-people-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
failed using three divs
Have close enough match - title='Extended Summary Of Enlightenment Now: The Case for Reason, Science, Humanism and Progress - By Steven Pinker', id='extended-summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker'
failed using three divs
Have close enough match - title='Summary of Enlightenment Now: The Case for Reason, Science, Humanism, and Progress by Steven Pinker (Discussion Prompts)', id='summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker-discussion-prompts'
failed using three divs
Have close enough match - title='Extended Summary | Enlightenment Now: The Case For Reason, Science, Humanism And Progress - Based On The Book By Steven Pinker', id='extended-summary-enlightenment-now-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
KoboBooks url: 'https://www.kobo.com/ebook/enlightenment-now-4'
KoboBooks url: 'https://www.kobo.com/ebook/enlightenment-now-summarized-for-busy-people-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
KoboBooks url: 'https://www.kobo.com/ebook/extended-summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker'
KoboBooks url: 'https://www.kobo.com/ebook/summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker-discussion-prompts'
KoboBooks url: 'https://www.kobo.com/ebook/extended-summary-enlightenment-now-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
parse_authors - author: "Sapiens Editorial,Sapiens Editorial"
parse_authors - authors: "['Sapiens Editorial', 'Sapiens Editorial']"
Rejecting authors as not a close match:  Sapiens Editorial,Sapiens Editorial
Could not find title/authors/KoboBooks id for 'https://www.kobo.com/ebook/extended-summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker'
Kobo Books: 'extended-summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker' Title: 'Extended Summary Of Enlightenment Now: The Case for Reason, Science, Humanism and Progress - By Steven Pinker' Authors: None
parse_authors - author: "Steven Pinker"
parse_authors - authors: "['Steven Pinker']"
Script page_metadata= {'@context': 'http://schema.org', '@type': 'Product', 'name': 'Enlightenment Now', 'description': 'Read "Enlightenment Now The Case for Reason, Science, Humanism, and Progress" by Steven Pinker available from Rakuten Kobo. \'My new favourite book of all time\' Bill Gates\n**TOP TEN SUNDAY TIMES BESTSELLER\nIs modernity really failing? Or have we...', 'image': 'https://kbimages1-a.akamaihd.net/90d573bc-bf50-45a4-b2ab-bde54f94b03a/180/1000/False/enlightenment-now-4.jpg', 'releasedate': '2018-02-13T05:00:00', 'sku': '9780141979106', 'gtin13': '9780141979106', 'offers': {'@type': 'Offer', 'price': 31.89, 'priceCurrency': 'NZD', 'availability': 'http://schema.org/InStock', 'url': 'https://www.kobo.com/nz/en/ebook/enlightenment-now-4'}, 'aggregateRating': {'@type': 'AggregateRating', 'bestRating': '4', 'ratingValue': '4.33', 'reviewCount': '2', 'ratingCount': '54'}, 'review': {'@type': 'Review', 'reviewRating': {'@type': 'Rating', 'ratingValue': '5.0'}, 'name': 'Enlightenment Now exudes the positive.', 'author': {'@type': 'Person', 'name': 'Jon S.'}, 'datePublished': 'August 4, 2019', 'reviewBody': 'I found this book the perfect antidote to the contemporary journalistic attitude of reporting bad news stories only. In a nutshell Enlightenment Now gives the incredibly well researched evidence that most of the world's societies are improving at every level. After reading this book you will come away with a new found faith in the positiveness of human society.'}, 'brand': 'Penguin Books Ltd'}
pubdate from JSON: 2018-02-13 05:00:00
parse_series - no series info
parse_rating - rating: "4.33"
parse_authors - author: "Sarah Fields"
parse_authors - authors: "['Sarah Fields']"
Rejecting authors as not a close match:  Sarah Fields
Could not find title/authors/KoboBooks id for 'https://www.kobo.com/ebook/summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker-discussion-prompts'
Kobo Books: 'summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker-discussion-prompts' Title: 'Summary of Enlightenment Now: The Case for Reason, Science, Humanism, and Progress by Steven Pinker (Discussion Prompts)' Authors: None
parse_authors - author: "Mentors Library"
parse_authors - authors: "['Mentors Library']"
Rejecting authors as not a close match:  Mentors Library
Could not find title/authors/KoboBooks id for 'https://www.kobo.com/ebook/extended-summary-enlightenment-now-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
Kobo Books: 'extended-summary-enlightenment-now-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker' Title: 'Extended Summary | Enlightenment Now: The Case For Reason, Science, Humanism And Progress - Based On The Book By Steven Pinker' Authors: None
parse_authors - author: "Goldmine Reads"
parse_authors - authors: "['Goldmine Reads']"
Rejecting authors as not a close match:  Goldmine Reads
Could not find title/authors/KoboBooks id for 'https://www.kobo.com/ebook/enlightenment-now-summarized-for-busy-people-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
Kobo Books: 'enlightenment-now-summarized-for-busy-people-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker' Title: 'Enlightenment Now - Summarized for Busy People: The Case for Reason, Science, Humanism, and Progress: Based on the Book by Steven Pinker' Authors: None 

******************************************************************************** 

****************************** Amazon.com (1, 2, 14) ****************************** 
Found 0 results 
Downloading from Amazon.com took 5.4232447147369385 
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=Enlightenment+Now+Steven+Pinker+site%3Awww.amazon.com
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Failed to find any results on results page, with title: Enlightenment Now Steven Pinker site:www.amazon.com - Google Search
No search engine results for terms: Enlightenment Now Steven Pinker
Trying the bing search engine instead
Making bing query: https://www.bing.com/search?q=Enlightenment+Now+Steven+Pinker+site%3Awww.amazon.com
Failed to find any results on results page, with title: Enlightenment Now Steven Pinker site:www.amazon.com - Bing
No search engine results for terms: Enlightenment Now Steven Pinker
No matches found with query: ['Enlightenment', 'Now', 'Steven', 'Pinker'] 

******************************************************************************** 
The identify phase took 13.92 seconds 
The longest time (13.868917) was taken by: Kobo Books 
Merging results from different sources 
We have 1 merged results, merging took: 0.00 seconds


Interestingly, it's still showing a different ISBN to your results. I tried manually adding the one you got, but it replaced it with the same ISBN again:

Spoiler:
Code:
Running identify query with parameters: 
{'title': 'Enlightenment Now', 'authors': ['Steven Pinker'], 'identifiers': {'isbn': '9780698177888'}, 'timeout': 30} 
Using plugins: Kobo Books (1, 8, 0), Amazon.com (1, 2, 14) 
The log from individual plugins is below 

****************************** Kobo Books (1, 8, 0) ****************************** 
Found 1 results 
Downloading from Kobo Books took 26.95359516143799 


--- 
Title               : Enlightenment Now
Author(s)           : Steven Pinker
Publisher           : Penguin Books Ltd
Tags                : Nonfiction, Religion & Spirituality, Philosophy, Humanism, Political
Rating              : 2.2
Published           : 2018-02-12T16:00:00+00:00
Identifiers         : kobo:enlightenment-now-4, isbn:9780141979106
Comments            : b'<div class="synopsis-description" translate="no"><p><strong>\'My new favourite book of all time\' Bill Gates</strong><br>\n**TOP TEN <em>SUNDAY TIMES</em> BESTSELLER</p>\n<p>Is modernity really failing? Or have we failed to appreciate progress and the ideals that** <strong>make it possible?</strong></p>\n<p>If you follow the headlines, the world in the 21st century appears to be sinking into chaos, hatred, and irrationality. Yet Steven Pinker shows that this is an illusion - a symptom of historical amnesia and statistical fallacies. If you follow the trendlines rather than the headlines, you discover that our lives have become longer, healthier, safer, happier, more peaceful, more stimulating and more prosperous - not just in the West, but worldwide. Such progress is no accident: it\'s the gift of a coherent and inspiring value system that many of us embrace without even realizing it. These are the values of the Enlightenment: of reason, science, humanism and progress.</p>\n<p>The challenges we face today are formidable, including inequality, climate change, Artificial Intelligence and nuclear weapons. But the way to deal with them is not to sink into despair or try to lurch back to a mythical idyllic past; it\'s to treat them as problems we can solve, as we have solved other problems in the past. In making the case for an Enlightenment newly recharged for the 21st century, Pinker shows how we can use our faculties of reason and sympathy to solve the problems that inevitably come with being products of evolution in an indifferent universe. We will never have a perfect world, but - defying the chorus of fatalism and reaction - we can continue to make it a better one.</p>\n</div> \r\n    ' 
identify - title: "Enlightenment Now" authors= "['Steven Pinker']"
Querying: https://www.kobo.com/search?Query=9780698177888&fcmedia=Book&fclanguages=all
No matches found with identifiers, retrying using only title and authors. Query: 'https://www.kobo.com/search?Query=9780698177888&fcmedia=Book&fclanguages=all'
identify - title: "Enlightenment Now" authors= "['Steven Pinker']"
create_query - title: "Enlightenment Now"
create_query - after decode title: "Enlightenment Now"
create_query - title_tokens: "['Enlightenment', 'Now']"
Querying: https://www.kobo.com/search?Query=Enlightenment+Now+Steven+Pinker&fcmedia=Book&fclanguages=all
failed using three divs
Have close enough match - title='Enlightenment Now', id='enlightenment-now-4'
failed using three divs
Have close enough match - title='Enlightenment Now - Summarized for Busy People: The Case for Reason, Science, Humanism, and Progress: Based on the Book by Steven Pinker', id='enlightenment-now-summarized-for-busy-people-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
failed using three divs
Have close enough match - title='Extended Summary Of Enlightenment Now: The Case for Reason, Science, Humanism and Progress - By Steven Pinker', id='extended-summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker'
failed using three divs
Have close enough match - title='Summary of Enlightenment Now: The Case for Reason, Science, Humanism, and Progress by Steven Pinker (Discussion Prompts)', id='summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker-discussion-prompts'
failed using three divs
Have close enough match - title='Extended Summary | Enlightenment Now: The Case For Reason, Science, Humanism And Progress - Based On The Book By Steven Pinker', id='extended-summary-enlightenment-now-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
KoboBooks url: 'https://www.kobo.com/ebook/enlightenment-now-4'
KoboBooks url: 'https://www.kobo.com/ebook/enlightenment-now-summarized-for-busy-people-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
KoboBooks url: 'https://www.kobo.com/ebook/extended-summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker'
KoboBooks url: 'https://www.kobo.com/ebook/summary-of-enlightenment-now-the-case-for-reason-science-humanism-and-progress-by-steven-pinker-discussion-prompts'
KoboBooks url: 'https://www.kobo.com/ebook/extended-summary-enlightenment-now-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
parse_authors - author: "Mentors Library"
parse_authors - authors: "['Mentors Library']"
Rejecting authors as not a close match:  Mentors Library
Could not find title/authors/KoboBooks id for 'https://www.kobo.com/ebook/extended-summary-enlightenment-now-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
Kobo Books: 'extended-summary-enlightenment-now-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker' Title: 'Extended Summary | Enlightenment Now: The Case For Reason, Science, Humanism And Progress - Based On The Book By Steven Pinker' Authors: None
parse_authors - author: "Steven Pinker"
parse_authors - authors: "['Steven Pinker']"
Script page_metadata= {'@context': 'http://schema.org', '@type': 'Product', 'name': 'Enlightenment Now', 'description': 'Read "Enlightenment Now The Case for Reason, Science, Humanism, and Progress" by Steven Pinker available from Rakuten Kobo. \'My new favourite book of all time\' Bill Gates\n**TOP TEN SUNDAY TIMES BESTSELLER\nIs modernity really failing? Or have we...', 'image': 'https://kbimages1-a.akamaihd.net/90d573bc-bf50-45a4-b2ab-bde54f94b03a/180/1000/False/enlightenment-now-4.jpg', 'releasedate': '2018-02-13T05:00:00', 'sku': '9780141979106', 'gtin13': '9780141979106', 'offers': {'@type': 'Offer', 'price': 31.89, 'priceCurrency': 'NZD', 'availability': 'http://schema.org/InStock', 'url': 'https://www.kobo.com/nz/en/ebook/enlightenment-now-4'}, 'aggregateRating': {'@type': 'AggregateRating', 'bestRating': '4', 'ratingValue': '4.33', 'reviewCount': '2', 'ratingCount': '54'}, 'review': {'@type': 'Review', 'reviewRating': {'@type': 'Rating', 'ratingValue': '5.0'}, 'name': 'Enlightenment Now exudes the positive.', 'author': {'@type': 'Person', 'name': 'Jon S.'}, 'datePublished': 'August 4, 2019', 'reviewBody': 'I found this book the perfect antidote to the contemporary journalistic attitude of reporting bad news stories only. In a nutshell Enlightenment Now gives the incredibly well researched evidence that most of the world's societies are improving at every level. After reading this book you will come away with a new found faith in the positiveness of human society.'}, 'brand': 'Penguin Books Ltd'}
pubdate from JSON: 2018-02-13 05:00:00
parse_series - no series info
parse_rating - rating: "4.33"
parse_authors - author: "Goldmine Reads"
parse_authors - authors: "['Goldmine Reads']"
Rejecting authors as not a close match:  Goldmine Reads
Could not find title/authors/KoboBooks id for 'https://www.kobo.com/ebook/enlightenment-now-summarized-for-busy-people-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker'
Kobo Books: 'enlightenment-now-summarized-for-busy-people-the-case-for-reason-science-humanism-and-progress-based-on-the-book-by-steven-pinker' Title: 'Enlightenment Now - Summarized for Busy People: The Case for Reason, Science, Humanism, and Progress: Based on the Book by Steven Pinker' Authors: None
Kobo Books timed out. Try again later.
Kobo Books timed out. Try again later. 

******************************************************************************** 

****************************** Amazon.com (1, 2, 14) ****************************** 
Found 0 results 
Downloading from Amazon.com took 23.877245664596558 
User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=%289780698177888+or+978-0698177888%29+site%3Awww.amazon.com
Failed to find any results on results page, with title: (9780698177888 or 978-0698177888) site:www.amazon.com - Google Search
No search engine results for terms: (9780698177888 OR 978-0698177888)
Trying the bing search engine instead
Making bing query: https://www.bing.com/search?q=%289780698177888+or+978-0698177888%29+site%3Awww.amazon.com
Failed to find any results on results page, with title: (9780698177888 or 978-0698177888) site:www.amazon.com - Bing
No search engine results for terms: (9780698177888 OR 978-0698177888)
No matches found with identifiers, retrying using only title and authors. Query: ['(9780698177888', 'OR', '978-0698177888)']
User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=Enlightenment+Now+Steven+Pinker+site%3Awww.amazon.com
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Ignoring div with no descendant
Failed to find any results on results page, with title: Enlightenment Now Steven Pinker site:www.amazon.com - Google Search
No search engine results for terms: Enlightenment Now Steven Pinker
Trying the bing search engine instead
Making bing query: https://www.bing.com/search?q=Enlightenment+Now+Steven+Pinker+site%3Awww.amazon.com
Failed to find any results on results page, with title: Enlightenment Now Steven Pinker site:www.amazon.com - Bing
No search engine results for terms: Enlightenment Now Steven Pinker
No matches found with query: ['Enlightenment', 'Now', 'Steven', 'Pinker'] 

******************************************************************************** 
The identify phase took 27.03 seconds 
The longest time (26.953595) was taken by: Kobo Books 
Merging results from different sources 
We have 1 merged results, merging took: 0.00 seconds


By the way, I didn't realise a Kobo metadata plugin existed until your comment, thanks a lot!
timnz is offline   Reply With Quote
Old 12-24-2020, 11:50 AM   #4
DNSB
Bibliophagist
DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.
 
DNSB's Avatar
 
Posts: 45,107
Karma: 168808721
Join Date: Jul 2010
Location: Vancouver
Device: Kobo Sage, Libra Colour, Lenovo M8 FHD, Paperwhite 4, Tolino epos
One thing I did notice is that you seem to be using the Choose server automatically option for the Amazon servers. What happens if you change that to Amazon servers?

Edit: Kovid Goyal posted in another thread:

Quote:
Originally Posted by kovidgoyal View Post
Ah there was indeed a change to the google search results page, that affects amazon metadata download if the amazon server is set to auto or google. Now fixed.
Attached Thumbnails
Click image for larger version

Name:	meatadata_amazon_servers.png
Views:	80
Size:	30.6 KB
ID:	184245  

Last edited by DNSB; 12-24-2020 at 12:02 PM. Reason: Added comment on fix from KG
DNSB is offline   Reply With Quote
Reply


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
major problems with downloading metadata piosza Library Management 7 09-08-2019 05:47 PM
Problems downloading metadata for books dbillmanql Devices 4 09-18-2014 12:34 PM
Metadata not downloading from Amazon? bauerhjb Library Management 3 09-23-2013 11:15 PM
Problems downloading metadata from Goodreads? Japes Plugins 2 10-19-2012 02:15 PM
Calibre, Win 64 bit, News not auto downloading LibertyToad Devices 3 12-09-2011 11:03 PM


All times are GMT -4. The time now is 01:29 AM.


MobileRead.com is a privately owned, operated and funded community.