Thread: [Metadata Source Plugin] Kobo Metadata
View Single Post
Old 09-04-2023, 05:10 PM   #7
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 74,405
Karma: 129358310
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
I've tried both versions and neither version works for me. I get no covers downloaded. I've tried both USA and UK.

Here is the debug log for the latest version with calibre 6.25. It looks like maybe something has changed at Kobo.
Code:
Starting cover download for: Fairy Tale 
Query: Fairy Tale ['Stephen King'] {} 

****************************** Barnes & Noble Covers ****************************** 
Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36')] 
Downloaded cover: 460x700 
Took 3.9463155269622803 seconds 
No cached cover found, running identify
Querying: https://www.barnesandnoble.com/s?store=book&keyword=Fairy+Tale+Stephen+King
Parsing search results
Considering search result: Fairy Tale by Stephen King
Rejecting as not close enough match: Summary of Fairy Tale: by by Alexander Cooper
Rejecting as not close enough match: Cuento de hadas: Una novela / by Stephen King
Considering search result: Fairy Tale by Stephen King
Considering search result: Fairy Tale by Stephen King & Bernhard Kleinschmidt (Translator)
B&N url: https://www.barnesandnoble.com/w/fairy-tale-stephen-king/1140917915?ean=9781668002179
Downloading cover from: http://prodimage.images-bn.com/lf?source=url[file:images/Images/pimages/2179/9781668002179_p0.jpg]&sink 

******************************************************************************** 

****************************** Kindle hi-res covers Covers ****************************** 
Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36')] 
Failed to download valid cover 
Took 5.095068454742432 seconds 
ASIN not present in metadata
Goodreads id not present in metadata
ISBN not present in metadata
Searching Goodreads for book: https://www.goodreads.com/search?q=Fairy+Tale+Stephen+King
Fetching book details: https://www.goodreads.com/book/show/62791805-fairy-tale-hardcover-by-stephen-king-lord-of-the-flies-by-william-gol?from_search=true&from_srp=true&qid=dPq5yawbc6&rank=1
Cover URLs: [] 

******************************************************************************** 

****************************** Kobo Books Covers ****************************** 
Request extra headers: [('User-agent', 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_6) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/14.0.3 Safari/605.1.15')] 
Failed to download valid cover 
Took 3.965352773666382 seconds 
No cached cover found, running identify
identify - title: "Fairy Tale" authors= "['Stephen King']"
create_query - title: "Fairy Tale"
create_query - after decode title: "Fairy Tale"
create_query - title_tokens: "['Fairy', 'Tale']"
Querying: https://www.kobo.com/search?Query=Fairy+Tale+Stephen+King&fcmedia=Book&fclanguages=all
failed using three divs
Have close enough match - title='Fairy Tale', id='fairy-tale-22'
failed using three divs
Have close enough match - title='Fairy Tale', id='fairy-tale-17'
failed using three divs
Have close enough match - title='Fairy Tale', id='fairy-tale-19'
failed using three divs
Have close enough match - title='Fairy Tale', id='fairy-tale-20'
failed using three divs
Have close enough match - title='SUMMARY BOOK OF STEPHEN KING; FAIRY TALE', id='summary-book-of-stephen-king-fairy-tale'
KoboBooks url: 'https://www.kobo.com/ebook/fairy-tale-22'
KoboBooks url: 'https://www.kobo.com/ebook/fairy-tale-17'
KoboBooks url: 'https://www.kobo.com/ebook/fairy-tale-19'
KoboBooks url: 'https://www.kobo.com/ebook/fairy-tale-20'
KoboBooks url: 'https://www.kobo.com/ebook/summary-book-of-stephen-king-fairy-tale'
parse_details - kobobooks_id: "fairy-tale-20" 
parse_details - title: "Fairy Tale" 
parse_authors - author: "Stephen King"
parse_authors - authors: "['Stephen King']"
parse_details - authors: "['Stephen King']" 
No scripts founds for book details metadata????
parse_series - series_name=None, series_index=None
Error parsing cover for url: 'https://www.kobo.com/ebook/fairy-tale-20'
Traceback (most recent call last):
  File "calibre_plugins.kobobooks.worker", line 165, in parse_details
  File "calibre_plugins.kobobooks.worker", line 300, in parse_cover
ValueError: invalid literal for int() with base 10: '74f19e86-431d-42a9-874e-3e93c9daa67e'

parse_details - kobobooks_id: "fairy-tale-22" 
parse_details - title: "Fairy Tale" 
parse_authors - author: "Stephen King"
parse_authors - authors: "['Stephen King']"
parse_details - authors: "['Stephen King']" 
No scripts founds for book details metadata????
parse_series - series_name=None, series_index=None
Error parsing cover for url: 'https://www.kobo.com/ebook/fairy-tale-22'
Traceback (most recent call last):
  File "calibre_plugins.kobobooks.worker", line 165, in parse_details
  File "calibre_plugins.kobobooks.worker", line 300, in parse_cover
ValueError: invalid literal for int() with base 10: 'b8c98ca3-e8f4-412d-97c9-2162363af9b9'

parse_details - kobobooks_id: "summary-book-of-stephen-king-fairy-tale" 
parse_details - title: "SUMMARY BOOK OF STEPHEN KING; FAIRY TALE" 
parse_authors - author: "Mike Vincent"
parse_authors - authors: "['Mike Vincent']"
Rejecting authors as not a close match:  Mike Vincent
parse_details - authors: "None" 
Could not find title/authors/KoboBooks id for 'https://www.kobo.com/ebook/summary-book-of-stephen-king-fairy-tale'
Kobo Books: 'summary-book-of-stephen-king-fairy-tale' Title: 'SUMMARY BOOK OF STEPHEN KING; FAIRY TALE' Authors: None
parse_details - kobobooks_id: "fairy-tale-17" 
parse_details - title: "Fairy Tale" 
parse_authors - author: "Stephen King"
parse_authors - authors: "['Stephen King']"
parse_details - authors: "['Stephen King']" 
No scripts founds for book details metadata????
parse_series - series_name=None, series_index=None
Error parsing cover for url: 'https://www.kobo.com/ebook/fairy-tale-17'
Traceback (most recent call last):
  File "calibre_plugins.kobobooks.worker", line 165, in parse_details
  File "calibre_plugins.kobobooks.worker", line 300, in parse_cover
ValueError: invalid literal for int() with base 10: '00fc74ca-66d2-4741-b3fa-6847508ab303'

parse_details - kobobooks_id: "fairy-tale-19" 
parse_details - title: "Fairy Tale" 
parse_authors - author: "Stephen King"
parse_authors - authors: "['Stephen King']"
parse_details - authors: "['Stephen King']" 
No scripts founds for book details metadata????
parse_series - series_name=None, series_index=None
Error parsing cover for url: 'https://www.kobo.com/ebook/fairy-tale-19'
Traceback (most recent call last):
  File "calibre_plugins.kobobooks.worker", line 165, in parse_details
  File "calibre_plugins.kobobooks.worker", line 300, in parse_cover
ValueError: invalid literal for int() with base 10: 'c0a0f150-c619-48b5-9eba-e10657244676'

No cover found 

******************************************************************************** 

****************************** Kobo Metadata Covers ****************************** 
Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36')] 
Failed to download valid cover 
Took 2.055835485458374 seconds 
KoboMetadata::download_cover: No cached url found, running identify
KoboMetadata::identify: title: Fairy Tale, authors: ['Stephen King'], identifiers: {}
KoboMetadata::identify: Searching with query: Fairy Tale Stephen King
KoboMetadata::identify: Searching for book with url: https://www.kobo.com/us/en/search?query=Fairy+Tale+Stephen+King
KoboMetadata::identify: Looking up metadata with url: https://www.kobo.com/us/en/ebook/fairy-tale-16
KoboMetadata::_lookup_metadata: Got title: Fairy Tale
KoboMetadata::_lookup_metadata: Got authors: ['Stephen King']
KoboMetadata::_lookup_metadata: Got publisher: Scribner
KoboMetadata::_lookup_metadata: Got pubdate: 2022-09-06 00:00:00+00:00
KoboMetadata::_lookup_metadata: Got isbn: 9781668002186
KoboMetadata::_lookup_metadata: Got language: English
KoboMetadata::_lookup_metadata: Got tags: {'Thrillers', 'Science Fiction & Fantasy', 'Mystery & Suspense', 'Fantasy'}
KoboMetadata::_lookup_metadata: Got comments: b'
A #1 New York Times Bestseller and New York Times Book Review Editors’ Choice!
\n
Legendary storyteller Stephen King goes into the deepest well of his imagination in this spellbinding novel about a seventeen-year-old boy who inherits the keys to a parallel world where good and evil are at war, and the stakes could not be higher—for that world or ours.
\n
Charlie Reade looks like a regular high school kid, great at baseball and football, a decent student. But he carries a heavy load. His mom was killed in a hit-and-run accident when he was ten, and grief drove his dad to drink. Charlie learned how to take care of himself—and his dad. When Charlie is seventeen, he meets a dog named Radar and her aging master, Howard Bowditch, a recluse in a big house at the top of a big hill, with a locked shed in the backyard. Sometimes strange sounds emerge from it.
\n
Charlie starts doing jobs for Mr. Bowditch and loses his heart to Radar. Then, when Bowditch dies, he leaves Charlie a cassette tape telling a story no one would believe. What Bowditch knows, and has kept secret all his long life, is that inside the shed is a portal to another world.
\n
Magnificent, terrifying, and “spellbinding…packed with glorious flights of imagination and characteristic tenderness about childhood, Fairy Tale is vintage King at his finest” (Esquire).
\n
“Good, evil, a kingdom to save, monsters to slay—these are the stuff that page-turners are made from.” —Laura Miller, Slate
\n
 \r\n    '
KoboMetadata::_lookup_metadata: Got cover: https://cdn.kobo.com/book-images/0b63e53e-de3c-4069-b02e-e73ce05272df/2000/4000/90/False/fairy-tale-16.jpg
KoboMetadata::_check_title_blacklist: blacklisted title words: {''}
KoboMetadata::_check_tag_blacklist: blacklisted tags: blacklisted_tags
Failed to download cover from Kobo Metadata
Traceback (most recent call last):
  File "calibre\ebooks\metadata\sources\covers.py", line 46, in run
  File "calibre_plugins.dummy2.__init__", line 220, in download_cover
AttributeError: 'Queue' object has no attribute 'front' 

******************************************************************************** 

****************************** Google Images Covers ****************************** 
Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36')] 
Downloaded cover: 2244x2992 
Took 1.58723783493042 seconds 
Search URL: https://www.google.com/search?as_st=y&tbm=isch&as_q=Fairy+Tale+Stephen+King&as_epq=&as_oq=&as_eq=&cr=&as_sitesearch=&safe=images&tbs=isz:lt,islt:svga,iar:t,ift:jpg
Downloading 5 covers
Downloaded cover from: https://m.media-amazon.com/images/I/612BYerla-L._AC_UF894,1000_QL80_.jpg
Downloaded cover from: https://m.media-amazon.com/images/I/71CNQzIm1AL._AC_UF894,1000_QL80_.jpg
Downloaded cover from: https://d28hgpri8am2if.cloudfront.net/book_images/onix/cvr9781668002193/fairy-tale-9781668002193_hr.jpg
Downloaded cover from: http://bookspaperscissors.co.uk/cdn/shop/files/image_c096ce02-9bb5-4125-9e22-b66a10963503_1024x1024.heic?v=1686145576
Downloaded cover from: https://i.etsystatic.com/28166605/r/il/8d4d14/4521256305/il_fullxfull.4521256305_req6.jpg 

******************************************************************************** 

****************************** Amazon.com Covers ****************************** 
Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.88 Safari/537.36'), ('Accept', 'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8'), ('Upgrade-insecure-requests', '1'), ('Referer', 'https://www.google.com/search?q=Fairy+Tale+Stephen+King+site%3Awww.amazon.com')] 
Downloaded cover: 328x500 
Took 5.274893045425415 seconds 
No cached cover found, running identify
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.88 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=Fairy+Tale+Stephen+King+site%3Awww.amazon.com
Ignoring 'Fairy Tale: King, Stephenamazon.comhttps://www.amazon.com › Fairy-Tale-Stephen-King' as it has no cached page
Ignoring 'Fairy Tale: King, Stephenamazon.comhttps://www.amazon.com › Fairy-Tale-Stephen-King' as it has no cached page
Ignoring 'Fairy Tale: King, Stephenamazon.comhttps://www.amazon.com › Fairy-Tale-Stephen-King' as it has no cached page
Ignoring 'Fairy Tale: King, Stephenamazon.comhttps://www.amazon.com › Fairy-Tale-Stephen-King' as it has no cached page
Ignoring 'Fairy Tale: King, Stephenamazon.comhttps://www.amazon.com › Fairy-Tale-Stephen-King' as it has no cached page
Ignoring 'Fairy Tale: King, Stephenamazon.comhttps://www.amazon.com › Fairy-Tale-Stephen-King' as it has no cached page
Ignoring 'Images for Fairy Tale Stephen King site:www.amazon.com' as it has no cached page
Ignoring 'Images for Fairy Tale Stephen King site:www.amazon.com' as it has no cached page
Ignoring 'Images for Fairy Tale Stephen King site:www.amazon.com' as it has no cached page
Ignoring 'Images for Fairy Tale Stephen King site:www.amazon.com' as it has no cached page
Ignoring 'Images for Fairy Tale Stephen King site:www.amazon.com' as it has no cached page
Ignoring div with no main result link
Ignoring 'novel' as it has no cached page
Ignoring 'novel' as it has no cached page
Ignoring 'novel' as it has no cached page
Skipping non-book result: Result(url='https://www.amazon.com/Fairy-Tale-Stephen-King/product-reviews/1668002175', title='Customer reviews: Fairy Taleamazon.comhttps://www.amazon.com › product-reviews', cached_url='https://webcache.googleusercontent.com/search?q=cache:Rd5nDSF0pUgJ:https://www.amazon.com/Fairy-Tale-Stephen-King/product-reviews/1668002175&cd=10&hl=en&ct=clnk&gl=uk')
Skipping non-book result: Result(url='https://www.amazon.com/Fairy-Tale-Stephen-King/product-reviews/1668002175', title='Customer reviews: Fairy Taleamazon.comhttps://www.amazon.com › product-reviews', cached_url='https://webcache.googleusercontent.com/search?q=cache:Rd5nDSF0pUgJ:https://www.amazon.com/Fairy-Tale-Stephen-King/product-reviews/1668002175&cd=10&hl=en&ct=clnk&gl=uk')
Skipping non-book result: Result(url='https://www.amazon.com/Fairy-Tale-Stephen-King/product-reviews/1668002175', title='Customer reviews: Fairy Taleamazon.comhttps://www.amazon.com › product-reviews', cached_url='https://webcache.googleusercontent.com/search?q=cache:Rd5nDSF0pUgJ:https://www.amazon.com/Fairy-Tale-Stephen-King/product-reviews/1668002175&cd=10&hl=en&ct=clnk&gl=uk')
Skipping non-book result: Result(url='https://www.amazon.com/Fairy-Tale-Stephen-King/product-reviews/1668002175', title='Customer reviews: Fairy Taleamazon.comhttps://www.amazon.com › product-reviews', cached_url='https://webcache.googleusercontent.com/search?q=cache:Rd5nDSF0pUgJ:https://www.amazon.com/Fairy-Tale-Stephen-King/product-reviews/1668002175&cd=10&hl=en&ct=clnk&gl=uk')
Skipping non-book result: Result(url='https://www.amazon.com/Fairy-Tale-Stephen-King/product-reviews/1668002175', title='Customer reviews: Fairy Taleamazon.comhttps://www.amazon.com › product-reviews', cached_url='https://webcache.googleusercontent.com/search?q=cache:Rd5nDSF0pUgJ:https://www.amazon.com/Fairy-Tale-Stephen-King/product-reviews/1668002175&cd=10&hl=en&ct=clnk&gl=uk')
Skipping non-book result: Result(url='https://www.amazon.com/Fairy-Tale-Stephen-King/product-reviews/1668002175', title='Customer reviews: Fairy Taleamazon.comhttps://www.amazon.com › product-reviews', cached_url='https://webcache.googleusercontent.com/search?q=cache:Rd5nDSF0pUgJ:https://www.amazon.com/Fairy-Tale-Stephen-King/product-reviews/1668002175&cd=10&hl=en&ct=clnk&gl=uk')
Downloading details from: https://webcache.googleusercontent.com/search?q=cache:7fovMmVc8g8J:https://www.amazon.com/Fairy-Tale-Stephen-King/dp/B0B1PLS7CB&cd=11&hl=en&ct=clnk&gl=uk
Found image: https://m.media-amazon.com/images/I/91aCox8y3rL._AC_UF350,350_QL50_.jpg
Downloading details from: https://webcache.googleusercontent.com/search?q=cache:HAsTD4WWph8J:https://www.amazon.com/Fairy-Tale-Stephen-King-ebook/dp/B09QXZB6SK&cd=22&hl=en&ct=clnk&gl=uk
Failed to find product description for url: 'https://webcache.googleusercontent.com/search?q=cache:HAsTD4WWph8J:https://www.amazon.com/Fairy-Tale-Stephen-King-ebook/dp/B09QXZB6SK&cd=22&hl=en&ct=clnk&gl=uk'
Downloading details from: https://webcache.googleusercontent.com/search?q=cache:mUh-KtKM5WEJ:https://www.amazon.com/Fairy-Tale/dp/1399705423&cd=23&hl=en&ct=clnk&gl=uk
Could not find title/authors/asin for 'https://webcache.googleusercontent.com/search?q=cache:mUh-KtKM5WEJ:https://www.amazon.com/Fairy-Tale/dp/1399705423&cd=23&hl=en&ct=clnk&gl=uk'
ASIN: '1399705423' Title: 'Fairy Tale' Authors: []
Downloading cover from: https://m.media-amazon.com/images/I/51WTYfWgfSL.jpg 

********************************************************************************
Last edited by JSWolf; 09-04-2023 at 05:33 PM.
JSWolf is offline   Reply With Quote