fail to import isbns to Calibre and get the metadata - Page 2

Celialiu · 01-10-2020, 08:33 PM

Quote:

Originally Posted by davidfor

In the last screen shot, one of those buttons is to display the details of the attempt to download the metadata. Clicking it will show the log of what was done. And any errors. One of the other buttons is to copy the log into the clipboard. Then you can post that for us.

But, trying just the first on in the list, I was able to get a match. The matches came from Google and Goodreads. Google is one of the built-in plugins. Goodreads is one you need to install.

Which gets us to @thiago.eec's post. You need to install or configure the metadata source plugins to do the searches. And look at the results in the log to see more about what happened.

and I want to know if i managed to import my books by isbns, can i get the mass downloads of the cover images, weights, price, and the reading age range of every book in my library? The 4 kinds of statistics are important for me, and i have tried in goodreads and librarything and libib, but they all cant offer mass downloads of cover images and dont have information about price and age range. If cant, then i would not waste my time on Calibre.

davidfor · 01-10-2020, 09:57 PM

Quote:

Originally Posted by Celialiu

and I want to know if i managed to import my books by isbns, can i get the mass downloads of the cover images, weights, price, and the reading age range of every book in my library? The 4 kinds of statistics are important for me, and i have tried in goodreads and librarything and libib, but they all cant offer mass downloads of cover images and dont have information about price and age range. If cant, then i would not waste my time on Calibre.

Firstly, nearly all of the metadata source plugins will do bulk downloads of metadata and covers. Several of us have demonstrated we can get the metadata for some of the ISBNs in your list. If you cannot, it means something is wrong on your end. Most likely, it is a configuration issue, or that you haven't installed the appropriate metadata source plugin. This is why I have asked twice to see the logs from fetch. We can at least see what sources are being used and if there are errors. Though, maybe you have sorted this out.

But, if price, reading age and "weight" (I don't know what you mean by this) are important, than you are probably wasting your time. None of the metadata source plugins will get these. And in fact, very few of them have them on the site the the metadata is fetched from. The source site would need to be a shop to have the price and I'm not sure if I have seen anywhere that has reading age. There is also a technical issue. The metadata source plugins can only updates the core metadata. Price and reading age are not part of this. Which means that even if they are available on the site, it isn't easy to fetch them into the library. You can store these in calibre using a custom column, but, you will have to populate them by some other means.

BetterRed · 01-10-2020, 10:01 PM

Quote:

Originally Posted by theducks

It worked back in 2010

when I added entries for my entire paper library.
Since then, I have had little reason to try it

as all my ebooks come with basic metadata.

But I can't believe more people have not run into this issue.

IIRC it worked for me too, would have been version 0.8.?

BR

BetterRed · 01-10-2020, 10:24 PM

Quote:

Originally Posted by davidfor

Firstly, nearly all of the metadata source plugins will do bulk downloads of metadata and covers. Several of us have demonstrated we can get the metadata for some of the ISBNs in your list. If you cannot, it means something is wrong on your end. Most likely, it is a configuration issue, or that you haven't installed the appropriate metadata source plugin. This is why I have asked twice to see the logs from fetch. We can at least see what sources are being used and if there are errors. Though, maybe you have sorted this out.

But, if price, reading age and "weight" (I don't know what you mean by this) are important, than you are probably wasting your time. None of the metadata source plugins will get these. And in fact, very few of them have them on the site the the metadata is fetched from. The source site would need to be a shop to have the price and I'm not sure if I have seen anywhere that has reading age. There is also a technical issue. The metadata source plugins can only updates the core metadata. Price and reading age are not part of this. Which means that even if they are available on the site, it isn't easy to fetch them into the library. You can store these in calibre using a custom column, but, you will have to populate them by some other means.

@davidfor - on a freshly installed calibre portable with default settings (including MD sources), I can't get a MD download for the following book,

Click image for larger version

Name: Annotation 2020-01-11 141216.jpg
Views: 147
Size: 316.8 KB
ID: 176321

Spoiler:

Amazon has the ISBN, see post 11.

BR

DNSB · 01-10-2020, 11:01 PM

Quote:

Originally Posted by BetterRed

@davidfor - on a freshly installed calibre portable with default settings (including MD sources), I can't get a MD download for the following book,

Attachment 176321

Spoiler:

Amazon has the ISBN, see post 11.

BR

Interesting. When I did add book by ISBN, the metadata download came up with data for A Impossível Faca da Memória. See the attached image.

Edit: Looking closer at the log snippet, one difference is that @BetterRed seems to be using Google to search Amazon while I am using Amazon's servers

davidfor · 01-10-2020, 11:16 PM

Quote:

Originally Posted by BetterRed

@davidfor - on a freshly installed calibre portable with default settings (including MD sources), I can't get a MD download for the following book,

Attachment 176321

Spoiler:

Amazon has the ISBN, see post 11.

BR

And that demonstrates the need to see the log. The Amazon search is actually finding it, but, it doesn't the match isn't meeting one of the conditions of the search (having a cached page). The contents of the log did suggest to me to change which county to use. Changing to Brazil found the book. As did changing to the Amazon servers.

I don't expect a new calibre user to look at the log and think to try this. But, if someone is reporting a problem, then we need some details to be able to work out what is happening.

BetterRed · 01-11-2020, 01:52 AM

@davidfor - when you add a book from an ISBN and it does the Ctrl+D style download and then fails, then there's no View Log option and the error detail is very sparse

calibre, version 4.8.0
ERROR: Download failed: Failed to download metadata or cover for the selected book.
Unknown (Failed metadata) (Failed cover)

One only gets a View Log button if something is found, I had to salvage this from ...\Temp\calibre_yohscz

Spoiler:

According to that it's finding the book at Amazon but it ignores it because there's there is 'no cached page' - I assume that's a cache on the server side.

BR

thiago.eec · 01-11-2020, 03:20 AM

Sorry everyone. I made a mistake that caused a lot of confusion.
On my first post I typed the WRONG ISBN (it was on my clipboard because I was testing another title in portuguese).

This is the list of ISBNs posted by the OP:

9780857531094
9781842368848
9780333984895
9780747550990
9780141357270
9781847389664

Now, adding these books from ISBN (using all metadata sources here), worked fined. Only one was not found (9781842368848).

See the attached images.

theducks · 01-11-2020, 12:27 PM

DNSB
9788 is not an English ISBN (as the MDE view shows: Portuguese )

This may be a Metadata plugin configuration issue. Yours must accept a broader lookup scope.

(English language books are 9780 or 9781 )

DNSB · 01-11-2020, 12:34 PM

Quote:

Originally Posted by theducks

DNSB
9788 is not an English ISBN (as the MDE view shows: Portuguese )

This may be a Metadata plugin configuration issue. Yours must accept a broader lookup scope.

(English language books are 9780 or 9781 )

I've already edited my message but looking closer at BR's log snippet, it appears he is using the Google search cache option for Amazon metadata while I am using the Amazon servers option.

theducks · 01-11-2020, 12:56 PM

Quote:

Originally Posted by DNSB

I've already edited my message but looking closer at BR's log snippet, it appears he is using the Google search cache option for Amazon metadata while I am using the Amazon servers option.

As I do (I just checked as I did not know other than US). Great point. A number of metadata sources have fine tune settings

BetterRed · 01-11-2020, 03:29 PM

FTR: Because most of my 'books' aren't commercial books I enter the metadata manually, including the commercial books. I'm not interested in tags, ratings, blurbs etc - and other fields are often wrong or waste of space variants.

Quote:

Originally Posted by thiago.eec

Sorry everyone. I made a mistake that caused a lot of confusion.
On my first post I typed the WRONG ISBN (it was on my clipboard because I was testing another title in portuguese).

<snip>

Thank goodness for that, I thought I was going nuts for a while. I made a similar mistake yesterday in another thread - read 'title' and thought 'author'

Quote:

Originally Posted by theducks

DNSB
9788 is not an English ISBN (as the MDE view shows: Portuguese )

This may be a Metadata plugin configuration issue. Yours must accept a broader lookup scope.

(English language books are 9780 or 9781 )

I now notice you pointed this out earlier - I missed it first time around.

Quote:

Originally Posted by DNSB

I've already edited my message but looking closer at BR's log snippet, it appears he is using the Google search cache option for Amazon metadata while I am using the Amazon servers option.

I did my tests using default settings on a freshly installed 4.8 Portable, the "Google search cache option" is what comes in the box. So, where is the "Amazon servers option"?

When I did an Advanced Search on the amazon.com and the amazon.co.uk sites using thiago.eec's 9788xxxxxxxxx ISBN they found the Portuguese book. So why does the built-in Amazon MD Source plugin search via Google and Bing rather than direct?

I assume it's because of the 'swamping the server' issue. Poor little AMZN, last time I looked it was only worth just shy of a trillion USD.

BR

thiago.eec · 01-11-2020, 04:09 PM

Quote:

Originally Posted by BetterRed

Thank goodness for that, I thought I was going nuts for a while.

Sorry for that.

DNSB · 01-12-2020, 12:16 AM

Quote:

Originally Posted by BetterRed

I did my tests using default settings on a freshly installed 4.8 Portable, the "Google search cache option" is what comes in the box. So, where is the "Amazon servers option"?

Preferences => Metadata download => select Amazon.com => Configure selected source.

BetterRed · 01-12-2020, 03:15 PM

Quote:

Originally Posted by DNSB

Preferences => Metadata download => select Amazon.com => Configure selected source.

Thanks. FTR: the defaults in Portable are US, Choose server automatically, and Use MOBI-ASIN… is unchecked.

IIRC some of those weren't there when I set my MD Prefs back in 2011/12. I only download languages, pubdate and publisher, and only then if I can't get them from the publication itself or the publisher site.

BR

01-11-2020, 01:52 AM	#22
BetterRed null operator (he/him) Posts: 22,010 Karma: 30277294 Join Date: Mar 2012 Location: Sydney Australia Device: none	@davidfor - when you add a book from an ISBN and it does the Ctrl+D style download and then fails, then there's no View Log option and the error detail is very sparse calibre, version 4.8.0 ERROR: Download failed: Failed to download metadata or cover for the selected book. Unknown (Failed metadata) (Failed cover) One only gets a View Log button if something is found, I had to salvage this from ...\Temp\calibre_yohscz Spoiler: #################### Log for Unknown #################### Running identify query with parameters: {u'identifiers': {u'isbn': u'9788558890243'}, u'timeout': 30, u'title': None, u'authors': None} Using plugins: Google (1, 0, 1), Amazon.com (1, 2, 11) The log from individual plugins is below **************************** Google (1, 0, 1) ************************** Found 0 results Downloading from Google took 0.695000171661 Making query: https://books.google.com/books/feeds...&start-index=1 ********************************************** ************************** ************************** Amazon.com (1, 2, 11) ************************** Found 0 results Downloading from Amazon.com took 1.49599981308 User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36 Server: auto Making google query: https://www.google.com/search?q=%289...www.amazon.com Ignoring u'A Impossivel Faca da Memoria (Em Portugues do Brasil ...https://www.amazon.com \u203a Impossivel-Faca-Memoria-P...' as it has no cached page Failed to find any results on results page, with title: (9788558890243 or 978-8558890243) site:www.amazon.com - Google Search No search engine results for terms: (9788558890243 OR 978-8558890243) Trying the bing search engine instead Making bing query: https://www.bing.com/search?q=%28978...www.amazon.com Failed to find any results on results page, with title: (9788558890243 or 978-8558890243) site:www.amazon.com - Bing No search engine results for terms: (9788558890243 OR 978-8558890243) No matches found with query: [u'(9788558890243', u'OR', u'978-8558890243)'] ********************************************** ************************** The identify phase took 1.61 seconds The longest time (1.496000) was taken by: Amazon.com Merging results from different sources We have 0 merged results, merging took: 0.00 seconds Failed to download metadata for Unknown ************************** Google Covers ************************** Request extra headers: [(u'User-agent', u'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36')] Failed to download valid cover Took 1.44800019264 seconds No cached cover found, running identify Making query: https://books.google.com/books/feeds...&start-index=1 No cover found ********************************************** ************************** ************************** Amazon.com Covers **************************** Request extra headers: [(u'User-agent', u'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36'), (u'Accept', u'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,/;q=0.8'), (u'Upgrade-insecure-requests', u'1'), (u'Referer', u'https://www.bing.com/search?q=%289788558890243+or+978-8558890243%29+site%3Awww.amazon.com')] Failed to download valid cover Took 2.21199989319 seconds No cached cover found, running identify User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36 Server: auto Making google query: https://www.google.com/search?q=%289...www.amazon.com Ignoring u'A Impossivel Faca da Memoria (Em Portugues do Brasil ...https://www.amazon.com \u203a Impossivel-Faca-Memoria-P...' as it has no cached page Failed to find any results on results page, with title: (9788558890243 or 978-8558890243) site:www.amazon.com - Google Search No search engine results for terms: (9788558890243 OR 978-8558890243) Trying the bing search engine instead Making bing query: https://www.bing.com/search?q=%28978...www.amazon.com Failed to find any results on results page, with title: (9788558890243 or 978-8558890243) site:www.amazon.com - Bing No search engine results for terms: (9788558890243 OR 978-8558890243) No matches found with query: [u'(9788558890243', u'OR', u'978-8558890243)'] No cover found ************************************************ ************************** ************************** Open Library Covers ************************** Request extra headers: [(u'User-agent', u'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36')] Failed to download valid cover Took 2.36600017548 seconds No cover for ISBN: u'9788558890243' found ********************************************** **************************** According to that it's finding the book at Amazon but it ignores it because there's there is 'no cached page' - I assume that's a cache on the server side. BR

01-11-2020, 03:20 AM	#23
thiago.eec Wizard Posts: 1,291 Karma: 1428263 Join Date: Dec 2016 Location: Goiânia - Brazil Device: iPad, Kindle Paperwhite, Kindle Oasis	Sorry everyone. I made a mistake that caused a lot of confusion. On my first post I typed the WRONG ISBN (it was on my clipboard because I was testing another title in portuguese). This is the list of ISBNs posted by the OP: 9780857531094 9781842368848 9780333984895 9780747550990 9780141357270 9781847389664 Now, adding these books from ISBN (using all metadata sources here), worked fined. Only one was not found (9781842368848). See the attached images. Attached Thumbnails

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
fail to import isbns to Calibre and get the metadata	Celialiu	Calibre	3	01-10-2020 04:47 AM
Export and Import of Metadata in Calibre	jeffersonm	Library Management	3	06-07-2017 06:32 PM
Dictionary / Calibre fail to change Language metadata	jmesar	Calibre	0	09-19-2012 04:54 PM
Exporting ISBNs for Import Into GoodReads	anamardoll	Calibre	3	06-12-2011 01:02 PM
Mass import of ISBNs	avantman42	Calibre	9	12-03-2010 01:39 AM

01-11-2020, 12:27 PM	#24
theducks Well trained by Cats Posts: 31,249 Karma: 61360164 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	DNSB 9788 is not an English ISBN (as the MDE view shows: Portuguese ) This may be a Metadata plugin configuration issue. Yours must accept a broader lookup scope. (English language books are 9780 or 9781 )