[Metadata Source Plugin] Goodreads - Page 36

davidfor · 10-11-2020, 08:40 PM

Quote:

Originally Posted by MegAnne

Top level only on Shelves.

Sorry, I think I can guess what that means, but, I'm not going to. Because if I get it wrong, we are all just wasting our time. Please explain in a reasonable amount of detail what you mean. Some examples would probably be a good idea.

MegAnne · 10-15-2020, 01:45 AM

That's fair. In the meantime, ridiculously enough, I figured out what I "wanted". So, starting from https://www.goodreads.com/genres/non-fiction I added to my spreadsheet all the "related genres" listed in that page. Same for https://www.goodreads.com/genres/fiction. And proceeded to use only those on my goodreads.json i.e. Fiction -> Fantasy.
In my mind, that gives me the genres at the 2nd level. I assume that's not fully accurate but is a good starting point for what I was trying to accomplish.
Long story short: from my point of view, Tags are "nice to have", Genres are "needed".

Terisa de morgan · 10-26-2020, 01:35 AM

Just a comment: Currently, you cannot remove the goodreads id from the book window with the mouse right button even if the option is offered and you select it.

MReprogle · 10-29-2020, 11:56 AM

I might be stupid, but I can't seem to get Tags to work correctly. When I try to pull tags from the book, "The Highly Sensitive Child" for example, it pulls the following tags:Psychology, Self Help, Reference, Childrens
Yet, when I go to the Goodreads page, it has Parenting, Nonfiction, Psychology, Self Help, Education
I'm not sure where it is pulling the tags that it is currently getting, but how do I change it over to the genres?
Also, I am running on Linux Mint 20, Calibre 5.3.0 and the 1.5.1 plugin. I am betting that this is more user error than anything, but just wanted to see if anyone had an idea of what I was doing wrong.
Thanks!

UPDATE:
Nevermind! I found that the 'Parenting' genre wasn't listed in the mappings, so that expains why it never showed up.

Penny_Dreadful · 10-31-2020, 01:16 AM

I'm having a problem with the plugin grabbing an isbn rather than the asin for Kindle editions of books. Get ASIN for Kindle Editions is ticked in the options.

For example when the only id for the book in Calibre is goodreads:40489693 I would expect to get back the amazon id amazon:B07DH9HCPT and no ISBN because that edition doesn't have an ISBN, this is what used to happen before I upgraded to Calibre 5 and the python 3 plug-in version. But instead I get a ISBN and no asin/amazon ID.

I've also found it I give the book just the ID amazon:B07DH9HCPT it still wants to grab an ISBN that dosen't belong to that edition, but at least that way I do get the goodreads id (which I want) aswell as the ISBN (which I don't want).

Windows 10, Calibre 5.4.2, Goodreads Plugin 1.5.1

Any help would be really appreciated, and thanks for all the work you've already done

Freakeao · 11-28-2020, 08:24 PM

I've got a book with a mobi-asin GUID, I run this pluging (and no other metadata downloads). I have scan multiple editions and get ASIN checked. But I always get matched to the hard cover. Not the Kindle edition or the ebook edition.

All the metadata will probably be the same between editions I'm looking at (same publishers, etc) but I'd like to get the IDs for the right edition. Is this just because publishers are all this same for this particular book? Is there a way to prefer ebook editions?

kblair210 · 11-29-2020, 04:37 AM

Would it be possible to add the ability to scrape awards information from Goodreads? An example Goodreads entry with awards is id# 19398490. These appear under 'Literary Awards' and is clearly visible in the page source code, so I'm hoping it would be a somewhat easy thing to pull. Even better if you could also pull the link information to each of the awards. The data could be stored at the end of the comments or a custom column (long text to support links). I'm fairly certain this information is book related and not ID related, meaning any version (ID) of the book would have the same entries.

If feeling over ambitious, could pull Characters and Setting too in case anyone wants them. The book above has examples of all three of these.

If feeling super ambitious, is it possible to pull the author information from a Goodreads book page and toss that information into a custom text column (or put it at the end of the comments field)?

davidfor · 11-29-2020, 05:00 AM

Quote:

Originally Posted by kblair210

Would it be possible to add the ability to scrape awards information from Goodreads? An example Goodreads entry with awards is id# 19398490. These appear under 'Literary Awards' and is clearly visible in the page source code, so I'm hoping it would be a somewhat easy thing to pull. Even better if you could also pull the link information to each of the awards. The data could be stored at the end of the comments or a custom column (long text to support links). I'm fairly certain this information is book related and not ID related, meaning any version (ID) of the book would have the same entries.

If feeling over ambitious, could pull Characters and Setting too in case anyone wants them. The book above has examples of all three of these.

If feeling super ambitious, is it possible to pull the author information from a Goodreads book page and toss that information into a custom text column (or put it at the end of the comments field)?

Sorry, but, none of this is something I am interested in doing. And, honestly, I don't really feel it is the right thing to do. It just isn't the sort of information I am interested in seeing. A lot of book descriptions already include author information, and I normally delete that.

The suggestion of using separate custom columns make more sense, but cannot be done from a metadata source plugin. Metadata source plugins can only returned data for the core columns. There have been discussion on handling this extra data. A search of the forum should find them.

DoctorOhh · 11-29-2020, 08:41 PM

Quote:

Originally Posted by Freakeao

I've got a book with a mobi-asin GUID, I run this pluging (and no other metadata downloads). I have scan multiple editions and get ASIN checked. But I always get matched to the hard cover. Not the Kindle edition or the ebook edition.

Try removing all id's then download metadata, it should give you many more options.

queensacrifice · 11-30-2020, 01:58 AM

Quote:

Originally Posted by Freakeao

I've got a book with a mobi-asin GUID, I run this pluging (and no other metadata downloads). I have scan multiple editions and get ASIN checked. But I always get matched to the hard cover. Not the Kindle edition or the ebook edition.

All the metadata will probably be the same between editions I'm looking at (same publishers, etc) but I'd like to get the IDs for the right edition. Is this just because publishers are all this same for this particular book? Is there a way to prefer ebook editions?

For this, in the line in __init__.py that reads

Code:

if identifier_name in ('amazon', 'asin') or identifier_name.startswith('amazon_'):

I added mobi-asin to the list, so that the line reads

Code:

if identifier_name in ('amazon', 'asin', 'mobi-asin') or identifier_name.startswith('amazon_'):

davidfor · 11-30-2020, 03:16 AM

Quote:

Originally Posted by queensacrifice

For this, in the line in __init__.py that reads

Code:

if identifier_name in ('amazon', 'asin') or identifier_name.startswith('amazon_'):

I added mobi-asin to the list, so that the line reads

Code:

if identifier_name in ('amazon', 'asin', 'mobi-asin') or identifier_name.startswith('amazon_'):

That makes sense. I have added it in the attached beta. But, it might not solve @Freakeao problem.

Firstly, the tooltip for the "Get ASIN for kindle editions" option is:

Quote:

When this option is checked, in cases where Goodreads has an ASIN listed instead of an ISBN, the ASIN is retrieved. This is useful for books that already have the specific Goodreads identifier of a kindle editon.

That doesn't say to use the ASIN, but, if the book that is found has am ASIN, to get it. The ASIN will be put into the amazon identifier. And will replace any existing amazon identifier. The plugin will use the Goodreads ID and then the ISBN. If these do not find a book, the Amazon identifiers will be tried. For a book from Amazon just added, I think it will just have one of the Amazon identifiers. But, if it has an ISBN, it will get that edition.

bc4me · 12-02-2020, 12:24 PM

Good Morning, newbie on the site here.

I just reinstalled the latest version of Calibre on Windows 10 after a PC reset. I'm having issues when I enable the Goodreads plugin.

On the 'edit metadata' screen, with metadata sources 'Google' and 'Amazon' selected, when I click 'download metadata' I get 2 separate unique entries, which is what I'd expect.
When I enable 'Goodreads' and click 'download metadata', I only get an entry from Goodreads, none from Google or Amazon to choose from. All 3 show information in the log.

Is there some option I'm missing? I'd like to be able to choose the best info, and still have all 3 links show in the 'Ids' sidebar.

Thanks for all the good work!

davidfor · 12-02-2020, 09:13 PM

Quote:

Originally Posted by bc4me

Good Morning, newbie on the site here.

I just reinstalled the latest version of Calibre on Windows 10 after a PC reset. I'm having issues when I enable the Goodreads plugin.

On the 'edit metadata' screen, with metadata sources 'Google' and 'Amazon' selected, when I click 'download metadata' I get 2 separate unique entries, which is what I'd expect.
When I enable 'Goodreads' and click 'download metadata', I only get an entry from Goodreads, none from Google or Amazon to choose from. All 3 show information in the log.

Is there some option I'm missing? I'd like to be able to choose the best info, and still have all 3 links show in the 'Ids' sidebar.

Thanks for all the good work!

The metadata download can merge the results from multiple sources into one. But, if that is what is happening, it should show the identifiers for each of the sources.

Otherwise, I'd need to see the log to get an idea of what might be happening. Can you post it?

bc4me · 12-03-2020, 11:40 AM

Quote:

Originally Posted by davidfor

The metadata download can merge the results from multiple sources into one. But, if that is what is happening, it should show the identifiers for each of the sources.

Otherwise, I'd need to see the log to get an idea of what might be happening. Can you post it?

Here's a couple of screenshots with Amazon and Google sources selected, then one with Goodreads, Amazon, and Google.

bc4me · 12-03-2020, 11:42 AM

Quote:

Originally Posted by bc4me

Here's a couple of screenshots with Amazon and Google sources selected, then one with Goodreads, Amazon, and Google.

And here's the log with all 3 sources selected:

Running identify query with parameters:
{'title': 'Easy Cycling Around Vancouver: Fun Day Trips for All Ages', 'authors': ['Jean Cousins', 'Norman Cousins'], 'identifiers': {'isbn': '9781553655824', 'goodreads': '10168722', 'google': 'MSOaBAAAQBAJ', 'mobi-asin': '512851e5-aed9-453d-ac36-5c912cbb3f6c'}, 'timeout': 30}
Using plugins: Goodreads (1, 5, 1), Google (1, 0, 1), Amazon.com (1, 2, 14)
The log from individual plugins is below

****************************** Goodreads (1, 5, 1) ******************************
Found 1 results
Downloading from Goodreads took 2.4547159671783447

---
Title : Easy Cycling Around Vancouver: Fun Day Trips for All Ages
Author(s) : Jean Cousins & Norman Cousins
Publisher : Greystone Books
Languages : eng
Rating : 1.8
Published : 2011-03-28T00:00:00+00:00
Identifiers : goodreads:10168722, isbn:9781553655824
Comments : The Lower Mainland's most popular cycling guide; updated and expanded with forty-five bike routes. 
Considered the fastest-growing method of travel in Vancouver, cycling is a good way to stay fit, save money, and have little impact on the environment. This guide provides forty-five good reasons to do all three and have fun at the same time. 
Easy Cycling around Vancouver features dozens of bike routes to discover across the Lower Mainland and northwestern Washington State. From Squamish to Bellingham, Richmond to Agassiz, Jean and Norman Cousins take you on bike tours along winding backroads and quiet country lanes, pointing out the best cafes and swimming holes as well as local flora and historic sites. 
This updated and expanded second edition includes: 
forty-five tours (nine all-new ones) ranging from 10 to 45 kilometers long 
concise, easy-to-follow maps and route descriptions 
helpful tips about cycling basics, safety, and trip planning 
The tours are perfect for families, novice riders, and older cyclists, or those who just want to have a lazy day exploring the countryside by bicycle. Try a flat, scenic trail with the kids or combine several tours to make up a multi-day trip. Ride right from your front door or take a bus, train, ferry, or car to the starting point. Whatever your cycling interest, Easy Cycling around Vancouver is just the ticket.
identify - start. title=Easy Cycling Around Vancouver: Fun Day Trips for All Ages, authors=['Jean Cousins', 'Norman Cousins'], identifiers={'isbn': '9781553655824', 'goodreads': '10168722', 'google': 'MSOaBAAAQBAJ', 'mobi-asin': '512851e5-aed9-453d-ac36-5c912cbb3f6c'}
Goodreads book url: 'https://www.goodreads.com/book/show/10168722-aaaa'
parse_title:: title_text='Easy Cycling Around Vancouver: Fun Day Trips for All Ages'
parse_authors - author: Jean Cousins
parse_authors - author: Norman Cousins
parse_authors - author: Jean Cousins
parse_authors - author: Norman Cousins
parse_details - goodreads_id: 10168722, mi: Title : Easy Cycling Around Vancouver: Fun Day Trips for All Ages
Author(s) : Jean Cousins & Norman Cousins
Error parsing series for url: 'https://www.goodreads.com/book/show/10168722-aaaa'
Traceback (most recent call last):
File "calibre_plugins.goodreads.worker", line 167, in parse_details
File "calibre_plugins.goodreads.worker", line 257, in parse_series
IndexError: list index out of range

parse_rating: rating_node= [<Element span at 0x762e488>]
parse_rating: have rating node - rating_node[0].text=
3.50

_parse_language: Have language node
_parse_language: raw= English
_parse_language: ans= eng

************************************************** ******************************

****************************** Google (1, 0, 1) ******************************
Found 1 results
Downloading from Google took 0.5918533802032471

---
Title : Easy Cycling Around Vancouver: Fun Day Trips for All Ages
Author(s) : Jean Cousins
Publisher : Greystone Books Ltd
Tags : Sports & Recreation, Cycling, Travel, Canada, Western Provinces (AB; BC)
Languages : eng
Published : 2011-12-15T16:12:17.951762+00:00
Identifiers : google:MSOaBAAAQBAJ, isbn:9781553655824
Comments : Whether you bicycle for fitness, pleasure, transportation or all of the above,Easy Cycling around Vancouverfeatures dozens of routes to discover across the Lower Mainland and northwestern Washington State. From Squamish to Bellingham, Richmond to Agassiz, Jean and Norman Cousins guide you along winding backroads and quiet country lanes, pointing out the best cafes and swimming holes as well as local flora and historic sites. This updated and expanded second edition includes: * forty-five tours (nine all-new ones) ranging from 20 to 45 km long * concise, easy-to-follow maps and route descriptions * helpful tips about cycling basics, safety and trip planning Try a flat, scenic trail with the kids or combine several tours to make up a multi-day trip. Ride right from your front door or take a bus, train or ferry to the starting point. Whatever your cycling interest,Easy Cycling around Vancouverwill fit the bill.
Making query: https://books.google.com/books/feeds...ewability=none

************************************************** ******************************

****************************** Amazon.com (1, 2, 14) ******************************
Found 1 results
Downloading from Amazon.com took 2.8911683559417725

---
Title : Easy Cycling Around Vancouver: Fun Day Trips for All Ages
Author(s) : Jean Cousins & Norman Cousins
Publisher : Greystone Books
Languages : eng
Rating : 2
Published : 2011-05-17T00:00:00+00:00
Identifiers : amazon_ca:1553655826, isbn:1553655826
Comments : Whether you bicycle for fitness, pleasure, transportation or all of the above, Easy Cycling around Vancouver features dozens of routes to discover across the Lower Mainland and northwestern Washington State. From Squamish to Bellingham, Richmond to Agassiz, Jean and Norman Cousins guide you along winding backroads and quiet country lanes, pointing out the best cafes and swimming holes as well as local flora and historic sites. 
This updated and expanded second edition includes: 
<ul>
<li>forty-five tours (nine all-new ones) ranging from 20 to 45 km long </li>
<li>concise, easy-to-follow maps and route descriptions </li>
<li>helpful tips about cycling basics, safety and trip planning </li>
</ul>
Try a flat, scenic trail with the kids or combine several tours to make up a multi-day trip. Ride right from your front door or take a bus, train or ferry to the starting point. Whatever your cycling interest, Easy Cycling around Vancouver will fit the bill. 
**
User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36
Server: auto
Making google query: https://www.google.com/search?q=%289...Awww.amazon.ca
Ignoring div with no descendant
Failed to find any results on results page, with title: (9781553655824 or 978-1553655824) site:www.amazon.ca - Google Search
No search engine results for terms: (9781553655824 OR 978-1553655824)
Trying the bing search engine instead
Making bing query: https://www.bing.com/search?q=%28978...Awww.amazon.ca
Getting details from: http://cc.bingj.com/cache.aspx?q=%28...Es6cYc3nHCk3vS

************************************************** ******************************
The identify phase took 3.08 seconds
The longest time (2.891168) was taken by: Amazon.com
Merging results from different sources
We have 1 merged results, merging took: 0.00 seconds

Thanks!

10-15-2020, 01:45 AM	#527
MegAnne Enthusiast Posts: 40 Karma: 10 Join Date: Aug 2011 Location: Atlantic Beach, FL Device: Amazon Fire HD 10	That's fair. In the meantime, ridiculously enough, I figured out what I "wanted". So, starting from https://www.goodreads.com/genres/non-fiction I added to my spreadsheet all the "related genres" listed in that page. Same for https://www.goodreads.com/genres/fiction. And proceeded to use only those on my goodreads.json i.e. Fiction -> Fantasy. In my mind, that gives me the genres at the 2nd level. I assume that's not fully accurate but is a good starting point for what I was trying to accomplish. Long story short: from my point of view, Tags are "nice to have", Genres are "needed". Last edited by MegAnne; 10-15-2020 at 10:59 AM.

10-29-2020, 11:56 AM	#529
MReprogle Junior Member Posts: 1 Karma: 10 Join Date: Jun 2014 Device: none	I might be stupid, but I can't seem to get Tags to work correctly. When I try to pull tags from the book, "The Highly Sensitive Child" for example, it pulls the following tags:Psychology, Self Help, Reference, Childrens Yet, when I go to the Goodreads page, it has Parenting, Nonfiction, Psychology, Self Help, Education I'm not sure where it is pulling the tags that it is currently getting, but how do I change it over to the genres? Also, I am running on Linux Mint 20, Calibre 5.3.0 and the 1.5.1 plugin. I am betting that this is more user error than anything, but just wanted to see if anyone had an idea of what I was doing wrong. Thanks! UPDATE: Nevermind! I found that the 'Parenting' genre wasn't listed in the mappings, so that expains why it never showed up. Last edited by MReprogle; 10-29-2020 at 11:59 AM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
[GUI Plugin] Goodreads Sync	kiwidude	Plugins	1781	02-12-2025 07:09 PM
[Metadata Download Plugin] Goodreads Metadata Deprecated	kiwidude	Plugins	30	04-23-2011 02:10 PM
[Covers Plugin] Goodreads Covers Deprecated	kiwidude	Plugins	13	04-17-2011 05:09 PM
metadata plugin	redneck_momma	Plugins	1	05-21-2010 08:41 PM

10-26-2020, 01:35 AM	#528
Terisa de morgan Grand Sorcerer Posts: 6,637 Karma: 12595249 Join Date: Jun 2009 Location: Madrid, Spain Device: Kobo Clara/Aura One/Forma,XiaoMI 5, iPad, Huawei MediaPad, YotaPhone 2	Just a comment: Currently, you cannot remove the goodreads id from the book window with the mouse right button even if the option is offered and you select it.

10-31-2020, 01:16 AM	#530
Penny_Dreadful She/Her Posts: 87 Karma: 142774 Join Date: Aug 2009 Location: Perth, Australia Device: Kindle PW5 (G001PX) PW3 PW1	I'm having a problem with the plugin grabbing an isbn rather than the asin for Kindle editions of books. Get ASIN for Kindle Editions is ticked in the options. For example when the only id for the book in Calibre is goodreads:40489693 I would expect to get back the amazon id amazon:B07DH9HCPT and no ISBN because that edition doesn't have an ISBN, this is what used to happen before I upgraded to Calibre 5 and the python 3 plug-in version. But instead I get a ISBN and no asin/amazon ID. I've also found it I give the book just the ID amazon:B07DH9HCPT it still wants to grab an ISBN that dosen't belong to that edition, but at least that way I do get the goodreads id (which I want) aswell as the ISBN (which I don't want). Windows 10, Calibre 5.4.2, Goodreads Plugin 1.5.1 Any help would be really appreciated, and thanks for all the work you've already done

11-28-2020, 08:24 PM	#531
Freakeao Connoisseur Posts: 51 Karma: 10 Join Date: Nov 2012 Device: none	I've got a book with a mobi-asin GUID, I run this pluging (and no other metadata downloads). I have scan multiple editions and get ASIN checked. But I always get matched to the hard cover. Not the Kindle edition or the ebook edition. All the metadata will probably be the same between editions I'm looking at (same publishers, etc) but I'd like to get the IDs for the right edition. Is this just because publishers are all this same for this particular book? Is there a way to prefer ebook editions?

11-29-2020, 04:37 AM	#532
kblair210 Enthusiast Posts: 30 Karma: 10 Join Date: Jan 2011 Location: Tampa Bay, FL Device: Kindle Oasis	Would it be possible to add the ability to scrape awards information from Goodreads? An example Goodreads entry with awards is id# 19398490. These appear under 'Literary Awards' and is clearly visible in the page source code, so I'm hoping it would be a somewhat easy thing to pull. Even better if you could also pull the link information to each of the awards. The data could be stored at the end of the comments or a custom column (long text to support links). I'm fairly certain this information is book related and not ID related, meaning any version (ID) of the book would have the same entries. If feeling over ambitious, could pull Characters and Setting too in case anyone wants them. The book above has examples of all three of these. If feeling super ambitious, is it possible to pull the author information from a Goodreads book page and toss that information into a custom text column (or put it at the end of the comments field)?

12-02-2020, 12:24 PM	#537
bc4me Junior Member Posts: 4 Karma: 10 Join Date: Dec 2020 Location: New Westminster, B.C Device: KOBO Touch	Good Morning, newbie on the site here. I just reinstalled the latest version of Calibre on Windows 10 after a PC reset. I'm having issues when I enable the Goodreads plugin. On the 'edit metadata' screen, with metadata sources 'Google' and 'Amazon' selected, when I click 'download metadata' I get 2 separate unique entries, which is what I'd expect. When I enable 'Goodreads' and click 'download metadata', I only get an entry from Goodreads, none from Google or Amazon to choose from. All 3 show information in the log. Is there some option I'm missing? I'd like to be able to choose the best info, and still have all 3 links show in the 'Ids' sidebar. Thanks for all the good work!