[Metadata Source Plugin] Goodreads More Tags

MaienM · 08-04-2019, 07:30 AM

This plugin scrapes the shelves page of Goodreads to provide more tags than the top 4 (which are shown on the main page and scraped by the Goodreads plugin).

This plugin will only provide tags. It is meant to be used as a companion to the Goodreads plugin, and it is essentially an extended version of the genre -> tag mapping included in that plugin.

Main Features

Can retrieve the shelves page of Goodreads to provide more tags.
Customizable mapping from shelf name -> tags. A shelf can be mapped to multiple tags, and multiple shelves can map to the same tag(s).
Fine-grained filtering to only keep tags that enough people agree on.
Integrates with the Goodreads plugin to provide tags for all of its results.

Special Notes

Requires Calibre 0.8 or later.
If used without the base Goodreads plugin, it will only get tags for books that have a Goodreads identifier.

Installation Notes

Download the attached zip file and install the plugin as described in the Introduction to plugins thread.
Note that this is not a GUI plugin so it is not intended/cannot be added to context menus/toolbars etc.
Customize your desired genre -> tag mappings and other options from the metadata download configuration screen. Hover over the ? symbols to get an explanation of what the various options do.

Version History

Spoiler:

Penny_Dreadful · 08-14-2019, 07:13 AM

I'd been occasionally doing this manually for books with only one Tag, being able to do it automatically is brilliant!

Thank you!!

Isomorpheus · 10-19-2019, 10:13 AM

This is very useful, thank you!

I don't quite understand, though, how the Goodreads identifier is being grabbed. I have the Goodreads plugin installed too but it seems like I need to run the metadata download twice -- once to get the Goodreads identifier, and then again to get the extra tags. Is that intended?

Wolgan · 11-24-2019, 08:10 PM

Great concept, and it works great, when it works. It seems like about 2 out 3 times it hangs and won't download. All my books already have a goodreads ID attached, so that's not the issue. Even when it's the only metadata plugin enabled, same issue. If I run it as a job, it throws the error below if I wait long enough.

Code:

Starting job: Download metadata for one book 
Job: "Download metadata for one book" failed with error: 
Traceback (most recent call last):
  File "site-packages\calibre\gui2\threaded_jobs.py", line 83, in start_work
  File "site-packages\calibre\gui2\metadata\bulk_download.py", line 251, in download
  File "site-packages\calibre\utils\ipc\simple_worker.py", line 262, in fork_job
  File "site-packages\calibre\utils\ipc\simple_worker.py", line 186, in run_job
  File "site-packages\calibre\utils\ipc\simple_worker.py", line 108, in communicate
WorkerError: Worker appears to have hung
 
Called with args: ([912], u'C:\\Users\\Wolgan\\AppData\\Local\\Temp\\calibre__ma5nf\\mo7gjl_metadata_bulk.log', <calibre.db.legacy.LibraryDatabase object at 0x00000208EEE73248>, True, False, None) {u'notifications': <Queue.Queue instance at 0x00000208F4D3E348>, u'abort': <threading._Event object at 0x000002088AA37D48>, u'log': <calibre.utils.logging.GUILog object at 0x00000209171938C8>}

MaienM · 12-09-2019, 02:02 PM

Quote:

Originally Posted by Isomorpheus

This is very useful, thank you!

I don't quite understand, though, how the Goodreads identifier is being grabbed. I have the Goodreads plugin installed too but it seems like I need to run the metadata download twice -- once to get the Goodreads identifier, and then again to get the extra tags. Is that intended?

This is not intentional, no. It attempts to detect the identifiers found by Goodreads and uses these, in a single pass. This seemed to work on my system last I used this, but I'll take another look at it to make sure.

Quote:

Originally Posted by Wolgan

Great concept, and it works great, when it works. It seems like about 2 out 3 times it hangs and won't download. All my books already have a goodreads ID attached, so that's not the issue. Even when it's the only metadata plugin enabled, same issue. If I run it as a job, it throws the error below if I wait long enough.

Code:

Starting job: Download metadata for one book 
Job: "Download metadata for one book" failed with error: 
Traceback (most recent call last):
  File "site-packages\calibre\gui2\threaded_jobs.py", line 83, in start_work
  File "site-packages\calibre\gui2\metadata\bulk_download.py", line 251, in download
  File "site-packages\calibre\utils\ipc\simple_worker.py", line 262, in fork_job
  File "site-packages\calibre\utils\ipc\simple_worker.py", line 186, in run_job
  File "site-packages\calibre\utils\ipc\simple_worker.py", line 108, in communicate
WorkerError: Worker appears to have hung
 
Called with args: ([912], u'C:\\Users\\Wolgan\\AppData\\Local\\Temp\\calibre__ma5nf\\mo7gjl_metadata_bulk.log', <calibre.db.legacy.LibraryDatabase object at 0x00000208EEE73248>, True, False, None) {u'notifications': <Queue.Queue instance at 0x00000208F4D3E348>, u'abort': <threading._Event object at 0x000002088AA37D48>, u'log': <calibre.utils.logging.GUILog object at 0x00000209171938C8>}

Yeah, it's not yet 100% reliable unfortunately. I'll take a look at this again soon. I'm pretty sure I actually have some unreleased work/fixes related to it hanging, but it might need some polishing.

On a somewhat related note, does anyone know what the process is to release updates? It doesn't seem like I can edit the first post, unless I'm missing something.

davidfor · 12-09-2019, 05:39 PM

Quote:

Originally Posted by MaienM

On a somewhat related note, does anyone know what the process is to release updates? It doesn't seem like I can edit the first post, unless I'm missing something.

There should be an edit button in the bottom right of the post next to the quote button. But, you might need a certain number of posts before it gets enabled. I'd ask a moderator about that. Or ask them to update the post until you can edit your post.

DoctorOhh · 12-11-2019, 12:17 AM

Quote:

Originally Posted by MaienM

On a somewhat related note, does anyone know what the process is to release updates? It doesn't seem like I can edit the first post, unless I'm missing something.

As @davidfor states there should be an edit button in the bottom right corner of your post, see attached. If you don't see an edit button, create a new thread in the Feedback forum and ask for assistance from a moderator.

MaienM · 12-15-2019, 01:37 PM

I just released a new version, which includes a number of improvements.

First of all, I've resolved the issues with hooking into the Goodreads plugin (or so it seems from my testing). This means it should just work™ now

Second, if this hook does fail, it will now give up on waiting after a bit, and continue with an existing Goodreads id on the book (if any). This means that if the hook does fail, you should at least be able to get the tags on a second run. Not ideal, but better than hanging.

I've also made it possible to disable the integration with the base Goodreads plugin in the settings, so if you run into issues you can just turn the integration off, and always fallback to using the existing Goodreads id on the book.

Let me know if this works for you guys!

jennie2486 · 11-07-2020, 05:55 PM

Hi,

This is my first time installing Goodreads More Tags plugin to Calibre. When I tried to install it I received an error of the following:

calibre, version 5.1.0
ERROR: Install plugin failed: A problem occurred while installing this plugin. This plugin will now be uninstalled. Please post the error message in details below into the forum thread for this plugin and restart calibre.

Traceback (most recent call last):
File "site-packages\calibre\gui2\dialogs\plugin_updater.py", line 731, in _install_clicked
File "site-packages\calibre\customize\ui.py", line 472, in add_plugin
File "site-packages\calibre\customize\ui.py", line 61, in load_plugin
File "site-packages\calibre\customize\zipplugin.py", line 202, in load
File "importlib\__init__.py", line 127, in import_module
File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
File "<frozen importlib._bootstrap>", line 991, in _find_and_load
File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 655, in _load_unlocked
File "<frozen importlib._bootstrap>", line 618, in _load_backward_compatible
File "site-packages\calibre\customize\zipplugin.py", line 184, in load_module
File "calibre_plugins.goodreads_more_tags.__init__" , line 4, in <module>
ModuleNotFoundError: No module named 'Queue'

I would really like to use this plugin, does anyone have a solution?

Thanks.

theducks · 11-07-2020, 06:46 PM

5.4.2 is the latest and fixes a bunch of issues (that can happen with any new release)
Why not get current, then update the PI if it shows as available.

It just might be your issue has been fixed

davidfor · 11-07-2020, 08:58 PM

Quote:

Originally Posted by jennie2486

Hi,

This is my first time installing Goodreads More Tags plugin to Calibre. When I tried to install it I received an error of the following:

calibre, version 5.1.0
ERROR: Install plugin failed: A problem occurred while installing this plugin. This plugin will now be uninstalled. Please post the error message in details below into the forum thread for this plugin and restart calibre.

Traceback (most recent call last):
File "site-packages\calibre\gui2\dialogs\plugin_updater.py", line 731, in _install_clicked
File "site-packages\calibre\customize\ui.py", line 472, in add_plugin
File "site-packages\calibre\customize\ui.py", line 61, in load_plugin
File "site-packages\calibre\customize\zipplugin.py", line 202, in load
File "importlib\__init__.py", line 127, in import_module
File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
File "<frozen importlib._bootstrap>", line 991, in _find_and_load
File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 655, in _load_unlocked
File "<frozen importlib._bootstrap>", line 618, in _load_backward_compatible
File "site-packages\calibre\customize\zipplugin.py", line 184, in load_module
File "calibre_plugins.goodreads_more_tags.__init__" , line 4, in <module>
ModuleNotFoundError: No module named 'Queue'

I would really like to use this plugin, does anyone have a solution?

That looks like a Python 3 problem. The plugin needs to updated for calibre v5/Python 3.

MaienM · 11-13-2020, 02:06 AM

Quote:

Originally Posted by davidfor

That looks like a Python 3 problem. The plugin needs to updated for calibre v5/Python 3.

This is correct. I'll take a look at getting this updated. Might take a bit depending on how much work it is, we'll see.

Penny_Dreadful · 11-13-2020, 05:02 AM

Quote:

Originally Posted by MaienM

This is correct. I'll take a look at getting this updated. Might take a bit depending on how much work it is, we'll see.

That would be brilliant, this plugin is really useful.

davidfor · 11-13-2020, 10:11 PM

Quote:

Originally Posted by MaienM

This is correct. I'll take a look at getting this updated. Might take a bit depending on how much work it is, we'll see.

I'm pretty sure I looked at it and there were not that many changes. If you have just made changes to the Goodreads plugin, you might want to just take that and apply your changes again. Or even subclass of that with overrides of the appropriate methods.

And if you are doing either of those things, if I there are reasonable changes to the Goodreads plugin to make it simpler for you, I'll be happy to look at them.

MaienM · 11-14-2020, 06:36 AM

That was pretty easy, new version is up now.

Quote:

Originally Posted by davidfor

If there are reasonable changes to the Goodreads plugin to make it simpler for you, I'll be happy to look at them.

I appreciate the offer and I'll keep it in mind for the future!

11-07-2020, 05:55 PM	#9
jennie2486 Member Posts: 11 Karma: 10 Join Date: Feb 2017 Device: Android Tablet	Error when installing Goodreads More Tags plugin to Calibre Hi, This is my first time installing Goodreads More Tags plugin to Calibre. When I tried to install it I received an error of the following: calibre, version 5.1.0 ERROR: Install plugin failed: A problem occurred while installing this plugin. This plugin will now be uninstalled. Please post the error message in details below into the forum thread for this plugin and restart calibre. Traceback (most recent call last): File "site-packages\calibre\gui2\dialogs\plugin_updater.py", line 731, in _install_clicked File "site-packages\calibre\customize\ui.py", line 472, in add_plugin File "site-packages\calibre\customize\ui.py", line 61, in load_plugin File "site-packages\calibre\customize\zipplugin.py", line 202, in load File "importlib\__init__.py", line 127, in import_module File "<frozen importlib._bootstrap>", line 1014, in _gcd_import File "<frozen importlib._bootstrap>", line 991, in _find_and_load File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 655, in _load_unlocked File "<frozen importlib._bootstrap>", line 618, in _load_backward_compatible File "site-packages\calibre\customize\zipplugin.py", line 184, in load_module File "calibre_plugins.goodreads_more_tags.__init__" , line 4, in <module> ModuleNotFoundError: No module named 'Queue' I would really like to use this plugin, does anyone have a solution? Thanks.

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
[Metadata Source Plugin] Goodreads	kiwidude	Plugins	784	04-27-2025 05:23 AM
Goodreads plugin / tags from Calibre	sstdiana	Plugins	5	03-01-2016 02:09 PM
Suggestion: goodreads.com as metadata source.	smokex	Calibre	2	08-25-2013 11:57 PM
Ideas on how to improve Calibre: new metadata source (goodreads) + a new cover search	MelBr	Calibre	2	03-06-2013 03:25 PM
[Metadata Download Plugin] Goodreads Metadata Deprecated	kiwidude	Plugins	30	04-23-2011 02:10 PM

08-14-2019, 07:13 AM	#2
Penny_Dreadful She/Her Posts: 87 Karma: 142774 Join Date: Aug 2009 Location: Perth, Australia Device: Kindle PW5 (G001PX) PW3 PW1	I'd been occasionally doing this manually for books with only one Tag, being able to do it automatically is brilliant! Thank you!!

10-19-2019, 10:13 AM	#3
Isomorpheus Junior Member Posts: 7 Karma: 10 Join Date: Oct 2019 Device: Kobo Aura HD	This is very useful, thank you! I don't quite understand, though, how the Goodreads identifier is being grabbed. I have the Goodreads plugin installed too but it seems like I need to run the metadata download twice -- once to get the Goodreads identifier, and then again to get the extra tags. Is that intended?

12-15-2019, 01:37 PM	#8
MaienM Member Posts: 15 Karma: 100000 Join Date: Aug 2019 Device: Kobo Aura H2O	I just released a new version, which includes a number of improvements. First of all, I've resolved the issues with hooking into the Goodreads plugin (or so it seems from my testing). This means it should just work™ now Second, if this hook does fail, it will now give up on waiting after a bit, and continue with an existing Goodreads id on the book (if any). This means that if the hook does fail, you should at least be able to get the tags on a second run. Not ideal, but better than hanging. I've also made it possible to disable the integration with the base Goodreads plugin in the settings, so if you run into issues you can just turn the integration off, and always fallback to using the existing Goodreads id on the book. Let me know if this works for you guys!

11-07-2020, 06:46 PM	#10
theducks Well trained by Cats Posts: 31,249 Karma: 61360164 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	5.4.2 is the latest and fixes a bunch of issues (that can happen with any new release) Why not get current, then update the PI if it shows as available. It just might be your issue has been fixed