[GUI Plugin] OverDrive Libby

[sgmoore]

Originally Posted by foosion

Out of curiosity:

You can't just run the javascript in the plugin? Or run something like selenium to imitate a browser?

Not an expert in the field, but my understanding is : it usually not worth the effort if the website designers are making deliberate changes to stop you from doing something.

When a company has an API to access their servers (whether officially documented or not) there is usually an expectation that it will not change very often. Quite often the api is used by mobile and desktop applications and if the api changes it would force users to upgrade their device. Since some users could be running on computers that are decades old, it is quite common that new versions of the app would not even install on their machine and they get locked out much to their disgust (It generates a similar reaction to the reaction people are having with the news that Overdrive are going to stop providing MP3 downloads for audiobooks).

But websites are totally self-contained and can be changed in my ways without the end-user noticing. So if someone was to decode the way the website currently works, there is nothing to stop Libby from changing it. Hence you could get into a game of 'whack-a-mole' where you constantly need to update the plugin. But the effort required to work out what libby changed is sometimes much, much greater that the effort they need to put in to make the change.

It gets even worse in that the website that you see may be different from the one I see. It is common for companies to test changes on some users - sometimes this is initially rolled out in one country only. Amazon are reported to regularly use A/B testing to serve different websites to different users.

So if Libby are making this changes deliberately, then this is a losing strategy and whilst it is probably legal in some countries to do this for yourself, it may be illegal to publish a method that allows other people to do it (Not a lawyer.)

Just to be clear, I don't have any workaround for this.

[sgmoore]

Available now at https://github.com/sgmoore/libby-calibre-plugin

This version should keep the token refreshed and so should hopefully do away with the need to manually retrieve a new token from the website every week.

Credit for this fix should go to Orion Buske.

[synthese]

Hi,
I’m still getting a 403 error when I try to download an ebook or magazine. Any ideas on how to resolve this?

Thanks so much.

Harry

Originally Posted by sgmoore

Available now at https://github.com/sgmoore/libby-calibre-plugin

This version should keep the token refreshed and so should hopefully do away with the need to manually retrieve a new token from the website every week.

Credit for this fix should go to Orion Buske.

[PeterT]

Originally Posted by synthese

Hi,
I’m still getting a 403 error when I try to download an ebook or magazine. Any ideas on how to resolve this?

Thanks so much.

Harry

The fix was for a different issue. And no; as of this time no way to perform the download.

[Terisa de morgan]

Originally Posted by sgmoore

Available now at https://github.com/sgmoore/libby-calibre-plugin

This version should keep the token refreshed and so should hopefully do away with the need to manually retrieve a new token from the website every week.

Credit for this fix should go to Orion Buske.

Thank you, it's working for me.

[DashingDave]

I can't even get the 8-digit code to work. If I enter it, click OK, and then return to the plugin, the code field is empty and is still says that "Libby is not configured yet."

I've even tried entering a code just used to transfer to the iOS app, and I get the error

Spoiler:

calibre, version 7.20.0
ERROR: Unhandled exception: ClientNotFoundError:<calibre_plugins.overdrive_lib by.libby.errors.ClientNotFoundError; http_status=404, msg='HTTP Error 404: Not Found', error_response='{"result":"not_found"}''>

calibre 7.20 embedded-python: True
macOS-13.7-x86_64-i386-64bit Darwin ('64bit', '')
('Darwin', '22.6.0', 'Darwin Kernel Version 22.6.0: Wed Jul 31 21:42:48 PDT 2024; root:xnu-8796.141.3.707.4~1/RELEASE_X86_64')
Python 3.11.5
OSX: ('13.7', ('', '', ''), 'x86_64')
Interface language: None
EXE path: /Applications/calibre.app/Contents/MacOS/calibre
Successfully initialized third party plugins: DeACSM (0, 0, 16) && Gather KFX-ZIP (from KFX Input) (2, 16, 0) && DeDRM (10, 0, 9) && Package KFX (from KFX Input) (2, 16, 0) && KFX metadata reader (from KFX Input) (2, 16, 0) && From KFX (2, 16, 0) && KFX Input (2, 16, 0) && KindleUnpack - The Plugin (0, 83, 1) && OverDrive Libby (0, 1, 9) && PDF Cover (0, 1, 0) && Prettify Cover (1, 6, 0)
Traceback (most recent call last):
File "calibre_plugins.overdrive_libby.libby.client" , line 520, in send_request
response = req_opener.open(req, timeout=self.timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "urllib/request.py", line 525, in open
File "urllib/request.py", line 634, in http_response
File "urllib/request.py", line 563, in error
File "urllib/request.py", line 496, in _call_chain
File "urllib/request.py", line 643, in http_error_default
urllib.error.HTTPError: HTTP Error 404: Not Found

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "calibre/gui2/preferences/plugins.py", line 298, in customize_plugin
File "calibre/gui2/preferences/plugins.py", line 375, in modify_plugin
File "calibre/customize/__init__.py", line 188, in do_user_config
File "calibre_plugins.overdrive_libby.__init__", line 104, in save_settings
config_widget.save_settings()
File "calibre_plugins.overdrive_libby.config", line 953, in save_settings
libby_client.clone_by_code(setup_code)
File "calibre_plugins.overdrive_libby.libby.client" , line 615, in clone_by_code
res: Dict = self.send_request("chip/clone/code", params={"code": code})
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ^^^^^^^^^
File "calibre_plugins.overdrive_libby.libby.client" , line 540, in send_request
ErrorHandler.process(e, error_response)
File "calibre_plugins.overdrive_libby.libby.errors" , line 135, in process
raise ClientNotFoundError(
calibre_plugins.overdrive_libby.libby.errors.Clien tNotFoundError:

[sgmoore]

Originally Posted by DashingDave

I can't even get the 8-digit code to work. If I enter it, click OK, and then return to the plugin, the code field is empty and is still says that "Libby is not configured yet."

I just deleted my settings file and tried setting up from scratch using the Sonos method (for example browsing to https://libbyapp.com/interview/authe...ayCodeForSonos ) and it worked fine.

The error you are getting is just the standard 404 message saying that it can't find the website.

Can you try a few things.

Browse to https://sentry.libbyapp.com/chip/clone/code.
This will give you an error, but it is the type of error I am interested in (i.e 404 or 403 etc)

Install the latest version v0.1.9.2 from https://github.com/sgmoore/libby-calibre-plugin
It is unlikely to fix anything, but it is easier to debug if we are running the same version.

Restart calibre in debug mode (You can access that from the preferences menu) and repeat the setup procedure and post the updated log. This should give more details, including the exact url that is failing.

[sgmoore]

Originally Posted by synthese

I’m still getting a 403 error when I try to download an ebook or magazine. Any ideas on how to resolve this?

You can't download anything from the plugin and I don't think this will ever change. I fact I am considering removing or hiding the download buttons from my version.

You should still be able to download ebooks (but not magazines) from either the libby website or your library's overdrive website.

[foosion]

Originally Posted by sgmoore

You can't download anything from the plugin and I don't think this will ever change. I fact I am considering removing or hiding the download buttons from my version.

You should still be able to download ebooks (but not magazines) from either the libby website or your library's overdrive website.

Perhaps have a button to open libbyapp.com, if possible to the download page for the relevant book, just to make things a bit easier.

For that matter, a function to monitor a folder for a new acsm file, then import to Calibre would be nice, if it's possible to implement without undue effort.

In any event, thank you for all your work on this plugin.

[sgmoore]

Originally Posted by foosion

Perhaps have a button to open libbyapp.com, if possible to the download page for the relevant book, just to make things a bit easier.

Is this any easier than right-clicking on the book and selecting either of the top two options?

[PeterT]

The unfortunate thing is that loss of the download functionality is a pain when one's main computer is linux or a chromebook.

[foosion]

Originally Posted by sgmoore

Is this any easier than right-clicking on the book and selecting either of the top two options?

Yes. Right-clicking on Libby leads me to a page that lets me read the book on my computer ("open book"), but not download the acsm. Overdrive leads me to a page that allows me to borrow the book (perhaps because I have multiple cards and it defaults to one that may not have been the one I borrowed from).

At the bottom of the libby page there's a "read with ..." and underlined epub, but clicking on epub just gives me a popup saying download a file that can be read, rather than downloading the file.

I have the feeling I'm missing something.

Plus, if possible, the "monitor folder for new acsm and if so download to calibre" function.

EDIT: The useful links, from which I can download the acsm file, are in the form https://libbyapp.com/shelf/loans/123...012345/fulfill

[ComputerGranny]

I am really stumped. I have downloaded the Overdrive Libby plug-in and put it in my Calibre 6.26. I know there are newer versions but this one works for me and when I do upgrades, I frequently wind up with a non-functioning software, so I haven't. When I try to put in the setup code (obtained by clicking on the Sonos button in the Libby app), I get a Calibre unhandled exception error. My Libby is installed on my smartphone. I can't tell what the problem is in the error message. I'm going to paste in the error since I don't see anyway to attach the text file. Thanks in advance for anyone who can help. The loss of the ability to download audiobooks is a really big deal for me.

calibre, version 6.26.0
ERROR: Unhandled exception: <b>ClientConnectionError</b>:&lt;calibre_plugins.overdrive_libby.libby.error s.ClientConnectionError; http_status=0, msg='URLError &lt;urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Hostname mismatch, certificate is not valid for 'sentry-read.svc.overdrive.com'. (_ssl.c:997)&gt;', error_response='''&gt;

calibre 6.26 embedded-python: True
Windows-10-10.0.22621-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.22621')
Python 3.10.1
Windows: ('10', '10.0.22621', 'SP0', 'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: Gather KFX-ZIP (from KFX Input) (2, 11, 0) && DeDRM (10, 0, 3) && Package KFX (from KFX Input) (2, 11, 0) && KFX metadata reader (from KFX Input) (2, 11, 0) && From KFX (2, 11, 0) && KFX Input (2, 11, 0) && OverDrive Libby (0, 1, 9)
Traceback (most recent call last):
File "urllib\request.py", line 1348, in do_open
File "http\client.py", line 1282, in request
File "http\client.py", line 1328, in _send_request
File "http\client.py", line 1277, in endheaders
File "http\client.py", line 1037, in _send_output
File "http\client.py", line 975, in send
File "http\client.py", line 1454, in connect
File "ssl.py", line 512, in wrap_socket
File "ssl.py", line 1070, in _create
File "ssl.py", line 1341, in do_handshake
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Hostname mismatch, certificate is not valid for 'sentry-read.svc.overdrive.com'. (_ssl.c:997)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "calibre_plugins.overdrive_libby.libby.client" , line 518, in send_request
File "urllib\request.py", line 519, in open
File "urllib\request.py", line 536, in _open
File "urllib\request.py", line 496, in _call_chain
File "urllib\request.py", line 1391, in https_open
File "urllib\request.py", line 1351, in do_open
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Hostname mismatch, certificate is not valid for 'sentry-read.svc.overdrive.com'. (_ssl.c:997)>

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "calibre\gui2\preferences\plugins.py", line 301, in customize_plugin
File "calibre\gui2\preferences\plugins.py", line 378, in modify_plugin
File "calibre\customize\__init__.py", line 191, in do_user_config
File "calibre_plugins.overdrive_libby.__init__", line 104, in save_settings
File "calibre_plugins.overdrive_libby.config", line 947, in save_settings
File "calibre_plugins.overdrive_libby.libby.client" , line 593, in get_chip
File "calibre_plugins.overdrive_libby.libby.client" , line 556, in send_request
calibre_plugins.overdrive_libby.libby.errors.Clien tConnectionError: <calibre_plugins.overdrive_libby.libby.errors.Clie ntConnectionError; http_status=0, msg='URLError <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Hostname mismatch, certificate is not valid for 'sentry-read.svc.overdrive.com'. (_ssl.c:997)>', error_response='''>

[foosion]

Originally Posted by ComputerGranny

I am really stumped. I have downloaded the Overdrive Libby plug-in and put it in my Calibre 6.26. I know there are newer versions but this one works for me and when I do upgrades, I frequently wind up with a non-functioning software, so I haven't. When I try to put in the setup code (obtained by clicking on the Sonos button in the Libby app), I get a Calibre unhandled exception error. My Libby is installed on my smartphone. I can't tell what the problem is in the error message. I'm going to paste in the error since I don't see anyway to attach the text file. Thanks in advance for anyone who can help. The loss of the ability to download audiobooks is a really big deal for me.

Libby changed things internally so the version of the plugin you are using doesn't work any more. You should use the latest, which is posted by sgmoore a few posts above. Using the sonos code does no longer works, at least not for many. You might want to read back a bunch of posts to see various issues with the plugin, including losing the ability to download.

[synthese]

Originally Posted by foosion

You might want to read back a bunch of posts to see various issues with the plugin, including losing the ability to download.

It’s really sad that downloading isn’t working anymore. Is anyone working on a solution to bring it back?

Best regards,
Harry