[GUI Plugin] OverDrive Libby

[foosion]

I am able to download. Unfortunately what I download is an .acsm file rather than the epub. If I double click on the .acsm file in Calibre it launches ADE which then downloads the actual epub.

How do I fix this?

Originally Posted by miss_p1nky

You need a De-DRM plugin for the book to be displayed as epub. Otherwise it'll just be imported as an ACSM file and thus can't be read using Calibre or transferred to your device.

I have DeDRM (7.2.1) installed. I can import the epub from ADE into Calibre without issue.

I had to use developer mode to get the libby token as shown in https://www.mobileread.com/forums/sh...&postcount=140. Oddly, when I used the token from FireFox I got a unicode error, while the token from Chrome worked (probably the issue in #192 above). Otherwise I could see a list of my books (loans and holds) but was getting 403 forbidden errors when trying to download.

[miss_p1nky]

Originally Posted by foosion

I am able to download. Unfortunately what I download is an .acsm file rather than the epub. If I double click on the .acsm file in Calibre it launches ADE which then downloads the actual epub.

How do I fix this?


I have DeDRM (7.2.1) installed. I can import the epub from ADE into Calibre without issue.

I had to use developer mode to get the libby token as shown in https://www.mobileread.com/forums/sh...&postcount=140. Oddly, when I used the token from FireFox I got a unicode error, while the token from Chrome worked (probably the issue in #192 above). Otherwise I could see a list of my books (loans and holds) but was getting 403 forbidden errors when trying to download.

Your deDRM is too old. It's now known as noDRM and the latest ver is 10.0.3. https://github.com/noDRM/DeDRM_tools

[foosion]

Originally Posted by miss_p1nky

Your deDRM is too old. It's now known as noDRM and the latest ver is 10.0.3. https://github.com/noDRM/DeDRM_tools

I was wondering about that. I've been hesitant to upgrade since it works perfectly and I worry that changing it will break something.

Since it works standalone, why wouldn't it work with this plugin?

EDIT: I haven't found anything in the plugin's code that's hardwired to the DeDRM version.

EDIT2: In any event, I installed the latest DeDRM and nothing changed. OverLibby Libby still downloads acsm rather than epub.

[miss_p1nky]

Originally Posted by foosion

I was wondering about that. I've been hesitant to upgrade since it works perfectly and I worry that changing it will break something.

Since it works standalone, why wouldn't it work with this plugin?

EDIT: I haven't found anything in the plugin's code that's hardwired to the DeDRM version.

EDIT2: In any event, I installed the latest DeDRM and nothing changed. OverLibby Libby still downloads acsm rather than epub.

Ah apologies, I didn't know why the update is required nor why it doesn't work with yours. I hope you'll manage to in the end by tinkering with the plugin.

[JSWolf]

Originally Posted by miss_p1nky

Your deDRM is too old. It's now known as noDRM and the latest ver is 10.0.3. https://github.com/noDRM/DeDRM_tools

The plugin is still called DeDRM. The latest version is the alpha release which is later then the 10.0.3 version.

https://github.com/noDRM/DeDRM_tools_autorelease/tags

[JSWolf]

Originally Posted by foosion

I was wondering about that. I've been hesitant to upgrade since it works perfectly and I worry that changing it will break something.

Since it works standalone, why wouldn't it work with this plugin?

EDIT: I haven't found anything in the plugin's code that's hardwired to the DeDRM version.

EDIT2: In any event, I installed the latest DeDRM and nothing changed. OverLibby Libby still downloads acsm rather than epub.

An ACSM file is the file that ADE uses the download the ePub with DRM. What you want is the DeACSM plugin that's used to download the ePub without needing ADE and it imports the eBook directly into calibre. The URL below is the thread on this plugin which you should have a read.

https://www.mobileread.com/forums/sh...d.php?t=341975

[foosion]

Originally Posted by JSWolf

An ACSM file is the file that ADE uses the download the ePub with DRM. What you want is the DeACSM plugin that's used to download the ePub without needing ADE and it imports the eBook directly into calibre. The URL below is the thread on this plugin which you should have a read.

https://www.mobileread.com/forums/sh...d.php?t=341975

I had tried that. I expected it to download the eBook as soon as this plugin downloaded the ACSM file into Calibre or to do so when I double clicked on the ACSM file in Calibre. It did neither. Nothing happens after the ACSM file shows up in Calibre and double clicking on the ACSM files in Calibre launches ADE (after which I can import the epub into Calibre).

What am I missing?

[JSWolf]

Originally Posted by foosion

I had tried that. I expected it to download the eBook as soon as this plugin downloaded the ACSM file into Calibre or to do so when I double clicked on the ACSM file in Calibre. It did neither. Nothing happens after the ACSM file shows up in Calibre and double clicking on the ACSM files in Calibre launches ADE (after which I can import the epub into Calibre).

What am I missing?

I don't use this plugin. So I would ask then the thread for the plugin.

[foosion]

I'm getting ssl certificate errors. Please see this post: https://www.mobileread.com/forums/sh...&postcount=486

Spoiler:

calibre, version 7.15.0
ERROR: Unhandled exception: <b>ClientConnectionError</b>: Error synchronizing data<p>Check your connection or retry in a few minutes.</p>

calibre 7.15 embedded-python: True
Windows-10-10.0.19045-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.19045')
Python 3.11.5
Windows: ('10', '10.0.19045', 'SP0', 'Multiprocessor Free')
Interface language: None
EXE path: C:\Program Files\Calibre2\calibre.exe
Successfully initialized third party plugins: DeACSM (0, 0, 16) && DeDRM (10, 0, 3) && Action Chains (1, 20, 7) && EpubSplit (3, 6, 0) && Find Duplicates (1, 6, 3) && Goodreads (1, 8, 2) && KePub Output (3, 6, 6) && Kindle hi-res covers (0, 5, 1) && Kobo Utilities (2, 17, 1) && KoboTouchExtended (3, 6, 11) && OverDrive Libby (0, 1, 9) && Reading List (1, 15, 4) && SmartEject (2, 5, 1)
Traceback (most recent call last):
File "urllib\request.py", line 1348, in do_open
File "http\client.py", line 1286, in request
File "http\client.py", line 1332, in _send_request
File "http\client.py", line 1281, in endheaders
File "http\client.py", line 1041, in _send_output
File "http\client.py", line 979, in send
File "http\client.py", line 1458, in connect
File "ssl.py", line 517, in wrap_socket
File "ssl.py", line 1108, in _create
File "ssl.py", line 1379, in do_handshake
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Hostname mismatch, certificate is not valid for 'sentry-read.svc.overdrive.com'. (_ssl.c:1006)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "calibre_plugins.overdrive_libby.libby.client" , line 518, in send_request
File "urllib\request.py", line 519, in open
File "urllib\request.py", line 536, in _open
File "urllib\request.py", line 496, in _call_chain
File "urllib\request.py", line 1391, in https_open
File "urllib\request.py", line 1351, in do_open
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Hostname mismatch, certificate is not valid for 'sentry-read.svc.overdrive.com'. (_ssl.c:1006)>

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "calibre_plugins.overdrive_libby.workers", line 351, in run
File "calibre_plugins.overdrive_libby.libby.client" , line 631, in sync
File "calibre_plugins.overdrive_libby.libby.client" , line 556, in send_request
calibre_plugins.overdrive_libby.libby.errors.Clien tConnectionError: <calibre_plugins.overdrive_libby.libby.errors.Clie ntConnectionError; http_status=0, msg='URLError <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Hostname mismatch, certificate is not valid for 'sentry-read.svc.overdrive.com'. (_ssl.c:1006)>', error_response='''>

[sgmoore]

Originally Posted by foosion

I'm getting ssl certificate errors. Please see this post: https://www.mobileread.com/forums/sh...&postcount=486

Spoiler:

calibre, version 7.15.0
ERROR: Unhandled exception: <b>ClientConnectionError</b>: Error synchronizing data<p>Check your connection or retry in a few minutes.</p>

calibre 7.15 embedded-python: True
Windows-10-10.0.19045-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.19045')
Python 3.11.5
Windows: ('10', '10.0.19045', 'SP0', 'Multiprocessor Free')
Interface language: None
EXE path: C:\Program Files\Calibre2\calibre.exe
Successfully initialized third party plugins: DeACSM (0, 0, 16) && DeDRM (10, 0, 3) && Action Chains (1, 20, 7) && EpubSplit (3, 6, 0) && Find Duplicates (1, 6, 3) && Goodreads (1, 8, 2) && KePub Output (3, 6, 6) && Kindle hi-res covers (0, 5, 1) && Kobo Utilities (2, 17, 1) && KoboTouchExtended (3, 6, 11) && OverDrive Libby (0, 1, 9) && Reading List (1, 15, 4) && SmartEject (2, 5, 1)
Traceback (most recent call last):
File "urllib\request.py", line 1348, in do_open
File "http\client.py", line 1286, in request
File "http\client.py", line 1332, in _send_request
File "http\client.py", line 1281, in endheaders
File "http\client.py", line 1041, in _send_output
File "http\client.py", line 979, in send
File "http\client.py", line 1458, in connect
File "ssl.py", line 517, in wrap_socket
File "ssl.py", line 1108, in _create
File "ssl.py", line 1379, in do_handshake
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Hostname mismatch, certificate is not valid for 'sentry-read.svc.overdrive.com'. (_ssl.c:1006)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "calibre_plugins.overdrive_libby.libby.client" , line 518, in send_request
File "urllib\request.py", line 519, in open
File "urllib\request.py", line 536, in _open
File "urllib\request.py", line 496, in _call_chain
File "urllib\request.py", line 1391, in https_open
File "urllib\request.py", line 1351, in do_open
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Hostname mismatch, certificate is not valid for 'sentry-read.svc.overdrive.com'. (_ssl.c:1006)>

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "calibre_plugins.overdrive_libby.workers", line 351, in run
File "calibre_plugins.overdrive_libby.libby.client" , line 631, in sync
File "calibre_plugins.overdrive_libby.libby.client" , line 556, in send_request
calibre_plugins.overdrive_libby.libby.errors.Clien tConnectionError: <calibre_plugins.overdrive_libby.libby.errors.Clie ntConnectionError; http_status=0, msg='URLError <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Hostname mismatch, certificate is not valid for 'sentry-read.svc.overdrive.com'. (_ssl.c:1006)>', error_response='''>

Different issue from your linked message which I think was when the website had a valid certificate, but was not trusted automatically and so you had to download the certificate for it to be used.

In this case the website certificate is invalid (or not valid for the sentry-read.svc.overdrive.com domain)

See https://github.com/ping/libby-calibre-plugin/issues/33

[foosion]

Originally Posted by sgmoore

Different issue from your linked message which I think was when the website had a valid certificate, but was not trusted automatically and so you had to download the certificate for it to be used.

In this case the website certificate is invalid (or not valid for the sentry-read.svc.overdrive.com domain)

See https://github.com/ping/libby-calibre-plugin/issues/33

That worked! I downloaded the patched file at https://gofile.io/d/SJp0r9

[DaySleeper]

Originally Posted by foosion

That worked! I downloaded the patched file at https://gofile.io/d/SJp0r9

I downloaded that file; is there a particular file from that archive I should copy over its existing counterpart, or should I uninstall the current plugin & reinstall via the zip file I just downloaded?

[foosion]

Originally Posted by DaySleeper

I downloaded that file; is there a particular file from that archive I should copy over its existing counterpart, or should I uninstall the current plugin & reinstall via the zip file I just downloaded?

Just install the file I linked above.

[sgmoore]

Originally Posted by DaySleeper

I downloaded that file; is there a particular file from that archive I should copy over its existing counterpart, or should I uninstall the current plugin & reinstall via the zip file I just downloaded?

It is easiest to just reinstall from the zip file.

If you want to patch manually, then it depends on how old your plugin is. My zip file contains some changes Ping made which were on his repo but not released and I have also include another patch by spicefather to fix a date issue.

If you want to see the change to fix the certificate error, it is to calibre-plugin/libby/client.py as shown at https://github.com/sgmoore/libby-cal...710503a7cf524a

If you are cautious about untrusted changes, a tool that can compare zip files like Beyond Compare makes it easy to see the differences.

[dhdurgee]

Originally Posted by spicefather

I've been playing around with this a little bit and it looks like as Pjama suggested, they changed their security a little bit. I tried generating a new auth token in the app via the clone code and that didn't work for me, but I did the same in my browser and copied its auth token into this plugin's config and that worked perfectly.
No promises on timeline since I have limited time to work on this, but I'm going to see if I can work the newer token generation method into the plugin. Alternatively if anyone is interested in working on it I'm happy to share my findings so far.

If anyone needs to get their plugin working, you can follow the steps below. I don't know how long this lasts for, so you may end up needing to redo it after some hours/days. Also the instructions are based on Firefox, hopefully they apply to other browsers as well but if not just ask and someone will try to help out.

1. In your browser, open your dev console (ctrl-shift-I or F12 for me).
2. Go to the network tab, click the cog at the top-right and make sure "Persist Logs" is on.
3. Go to https://libbyapp.com/.
4. In the dev console, type "sentry" into the filter bar.
5. Click on the furthest-down entry that is a "GET" request.
6. In the right panel, go into the "Request Headers" and find "Authorization" -- its format should be "Bearer" followed by a long string of characters. Copy just the long string.
7. Make sure Calibre is closed, and open the plugin config file (%APPDATA%\calibre\plugins\overdrive_libby.json on Windows, unsure Mac/Linux paths).
8. Find the line for "libby_token", and replace its value with the one you copied in step 6.
9. Open Calibre and the plugin should work as expected now.

Hopefully this is helpful to people.

I tried this out today and unfortunately ran into what appears to be another error:

Spoiler:

calibre, version 7.16.0
ERROR: Unhandled exception: <b>ClientConnectionError</b>: Error synchronizing data<p>Check your connection or retry in a few minutes.</p>

calibre 7.16 embedded-python: True
Linux-6.8.0-44-generic-x86_64-with-glibc2.39 Linux ('64bit', 'ELF')
('Linux', '6.8.0-44-generic', '#44-Ubuntu SMP PREEMPT_DYNAMIC Tue Aug 13 13:35:26 UTC 2024')
Python 3.11.5
Interface language: None
EXE path: /opt/calibre/bin/calibre
Successfully initialized third party plugins: DeACSM (0, 0, 16) && DeDRM (10, 0, 3) && Hyphenate This! (0, 1, 3) && OverDrive Libby (0, 1, 9)
Traceback (most recent call last):
File "urllib/request.py", line 1348, in do_open
File "http/client.py", line 1286, in request
File "http/client.py", line 1332, in _send_request
File "http/client.py", line 1281, in endheaders
File "http/client.py", line 1041, in _send_output
File "http/client.py", line 979, in send
File "http/client.py", line 1458, in connect
File "ssl.py", line 517, in wrap_socket
File "ssl.py", line 1108, in _create
File "ssl.py", line 1379, in do_handshake
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Hostname mismatch, certificate is not valid for 'sentry-read.svc.overdrive.com'. (_ssl.c:1006)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "calibre_plugins.overdrive_libby.libby.client" , line 518, in send_request
response = req_opener.open(req, timeout=self.timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "urllib/request.py", line 519, in open
File "urllib/request.py", line 536, in _open
File "urllib/request.py", line 496, in _call_chain
File "urllib/request.py", line 1391, in https_open
File "urllib/request.py", line 1351, in do_open
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Hostname mismatch, certificate is not valid for 'sentry-read.svc.overdrive.com'. (_ssl.c:1006)>

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "calibre_plugins.overdrive_libby.workers", line 351, in run
synced_state = libby_client.sync()
^^^^^^^^^^^^^^^^^^^
File "calibre_plugins.overdrive_libby.libby.client" , line 631, in sync
res: Dict = self.send_request("chip/sync")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "calibre_plugins.overdrive_libby.libby.client" , line 556, in send_request
raise ClientConnectionError(
calibre_plugins.overdrive_libby.libby.errors.Clien tConnectionError: <calibre_plugins.overdrive_libby.libby.errors.Clie ntConnectionError; http_status=0, msg='URLError <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Hostname mismatch, certificate is not valid for 'sentry-read.svc.overdrive.com'. (_ssl.c:1006)>', error_response='''>

This appears to be some sort of an SSL certificate error.

Dave

PS: got this fixed with guidance from:
https://github.com/ping/libby-calibre-plugin/issues/33