[GUI Plugin] Overdrive Link - Page 17

jhowell · 07-27-2014, 11:56 AM

Quote:

Originally Posted by LilyEvie

I think I have found another little quirk.

Night Terrors: The Ghost Stories of E.F. Benson by E. F. Benson & David Stuart Davies

When I click on that particular book to find other books by those two authors, OL seems to search for just books by just the first author listed - E.F. Benson and not the second - David Stuart Davies. The only way I can find books by David Stuart Davies is to add an empty book.

The plugin configuration setting "Max authors to search per book" defaults to 1. This means that unless you change that setting only the first author name for each book is used for searching. It is assumed that you have entered books in calibre with the primary author first.

Setting this value higher will cause more of the authors to be searched per book. Doing this will cause the plugin to find additional book matches occasionally, but can result in significantly longer search times.

At the moment this setting is not used for the discovery of additional books, not already in calibre. Only the first author is used for that. I will change this in the next plugin release so that book discovery will use multiple authors per book when "Max authors to search per book" is set greater than one.

Gunnerp245 · 08-03-2014, 07:55 AM

@jhowell

I recently joined the Kindle Unlimited 30-day offer and located several books with your plugin. However, the PI will not unlink them.

Stats:
calibre, version 1.47.0
Overdrive PI 1.16.0

Metadata:
IDs: odid:B00H3RF7QA@ak/prime&B00H3RF7QA@ak/unlimited

Error:

Spoiler:

Unlink works fine on local library notifications.

jhowell · 08-03-2014, 05:48 PM

Quote:

Originally Posted by Gunnerp245

@jhowell

I recently joined the Kindle Unlimited 30-day offer and located several books with your plugin. However, the PI will not unlink them.

I haven't been able to duplicate this problem.

It may be an issue with your configuration. The "unlink" function intentionally ignores libraries that are configured, but not enabled (checked in the first column). If that isn't the cause then let me know and I'll do more investigation.

Gunnerp245 · 08-03-2014, 08:54 PM

That would be the case. Did not realize if not enabled the books could not be unlink. Thanks.

jhowell · 08-04-2014, 08:24 AM

Quote:

Originally Posted by Gunnerp245

That would be the case. Did not realize if not enabled the books could not be unlink. Thanks.

It is implemented that way in order for the unlinking to be selectable by library, but it apparently isn't as intuitive as I hoped. I will add a note about this to the tooltip for the unlinking menu choice in the next plugin release to try to make the functionality more clear.

misc · 08-18-2014, 08:15 AM

First of all - jhowell - thank you *so* much for this completely life-changing plugin. It's incredible.

I'm greedy though and I want to add every catalog I can. I'm running into trouble with EBSCOhost. In my browser, I can get to it via this url: http://ezwx.ez.cwmars.org:58000/logi...aultdb=e700xna

I notice under authtype it says "ip,uid" so maybe this is some hybrid that the Overdrive plugin doesn't currently support?

In any case, by poking around the HTML source, I found this line close to the bottom of the main search page:

Code:

<!-- user: s8333660.main.ehost  -->

That was the only thing I could find that looked like the example EBSCOhost customer id/library-id listed in the help file.

I enter my library card and pin of course, as well. Here's what it looks like:

But when I try submitting, I get something like this:

Code:

Search for books by 1 author
Using lib=http://ezwx.ez.cwmars.org:58000/login?url=http://search.ebscohost.com/login.aspx?authtype=ip,uid&profile=ehost&defaultdb=e700xna authentication
Browse: http://ezwx.ez.cwmars.org:58000/login?url=http://search.ebscohost.com/login.aspx?authtype=ip,uid&profile=ehost&defaultdb=e700xna None
Browse: submit
Signing in to Websco: : Server response error (Sign in failed - unexpected url: http://web.b.ebscohost.com.ezwx.ez.cwmars.org:58000/ehost/search/basic?sid=0d895853-f2a4-45fc-81fe-27cd49d9da01@sessionmgr112&vid=0&tid=2003EB) 
Traceback (most recent call last):
  File "calibre_plugins.overdrive_link.jobs", line 1073, in sign_in
  File "calibre_plugins.overdrive_link.ebscohost", line 293, in sign_in
LibraryError: u'Sign in failed - unexpected url: http://web.b.ebscohost.com.ezwx.ez.cwmars.org:58000/ehost/search/basic?sid=0d895853-f2a4-45fc-81fe-27cd49d9da01@sessionmgr112&vid=0&tid=2003EB'
 
=================================================
Finding library books by Grace Palladino
Search Websco for all by grace palladino
Cannot perform search due to sign in failure
Found 0 books in 0.0 sec
=================================================
=================================================
Unmatched book (unchanged): Teenagers: An American History by Grace Palladino

I've also tried the following, and various permutations thereof:

Signing up for an EBSCO account and entering that username and password for the card number and pin.
The following identification options: cpid, custuid, ip, uid, and user.
Entering, after lib=, the search page that I get redirected to: http://web.a.ebscohost.com.ezwx.ez.c...d=0&tid=2003EB
Getting a new IP address by tethering my computer to my phone, in case the problem was EBSCOhost recognizing my IP (from my having logged in through a desktop browser) and letting me straight in, while the plugin expected to encounter a login prompt.

I'm out of ideas. Any suggestions?

jhowell · 08-18-2014, 01:16 PM

Quote:

Originally Posted by misc

First of all - jhowell - thank you *so* much for this completely life-changing plugin. It's incredible.
...
I'm out of ideas. Any suggestions?

I'm glad to hear that the plugin has been useful for you.

Setting it up to work with EBSCOhost can be difficult. Their authentication system is complex, with lots of possible variations. I wasn't able to test most of the possibilities with the few libraries I can access. It turns out that it doesn't properly handle the library you use.

Your library authenticates your credentials and then redirects your browser to EBSCOhost. You were correct in choosing lib= as the authentication type to be used by the plugin.

FYI: The authtype of "ip,uid" embedded in the url is part of what your library passes to EBSCOhost and isn't directly relevant to configuring the plugin. ("ip" mean access is allowed for anyone connecting from a computer with an IP address registered as being located at the library. "uid" is the authentication type used otherwise.)

The comment you found on the web page, "user: s8333660.main.ehost", indicates that the customer id of your library is s8333660, so that is what you should use as the library-id in the plugin configuration.

Looking at the log from the plugin, from the error message it appears that the login was actually successful, but the plugin did not recognize it properly. The plugin expects that it will be redirected to a host name ending in ebscohost.com, but in your case the redirected host was web.b.ebscohost.com.ezwx.ez.cwmars.org:58000.
I will update the plugin in the next few days to (hopefully) handle cases like this.

You may be able to work around the problem by signing in to EBSCOhost directly instead of through your library. To do this change the plugin configuration from lib=... to uid (just those three characters). It is not certain to work, but is worth a try.

jhowell · 08-20-2014, 02:07 PM

Version 1.17.0 - 20 Aug 2014

Allow discovery of books based on multiple authors of selected books (instead of just the first author of each book) when "Max authors to search per book" is set greater than one.

Sort e-book links before audiobook links in search results and discovered book table.

Handle EBSCOhost access via a proxy URL.

Minor bug fixes and internal improvements.

misc · 08-20-2014, 03:31 PM

Thanks for the quick turnaround! It's still not working unfortunately. I'm getting a new error now:

Code:

Using lib=http://ezwx.ez.cwmars.org:58000/login?url=http://search.ebscohost.com/login.aspx?authtype=ip,uid&profile=ehost&defaultdb=e700xna authentication
Browse: http://ezwx.ez.cwmars.org:58000/logi...aultdb=e700xna None
Browse: submit
Redirected to http://web.a.ebscohost.com.ezwx.ez.c...d=0&tid=2003EB
cookiejar: &lt;cookielib.CookieJar[&lt;Cookie ezproxy=HhEi2UTNRAlKyxR for .ez.cwmars.org/&gt;, &lt;Cookie BIGipServersdc-web_80=673317898.20480.0000 for web.a.ebscohost.com.ezwx.ez.cwmars.org/&gt;, &lt;Cookie EHost2=sid=bf2aaadc-4972-4d79-868c-51f2aa55eab6@sessionmgr4004&amp;k2=dGJyMPGusUuxrLRIrOPfgeyk44Dt6fIA&amp;k3=dGJyMOPmtUq0qrFI&amp;k4=ehost&amp;k6=en&amp;k7=live&amp;k8=DS:live for web.a.ebscohost.com.ezwx.ez.cwmars.org/&gt;]&gt;
<span style="color:red">Signing in to Worsco: : ValueError (Failed to find sign in cookie) </span>
<span style="color:green">Traceback (most recent call last):
  File "calibre_plugins.overdrive_link.jobs", line 1031, in sign_in
  File "calibre_plugins.overdrive_link.ebscohost", line 323, in sign_in
ValueError: Failed to find sign in cookie
 </span>

jhowell · 08-20-2014, 05:22 PM

Quote:

Originally Posted by misc

Thanks for the quick turnaround! It's still not working unfortunately. I'm getting a new error now...

It looks like your library's proxy is blocking cookies from EBSCOhost. I have made a patch to the plugin that should handle this.

It may take a few iterations to get this working since I am unable to test it myself. I am attaching a test version of the plugin to this post. You can download it and install to calibre using Preferences -> Plugins -> Load plugin from file.

misc · 08-21-2014, 07:33 AM

Happy to help you test this and work out the kinks. Definitely getting closer!

We seem to have cleared the sign in hump. But my queries were consistently returning 0 results. For example:

Code:

Search for books by 1 author
Using lib=http://ezwx.ez.cwmars.org:58000/login?url=http://search.ebscohost.com/login.aspx?authtype=ip,uid&profile=ehost&defaultdb=e700xna authentication
Browse: http://ezwx.ez.cwmars.org:58000/logi...aultdb=e700xna None
Browse: submit
Redirected to http://web.b.ebscohost.com.ezwx.ez.c...d=0&tid=2003EB
Sign in successful
Sign in took 13.0 sec
=================================================
Finding library books by Ray Bradbury
Search Worsco for writing by ray bradbury
Post http://web.b.ebscohost.com.ezwx.ez.c...0sessionmgr198
Data __EVENTARGUMENT=&RelRequestPath=search%2Fadvanced&__CUSTOMVIEWSTATE=...&searchMode=Bool&ajax=enabled&__sid=668cced0-72d8-4a0d-afa9-717c6035fc59%40sessionmgr198&SearchTerm=AU+%28ray+AND+bradbury%29+AND+TI+%28writing%29+AND+FM+%28E4+OR+EA+OR+E3+OR+EK+OR+EB%29+AND+LA+%28eng%29&__VIEWSTATE=&__EVENTTARGET=
Found 0 books in 7.4 sec
=================================================
=================================================
Unmatched book (unchanged): Zen in the Art of Writing by Ray Bradbury

This struck me as suspicious - I could blame it on a thin catalog, but I wanted to at least establish that it could find *something*.

My next thought was to try a keyword discovery search.

Code:

Search for books by 1 author
Using lib=http://ezwx.ez.cwmars.org:58000/login?url=http://search.ebscohost.com/login.aspx?authtype=ip,uid&profile=ehost&defaultdb=e700xna authentication
Browse: http://ezwx.ez.cwmars.org:58000/logi...aultdb=e700xna None
Browse: submit
Redirected to http://web.a.ebscohost.com.ezwx.ez.c...d=0&tid=2003EB
Sign in successful
=================================================
Search Worsco for adhd by all
Post http://web.a.ebscohost.com.ezwx.ez.c...sessionmgr4004
Data __EVENTARGUMENT=&RelRequestPath=search%2Fadvanced&__CUSTOMVIEWSTATE=...&searchMode=Bool&ajax=enabled&__sid=2239ff14-7f6f-4ed5-8ed4-bdf1093f8d15%40sessionmgr4004&SearchTerm=TI+%28adhd%29+AND+FM+%28E4+OR+EA+OR+E3+OR+EK+OR+EB%29+AND+LA+%28eng%29&__VIEWSTATE=&__EVENTTARGET=
Response: page 1 of 3. 1-10 of 29 total results
Get http://web.a.ebscohost.com.ezwx.ez.c...eResultListId=
Search Worsco for adhd by all: Retrying web.a.ebscohost.com.ezwx.ez.cwmars.org on exception URLError ([Errno 61] Connection refused) 
Search Worsco for adhd by all: Retrying web.a.ebscohost.com.ezwx.ez.cwmars.org on exception URLError ([Errno 61] Connection refused) 
Search Worsco for adhd by all: : URLError ([Errno 61] Connection refused) 
Traceback (most recent call last):
  File "calibre_plugins.overdrive_link.jobs", line 1006, in find_books_at_lib
  File "calibre_plugins.overdrive_link.ebscohost", line 581, in find_books
  File "calibre_plugins.overdrive_link.net", line 144, in open_url
  File "lib/python2.7/urllib2.py", line 404, in open
  File "lib/python2.7/urllib2.py", line 422, in _open
  File "lib/python2.7/urllib2.py", line 382, in _call_chain
  File "lib/python2.7/urllib2.py", line 1214, in http_open
  File "lib/python2.7/urllib2.py", line 1184, in do_open
URLError: 
 
=================================================
=================================================

Interesting. Was the library blocking my IP for submitting too many queries too quickly? No - I checked to see if the catalog would load in Chrome, and it did.

Looking at the website gave me a new idea for something to test. Maybe my query for ADHD was too broad, and was exceeding some cap on the number of results? I picked the first featured book I saw on the front page, and used its title and author to create an empty "dummy" book in Calibre. Here's what happened when I searched for that:

Code:

Search for books by 1 author
Using lib=http://ezwx.ez.cwmars.org:58000/login?url=http://search.ebscohost.com/login.aspx?authtype=ip,uid&profile=ehost&defaultdb=e700xna authentication
Browse: http://ezwx.ez.cwmars.org:58000/logi...aultdb=e700xna None
Browse: submit
Redirected to http://web.a.ebscohost.com.ezwx.ez.c...d=0&tid=2003EB
Sign in successful
Sign in took 14.4 sec
=================================================
Finding library books by Jared Koch
Search Worsco for all by jared koch
Post http://web.a.ebscohost.com.ezwx.ez.c...sessionmgr4001
Data __EVENTARGUMENT=&RelRequestPath=search%2Fadvanced&__CUSTOMVIEWSTATE=...&searchMode=Bool&ajax=enabled&__sid=3319faac-6d92-442d-9db0-cdfbd07e55c8%40sessionmgr4001&SearchTerm=AU+%28jared+AND+koch%29+AND+FM+%28E4+OR+EA+OR+E3+OR+EK+OR+EB%29+AND+LA+%28eng%29&__VIEWSTATE=&__EVENTTARGET=
Response: page 1 of 1. 1-3 of 3 total results
Get http://web.a.ebscohost.com.ezwx.ez.c...eResultListId=
Search Worsco for all by jared koch: Retrying web.a.ebscohost.com.ezwx.ez.cwmars.org on exception URLError ([Errno 61] Connection refused) 
Search Worsco for all by jared koch: Retrying web.a.ebscohost.com.ezwx.ez.cwmars.org on exception URLError ([Errno 61] Connection refused) 
Search Worsco for all by jared koch: : URLError ([Errno 61] Connection refused) 
Traceback (most recent call last):
  File "calibre_plugins.overdrive_link.jobs", line 1006, in find_books_at_lib
  File "calibre_plugins.overdrive_link.ebscohost", line 581, in find_books
  File "calibre_plugins.overdrive_link.net", line 144, in open_url
  File "lib/python2.7/urllib2.py", line 404, in open
  File "lib/python2.7/urllib2.py", line 422, in _open
  File "lib/python2.7/urllib2.py", line 382, in _call_chain
  File "lib/python2.7/urllib2.py", line 1214, in http_open
  File "lib/python2.7/urllib2.py", line 1184, in do_open
URLError: 
 
=================================================
=================================================
Unmatched book (unchanged): The Clean Plates Cookbook : Sustainable, Delicious, and Healthier Eating for Every Body by Jared Koch

Hope this has been useful information! Thanks again.

jhowell · 08-21-2014, 05:05 PM

Quote:

Originally Posted by misc

Happy to help you test this and work out the kinks. Definitely getting closer!

We seem to have cleared the sign in hump. But my queries were consistently returning 0 results.
...
Hope this has been useful information! Thanks again.

The plugin makes queries to EBSCOhost for books and when results are returned it makes another query for each one to get that book's details. The software for this second query didn't take into account the non-standard port number used by your library. I am attaching another test release that should take care of this.

EBSCOhost collections are weighted heavily toward academic titles rather than popular ones. Results may be sparse compared with other providers, such as OverDrive. However, I would like to be made aware of any cases when a book known to be in an EBSCOhost collection is not found by the plugin.

JSWolf · 08-21-2014, 11:38 PM

Has this been fixed to work with the new Qt5 Calibre 2.0 due out tomorrow? I've been thinking of giving this a try, but unless it;s Qt5 ready, I won't be able to use it.

GoSharks · 08-22-2014, 12:11 AM

Quote:

Originally Posted by JSWolf

Has this been fixed to work with the new Qt5 Calibre 2.0 due out tomorrow? I've been thinking of giving this a try, but unless it;s Qt5 ready, I won't be able to use it.

Kovid has a list here...

misc · 08-22-2014, 11:51 AM

Quote:

Originally Posted by jhowell

I am attaching another test release that should take care of this.

It works! Smooth as butter. You rock.

08-03-2014, 07:55 AM	#242
Gunnerp245 Gadget Freak Posts: 1,169 Karma: 1043832 Join Date: Nov 2007 Location: US Device: EE, Note 8	Not unlinking. @jhowell I recently joined the Kindle Unlimited 30-day offer and located several books with your plugin. However, the PI will not unlink them. Stats: calibre, version 1.47.0 Overdrive PI 1.16.0 Metadata: IDs: odid:B00H3RF7QA@ak/prime&B00H3RF7QA@ak/unlimited Error: Spoiler: Overdrive Link: Search complete: <p>Overdrive Link found: 1 book/library link unchanged<p>No changes will be made. (Key: *=Discovered book, @=Available at, !=Recommendable at, $=Purchasable at, #=Audiobook) -------------------- UNCHANGED LINKS --------------------- Luna Park by Blackwood, Heather (@PRIME.AK, @UNLIMITED.AK) Unlink works fine on local library notifications.

08-18-2014, 08:15 AM	#246
misc Junior Member Posts: 5 Karma: 10 Join Date: May 2014 Device: iPad	First of all - jhowell - thank you so much for this completely life-changing plugin. It's incredible. I'm greedy though and I want to add every catalog I can. I'm running into trouble with EBSCOhost. In my browser, I can get to it via this url: http://ezwx.ez.cwmars.org:58000/logi...aultdb=e700xna I notice under authtype it says "ip,uid" so maybe this is some hybrid that the Overdrive plugin doesn't currently support? In any case, by poking around the HTML source, I found this line close to the bottom of the main search page: Code: <!-- user: s8333660.main.ehost --> That was the only thing I could find that looked like the example EBSCOhost customer id/library-id listed in the help file. I enter my library card and pin of course, as well. Here's what it looks like: But when I try submitting, I get something like this: Code: Search for books by 1 author Using lib=http://ezwx.ez.cwmars.org:58000/login?url=http://search.ebscohost.com/login.aspx?authtype=ip,uid&profile=ehost&defaultdb=e700xna authentication Browse: http://ezwx.ez.cwmars.org:58000/login?url=http://search.ebscohost.com/login.aspx?authtype=ip,uid&profile=ehost&defaultdb=e700xna None Browse: submit Signing in to Websco: : Server response error (Sign in failed - unexpected url: http://web.b.ebscohost.com.ezwx.ez.cwmars.org:58000/ehost/search/basic?sid=0d895853-f2a4-45fc-81fe-27cd49d9da01@sessionmgr112&vid=0&tid=2003EB) Traceback (most recent call last): File "calibre_plugins.overdrive_link.jobs", line 1073, in sign_in File "calibre_plugins.overdrive_link.ebscohost", line 293, in sign_in LibraryError: u'Sign in failed - unexpected url: http://web.b.ebscohost.com.ezwx.ez.cwmars.org:58000/ehost/search/basic?sid=0d895853-f2a4-45fc-81fe-27cd49d9da01@sessionmgr112&vid=0&tid=2003EB' ================================================= Finding library books by Grace Palladino Search Websco for all by grace palladino Cannot perform search due to sign in failure Found 0 books in 0.0 sec ================================================= ================================================= Unmatched book (unchanged): Teenagers: An American History by Grace Palladino I've also tried the following, and various permutations thereof: Signing up for an EBSCO account and entering that username and password for the card number and pin. The following identification options: cpid, custuid, ip, uid, and user. Entering, after lib=, the search page that I get redirected to: http://web.a.ebscohost.com.ezwx.ez.c...d=0&tid=2003EB Getting a new IP address by tethering my computer to my phone, in case the problem was EBSCOhost recognizing my IP (from my having logged in through a desktop browser) and letting me straight in, while the plugin expected to encounter a login prompt. I'm out of ideas. Any suggestions? Attached Thumbnails

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
[GUI Plugin] KindleUnpack - The Plugin	DiapDealer	Plugins	527	08-15-2025 01:36 PM
[GUI Plugin] EpubSplit	JimmXinu	Plugins	459	07-31-2025 09:32 AM
[GUI Plugin] EpubMerge	JimmXinu	Plugins	560	06-09-2025 03:46 PM
[GUI Plugin] FanFictionDownLoader	JimmXinu	Plugins	3985	05-08-2015 11:18 PM
[GUI Plugin] Plugin Updater Deprecated	kiwidude	Plugins	159	06-19-2011 12:27 PM

08-03-2014, 08:54 PM	#244
Gunnerp245 Gadget Freak Posts: 1,169 Karma: 1043832 Join Date: Nov 2007 Location: US Device: EE, Note 8	That would be the case. Did not realize if not enabled the books could not be unlink. Thanks.

08-20-2014, 02:07 PM	#248
jhowell Grand Sorcerer Posts: 7,109 Karma: 92190133 Join Date: Nov 2011 Location: Charlottesville, VA Device: Kindles	Version 1.17.0 - 20 Aug 2014 Allow discovery of books based on multiple authors of selected books (instead of just the first author of each book) when "Max authors to search per book" is set greater than one. Sort e-book links before audiobook links in search results and discovered book table. Handle EBSCOhost access via a proxy URL. Minor bug fixes and internal improvements.

08-21-2014, 11:38 PM	#253
JSWolf Resident Curmudgeon Posts: 79,965 Karma: 147448039 Join Date: Nov 2006 Location: Roslindale, Massachusetts Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3	Has this been fixed to work with the new Qt5 Calibre 2.0 due out tomorrow? I've been thinking of giving this a try, but unless it;s Qt5 ready, I won't be able to use it.