[GUI Plugin] Overdrive Link - Page 53

seacity1 · 03-13-2017, 06:12 PM

Thanks!

Must have just happened today as was fine last night.

kenmac999 · 03-13-2017, 07:22 PM

It looks like the change is only affecting searches on new style OverDrive sites.

Here is my log after searching against 1 old style and 1 new style site.

Code:

Overdrive Link found: 1 error in searching. (click "View log" for details). 1 book/library link to be added





Key: *=Discovered book, @=Available at, !=Recommendable at, $=Purchasable at, #=Audiobook

---------------- ERRORS WHILE SEARCHING  ----------------

Search Pioneer Library for shards by lynn flewelling: : Server response error (missing "div class=(?=.*?\bmedia-container\b)(?=.*?\bloaded\b)^.*$")

------ NEWLY FOUND BOOK/LIBRARY LINKS (TO BE ADDED) ------

Shards of Time by Lynn Flewelling (@AF Library)





Starting job: Search for books by 1 author 
Overdrive Link 2.10.0, calibre 2.81.0 
Search formats: Adobe EPUB eBook, Adobe PDF eBook, Kindle Book, MP3 Audiobook, Mobipocket eBook, Open EPUB eBook, Open PDF eBook, OverDrive MP3 Audiobook 
================================================= 
Finding library books by Lynn Flewelling 
Accessing library Pioneer Library 
Get http://pioneerok.overdrive.com/ 
Redirected to https://pioneerok.overdrive.com/ 
new OverDrive site layout detected for Pioneer Library 
Get https://pioneerok.overdrive.com/acco...untMenu%3Dtrue 
Signing in to Pioneer Library (Pioneer Library System) 
Post https://pioneerok.auth.overdrive.com...942a78d5c68314 
Data username=21698002789622&signIn=7e2d2565619ef5b8b0942a78d5c68314&CaptchaBypass=%2FsBADnms4sQpwQ6HtTqffOktrcBNku3Znb93G6tPcX3sMdy3AsPhMn2FhR6MawwS36Znv4GC4HCaoisTW2P0CwMVuyg%3D&serverData=&websiteId=296&password={REMOVED}&formId=301e96ce-ced6-48ab-b862-2af42cf6120f&ilsName=pioneerok&librarylogin=true&idsrv.xsrf=7YfNr4ikoxbBPz_U0r-0YseowYbjvyRqMht4piN3H1uaQdAzdz_vUugjE79gq_nQxwF7lY0P9zjFvkvSvCgzoqC9wzs 
Post https://pioneerok.overdrive.com/acco...gn-in/complete 
Data code=2751c549548150d2475e8c5794354379&state=10722239698673582&session_state=9rSnMS623rbKTEK4hbNsbZSsWR3FPCil1LQIlkVxl4E.80c684fc31a3ac5ac30b3da4ebbebea9 
Sign in successful 
Get https://pioneerok.overdrive.com/advanced-search 
Search for recommendable books is supported by Pioneer Library 
Sign in took 41.2 sec 
Search Pioneer Library for shards by lynn flewelling 
Get https://pioneerok.overdrive.com/sear...AND+flewelling 
Response: page 1 of 1. 1 total results 
Search Pioneer Library for shards by lynn flewelling: : Server response error (missing "div class=(?=.*?\bmedia-container\b)(?=.*?\bloaded\b)^.*$") 
Traceback (most recent call last):
  File "calibre_plugins.overdrive_link.jobs", line 916, in find_book_at_lib
  File "calibre_plugins.overdrive_link.overdrive", line 739, in find_books
  File "calibre_plugins.overdrive_link.parseweb", line 244, in must_find
LibraryError: u'missing "div class=(?=.*?\\bmedia-container\\b)(?=.*?\\bloaded\\b)^.*$"'
 
Accessing library AF Library 
Get http://airforce.libraryreserve.com/ 
Redirected to https://airforce.libraryreserve.com/...en/Default.htm 
Legacy OverDrive site layout detected for AF Library 
Signing in to AF Library (branch 6) 
Browse: http://airforce.libraryreserve.com/B...rceLoginFlag=0 None 
Redirected login url https://airforce.libraryreserve.com/...=Default%2ehtm 
Browse: https://airforce.libraryreserve.com/...=Default%2ehtm None 
Browse: submit "BANGAuthenticate.dll" 
Sign in successful 
Get http://airforce.libraryreserve.com/AdvancedSearch.htm 
Search for recommendable books is supported by AF Library 
Sign in took 50.7 sec 
Search AF Library for shards by lynn flewelling 
Post https://airforce.libraryreserve.com/...esultsList.htm 
Data CollDate=&Publisher=&Subject=&AtosBooklevel=&contentmaturity=&PerPage=20&Language=&interestlevel=&GradeLevel=&ISBN=&availabilityoptions=&Format=&Lexilelevel=&Sort=SortBy%3DRelevancy&Award=&Title=%22shards%22&Creator=%22lynn+flewelling%22 
Response: page 1 of 1. 1 total results 
Found eBook: Shards of Time by Lynn Flewelling [Nightrunner [07], bac345e3-4c69-4436-9ab4-84c543faddb9@, @airforce.libraryreserve.com] 
Found 1 book in 7.2 sec 
Accessing library OpenLib 
Search OpenLib for shards by lynn flewelling 
Get https://openlibrary.org/search.json?...e&title=shards 
Found 0 books in 3.4 sec 
Accessing library KU 
Search KU for shards by lynn flewelling 
Get https://www.amazon.com/s/?url=node%3...d-title=shards 
Found 0 books in 4.2 sec 
================================================= 
Opening cache database /home/dad/.config/calibre/plugins/Overdrive Link Cache.db 
Opened in 0.0 sec. Cache is 483,328 bytes and contains 207 items. 
207 expired entries deleted from cache in 0.2 sec 
Getting info for bac345e3-4c69-4436-9ab4-84c543faddb9@AF Library 
Get https://airforce.libraryreserve.com/...4-84C543FADDB9 
Updated book info: Shards of Time by Lynn Flewelling [Nightrunner [07], bac345e3-4c69-4436-9ab4-84c543faddb9@, @airforce.libraryreserve.com, Adobe EPUB eBook|Kindle Book|OverDrive Read, 9780345546739, Random House Publishing Group, 2014-04-02T00:00:00+00:00] 
Closing cache database: 1 item added 
================================================= 
Matching 1 calibre book with 1 library book 
For "Shards of Time by Lynn Flewelling" found match "Shards of Time by Lynn Flewelling [Nightrunner [07], bac345e3-4c69-4436-9ab4-84c543faddb9@, @airforce.libraryreserve.com, Adobe EPUB eBook|Kindle Book|OverDrive Read, 9780345546739, Random House Publishing Group, 2014-04-02T00:00:00+00:00]" 
Found 1 matching calibre books in 0.0 sec

jhowell · 03-14-2017, 08:25 AM

Version 2.11.0 - 14 Mar 2017

Handle website changes at OverDrive. (Fixes "Server response error (missing "div class=(?=.*?\bmedia-container\b)(?=.*?\bloaded\b)^.*$")")

capnm · 03-14-2017, 11:06 AM

Hey, thanks for the quick update!

I remember when you started this, years ago, and I thought "What a great plugin, but it has to wither away because it will be a maintenance nightmare."

I'm delighted you proved me wrong.

Thank you for your tenacity over the years in keeping up with the moving targets Overdrive et al present.

seacity1 · 03-14-2017, 11:07 AM

Quote:

Originally Posted by jhowell

Version 2.11.0 - 14 Mar 2017

Handle website changes at OverDrive. (Fixes "Server response error (missing "div class=(?=.*?\bmedia-container\b)(?=.*?\bloaded\b)^.*$")")

Thanks so much for staying on top of OD & fixing this so quickly!

jhowell · 03-14-2017, 11:30 AM

You're welcome.

I developed the plugin because I wanted that functionality for myself and I plan to continue maintaining it as long as I have a use for it.

nabsltd · 03-19-2017, 10:21 PM

A book that was owned by the library no longer is, but the plugin didn't notice that. So, I deleted the cache, but that didn't help. So, I ran a search for the book at only the problem library to cut down on the clutter.

But, if you go to the page for that book at the library, you can see that it is not owned...it's only available for recommendation.

Here's the log:

Code:

Overdrive Link found: 1 book/library link to be added. 1 change to current availability





Key: *=Discovered book, @=Available at, !=Recommendable at, $=Purchasable at, #=Audiobook

------ NEWLY FOUND BOOK/LIBRARY LINKS (TO BE ADDED) ------

Devil's Waltz by Jonathan Kellerman (@MCPL)

------------- CHANGES TO CURRENT AVAILABILITY -------------

Devil's Waltz by Jonathan Kellerman (04@MCPL)





Starting job: Search for books by 1 author 
Overdrive Link 2.11.0, calibre 2.82.0 
Search language: English 
Search formats: Adobe EPUB eBook, Adobe PDF eBook, Kindle Book, Mobipocket eBook, Open EPUB eBook, Open PDF eBook 
================================================= 
Finding library books by Jonathan Kellerman 
Accessing library MCPL 
Get http://maryland.overdrive.com/ 
Redirected to https://maryland.overdrive.com/ 
new OverDrive site layout detected for MCPL 
Get https://maryland.overdrive.com/account/sign-in?forward=%2F%3FopenAccountMenu%3Dtrue 
Signing in to MCPL branch ID 21846 (Montgomery County Public Library) 

[snipped login]

Post https://maryland.overdrive.com/account/sign-in/complete 
Data session_state=Uw1tiYXWAd0vIhHaqwgVpU-X_kgsCMI6pw7zqcuLiQM.0934bbdbe5c2749b562acc9164c04fd2&state=20084927818742676&code=52d7dade820d4e6d436bd70ef420eaec 
Sign in successful 
Get https://maryland.overdrive.com/advanced-search 
Search for recommendable books is supported by MCPL 
Sign in took 12.8 sec 
Search MCPL for waltz by jonathan kellerman 
Get https://maryland.overdrive.com/search?creator=jonathan+AND+kellerman&language=en&query=waltz&mediaType=ebook&sortBy=relevancy 
Response: page 1 of 1. 1 total results 
Found: Devil's Waltz by Jonathan Kellerman [Alex Delaware [07], 34631@, @maryland.overdrive.com] 
Found 1 book in 2.5 sec 
================================================= 
Cache creation disabled by user 
Getting info for 34631@MCPL 
Get https://maryland.overdrive.com/media/34631 
Updated book info: Devil's Waltz by Jonathan Kellerman [Alex Delaware [07], 34631@, @maryland.overdrive.com, Adobe EPUB eBook|Adobe PDF eBook|Kindle Book|OverDrive Read, 9780345463791, Random House Publishing Group, 2003-05-20T04:00:00+00:00, English] 
================================================= 
Matching 1 calibre book with 1 library book 
For "Devil's Waltz by Jonathan Kellerman" found match "Devil's Waltz by Jonathan Kellerman [Alex Delaware [07], 34631@, @maryland.overdrive.com, Adobe EPUB eBook|Adobe PDF eBook|Kindle Book|OverDrive Read, 9780345463791, Random House Publishing Group, 2003-05-20T04:00:00+00:00, English]" 
Found 1 matching calibre books in 0.0 sec 
================================================= 
Updating current availability for 1 books with newly found available links 
================================================= 
Getting current availability of Devil's Waltz by Jonathan Kellerman 
Get https://maryland.overdrive.com/account/holds 
Holds: 217927, 148258, 218033, 217988, 2903024, 318629 
Get https://maryland.overdrive.com/account/loans 
Loans: 663099, 592302, 256421, 288745 
found 34631 in media data cache 
Calculated 4 week wait at MCPL: library_copies=1 number_waiting_overall=1

jhowell · 03-20-2017, 08:37 AM

Quote:

Originally Posted by nabsltd

A book that was owned by the library no longer is, but the plugin didn't notice that. So, I deleted the cache, but that didn't help. So, I ran a search for the book at only the problem library to cut down on the clutter.

But, if you go to the page for that book at the library, you can see that it is not owned...it's only available for recommendation.

I did the same search and it works for me, showing that book as not available at that library.

The only relevant difference is that you have supplied credentials for that library to the plugin allowing it to sign in. Sometimes a book can only be seen as available when signed in if it is owned by a member library that is part of a consortium. Could you sign in to your library and make sure that this is not the case for this book?

If you still see the book as unavailable even when signed in then I will need to add some additional logging to the plugin and have you test it again since I cannot duplicate the problem myself.

nabsltd · 03-21-2017, 06:33 PM

Quote:

Originally Posted by jhowell

The only relevant difference is that you have supplied credentials for that library to the plugin allowing it to sign in. Sometimes a book can only be seen as available when signed in if it is owned by a member library that is part of a consortium. Could you sign in to your library and make sure that this is not the case for this book?

It was definitely a sign-in issue of some sort on the Overdrive end.

I was signed in, but something apparently was screwed up with the server, and it only sort of thought I was logged in. I had all the normal "logged in" features (like my borrowed books, etc.) visible, but this and some other books showed as not owned by the library.

I had to manually log out and back in again for the browser to show the correct information. Your plugin obviously saw the correct information (the book was owned but checked out by somebody else), so I suspect you'll see more issues like this as time goes on, since Overdrive no longer seems to make you log in again if you check "remember me", but eventually something in the browser/server connection screws up.

nabsltd · 03-29-2017, 10:59 PM

I have "EPUB", "Mobi/Kindle", and "PDF" checked as the only formats to find, but the following book was found even though none of those formats are available:

https://fairfax.overdrive.com/media/428839

It's only available as "Overdrive Read", which should be found only if "Other app/viewer" is checked.

jhowell · 03-30-2017, 08:37 AM

Quote:

Originally Posted by nabsltd

It's only available as "Overdrive Read", which should be found only if "Other app/viewer" is checked.

That problem is a result of design decisions I made in developing the plugin and isn't going to be fixed.

For better search performance the plugin caches information for the same book across multiple OverDrive libraries and over time. It is assumed that all libraries will have the same formats available for each book and that the available formats will not change over time. This is true for most books, but it seems the Project Gutenberg books at the Fairfax County Public Library are an exception. The book you mentioned, Deathworld by Harry Harrison, is available in only OverDrive Read at Fairfax County, but the same book is also available in Open EPUB at other libraries, such as the Orange County Library System.

You can work around the problem yourself, but it will slow things down. You would need to disable caching by setting "Days to cache library book info" to zero in the plugin configuration. You would also need to do each search with only one library at a time enabled in the plugin configuration.

ETA: The next version of the plugin will prevent sharing information for the same book across lending libraries if the cache is disabled. This will prevent the need to search each lending library individually. (You will still need to disable caching.)

thebabycub · 04-13-2017, 04:31 AM

Hi, I have just enabled Audible search with the library-ID 'store' and am getting the following error:

Quote:

Overdrive Link found: 1 error in searching. (click "View log" for details). 1 book/library link to be added

Key: *=Discovered book, @=Available at, !=Recommendable at, $=Purchasable at, #=Audiobook

---------------- ERRORS WHILE SEARCHING ----------------

Search store.Audible for till by william shatner: : Server response error (missing "span class=adbl-results-index")

------ NEWLY FOUND BOOK/LIBRARY LINKS (TO BE ADDED) ------

Up Till Now: The Autobiography by William Shatner & David Fisher ($UK-AMZN, $US-AMZN)

Search for books by 1 author
Overdrive Link 2.11.0, calibre 2.82.0
Search formats: Acoustik Audiobook, Adobe EPUB eBook, Adobe PDF eBook, Apple Audiobook, Audible Audiobook, Axis 360 Audio, Hoopla Audiobook, Kindle Book, MP3 Audiobook, Mobipocket eBook, OneClickdigital Audiobook, Open EPUB eBook, Open PDF eBook, OverDrive Listen, OverDrive MP3 Audiobook, OverDrive Read-along, OverDrive WMA Audiobook, Scribd Audiobook, WMA Audiobook
=================================================
Finding library books by William Shatner
Accessing library UK-AMZN
Search UK-AMZN for till by william shatner
Get https://www.amazon.co.uk/s/?fap=1&fi...de%3D341689031
Response: page 1 of 1. 1 total results
Found (k) Up Till Now [B003GVUPSC@ak, $ak/uk-store]
Found 1 book in 1.7 sec
Accessing library US-AMZN
Search US-AMZN for till by william shatner
Get https://www.amazon.com/s/?fap=1&fiel...de%3D154606011
Response: page 1 of 1. 1 total results
Found (k) Up Till Now [B003GVUPSC@ak, $ak/store]
Found 1 book in 1.6 sec
Accessing library read.OpenLibrary
Search read.OpenLibrary for till by william shatner
Get https://openlibrary.org/search.json?...ner&title=till
Found Up Till Now: The Autobiography by William Shatner [OL116036W@ol, @ol/read, 0312372655, St. Martin's Press, 2008-04-15T00:00:00+00:00]
Found 1 book in 1.3 sec
Accessing library store.Audible
Search store.Audible for till by william shatner
Get http://www.audible.com/search?search...illiam+shatner
Search store.Audible for till by william shatner: : Server response error (missing "span class=adbl-results-index")
Traceback (most recent call last):
File "calibre_plugins.overdrive_link.jobs", line 916, in find_book_at_lib
File "calibre_plugins.overdrive_link.audible", line 118, in find_books
File "calibre_plugins.overdrive_link.parseweb", line 244, in must_find
LibraryError: u'missing "span class=adbl-results-index"'

=================================================
Opening cache database C:\Users\theba\AppData\Roaming\calibre\plugins\Ove rdrive Link Cache.db
Opened in 0.0 sec. Cache is 306,176 bytes and contains 457 items.
Getting info for B003GVUPSC@US-AMZN
Get https://www.amazon.com/dp/B003GVUPSC
Updated book info: Up Till Now by William Shatner [B003GVUPSC@ak, $ak/store, Kindle Book, Pan, 2009-05-02T00:00:00+00:00, English]
Getting info for OL116036W@read.OpenLibrary
Get https://openlibrary.org/works/OL116036W
Getting info for B003GVUPSC@UK-AMZN
Get https://www.amazon.co.uk/dp/B003GVUPSC
Updated book info: Up Till Now by William Shatner [B003GVUPSC@ak, $ak/uk-store, Kindle Book, Pan, 2009-05-02T00:00:00+00:00, English]
Closing cache database: 3 items added
=================================================
Matching 1 calibre book with 3 library books
For "Up Till Now: The Autobiography by William Shatner & David Fisher" found match "Up Till Now by William Shatner [B003GVUPSC@ak, $ak/store, Kindle Book, Pan, 2009-05-02T00:00:00+00:00, English]"
For "Up Till Now: The Autobiography by William Shatner & David Fisher" found match "Up Till Now by William Shatner [B003GVUPSC@ak, $ak/uk-store, Kindle Book, Pan, 2009-05-02T00:00:00+00:00, English]"
For "Up Till Now: The Autobiography by William Shatner & David Fisher" found match "Up Till Now: The Autobiography by William Shatner [OL116036W@ol, @ol/read, 0312372655, St. Martin's Press, 2008-04-15T00:00:00+00:00]"
Found 1 matching calibre books in 0.0 sec

The should be found in the Amazon.com store as available as an audible "format".

--Andy

jhowell · 04-13-2017, 01:30 PM

Quote:

Originally Posted by thebabycub

Hi, I have just enabled Audible search with the library-ID 'store' and am getting the following error: ...

Your search at Audible is failing because they are redirecting it to audible.co.uk based on your location. In the next plugin release I will allow searches at audible.co.uk as a configuration option.

cc_in_oh · 04-20-2017, 05:29 AM

Any chance that a future update might include date-stamping the availability search results?

Thanks,
CC

compurandom · 04-20-2017, 07:28 AM

Overdrive has nice covers in it; the books from overdrive not so much.

Would it be possible to add an action or option to import the covers from overdrive?

03-29-2017, 10:59 PM	#790
nabsltd Fanatic Posts: 528 Karma: 9529956 Join Date: Aug 2013 Location: Hamden, CT Device: Kindle Paperwhite (11th gen), Scribe, Kindle 4 Touch	Book found at Overdrive with wrong format I have "EPUB", "Mobi/Kindle", and "PDF" checked as the only formats to find, but the following book was found even though none of those formats are available: https://fairfax.overdrive.com/media/428839 It's only available as "Overdrive Read", which should be found only if "Other app/viewer" is checked.

04-20-2017, 05:29 AM	#794
cc_in_oh Bob's my uncle Posts: 985 Karma: 17073086 Join Date: Jul 2016 Location: NE OH Device: Kindle	Humble suggestion Any chance that a future update might include date-stamping the availability search results? Thanks, CC

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
[GUI Plugin] KindleUnpack - The Plugin	DiapDealer	Plugins	527	08-15-2025 01:36 PM
[GUI Plugin] EpubSplit	JimmXinu	Plugins	459	07-31-2025 09:32 AM
[GUI Plugin] EpubMerge	JimmXinu	Plugins	560	06-09-2025 03:46 PM
[GUI Plugin] FanFictionDownLoader	JimmXinu	Plugins	3985	05-08-2015 11:18 PM
[GUI Plugin] Plugin Updater Deprecated	kiwidude	Plugins	159	06-19-2011 12:27 PM

03-13-2017, 06:12 PM	#781
seacity1 Zealot Posts: 139 Karma: 84296 Join Date: Nov 2012 Location: Florida Device: Samsung Galaxy 10.1 2014 Edition,Nook HD+, Nook Color, Nook ST & Ipad3	Thanks! Must have just happened today as was fine last night.

03-14-2017, 08:25 AM	#783
jhowell Grand Sorcerer Posts: 7,116 Karma: 92190133 Join Date: Nov 2011 Location: Charlottesville, VA Device: Kindles	Version 2.11.0 - 14 Mar 2017 Handle website changes at OverDrive. (Fixes "Server response error (missing "div class=(?=.?\bmedia-container\b)(?=.?\bloaded\b)^.*$")")

03-14-2017, 11:06 AM	#784
capnm Groupie Posts: 156 Karma: 10001 Join Date: Feb 2011 Device: sony	Hey, thanks for the quick update! I remember when you started this, years ago, and I thought "What a great plugin, but it has to wither away because it will be a maintenance nightmare." I'm delighted you proved me wrong. Thank you for your tenacity over the years in keeping up with the moving targets Overdrive et al present.

03-14-2017, 11:30 AM	#786
jhowell Grand Sorcerer Posts: 7,116 Karma: 92190133 Join Date: Nov 2011 Location: Charlottesville, VA Device: Kindles	You're welcome. I developed the plugin because I wanted that functionality for myself and I plan to continue maintaining it as long as I have a use for it.

04-20-2017, 07:28 AM	#795
compurandom Wizard Posts: 1,016 Karma: 500000 Join Date: Jun 2015 Device: Rocketbook, kobo aura h2o, kobo forma, kobo libra color	Overdrive has nice covers in it; the books from overdrive not so much. Would it be possible to add an action or option to import the covers from overdrive?