[Metadata Source Plugin] Goodreads - Page 42

Eskoe · 09-06-2022, 11:58 AM

I gave it a few test runs and it seems to be working perfectly! All of my books have the goodreads ID tag beforehand where possible, though the titles and author names were not always set. I also included a book I know was not on goodreads and an article off of JSTOR (because why not, I guess? lol) just to... see what would happen? And everything seems to work as expected. Thank you so much, kiwidude! Amazing and incredibly fast work. I'll attach the log just in case you're interested.

Spoiler:

kiwidude · 09-06-2022, 12:36 PM

Thanks for giving it a run so quickly Eskoe and your logs, very helpful. It allowed me to confirm that you were exclusively hitting the "old" html pages with all those books - i.e. they would have coincidentally still worked with the old 1.5.x plugin. So at least I know that side of things is still working well, I will wait a little longer for feedback from others before releasing in the hope they happen to hit the new code more.

Unfortunately there is no guaranteed way I found to force it to hit one version of the Goodreads book page over another at the moment (which made testing my changes a pain). It is genuinely a heads or tails coin flip every time. I had to sit there doing Download -> View Log -> Cancel over and over each time I wanted to test something with specific page variants...

Incidentally if you are bored/curious and want to know what to look for in the logs - if you see "_legacy" in those log files then it is the "old" website page design (e.g. "parse_isbn_legacy: xxxx"). Whereas with the new web page the log will just say "parse_isbn: xxxx". There are other lines in there which point out more explicitly but that is the quickest way to skim read the answer.

Terisa de morgan · 09-06-2022, 01:38 PM

kiwidude, on Saturday I'll be able to test at the computer that is showing the new page, so I think I can check it. I'll be back to you to know if it's the old or the new one.

Kabutak · 09-07-2022, 03:13 PM

Still getting a number of undefined/empty publisher and date entries with the new version. Not unexpected but worth noting. More concerning was getting a number of 403 errors when attempting to fetch the publisher information for a bunch of books. It's possible that I was just being rate limited or something since I was updating a bunch of entries (~50) at once, but figured I'd mention it.

Small excerpt from the logs:

Spoiler:

Full log from a second attempt where 49/50 failed. Worth noting that I have previously fetched the information for all of these successfully, I was just testing the new publish date fetching.

This log is much bigger, but mostly the same errors.

Spoiler:

Code:

#################### Log for Things Fall Apart ####################
Running identify query with parameters: 
{'title': 'Things Fall Apart', 'authors': ['Chinua Achebe'], 'identifiers': {'goodreads': '45361760', 'isbn': '9780141186887'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.32277560234069824 
identify - start. title=Things Fall Apart, authors=['Chinua Achebe'], identifiers={'goodreads': '45361760', 'isbn': '9780141186887'}
Goodreads book url: 'https://www.goodreads.com/book/show/45361760'
Failed to make details query: 'https://www.goodreads.com/book/show/45361760'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.41 seconds 
The longest time (0.322776) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Things Fall Apart 

#################### Log for Dirk Gently's Holistic Detective Agency ####################
Running identify query with parameters: 
{'title': "Dirk Gently's Holistic Detective Agency", 'authors': ['Douglas Adams'], 'identifiers': {'goodreads': '44231076', 'isbn': '9780671746728'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.2014310359954834 
identify - start. title=Dirk Gently's Holistic Detective Agency, authors=['Douglas Adams'], identifiers={'goodreads': '44231076', 'isbn': '9780671746728'}
Goodreads book url: 'https://www.goodreads.com/book/show/44231076'
Failed to make details query: 'https://www.goodreads.com/book/show/44231076'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.22 seconds 
The longest time (0.201431) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Dirk Gently's Holistic Detective Agency 

#################### Log for The Long Dark Tea-Time of the Soul ####################
Running identify query with parameters: 
{'title': 'The Long Dark Tea-Time of the Soul', 'authors': ['Douglas Adams'], 'identifiers': {'isbn': '9780671929268', 'goodreads': '6098314'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.23662137985229492 
identify - start. title=The Long Dark Tea-Time of the Soul, authors=['Douglas Adams'], identifiers={'isbn': '9780671929268', 'goodreads': '6098314'}
Goodreads book url: 'https://www.goodreads.com/book/show/6098314'
Failed to make details query: 'https://www.goodreads.com/book/show/6098314'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.41 seconds 
The longest time (0.236621) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for The Long Dark Tea-Time of the Soul 

#################### Log for The Ultimate Hitchhiker's Guide to the Galaxy ####################
Running identify query with parameters: 
{'title': "The Ultimate Hitchhiker's Guide to the Galaxy", 'authors': ['Douglas Adams'], 'identifiers': {'goodreads': '13', 'isbn': '9780345453747'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.23940324783325195 
identify - start. title=The Ultimate Hitchhiker's Guide to the Galaxy, authors=['Douglas Adams'], identifiers={'goodreads': '13', 'isbn': '9780345453747'}
Goodreads book url: 'https://www.goodreads.com/book/show/13'
Failed to make details query: 'https://www.goodreads.com/book/show/13'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.239403) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for The Ultimate Hitchhiker's Guide to the Galaxy 

#################### Log for The Hitchhiker's Guide to the Galaxy ####################
Running identify query with parameters: 
{'title': "The Hitchhiker's Guide to the Galaxy", 'authors': ['Douglas Adams'], 'identifiers': {'mobi-asin': 'B000XUBC2C', 'amazon': 'B000XUBC2C', 'goodreads': '42410904'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.21401429176330566 
identify - start. title=The Hitchhiker's Guide to the Galaxy, authors=['Douglas Adams'], identifiers={'mobi-asin': 'B000XUBC2C', 'amazon': 'B000XUBC2C', 'goodreads': '42410904'}
Goodreads book url: 'https://www.goodreads.com/book/show/42410904'
Failed to make details query: 'https://www.goodreads.com/book/show/42410904'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.214014) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for The Hitchhiker's Guide to the Galaxy 

#################### Log for The Restaurant at the End of the Universe ####################
Running identify query with parameters: 
{'title': 'The Restaurant at the End of the Universe', 'authors': ['Douglas Adams'], 'identifiers': {'goodreads': '39108567', 'amazon': 'B001ODEQCU'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.2283155918121338 
identify - start. title=The Restaurant at the End of the Universe, authors=['Douglas Adams'], identifiers={'goodreads': '39108567', 'amazon': 'B001ODEQCU'}
Goodreads book url: 'https://www.goodreads.com/book/show/39108567'
Failed to make details query: 'https://www.goodreads.com/book/show/39108567'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.228316) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for The Restaurant at the End of the Universe 

#################### Log for Life, the Universe and Everything ####################
Running identify query with parameters: 
{'title': 'Life, the Universe and Everything', 'authors': ['Douglas Adams'], 'identifiers': {'goodreads': '361', 'isbn': '9780345418906'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 1 results 
Downloading from Goodreads took 0.8305277824401855 


--- 
Title               : Life, the Universe and Everything
Author(s)           : Douglas Adams
Publisher           : Del Rey
Tags                : Science Fiction, Humour, Fantasy, Classics, Adventure
Series              : The Hitchhiker's Guide to the Galaxy #3
Languages           : eng
Rating              : 2.1
Published           : 1982-12-29T00:00:00+00:00
Identifiers         : goodreads:361, isbn:9780345418906
Comments            : 
The unhappy inhabitants of planet Krikkit are sick of looking at the night sky above their heads—so they plan to destroy it. The universe, that is. Now only five individuals stand between the killer robots of Krikkit and their goal of total annihilation.  
They are Arthur Dent, a mild-mannered space and time traveler who tries to learn how to fly by throwing himself at the ground and missing; Ford Prefect, his best friend, who decides to go insane to see if he likes it; Slartibartfast, the indomitable vice president of the Campaign for Real Time, who travels in a ship powered by irrational behavior; Zaphod Beeblebrox, the two-headed, three-armed ex-president of the galaxy; and Trillian, the sexy space cadet who is torn between a persistent Thunder God and a very depressed Beeblebrox. How will it all end? Will it end? Only this stalwart crew knows as they try to avert “universal” Armageddon and save life as we know it—and don’t know it!

--back cover
 
identify - start. title=Life, the Universe and Everything, authors=['Douglas Adams'], identifiers={'goodreads': '361', 'isbn': '9780345418906'}
Goodreads book url: 'https://www.goodreads.com/book/show/361'
Trying to parse book json for 2022 web page format
Page is legacy html format as NO Json found
parse_title: title_text='Life, the Universe and Everything'
parse_authors_legacy - author: Douglas Adams
parse_authors_legacy - author: Douglas Adams
parse_details - goodreads_id: 361, mi: Title               : Life, the Universe and Everything
Author(s)           : Douglas Adams
parse_series: series_text='(The Hitchhiker's Guide to the Galaxy #3)'
parse_series_legacy: series_name='The Hitchhiker's Guide to the Galaxy', series_index='3.0'
parse_rating_legacy: rating_value= 4.18
parse_language_legacy: Have language node
parse_language_legacy: raw= English
parse_language_legacy: ans= eng 

******************************************************************************** 
The identify phase took 1.02 seconds 
The longest time (0.830528) was taken by: Goodreads 
Merging results from different sources 
We have 1 merged results, merging took: 0.00 seconds 

#################### Log for So Long, and Thanks for All the Fish ####################
Running identify query with parameters: 
{'title': 'So Long, and Thanks for All the Fish', 'authors': ['Douglas Adams'], 'identifiers': {'isbn': '9780345391834', 'goodreads': '68354'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.23063135147094727 
identify - start. title=So Long, and Thanks for All the Fish, authors=['Douglas Adams'], identifiers={'isbn': '9780345391834', 'goodreads': '68354'}
Goodreads book url: 'https://www.goodreads.com/book/show/68354'
Failed to make details query: 'https://www.goodreads.com/book/show/68354'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.41 seconds 
The longest time (0.230631) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for So Long, and Thanks for All the Fish 

#################### Log for Mostly Harmless ####################
Running identify query with parameters: 
{'title': 'Mostly Harmless', 'authors': ['Douglas Adams'], 'identifiers': {'isbn': '9780345418777', 'goodreads': '360'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.25902628898620605 
identify - start. title=Mostly Harmless, authors=['Douglas Adams'], identifiers={'isbn': '9780345418777', 'goodreads': '360'}
Goodreads book url: 'https://www.goodreads.com/book/show/360'
Failed to make details query: 'https://www.goodreads.com/book/show/360'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.259026) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Mostly Harmless 

#################### Log for Watership Down ####################
Running identify query with parameters: 
{'title': 'Watership Down', 'authors': ['Richard Adams'], 'identifiers': {'isbn': '9780743277709', 'goodreads': '12147'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.23337197303771973 
identify - start. title=Watership Down, authors=['Richard Adams'], identifiers={'isbn': '9780743277709', 'goodreads': '12147'}
Goodreads book url: 'https://www.goodreads.com/book/show/12147'
Failed to make details query: 'https://www.goodreads.com/book/show/12147'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.233372) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Watership Down 

#################### Log for The Five People You Meet in Heaven ####################
Running identify query with parameters: 
{'title': 'The Five People You Meet in Heaven', 'authors': ['Mitch Albom'], 'identifiers': {'amazon': 'B000PLXEU2', 'goodreads': '40193713'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.26313114166259766 
identify - start. title=The Five People You Meet in Heaven, authors=['Mitch Albom'], identifiers={'amazon': 'B000PLXEU2', 'goodreads': '40193713'}
Goodreads book url: 'https://www.goodreads.com/book/show/40193713'
Failed to make details query: 'https://www.goodreads.com/book/show/40193713'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.41 seconds 
The longest time (0.263131) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for The Five People You Meet in Heaven 

#################### Log for Little Women ####################
Running identify query with parameters: 
{'title': 'Little Women', 'authors': ['Louisa May Alcott'], 'identifiers': {'isbn': '9780451529305', 'goodreads': '60869467'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.22522783279418945 
identify - start. title=Little Women, authors=['Louisa May Alcott'], identifiers={'isbn': '9780451529305', 'goodreads': '60869467'}
Goodreads book url: 'https://www.goodreads.com/book/show/60869467'
Failed to make details query: 'https://www.goodreads.com/book/show/60869467'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.41 seconds 
The longest time (0.225228) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Little Women 

#################### Log for The Divine Comedy, Vol. 1: Inferno ####################
Running identify query with parameters: 
{'title': 'The Divine Comedy, Vol. 1: Inferno', 'authors': ['Dante Alighieri'], 'identifiers': {'goodreads': '19155', 'isbn': '9780142437223'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.21733760833740234 
identify - start. title=The Divine Comedy, Vol. 1: Inferno, authors=['Dante Alighieri'], identifiers={'goodreads': '19155', 'isbn': '9780142437223'}
Goodreads book url: 'https://www.goodreads.com/book/show/19155'
Failed to make details query: 'https://www.goodreads.com/book/show/19155'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.217338) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for The Divine Comedy, Vol. 1: Inferno 

#################### Log for Prelude to Foundation ####################
Running identify query with parameters: 
{'title': 'Prelude to Foundation', 'authors': ['Isaac Asimov'], 'identifiers': {'goodreads': '415996', 'isbn': '9780385233132'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.2276453971862793 
identify - start. title=Prelude to Foundation, authors=['Isaac Asimov'], identifiers={'goodreads': '415996', 'isbn': '9780385233132'}
Goodreads book url: 'https://www.goodreads.com/book/show/415996'
Failed to make details query: 'https://www.goodreads.com/book/show/415996'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.41 seconds 
The longest time (0.227645) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Prelude to Foundation 

#################### Log for Forward the Foundation ####################
Running identify query with parameters: 
{'title': 'Forward the Foundation', 'authors': ['Isaac Asimov'], 'identifiers': {'goodreads': '9924408', 'isbn': '9780385481298'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.25704216957092285 
identify - start. title=Forward the Foundation, authors=['Isaac Asimov'], identifiers={'goodreads': '9924408', 'isbn': '9780385481298'}
Goodreads book url: 'https://www.goodreads.com/book/show/9924408'
Failed to make details query: 'https://www.goodreads.com/book/show/9924408'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.257042) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Forward the Foundation 

#################### Log for Foundation ####################
Running identify query with parameters: 
{'title': 'Foundation', 'authors': ['Isaac Asimov'], 'identifiers': {'isbn': '9780553900347', 'goodreads': '59363282'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.23356270790100098 
identify - start. title=Foundation, authors=['Isaac Asimov'], identifiers={'isbn': '9780553900347', 'goodreads': '59363282'}
Goodreads book url: 'https://www.goodreads.com/book/show/59363282'
Failed to make details query: 'https://www.goodreads.com/book/show/59363282'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.233563) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Foundation 

#################### Log for Foundation and Empire ####################
Running identify query with parameters: 
{'title': 'Foundation and Empire', 'authors': ['Isaac Asimov'], 'identifiers': {'isbn': '9780385423038', 'goodreads': '63706'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.20300555229187012 
identify - start. title=Foundation and Empire, authors=['Isaac Asimov'], identifiers={'isbn': '9780385423038', 'goodreads': '63706'}
Goodreads book url: 'https://www.goodreads.com/book/show/63706'
Failed to make details query: 'https://www.goodreads.com/book/show/63706'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.21 seconds 
The longest time (0.203006) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Foundation and Empire 

#################### Log for Second Foundation ####################
Running identify query with parameters: 
{'title': 'Second Foundation', 'authors': ['Isaac Asimov'], 'identifiers': {'goodreads': '29580', 'isbn': '9780553803730'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.23504924774169922 
identify - start. title=Second Foundation, authors=['Isaac Asimov'], identifiers={'goodreads': '29580', 'isbn': '9780553803730'}
Goodreads book url: 'https://www.goodreads.com/book/show/29580'
Failed to make details query: 'https://www.goodreads.com/book/show/29580'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.235049) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Second Foundation 

#################### Log for Foundation's Edge ####################
Running identify query with parameters: 
{'title': "Foundation's Edge", 'authors': ['Isaac Asimov'], 'identifiers': {'isbn': '9780553293388', 'goodreads': '76683'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.21731114387512207 
identify - start. title=Foundation's Edge, authors=['Isaac Asimov'], identifiers={'isbn': '9780553293388', 'goodreads': '76683'}
Goodreads book url: 'https://www.goodreads.com/book/show/76683'
Failed to make details query: 'https://www.goodreads.com/book/show/76683'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.217311) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Foundation's Edge 

#################### Log for Foundation and Earth ####################
Running identify query with parameters: 
{'title': 'Foundation and Earth', 'authors': ['Isaac Asimov'], 'identifiers': {'isbn': '9781439507223', 'goodreads': '3947794'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.20742273330688477 
identify - start. title=Foundation and Earth, authors=['Isaac Asimov'], identifiers={'isbn': '9781439507223', 'goodreads': '3947794'}
Goodreads book url: 'https://www.goodreads.com/book/show/3947794'
Failed to make details query: 'https://www.goodreads.com/book/show/3947794'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.21 seconds 
The longest time (0.207423) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Foundation and Earth 

#################### Log for The Blind Assassin ####################
Running identify query with parameters: 
{'title': 'The Blind Assassin', 'authors': ['Margaret Atwood'], 'identifiers': {'goodreads': '227614', 'isbn': '9780385720953'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.27343201637268066 
identify - start. title=The Blind Assassin, authors=['Margaret Atwood'], identifiers={'goodreads': '227614', 'isbn': '9780385720953'}
Goodreads book url: 'https://www.goodreads.com/book/show/227614'
Failed to make details query: 'https://www.goodreads.com/book/show/227614'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.41 seconds 
The longest time (0.273432) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for The Blind Assassin 

#################### Log for Oryx and Crake ####################
Running identify query with parameters: 
{'title': 'Oryx and Crake', 'authors': ['Margaret Atwood'], 'identifiers': {'isbn': '9780385503853', 'goodreads': '78435'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.19599699974060059 
identify - start. title=Oryx and Crake, authors=['Margaret Atwood'], identifiers={'isbn': '9780385503853', 'goodreads': '78435'}
Goodreads book url: 'https://www.goodreads.com/book/show/78435'
Failed to make details query: 'https://www.goodreads.com/book/show/78435'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.21 seconds 
The longest time (0.195997) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Oryx and Crake 

#################### Log for The Year of the Flood ####################
Running identify query with parameters: 
{'title': 'The Year of the Flood', 'authors': ['Margaret Atwood'], 'identifiers': {'goodreads': '6080337', 'isbn': '9780385528771'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.2059767246246338 
identify - start. title=The Year of the Flood, authors=['Margaret Atwood'], identifiers={'goodreads': '6080337', 'isbn': '9780385528771'}
Goodreads book url: 'https://www.goodreads.com/book/show/6080337'
Failed to make details query: 'https://www.goodreads.com/book/show/6080337'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.22 seconds 
The longest time (0.205977) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for The Year of the Flood 

#################### Log for Emma ####################
Running identify query with parameters: 
{'title': 'Emma', 'authors': ['Jane Austen'], 'identifiers': {'goodreads': '6969', 'isbn': '9780141439587'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.22802734375 
identify - start. title=Emma, authors=['Jane Austen'], identifiers={'goodreads': '6969', 'isbn': '9780141439587'}
Goodreads book url: 'https://www.goodreads.com/book/show/6969'
Failed to make details query: 'https://www.goodreads.com/book/show/6969'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.40 seconds 
The longest time (0.228027) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Emma 

#################### Log for Mansfield Park ####################
Running identify query with parameters: 
{'title': 'Mansfield Park', 'authors': ['Jane Austen'], 'identifiers': {'isbn': '9780141439808', 'goodreads': '45032'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.22606778144836426 
identify - start. title=Mansfield Park, authors=['Jane Austen'], identifiers={'isbn': '9780141439808', 'goodreads': '45032'}
Goodreads book url: 'https://www.goodreads.com/book/show/45032'
Failed to make details query: 'https://www.goodreads.com/book/show/45032'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.40 seconds 
The longest time (0.226068) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Mansfield Park 

#################### Log for Persuasion ####################
Running identify query with parameters: 
{'title': 'Persuasion', 'authors': ['Jane Austen'], 'identifiers': {'isbn': '9780192802637', 'goodreads': '2156'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.2532308101654053 
identify - start. title=Persuasion, authors=['Jane Austen'], identifiers={'isbn': '9780192802637', 'goodreads': '2156'}
Goodreads book url: 'https://www.goodreads.com/book/show/2156'
Failed to make details query: 'https://www.goodreads.com/book/show/2156'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.41 seconds 
The longest time (0.253231) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Persuasion 

#################### Log for Northanger Abbey ####################
Running identify query with parameters: 
{'title': 'Northanger Abbey', 'authors': ['Jane Austen'], 'identifiers': {'isbn': '9781593082642', 'goodreads': '50398'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.22179126739501953 
identify - start. title=Northanger Abbey, authors=['Jane Austen'], identifiers={'isbn': '9781593082642', 'goodreads': '50398'}
Goodreads book url: 'https://www.goodreads.com/book/show/50398'
Failed to make details query: 'https://www.goodreads.com/book/show/50398'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.41 seconds 
The longest time (0.221791) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Northanger Abbey 

#################### Log for Pride and Prejudice ####################
Running identify query with parameters: 
{'title': 'Pride and Prejudice', 'authors': ['Jane Austen'], 'identifiers': {'isbn': '9780553213102', 'goodreads': '84979'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.22204041481018066 
identify - start. title=Pride and Prejudice, authors=['Jane Austen'], identifiers={'isbn': '9780553213102', 'goodreads': '84979'}
Goodreads book url: 'https://www.goodreads.com/book/show/84979'
Failed to make details query: 'https://www.goodreads.com/book/show/84979'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.222040) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Pride and Prejudice 

#################### Log for Sense and Sensibility ####################
Running identify query with parameters: 
{'title': 'Sense and Sensibility', 'authors': ['Jane Austen'], 'identifiers': {'goodreads': '14935', 'isbn': '9780141439662'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.22228717803955078 
identify - start. title=Sense and Sensibility, authors=['Jane Austen'], identifiers={'goodreads': '14935', 'isbn': '9780141439662'}
Goodreads book url: 'https://www.goodreads.com/book/show/14935'
Failed to make details query: 'https://www.goodreads.com/book/show/14935'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.222287) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Sense and Sensibility 

#################### Log for The Winner ####################
Running identify query with parameters: 
{'title': 'The Winner', 'authors': ['David Baldacci'], 'identifiers': {'goodreads': '113138', 'isbn': '9780446522595'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.22896313667297363 
identify - start. title=The Winner, authors=['David Baldacci'], identifiers={'goodreads': '113138', 'isbn': '9780446522595'}
Goodreads book url: 'https://www.goodreads.com/book/show/113138'
Failed to make details query: 'https://www.goodreads.com/book/show/113138'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.228963) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for The Winner 

#################### Log for Crash ####################
Running identify query with parameters: 
{'title': 'Crash', 'authors': ['J. G. Ballard'], 'identifiers': {'isbn': '9780312420338', 'goodreads': '70241'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.26445603370666504 
identify - start. title=Crash, authors=['J. G. Ballard'], identifiers={'isbn': '9780312420338', 'goodreads': '70241'}
Goodreads book url: 'https://www.goodreads.com/book/show/70241'
Failed to make details query: 'https://www.goodreads.com/book/show/70241'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.41 seconds 
The longest time (0.264456) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Crash 

#################### Log for The Algebraist ####################
Running identify query with parameters: 
{'title': 'The Algebraist', 'authors': ['Iain M. Banks'], 'identifiers': {'goodreads': '535041'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.21527338027954102 
identify - start. title=The Algebraist, authors=['Iain M. Banks'], identifiers={'goodreads': '535041'}
Goodreads book url: 'https://www.goodreads.com/book/show/535041'
Failed to make details query: 'https://www.goodreads.com/book/show/535041'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.40 seconds 
The longest time (0.215273) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for The Algebraist 

#################### Log for Transition ####################
Running identify query with parameters: 
{'title': 'Transition', 'authors': ['Iain M. Banks'], 'identifiers': {'goodreads': '6436659', 'isbn': '9780316071987'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.21522140502929688 
identify - start. title=Transition, authors=['Iain M. Banks'], identifiers={'goodreads': '6436659', 'isbn': '9780316071987'}
Goodreads book url: 'https://www.goodreads.com/book/show/6436659'
Failed to make details query: 'https://www.goodreads.com/book/show/6436659'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.215221) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Transition 

#################### Log for Consider Phlebas ####################
Running identify query with parameters: 
{'title': 'Consider Phlebas', 'authors': ['Iain M. Banks'], 'identifiers': {'isbn': '9780316005388', 'goodreads': '535073'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.22389435768127441 
identify - start. title=Consider Phlebas, authors=['Iain M. Banks'], identifiers={'isbn': '9780316005388', 'goodreads': '535073'}
Goodreads book url: 'https://www.goodreads.com/book/show/535073'
Failed to make details query: 'https://www.goodreads.com/book/show/535073'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.223894) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Consider Phlebas 

#################### Log for The Player of Games ####################
Running identify query with parameters: 
{'title': 'The Player of Games', 'authors': ['Iain M. Banks'], 'identifiers': {'goodreads': '1260578', 'isbn': '9780316005401'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.21938085556030273 
identify - start. title=The Player of Games, authors=['Iain M. Banks'], identifiers={'goodreads': '1260578', 'isbn': '9780316005401'}
Goodreads book url: 'https://www.goodreads.com/book/show/1260578'
Failed to make details query: 'https://www.goodreads.com/book/show/1260578'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.41 seconds 
The longest time (0.219381) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for The Player of Games 

#################### Log for Use of Weapons ####################
Running identify query with parameters: 
{'title': 'Use of Weapons', 'authors': ['Iain M. Banks'], 'identifiers': {'isbn': '9780316030571', 'goodreads': '3395563'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.22285032272338867 
identify - start. title=Use of Weapons, authors=['Iain M. Banks'], identifiers={'isbn': '9780316030571', 'goodreads': '3395563'}
Goodreads book url: 'https://www.goodreads.com/book/show/3395563'
Failed to make details query: 'https://www.goodreads.com/book/show/3395563'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.222850) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Use of Weapons 

#################### Log for Excession ####################
Running identify query with parameters: 
{'title': 'Excession', 'authors': ['Iain M. Banks'], 'identifiers': {'goodreads': '12013', 'isbn': '9780553575378'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.23324990272521973 
identify - start. title=Excession, authors=['Iain M. Banks'], identifiers={'goodreads': '12013', 'isbn': '9780553575378'}
Goodreads book url: 'https://www.goodreads.com/book/show/12013'
Failed to make details query: 'https://www.goodreads.com/book/show/12013'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.41 seconds 
The longest time (0.233250) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Excession 

#################### Log for Inversions ####################
Running identify query with parameters: 
{'title': 'Inversions', 'authors': ['Iain M. Banks'], 'identifiers': {'isbn': '9781416583783', 'goodreads': '2356574'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.23295164108276367 
identify - start. title=Inversions, authors=['Iain M. Banks'], identifiers={'isbn': '9781416583783', 'goodreads': '2356574'}
Goodreads book url: 'https://www.goodreads.com/book/show/2356574'
Failed to make details query: 'https://www.goodreads.com/book/show/2356574'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.232952) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Inversions 

#################### Log for Look to Windward ####################
Running identify query with parameters: 
{'title': 'Look to Windward', 'authors': ['Iain M. Banks'], 'identifiers': {'isbn': '9780743421928', 'goodreads': '12016'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.23255252838134766 
identify - start. title=Look to Windward, authors=['Iain M. Banks'], identifiers={'isbn': '9780743421928', 'goodreads': '12016'}
Goodreads book url: 'https://www.goodreads.com/book/show/12016'
Failed to make details query: 'https://www.goodreads.com/book/show/12016'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.40 seconds 
The longest time (0.232553) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Look to Windward 

#################### Log for Matter ####################
Running identify query with parameters: 
{'title': 'Matter', 'authors': ['Iain M. Banks'], 'identifiers': {'isbn': '9780316005364', 'goodreads': '535072'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.21709656715393066 
identify - start. title=Matter, authors=['Iain M. Banks'], identifiers={'isbn': '9780316005364', 'goodreads': '535072'}
Goodreads book url: 'https://www.goodreads.com/book/show/535072'
Failed to make details query: 'https://www.goodreads.com/book/show/535072'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.217097) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Matter 

#################### Log for The Damnation Game ####################
Running identify query with parameters: 
{'title': 'The Damnation Game', 'authors': ['Clive Barker'], 'identifiers': {'goodreads': '8500820', 'isbn': '9780297787204'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.3011813163757324 
identify - start. title=The Damnation Game, authors=['Clive Barker'], identifiers={'goodreads': '8500820', 'isbn': '9780297787204'}
Goodreads book url: 'https://www.goodreads.com/book/show/8500820'
Failed to make details query: 'https://www.goodreads.com/book/show/8500820'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.41 seconds 
The longest time (0.301181) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for The Damnation Game 

#################### Log for The Fifth Dominion ####################
Running identify query with parameters: 
{'title': 'The Fifth Dominion', 'authors': ['Clive Barker'], 'identifiers': {'goodreads': '52629', 'isbn': '9780061094149'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.22299671173095703 
identify - start. title=The Fifth Dominion, authors=['Clive Barker'], identifiers={'goodreads': '52629', 'isbn': '9780061094149'}
Goodreads book url: 'https://www.goodreads.com/book/show/52629'
Failed to make details query: 'https://www.goodreads.com/book/show/52629'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.222997) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for The Fifth Dominion 

#################### Log for Big Trouble ####################
Running identify query with parameters: 
{'title': 'Big Trouble', 'authors': ['Dave Barry'], 'identifiers': {'goodreads': '7786694', 'isbn': '9780425239476'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.22235846519470215 
identify - start. title=Big Trouble, authors=['Dave Barry'], identifiers={'goodreads': '7786694', 'isbn': '9780425239476'}
Goodreads book url: 'https://www.goodreads.com/book/show/7786694'
Failed to make details query: 'https://www.goodreads.com/book/show/7786694'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.40 seconds 
The longest time (0.222358) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Big Trouble 

#################### Log for Jennifer Government ####################
Running identify query with parameters: 
{'title': 'Jennifer Government', 'authors': ['Max Barry'], 'identifiers': {'goodreads': '828160'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.22059893608093262 
identify - start. title=Jennifer Government, authors=['Max Barry'], identifiers={'goodreads': '828160'}
Goodreads book url: 'https://www.goodreads.com/book/show/828160'
Failed to make details query: 'https://www.goodreads.com/book/show/828160'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.220599) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Jennifer Government 

#################### Log for The Wonderful Wizard of Oz ####################
Running identify query with parameters: 
{'title': 'The Wonderful Wizard of Oz', 'authors': ['L. Frank Baum'], 'identifiers': {'goodreads': '60178', 'isbn': '9780451530295'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.20937085151672363 
identify - start. title=The Wonderful Wizard of Oz, authors=['L. Frank Baum'], identifiers={'goodreads': '60178', 'isbn': '9780451530295'}
Goodreads book url: 'https://www.goodreads.com/book/show/60178'
Failed to make details query: 'https://www.goodreads.com/book/show/60178'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.21 seconds 
The longest time (0.209371) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for The Wonderful Wizard of Oz 

#################### Log for Jaws ####################
Running identify query with parameters: 
{'title': 'Jaws', 'authors': ['Peter Benchley'], 'identifiers': {'isbn': '9780385047715', 'goodreads': '941281'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.21621274948120117 
identify - start. title=Jaws, authors=['Peter Benchley'], identifiers={'isbn': '9780385047715', 'goodreads': '941281'}
Goodreads book url: 'https://www.goodreads.com/book/show/941281'
Failed to make details query: 'https://www.goodreads.com/book/show/941281'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.216213) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Jaws 

#################### Log for The Demolished Man ####################
Running identify query with parameters: 
{'title': 'The Demolished Man', 'authors': ['Alfred Bester'], 'identifiers': {'goodreads': '317641', 'isbn': '9780679767817'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.21954703330993652 
identify - start. title=The Demolished Man, authors=['Alfred Bester'], identifiers={'goodreads': '317641', 'isbn': '9780679767817'}
Goodreads book url: 'https://www.goodreads.com/book/show/317641'
Failed to make details query: 'https://www.goodreads.com/book/show/317641'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.219547) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for The Demolished Man 

#################### Log for The Illustrated Man ####################
Running identify query with parameters: 
{'title': 'The Illustrated Man', 'authors': ['Ray Bradbury'], 'identifiers': {'isbn': '9780380973842', 'goodreads': '760920'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.25557565689086914 
identify - start. title=The Illustrated Man, authors=['Ray Bradbury'], identifiers={'isbn': '9780380973842', 'goodreads': '760920'}
Goodreads book url: 'https://www.goodreads.com/book/show/760920'
Failed to make details query: 'https://www.goodreads.com/book/show/760920'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.41 seconds 
The longest time (0.255576) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for The Illustrated Man 

#################### Log for Fahrenheit 451 ####################
Running identify query with parameters: 
{'title': 'Fahrenheit 451', 'authors': ['Ray Bradbury'], 'identifiers': {'isbn': '9780345342966', 'goodreads': '16280156'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.2190718650817871 
identify - start. title=Fahrenheit 451, authors=['Ray Bradbury'], identifiers={'isbn': '9780345342966', 'goodreads': '16280156'}
Goodreads book url: 'https://www.goodreads.com/book/show/16280156'
Failed to make details query: 'https://www.goodreads.com/book/show/16280156'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.42 seconds 
The longest time (0.219072) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for Fahrenheit 451 

#################### Log for The Blade Itself ####################
Running identify query with parameters: 
{'title': 'The Blade Itself', 'authors': ['Joe Abercrombie'], 'identifiers': {'goodreads': '944072', 'isbn': '9780575077867'}, 'timeout': 30} 
Using plugins: Goodreads (1, 6, 1) 
The log from individual plugins is below 

****************************** Goodreads (1, 6, 1) ****************************** 
Found 0 results 
Downloading from Goodreads took 0.20200610160827637 
identify - start. title=The Blade Itself, authors=['Joe Abercrombie'], identifiers={'goodreads': '944072', 'isbn': '9780575077867'}
Goodreads book url: 'https://www.goodreads.com/book/show/944072'
Failed to make details query: 'https://www.goodreads.com/book/show/944072'
Traceback (most recent call last):
  File "calibre_plugins.goodreads.worker", line 74, in get_details
  File "mechanize\_mechanize.py", line 241, in open_novisit
  File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class..httperror_seek_wrapper: HTTP Error 403: Forbidden 

******************************************************************************** 
The identify phase took 0.21 seconds 
The longest time (0.202006) was taken by: Goodreads 
Merging results from different sources 
We have 0 merged results, merging took: 0.00 seconds 
Failed to download metadata for The Blade Itself

kiwidude · 09-07-2022, 03:50 PM

Quote:

Originally Posted by Kabutak

Still getting a number of undefined/empty publisher and date entries with the new version. Not unexpected but worth noting. More concerning was getting a number of 403 errors when attempting to fetch the publisher information for a bunch of books. It's possible that I was just being rate limited or something since I was updating a bunch of entries (~50) at once, but figured I'd mention it.

That most definitely looks like rate limiting to me. I hit that with another private plugin I wrote recently against Goodreads which was trying to do stuff for books in bulk - I ended up putting wait delays into that plugin when dealing with multiple books. Which makes it run considerably slower but at least you could let it run in the background. If you do books one at a time then you are usually ok given the inevitable delay in between.

TBH downloading metadata in bulk is never something I have recommended to anyone nor ever do myself - because there are too many cases where the goodreads search engine will suggest the wrong book as the first match and you won't catch it if you are not looking at them one by one. Yup it is slower/more clicks etc but you only need to do it once for each book and it is there forever "correct" rather than a mess you have to clean up later of fixing tags, series, covers, description etc...

If you have any specific examples (goodreads ids ideally) of books that are missing publisher/date data that you can see the info on the page please PM them through to me and I can figure it out. The "joy" of html web scraping is that there are no rules that we can rely on the website authors following, there are always special cases we have to deal with...

Kabutak · 09-07-2022, 04:36 PM

Quote:

Originally Posted by kiwidude

TBH downloading metadata in bulk is never something I have recommended to anyone nor ever do myself - because there are too many cases where the goodreads search engine will suggest the wrong book as the first match and you won't catch it if you are not looking at them one by one. Yup it is slower/more clicks etc but you only need to do it once for each book and it is there forever "correct" rather than a mess you have to clean up later of fixing tags, series, covers, description etc...

Agreed. I try to update in smaller batches and still manually review every entry before confirming it for those exact reasons. The only reason I was polling so many at once was because I was only updating publish dates. Usually I do less than ten at a time.

If I see any specific issues that aren't from overuse, I'll be sure to send them along your way. Thanks again for all the work.

Eskoe · 09-08-2022, 12:27 PM

Quote:

Originally Posted by kiwidude

Thanks for giving it a run so quickly Eskoe and your logs, very helpful. It allowed me to confirm that you were exclusively hitting the "old" html pages with all those books - i.e. they would have coincidentally still worked with the old 1.5.x plugin. So at least I know that side of things is still working well, I will wait a little longer for feedback from others before releasing in the hope they happen to hit the new code more.

Unfortunately there is no guaranteed way I found to force it to hit one version of the Goodreads book page over another at the moment (which made testing my changes a pain). It is genuinely a heads or tails coin flip every time. I had to sit there doing Download -> View Log -> Cancel over and over each time I wanted to test something with specific page variants...

Incidentally if you are bored/curious and want to know what to look for in the logs - if you see "_legacy" in those log files then it is the "old" website page design (e.g. "parse_isbn_legacy: xxxx"). Whereas with the new web page the log will just say "parse_isbn: xxxx". There are other lines in there which point out more explicitly but that is the quickest way to skim read the answer.

Not a problem! And definitely curious, that's quite interesting. I guess I somehow lucked (unlucked?) into only getting the legacy, explains why I got failures so often lol.

I double checked with a bunch of attempts, it's definitely both with and without the "_legacy"

Spoiler:

(The failure was because the book didn't have a cover).

Still haven't run into a problem, everything's working great. Can't thank you enough

kiwidude · 09-08-2022, 01:07 PM

Perfect Eskoe - that is exceedingly helpful. For the next version I have cleaned up that error being thrown in there when there is no cover.

I decided to add translation support to this plugin (for the configuration screen) and was blown away by how quickly the translators jumped into gear on Transifex. It's only been up a day or two and already nine languages pretty much done that I will also include in the next build - thanks so much to all of you kind folks!

kiwidude · 09-08-2022, 01:44 PM

Changes in this release:

Support new Goodreads web page formats in conjunction with legacy pages.
Add translation support for config screen.
Chinese, Spanish, French, Hungarian, Italian, Japanese, Dutch, Polish, Ukranian translations - thanks to everyone!!!
Add configuration option to use edition published date or first published date (default).

FrancisWeeks · 09-12-2022, 01:04 AM

The biggest issue with the current version of my article is one that I'll need to release a new version for. Please let me know if anything else comes up.

The tag names are being generated according to their popularity on their web page, and my code should sort them the same way as they sort them there, but it isn’t.

There are two settings that need to be changed on your Amazon feed. First you want to increase the limit on how many tags you want returned. Second, you need to change how you order the results returned.

dunhill · 09-12-2022, 09:26 AM

Quote:

Originally Posted by kiwidude

Perfect Eskoe - that is exceedingly helpful. For the next version I have cleaned up that error being thrown in there when there is no cover.

I decided to add translation support to this plugin (for the configuration screen) and was blown away by how quickly the translators jumped into gear on Transifex. It's only been up a day or two and already nine languages pretty much done that I will also include in the next build - thanks so much to all of you kind folks!

I have noticed that if I want to collaborate on another translation that is incomplete, I cannot access it. It is right ??

kiwidude · 09-12-2022, 10:44 AM

Quote:

Originally Posted by dunhill

I have noticed that if I want to collaborate on another translation that is incomplete, I cannot access it. It is right ??

I have absolutely no idea about that one @dunhill. I'm not doing anything permissions related in Transifex. I am just uploading the .pot and any translations previously generated for it and then leave the rest of the magic up to the translators. I see no settings in there related to collaboration or permissions for sharing?

Are you sure you were signed in to Transifex? Is it specific to one particular plugin/translation or all of them?

dunhill · 09-12-2022, 12:05 PM

Quote:

Originally Posted by kiwidude

I have absolutely no idea about that one @dunhill. I'm not doing anything permissions related in Transifex. I am just uploading the .pot and any translations previously generated for it and then leave the rest of the magic up to the translators. I see no settings in there related to collaboration or permissions for sharing?

Are you sure you were signed in to Transifex? Is it specific to one particular plugin/translation or all of them?

If logged in and as seen in the image the translate button is not active in the first image and if in the second.

Ready solved you have to join the selected language !! out another translation

kiwidude · 09-24-2022, 04:03 PM

Click to see CHANGELOG on GitHub

Two specific things I will call out on here:

Plugin can now (optionally) download the exact rating and #votes from Goodreads - in a way that will let you see them in custom columns.

There have been a number of plugins out there trying to do this but always hitting the brick wall limits of the metadata plugin API making them a multi-step/multi-plugin process.

A special shoutout to Melih who emailed me today which prompted this addition. The plugin can now return two additional identifiers of grrating and grvotes. You can then bind these to custom columns using existing calibre template syntax. For full details on how to do this, refer to the README here.

The super nice thing about this is you get that data at the same time you get the rest of your metadata for the book - no need for a "second pass" by another plugin. Note this is all opt-in behavior - you have to go into the configuration options for the plugin to enable this feature.

This is the first release from the kiwidude plugins "new home" and all that implies...

It has "only" taken me 11+ years to get around to it but all my plugins are now in GitHub. There has been a huge amount of plugin cleanup the last few weeks, dropping support for PyQt4 (i.e. a minimum of calibre 2.x for all my plugins now), common_utils.py refactored/rewritten to be actually shared between plugins again, constant refining and tweaking of command scripts for everything from builds to translation management to automating releases on GitHub, Transifex integration, documenting everything to the nth detail for maintainers etc.

I'm still "tinkering" so not ready to push the button on the new releases of every plugin just yet but that will happen in the next week or so. I'll write a separate post about it all when I am ready.

But you can expect that for my plugins going forward there will be a lot more linking direct to the GitHub repo for documentation for help files, change logs etc to avoid the duplication and overhead for the maintainers. So any early feedback on what people now like or dislike about the "new ways" would be appreciated.

dunhill · 09-24-2022, 04:42 PM

Quote:

Originally Posted by kiwidude

Click to see CHANGELOG on GitHub

Two specific things I will call out on here:

Plugin can now (optionally) download the exact rating and #votes from Goodreads - in a way that will let you see them in custom columns.

There have been a number of plugins out there trying to do this but always hitting the brick wall limits of the metadata plugin API making them a multi-step/multi-plugin process.

A special shoutout to Melih who emailed me today which prompted this addition. The plugin can now return two additional identifiers of grrating and grvotes. You can then bind these to custom columns using existing calibre template syntax. For full details on how to do this, refer to the README here.

The super nice thing about this is you get that data at the same time you get the rest of your metadata for the book - no need for a "second pass" by another plugin. Note this is all opt-in behavior - you have to go into the configuration options for the plugin to enable this feature.

This is the first release from the kiwidude plugins "new home" and all that implies...

It has "only" taken me 11+ years to get around to it but all my plugins are now in GitHub. There has been a huge amount of plugin cleanup the last few weeks, dropping support for PyQt4 (i.e. a minimum of calibre 2.x for all my plugins now), common_utils.py refactored/rewritten to be actually shared between plugins again, constant refining and tweaking of command scripts for everything from builds to translation management to automating releases on GitHub, Transifex integration, documenting everything to the nth detail for maintainers etc.

I'm still "tinkering" so not ready to push the button on the new releases of every plugin just yet but that will happen in the next week or so. I'll write a separate post about it all when I am ready.

But you can expect that for my plugins going forward there will be a lot more linking direct to the GitHub repo for documentation for help files, change logs etc to avoid the duplication and overhead for the maintainers. So any early feedback on what people now like or dislike about the "new ways" would be appreciated.

Thank you for your work and this update.

09-06-2022, 11:58 AM	#616
Eskoe Member Posts: 14 Karma: 10 Join Date: Jan 2011 Device: Sony Reader	I gave it a few test runs and it seems to be working perfectly! All of my books have the goodreads ID tag beforehand where possible, though the titles and author names were not always set. I also included a book I know was not on goodreads and an article off of JSTOR (because why not, I guess? lol) just to... see what would happen? And everything seems to work as expected. Thank you so much, kiwidude! Amazing and incredibly fast work. I'll attach the log just in case you're interested. Spoiler: #################### Log for Buckminster Fuller's universe #################### Running identify query with parameters: {'title': "Buckminster Fuller's universe", 'authors': ['Sieden, Lloyd Steven'], 'identifiers': {'goodreads': '190039'}, 'timeout': 30} Using plugins: Goodreads (1, 6, 1) The log from individual plugins is below **************************** Goodreads (1, 6, 1) ************************** Found 1 results Downloading from Goodreads took 3.8455708026885986 --- Title : Buckminster Fuller's Universe: An Appreciation Author(s) : Lloyd Steven Sieden & L. Seiden Publisher : Basic Books Tags : Biography, Non-Fiction, Science, Architecture, Business, History, Philosophy Languages : eng Rating : 2 Published : 1989-04-21T00:00:00+00:00 Identifiers : goodreads:190039, isbn:9780738203799 Comments : Buckminster Fuller, the brilliant and eccentric futurist philosopher best known as the inventor of the Geodesic Dome, was one of the most creative contributors to innovative thought and technology in the twentieth century. Incomparable designer, engineer, and architect, he proved that a lone genius, through sheer initiative, can have an astounding impact on the world. In this inspiring account of Fuller's life and legacy, Lloyd Steven Sieden brings new light to Fuller's belief system and recognizes his many contributions to humanity. identify - start. title=Buckminster Fuller's universe, authors=['Sieden, Lloyd Steven'], identifiers={'goodreads': '190039'} Goodreads book url: 'https://www.goodreads.com/book/show/190039' Trying to parse book json for 2022 web page format Page is legacy html format as NO Json found parse_title: title_text='Buckminster Fuller's Universe: An Appreciation' parse_authors_legacy - author: Lloyd Steven Sieden parse_authors_legacy - author: L. Seiden parse_authors_legacy - author: Norman Cousins (Foreword by) parse_authors_legacy - author: Lloyd Steven Sieden parse_authors_legacy - author: L. Seiden parse_authors_legacy - author: Norman Cousins parse_details - goodreads_id: 190039, mi: Title : Buckminster Fuller's Universe: An Appreciation Author(s) : Lloyd Steven Sieden & L. Seiden parse_rating_legacy: rating_value= 4.07 parse_language_legacy: Have language node parse_language_legacy: raw= English parse_language_legacy: ans= eng ********************************************** ************************** The identify phase took 3.89 seconds The longest time (3.845571) was taken by: Goodreads Merging results from different sources We have 1 merged results, merging took: 0.00 seconds ************************** Goodreads Covers ************************** Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.77 Safari/537.36')] Downloaded cover: 314x475 Took 0.45133137702941895 seconds Downloading cover from: https://i.gr-assets.com/images/S/com...82l/190039.jpg ********************************************** ************************** #################### Log for Metaphysics #################### Running identify query with parameters: {'title': 'Metaphysics', 'authors': ['Aristotle', 'Reeve, C. D. C. (Translator)'], 'identifiers': {'goodreads': '28255427'}, 'timeout': 30} Using plugins: Goodreads (1, 6, 1) The log from individual plugins is below ************************** Goodreads (1, 6, 1) ************************** Found 1 results Downloading from Goodreads took 2.9115829467773438 --- Title : Metaphysics Author(s) : Aristotle Publisher : Hackett Publishing Company, Inc. Tags : Philosophy, Classics, Non-Fiction, Science, History Rating : 2 Published : 2016-03-01T00:00:00+00:00 Identifiers : goodreads:28255427, isbn:9781624664397 Comments : This new translation of Aristotle's Metaphysics in its entirety is a model of accuracy and consistency, presented with a wealth of annotation and commentary. Sequentially numbered endnotes provide the information most needed at each juncture, while a detailed Index of Terms guides the reader to places where focused discussion of key notions occurs. An illuminating general Introduction describes the book that lies ahead, explaining what it is about, what it is trying to do, how it goes about doing it, and what sort of audience it presupposes. identify - start. title=Metaphysics, authors=['Aristotle', 'Reeve, C. D. C. (Translator)'], identifiers={'goodreads': '28255427'} Goodreads book url: 'https://www.goodreads.com/book/show/28255427' Trying to parse book json for 2022 web page format Page is legacy html format as NO Json found parse_title: title_text='Metaphysics' parse_authors_legacy - author: Aristotle parse_authors_legacy - author: C.D.C. Reeve (Translator/Introduction) parse_authors_legacy - author: Aristotle parse_authors_legacy - author: C.D.C. Reeve parse_details - goodreads_id: 28255427, mi: Title : Metaphysics Author(s) : Aristotle parse_rating_legacy: rating_value= 4.06 ********************************************** ************************** The identify phase took 3.06 seconds The longest time (2.911583) was taken by: Goodreads Merging results from different sources We have 1 merged results, merging took: 0.00 seconds ************************** Goodreads Covers ************************** Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.77 Safari/537.36')] Downloaded cover: 317x475 Took 1.4318978786468506 seconds Downloading cover from: https://i.gr-assets.com/images/S/com...l/28255427.jpg ********************************************** ************************** #################### Log for Algorithms to Live By #################### Running identify query with parameters: {'title': 'Algorithms to Live By', 'authors': ['Brian Christian'], 'identifiers': {'goodreads': '25666050'}, 'timeout': 30} Using plugins: Goodreads (1, 6, 1) The log from individual plugins is below ************************** Goodreads (1, 6, 1) ************************** Found 1 results Downloading from Goodreads took 8.211853504180908 --- Title : Algorithms to Live By: The Computer Science of Human Decisions Author(s) : Brian Christian & Tom Griffiths Publisher : Henry Holt and Co. Tags : Non-Fiction, Science, Psychology, Computer Science, Self Help, Business, Philosophy Languages : eng Rating : 2.1 Published : 2016-04-19T00:00:00+00:00 Identifiers : goodreads:25666050, isbn:9781627790369 Comments : A fascinating exploration of how insights from computer algorithms can be applied to our everyday lives, helping to solve common decision-making problems and illuminate the workings of the human mind All our lives are constrained by limited space and time, limits that give rise to a particular set of problems. What should we do, or leave undone, in a day or a lifetime? How much messiness should we accept? What balance of new activities and familiar favorites is the most fulfilling? These may seem like uniquely human quandaries, but they are not: computers, too, face the same constraints, so computer scientists have been grappling with their version of such issues for decades. And the solutions they've found have much to teach us. In a dazzlingly interdisciplinary work, acclaimed author Brian Christian and cognitive scientist Tom Griffiths show how the algorithms used by computers can also untangle very human questions. They explain how to have better hunches and when to leave things to chance, how to deal with overwhelming choices and how best to connect with others. From finding a spouse to finding a parking spot, from organizing one's inbox to understanding the workings of memory, Algorithms to Live By transforms the wisdom of computer science into strategies for human living. identify - start. title=Algorithms to Live By, authors=['Brian Christian'], identifiers={'goodreads': '25666050'} Goodreads book url: 'https://www.goodreads.com/book/show/25666050' Trying to parse book json for 2022 web page format Page is legacy html format as NO Json found parse_title: title_text='Algorithms to Live By: The Computer Science of Human Decisions' parse_authors_legacy - author: Brian Christian (Goodreads Author) parse_authors_legacy - author: Tom Griffiths (Goodreads Author) parse_authors_legacy - author: Brian Christian parse_authors_legacy - author: Tom Griffiths parse_details - goodreads_id: 25666050, mi: Title : Algorithms to Live By: The Computer Science of Human Decisions Author(s) : Brian Christian & Tom Griffiths parse_rating_legacy: rating_value= 4.13 parse_language_legacy: Have language node parse_language_legacy: raw= English parse_language_legacy: ans= eng ********************************************** ************************** The identify phase took 8.37 seconds The longest time (8.211854) was taken by: Goodreads Merging results from different sources We have 1 merged results, merging took: 0.00 seconds ************************** Goodreads Covers ************************** Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.77 Safari/537.36')] Downloaded cover: 265x400 Took 1.265071153640747 seconds Downloading cover from: https://i.gr-assets.com/images/S/com...l/25666050.jpg ********************************************** ************************** #################### Log for Walter Benjamin's Grave #################### Running identify query with parameters: {'title': "Walter Benjamin's Grave", 'authors': ['Taussig, Michael T.'], 'identifiers': {'goodreads': '146404'}, 'timeout': 30} Using plugins: Goodreads (1, 6, 1) The log from individual plugins is below ************************** Goodreads (1, 6, 1) ************************** Found 1 results Downloading from Goodreads took 4.201105356216431 --- Title : Walter Benjamin's Grave Author(s) : Michael Taussig Publisher : University of Chicago Press Tags : Non-Fiction, Essays, Theory, Philosophy Languages : eng Rating : 2.1 Published : 2006-08-15T00:00:00+00:00 Identifiers : goodreads:146404, isbn:9780226790046 Comments : In September 1940, Walter Benjamin committed suicide in Port Bou on the Spanish-French border when it appeared that he and his travelling partners would be denied passage into Spain in their attempt to escape the Nazis. In 2002, one of anthropology’s—and indeed today’s—most distinctive writers, Michael Taussig, visited Benjamin’s grave in Port Bou. The result is “Walter Benjamin’s Grave,” a moving essay about the cemetery, eyewitness accounts of Benjamin’s border travails, and the circumstances of his demise. It is the most recent of eight revelatory essays collected in this volume of the same name. “Looking over these essays written over the past decade,” writes Taussig, “I think what they share is a love of muted and defective storytelling as a form of analysis. Strange love indeed; love of the wound, love of the last gasp.” Although thematically these essays run the gamut—covering the monument and graveyard at Port Bou, discussions of peasant poetry in Colombia, a pact with the devil, the peculiarities of a shaman’s body, transgression, the disappearance of the sea, New York City cops, and the relationship between flowers and violence—each shares Taussig’s highly individual brand of storytelling, one that depends on a deep appreciation of objects and things as a way to retrieve even deeper philosophical and anthropological meanings. Whether he finds himself in Australia, Colombia, Manhattan, or Spain, in the midst of a book or a beach, whether talking to friends or staring at a monument, Taussig makes clear through these marvelous essays that materialist knowledge offers a crucial alternative to the increasingly abstract, globalized, homogenized, and digitized world we inhabit. Pursuing an adventure that is part ethnography, part autobiography, and part cultural criticism refracted through the object that is Walter Benjamin’s grave, Taussig, with this collection, provides his own literary memorial to the twentieth century’s greatest cultural critic. identify - start. title=Walter Benjamin's Grave, authors=['Taussig, Michael T.'], identifiers={'goodreads': '146404'} Goodreads book url: 'https://www.goodreads.com/book/show/146404' Trying to parse book json for 2022 web page format Page is legacy html format as NO Json found parse_title: title_text='Walter Benjamin's Grave' parse_authors_legacy - author: Michael Taussig parse_authors_legacy - author: Michael Taussig parse_details - goodreads_id: 146404, mi: Title : Walter Benjamin's Grave Author(s) : Michael Taussig parse_rating_legacy: rating_value= 4.11 parse_language_legacy: Have language node parse_language_legacy: raw= English parse_language_legacy: ans= eng ********************************************** ************************** The identify phase took 4.29 seconds The longest time (4.201105) was taken by: Goodreads Merging results from different sources We have 1 merged results, merging took: 0.00 seconds ************************** Goodreads Covers ************************** Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.77 Safari/537.36')] Downloaded cover: 318x472 Took 1.4924018383026123 seconds Downloading cover from: https://i.gr-assets.com/images/S/com...98l/146404.jpg ********************************************** ************************** #################### Log for Michael Taussig #################### Running identify query with parameters: {'title': 'Michael Taussig', 'authors': ['Shamanism, Colonialism', 'the Wild Man A Study in Terror', 'Healing-University of Chicago Press (1987)'], 'identifiers': {'goodreads': '146405'}, 'timeout': 30} Using plugins: Goodreads (1, 6, 1) The log from individual plugins is below ************************** Goodreads (1, 6, 1) **************************** Found 1 results Downloading from Goodreads took 2.8571646213531494 --- Title : Shamanism, Colonialism, and the Wild Man: A Study in Terror and Healing Author(s) : Michael Taussig Publisher : University of Chicago Press Tags : Non-Fiction, History, Philosophy, Religion Languages : eng Rating : 2.1 Published : 1987-01-01T00:00:00+00:00 Identifiers : goodreads:146405, isbn:9780226790138 Comments : Working with the image of the Indian shaman as Wild Man, Taussig reveals not the magic of the shaman but that of the politicizing fictions creating the effect of the real. "This extraordinary book . . . will encourage ever more critical and creative explorations."—Fernando Coronil, American Journal of Sociology "Taussig has brought a formidable collection of data from arcane literary, journalistic, and biographical sources to bear on . . . questions of evil, torture, and politically institutionalized hatred and terror. His intent is laudable, and much of the book is brilliant, both in its discovery of how particular people perpetrated evil and others interpreted it."—Stehen G. Bunker, Social Science Quarterly identify - start. title=Michael Taussig, authors=['Shamanism, Colonialism', 'the Wild Man A Study in Terror', 'Healing-University of Chicago Press (1987)'], identifiers={'goodreads': '146405'} Goodreads book url: 'https://www.goodreads.com/book/show/146405' Trying to parse book json for 2022 web page format Page is legacy html format as NO Json found parse_title: title_text='Shamanism, Colonialism, and the Wild Man: A Study in Terror and Healing' parse_authors_legacy - author: Michael Taussig parse_authors_legacy - author: Michael Taussig parse_details - goodreads_id: 146405, mi: Title : Shamanism, Colonialism, and the Wild Man: A Study in Terror and Healing Author(s) : Michael Taussig parse_rating_legacy: rating_value= 4.19 parse_language_legacy: Have language node parse_language_legacy: raw= English parse_language_legacy: ans= eng ************************************************ ************************** The identify phase took 2.86 seconds The longest time (2.857165) was taken by: Goodreads Merging results from different sources We have 1 merged results, merging took: 0.00 seconds ************************** Goodreads Covers ************************** Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.77 Safari/537.36')] Downloaded cover: 318x472 Took 0.639697790145874 seconds Downloading cover from: https://i.gr-assets.com/images/S/com...00l/146405.jpg ********************************************** ************************** #################### Log for The Filmmaker's Eye; Learning (and Breaking) the Rules of Cinematic Composition; Second Edition #################### Running identify query with parameters: {'title': "The Filmmaker's Eye; Learning (and Breaking) the Rules of Cinematic Composition; Second Edition", 'authors': ['Gustavo Mercado'], 'identifiers': {'goodreads': '31397269'}, 'timeout': 30} Using plugins: Goodreads (1, 6, 1) The log from individual plugins is below ************************** Goodreads (1, 6, 1) ************************** Found 1 results Downloading from Goodreads took 2.4885873794555664 --- Title : The Filmmaker's Eye: Learning (And Breaking) the Rules of Cinematic Composition Author(s) : Gustavo Mercado Publisher : Focal Press Tags : Film, Non-Fiction, Art, Photography, Writing, Textbooks, Reference Rating : 2.1 Published : 2010-09-01T00:00:00+00:00 Identifiers : goodreads:31397269, isbn:9781138780316 Comments : This fully revised and updated edition of the classic book on cinematic composition provides readers with the necessary skills and technical know-how to create polished and narratively eloquent images, using a unique approach that combines an analytical, technical, and aesthetic understanding of the essential visual grammar of the shot. Containing well over a hundred full-color case studies, this second edition was expanded to include brand-new shot types, and was completely updated to reflect developments in filmmaking technology and practices, including the DSLR revolution, the advent of mirrorless and compact cinema cameras, improvements in CMOS sensor performance, the introduction of 4K and higher video resolutions, and drone cinematography. The Filmmaker's Eye: Learning (and Breaking) the Rules of Cinematic Composition 2nd edition is essential reading for anyone with an interest in motion media and cinematic storytelling, including independent filmmakers, directors, producers, cinematographers, editors, as well as those studying filmmaking, media aesthetics, and film studies. identify - start. title=The Filmmaker's Eye; Learning (and Breaking) the Rules of Cinematic Composition; Second Edition, authors=['Gustavo Mercado'], identifiers={'goodreads': '31397269'} Goodreads book url: 'https://www.goodreads.com/book/show/31397269' Trying to parse book json for 2022 web page format Page is legacy html format as NO Json found parse_title: title_text='The Filmmaker's Eye: Learning (and Breaking) the Rules of Cinematic Composition' parse_authors_legacy - author: Gustavo Mercado parse_authors_legacy - author: Gustavo Mercado parse_details - goodreads_id: 31397269, mi: Title : The Filmmaker's Eye: Learning (and Breaking) the Rules of Cinematic Composition Author(s) : Gustavo Mercado parse_rating_legacy: rating_value= 4.19 ********************************************** ************************** The identify phase took 2.65 seconds The longest time (2.488587) was taken by: Goodreads Merging results from different sources We have 1 merged results, merging took: 0.00 seconds ************************** Goodreads Covers ************************** Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.77 Safari/537.36')] Downloaded cover: 318x318 Took 1.564852237701416 seconds Downloading cover from: https://i.gr-assets.com/images/S/com...69._SX318_.jpg ********************************************** ************************** #################### Log for The Devil and Commodity Fetishism in South America, 30th Anniversary Ed. #################### Running identify query with parameters: {'title': 'The Devil and Commodity Fetishism in South America, 30th Anniversary Ed.', 'authors': ['Michael Taussig'], 'identifiers': {'goodreads': '146409'}, 'timeout': 30} Using plugins: Goodreads (1, 6, 1) The log from individual plugins is below ************************** Goodreads (1, 6, 1) ************************** Found 1 results Downloading from Goodreads took 3.065912961959839 --- Title : The Devil and Commodity Fetishism in South America Author(s) : Michael Taussig Publisher : University of North Carolina Press Tags : Non-Fiction, History, Theory, Sociology, Philosophy Languages : eng Rating : 2 Published : 1980-01-01T00:00:00+00:00 Identifiers : goodreads:146409, isbn:9780807841068 Comments : My aim in this book is to elicit the social significance of the devil in the folklore of contemporary plantation workers and miners in South America. The devil is a stunningly apt symbol of the alienation experienced by peasants as they enter the ranks of the proletariat, and it is largely in terms of that experience that I have cast my interpretation. The historical and ethnographic context lead me to ask: What is the relationship between the image of the devil and capitalist development? What contradictions in social experience does the fetish of the spirit of evil mediate? Is there a structure of connections between the redeeming power of the antichrist and the analytic power of Marxism? identify - start. title=The Devil and Commodity Fetishism in South America, 30th Anniversary Ed., authors=['Michael Taussig'], identifiers={'goodreads': '146409'} Goodreads book url: 'https://www.goodreads.com/book/show/146409' Trying to parse book json for 2022 web page format Page is legacy html format as NO Json found parse_title: title_text='The Devil and Commodity Fetishism in South America' parse_authors_legacy - author: Michael Taussig parse_authors_legacy - author: Michael Taussig parse_details - goodreads_id: 146409, mi: Title : The Devil and Commodity Fetishism in South America Author(s) : Michael Taussig parse_rating_legacy: rating_value= 3.92 parse_language_legacy: Have language node parse_language_legacy: raw= English parse_language_legacy: ans= eng ********************************************** ************************** The identify phase took 3.26 seconds The longest time (3.065913) was taken by: Goodreads Merging results from different sources We have 1 merged results, merging took: 0.00 seconds ************************** Goodreads Covers ************************** Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.77 Safari/537.36')] Downloaded cover: 305x475 Took 0.8306488990783691 seconds Downloading cover from: https://i.gr-assets.com/images/S/com...92l/146409.jpg ********************************************** ************************** #################### Log for The Art of Biblical Poetry #################### Running identify query with parameters: {'title': 'The Art of Biblical Poetry', 'authors': ['Robert Alter'], 'identifiers': {'goodreads': '671130'}, 'timeout': 30} Using plugins: Goodreads (1, 6, 1) The log from individual plugins is below ************************** Goodreads (1, 6, 1) ************************** Found 1 results Downloading from Goodreads took 5.222418785095215 --- Title : The Art of Biblical Poetry Author(s) : Robert Alter Publisher : Basic Books Tags : Religion, Poetry, Theology, Non-Fiction Languages : eng Rating : 2.1 Published : 1985-01-01T00:00:00+00:00 Identifiers : goodreads:671130, isbn:9780465004317 Comments : Continuing his explorations of the art of the Bible, Robert Alter provides an interpretation of the poetry of the Old Testament and an account of how biblical poetry works. identify - start. title=The Art of Biblical Poetry, authors=['Robert Alter'], identifiers={'goodreads': '671130'} Goodreads book url: 'https://www.goodreads.com/book/show/671130' Trying to parse book json for 2022 web page format Page is legacy html format as NO Json found parse_title: title_text='The Art of Biblical Poetry' parse_authors_legacy - author: Robert Alter parse_authors_legacy - author: Robert Alter parse_details - goodreads_id: 671130, mi: Title : The Art of Biblical Poetry Author(s) : Robert Alter parse_rating_legacy: rating_value= 4.12 parse_language_legacy: Have language node parse_language_legacy: raw= English parse_language_legacy: ans= eng ********************************************** ************************** The identify phase took 5.33 seconds The longest time (5.222419) was taken by: Goodreads Merging results from different sources We have 1 merged results, merging took: 0.00 seconds ************************** Goodreads Covers ************************** Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.77 Safari/537.36')] Downloaded cover: 259x400 Took 0.19800877571105957 seconds Downloading cover from: https://i.gr-assets.com/images/S/com...84l/671130.jpg ********************************************** ************************** #################### Log for Screenwriters in French cinema #################### Running identify query with parameters: {'title': 'Screenwriters in French cinema', 'authors': ['Sarah Leahy', 'Isabelle Vanderschelden'], 'identifiers': {}, 'timeout': 30} Using plugins: Goodreads (1, 6, 1) The log from individual plugins is below ************************** Goodreads (1, 6, 1) ************************** Found 0 results Downloading from Goodreads took 1.3144991397857666 identify - start. title=Screenwriters in French cinema, authors=['Sarah Leahy', 'Isabelle Vanderschelden'], identifiers={} Querying: https://www.goodreads.com/search?sea...e=books&search[query]=Screenwriters+in+French+cinema+Sarah+Leahy No goodreads id via ISBN ********************************************** ************************** The identify phase took 1.43 seconds The longest time (1.314499) was taken by: Goodreads Merging results from different sources We have 0 merged results, merging took: 0.00 seconds Failed to download metadata for Screenwriters in French cinema ************************** Goodreads Covers ************************** Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.77 Safari/537.36')] Failed to download valid cover Took 0.8261001110076904 seconds No cached cover found, running identify identify - start. title=Screenwriters in French cinema, authors=['Sarah Leahy', 'Isabelle Vanderschelden'], identifiers={} Querying: https://www.goodreads.com/search?sea...e=books&search[query]=Screenwriters+in+French+cinema+Sarah+Leahy No goodreads id via ISBN No cover found ********************************************** ************************** #################### Log for Japanese Cinema: Texts and Contexts #################### Running identify query with parameters: {'title': 'Japanese Cinema: Texts and Contexts', 'authors': ['Alastair Phillips', 'Julian Stringer (edt)'], 'identifiers': {'goodreads': '1721102'}, 'timeout': 30} Using plugins: Goodreads (1, 6, 1) The log from individual plugins is below ************************** Goodreads (1, 6, 1) ************************** Found 1 results Downloading from Goodreads took 4.245915651321411 --- Title : Japanese Cinema: Texts and Contexts: Texts and Contexts Author(s) : Alistair Phillips & Julian Stringer Publisher : Routledge Tags : Film, Non-Fiction, Philosophy Languages : eng Rating : 1.9 Published : 2007-01-01T00:00:00+00:00 Identifiers : goodreads:1721102, isbn:9780415328487 Comments : Japanese Cinema includes twenty-four chapters on key films of Japanese cinema, from the silent era to the present day, providing a comprehensive introduction to Japanese cinema history and Japanese culture and society. Studying a range of important films, from Late Spring, Seven Samurai and In the Realm of the Senses to Godzilla, Hana-Bi and Ring , the collection includes discussion of all the major directors of Japanese cinema including Ozu, Mizoguchi, Kurosawa, Oshima, Suzuki, Kitano and Miyazaki. Each chapter discusses the film in relation to aesthetic, industrial or critical issues and ends with a complete filmography for each director. The book also includes a full glossary of terms and a comprehensive bibliography of readings on Japanese cinema. Bringing together leading international scholars and showcasing pioneering new research, this book is essential reading for all students and general readers interested in one of the world's most important film industries. identify - start. title=Japanese Cinema: Texts and Contexts, authors=['Alastair Phillips', 'Julian Stringer (edt)'], identifiers={'goodreads': '1721102'} Goodreads book url: 'https://www.goodreads.com/book/show/1721102' Trying to parse book json for 2022 web page format Page is legacy html format as NO Json found parse_title: title_text='Japanese Cinema: Texts and Contexts: Texts and Contexts' parse_authors_legacy - author: Alistair Phillips (Editor) parse_authors_legacy - author: Julian Stringer (Editor) parse_authors_legacy - author: Aaron Gerow (Goodreads Author) (Contributor) parse_authors_legacy - author: Toshie Mori (Contributor) parse_authors_legacy - author: Freda Freiberg (Contributor) parse_authors_legacy - author: Alexander Jacoby (Contributor) parse_authors_legacy - author: Abé Mark Nornes (Contributor) parse_authors_legacy - author: Joan Mellen (Contributor) parse_authors_legacy - author: more…Inuhiko Yomota (Contributor) parse_authors_legacy - author: D.P. Martínez (Contributor) parse_authors_legacy - author: Catherine Russell (Contributor) parse_authors_legacy - author: Keiko I. McDonald (Contributor) parse_authors_legacy - author: Michael Raine (Contributor) parse_authors_legacy - author: Mitsuhiro Yoshimoto (Contributor) parse_authors_legacy - author: Mitsuyo Wada-marciano (Contributor) parse_authors_legacy - author: Daisuke Miyao (Contributor) parse_authors_legacy - author: Carole Cavanaugh (Contributor) parse_authors_legacy - author: Isolde Standish (Contributor) parse_authors_legacy - author: Rayna Denison (Contributor) parse_authors_legacy - author: Donald Richie (Contributor) parse_authors_legacy - author: Linda C. Ehrlich (Contributor) parse_authors_legacy - author: David Desser (Contributor) parse_authors_legacy - author: Darrell William Davis (Contributor)…less parse_authors_legacy - author: Alistair Phillips parse_authors_legacy - author: Julian Stringer parse_authors_legacy - author: Aaron Gerow parse_details - goodreads_id: 1721102, mi: Title : Japanese Cinema: Texts and Contexts: Texts and Contexts Author(s) : Alistair Phillips & Julian Stringer parse_rating_legacy: rating_value= 3.78 parse_language_legacy: Have language node parse_language_legacy: raw= English parse_language_legacy: ans= eng ********************************************** ************************** The identify phase took 4.27 seconds The longest time (4.245916) was taken by: Goodreads Merging results from different sources We have 1 merged results, merging took: 0.00 seconds ************************** Goodreads Covers ************************** Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.77 Safari/537.36')] Downloaded cover: 316x475 Took 1.522219181060791 seconds Downloading cover from: https://i.gr-assets.com/images/S/com...02._SY475_.jpg ********************************************** ************************** #################### Log for Samuel Beckett and Cinema #################### Running identify query with parameters: {'title': 'Samuel Beckett and Cinema', 'authors': ['Anthony Paraskeva'], 'identifiers': {'goodreads': '18630001'}, 'timeout': 30} Using plugins: Goodreads (1, 6, 1) The log from individual plugins is below ************************** Goodreads (1, 6, 1) ************************** Found 1 results Downloading from Goodreads took 2.4205384254455566 --- Title : Samuel Beckett and Cinema Author(s) : Anthony Paraskeva Publisher : Bloomsbury Academic Rating : Published : 2016-04-01T00:00:00+00:00 Identifiers : goodreads:18630001, isbn:9781472524980 Comments : In 1936 Samuel Beckett wrote a letter to Sergei Eisenstein - the legendary director of such films as Battleship Potemkin - expressing his own desire to work in the lost tradition of silent film. Drawing on substantial archival material, Samuel Beckett and Cinema is the first book to examine comprehensively the full extent of Beckett's engagement with cinema and its influence on his work for stage and screen. Examining his writing on second wave modernist cinema, including the work of directors such as Eisenstein,Godard, Griffith and Bresson as well as performers such as Buster Keaton, Charlie Chaplin and Greta Garbo, the book reveals film art to be central to Beckett's modernist aesthetic. In this way, Beckett is revealed to be part of a wider modernist theatrical tradition that stood as an inheritor of early 20th century cinema, alongside Meyerhold, Brecht and Artaud. identify - start. title=Samuel Beckett and Cinema, authors=['Anthony Paraskeva'], identifiers={'goodreads': '18630001'} Goodreads book url: 'https://www.goodreads.com/book/show/18630001' Trying to parse book json for 2022 web page format Page is legacy html format as NO Json found parse_title: title_text='Samuel Beckett and Cinema' parse_authors_legacy - author: Anthony Paraskeva parse_authors_legacy - author: Anthony Paraskeva parse_details - goodreads_id: 18630001, mi: Title : Samuel Beckett and Cinema Author(s) : Anthony Paraskeva parse_rating_legacy: rating_value= 0.0 ********************************************** ************************** The identify phase took 2.46 seconds The longest time (2.420538) was taken by: Goodreads Merging results from different sources We have 1 merged results, merging took: 0.00 seconds ************************** Goodreads Covers ************************** Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.128 Safari/537.36')] Downloaded cover: 270x400 Took 0.49657130241394043 seconds Downloading cover from: https://i.gr-assets.com/images/S/com...l/18630001.jpg ********************************************** ************************** #################### Log for Voodoo Hermeneutics/The Crossroads Sublime #################### Running identify query with parameters: {'title': 'Voodoo Hermeneutics/The Crossroads Sublime', 'authors': ['mquarterly'], 'identifiers': {}, 'timeout': 30} Using plugins: Goodreads (1, 6, 1) The log from individual plugins is below ************************** Goodreads (1, 6, 1) ************************** Found 0 results Downloading from Goodreads took 1.530264139175415 identify - start. title=Voodoo Hermeneutics/The Crossroads Sublime, authors=['mquarterly'], identifiers={} Querying: https://www.goodreads.com/search?sea...e=books&search[query]=Voodoo+Hermeneutics+mquarterly No goodreads id via ISBN ********************************************** ************************** The identify phase took 1.63 seconds The longest time (1.530264) was taken by: Goodreads Merging results from different sources We have 0 merged results, merging took: 0.00 seconds Failed to download metadata for Voodoo Hermeneutics/The Crossroads Sublime ************************** Goodreads Covers ************************** Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.128 Safari/537.36')] Failed to download valid cover Took 1.4257738590240479 seconds No cached cover found, running identify identify - start. title=Voodoo Hermeneutics/The Crossroads Sublime, authors=['mquarterly'], identifiers={} Querying: https://www.goodreads.com/search?sea...e=books&search[query]=Voodoo+Hermeneutics+mquarterly No goodreads id via ISBN No cover found ********************************************** ****************************

09-08-2022, 01:44 PM	#624
kiwidude Calibre Plugins Developer Posts: 4,731 Karma: 2197770 Join Date: Oct 2010 Location: Australia Device: Kindle Oasis	Goodreads 1.6.2 released Changes in this release: Support new Goodreads web page formats in conjunction with legacy pages. Add translation support for config screen. Chinese, Spanish, French, Hungarian, Italian, Japanese, Dutch, Polish, Ukranian translations - thanks to everyone!!! Add configuration option to use edition published date or first published date (default).

09-24-2022, 04:03 PM	#629
kiwidude Calibre Plugins Developer Posts: 4,731 Karma: 2197770 Join Date: Oct 2010 Location: Australia Device: Kindle Oasis	Goodreads 1.7.0 Released Click to see CHANGELOG on GitHub Two specific things I will call out on here: Plugin can now (optionally) download the exact rating and #votes from Goodreads - in a way that will let you see them in custom columns. There have been a number of plugins out there trying to do this but always hitting the brick wall limits of the metadata plugin API making them a multi-step/multi-plugin process. A special shoutout to Melih who emailed me today which prompted this addition. The plugin can now return two additional identifiers of grrating and grvotes. You can then bind these to custom columns using existing calibre template syntax. For full details on how to do this, refer to the README here. The super nice thing about this is you get that data at the same time you get the rest of your metadata for the book - no need for a "second pass" by another plugin. Note this is all opt-in behavior - you have to go into the configuration options for the plugin to enable this feature. This is the first release from the kiwidude plugins "new home" and all that implies... It has "only" taken me 11+ years to get around to it but all my plugins are now in GitHub. There has been a huge amount of plugin cleanup the last few weeks, dropping support for PyQt4 (i.e. a minimum of calibre 2.x for all my plugins now), common_utils.py refactored/rewritten to be actually shared between plugins again, constant refining and tweaking of command scripts for everything from builds to translation management to automating releases on GitHub, Transifex integration, documenting everything to the nth detail for maintainers etc. I'm still "tinkering" so not ready to push the button on the new releases of every plugin just yet but that will happen in the next week or so. I'll write a separate post about it all when I am ready. But you can expect that for my plugins going forward there will be a lot more linking direct to the GitHub repo for documentation for help files, change logs etc to avoid the duplication and overhead for the maintainers. So any early feedback on what people now like or dislike about the "new ways" would be appreciated.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
[GUI Plugin] Goodreads Sync	kiwidude	Plugins	1781	02-12-2025 07:09 PM
[Metadata Download Plugin] Goodreads Metadata Deprecated	kiwidude	Plugins	30	04-23-2011 02:10 PM
[Covers Plugin] Goodreads Covers Deprecated	kiwidude	Plugins	13	04-17-2011 05:09 PM
metadata plugin	redneck_momma	Plugins	1	05-21-2010 08:41 PM

09-06-2022, 12:36 PM	#617
kiwidude Calibre Plugins Developer Posts: 4,731 Karma: 2197770 Join Date: Oct 2010 Location: Australia Device: Kindle Oasis	Thanks for giving it a run so quickly Eskoe and your logs, very helpful. It allowed me to confirm that you were exclusively hitting the "old" html pages with all those books - i.e. they would have coincidentally still worked with the old 1.5.x plugin. So at least I know that side of things is still working well, I will wait a little longer for feedback from others before releasing in the hope they happen to hit the new code more. Unfortunately there is no guaranteed way I found to force it to hit one version of the Goodreads book page over another at the moment (which made testing my changes a pain). It is genuinely a heads or tails coin flip every time. I had to sit there doing Download -> View Log -> Cancel over and over each time I wanted to test something with specific page variants... Incidentally if you are bored/curious and want to know what to look for in the logs - if you see "_legacy" in those log files then it is the "old" website page design (e.g. "parse_isbn_legacy: xxxx"). Whereas with the new web page the log will just say "parse_isbn: xxxx". There are other lines in there which point out more explicitly but that is the quickest way to skim read the answer.

09-06-2022, 01:38 PM	#618
Terisa de morgan Grand Sorcerer Posts: 6,637 Karma: 12595249 Join Date: Jun 2009 Location: Madrid, Spain Device: Kobo Clara/Aura One/Forma,XiaoMI 5, iPad, Huawei MediaPad, YotaPhone 2	kiwidude, on Saturday I'll be able to test at the computer that is showing the new page, so I think I can check it. I'll be back to you to know if it's the old or the new one.

09-08-2022, 01:07 PM	#623
kiwidude Calibre Plugins Developer Posts: 4,731 Karma: 2197770 Join Date: Oct 2010 Location: Australia Device: Kindle Oasis	Perfect Eskoe - that is exceedingly helpful. For the next version I have cleaned up that error being thrown in there when there is no cover. I decided to add translation support to this plugin (for the configuration screen) and was blown away by how quickly the translators jumped into gear on Transifex. It's only been up a day or two and already nine languages pretty much done that I will also include in the next build - thanks so much to all of you kind folks!

09-12-2022, 01:04 AM	#625
FrancisWeeks Junior Member Posts: 2 Karma: 10 Join Date: Sep 2022 Device: none	The biggest issue with the current version of my article is one that I'll need to release a new version for. Please let me know if anything else comes up. The tag names are being generated according to their popularity on their web page, and my code should sort them the same way as they sort them there, but it isn’t. There are two settings that need to be changed on your Amazon feed. First you want to increase the limit on how many tags you want returned. Second, you need to change how you order the results returned.