03-10-2022, 10:28 PM | #106 |
Grand Sorcerer
Posts: 24,905
Karma: 47303822
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
|
I did look at this after the previous posts, and it does appear that the site may be usable now. Either they no longer use CloudFlare, or how it is protecting the site has changed. But, the site has also changed in other ways and the plugin doesn't work for that reason. When I get a chance, I'll look at it, but, I don't know when that will be.
|
05-13-2022, 06:34 AM | #107 | |
Connoisseur
Posts: 60
Karma: 10
Join Date: Apr 2013
Device: Kindle Paperwhite 3 (Manga)
|
Quote:
Thank you! |
|
05-15-2022, 05:35 AM | #108 |
Grand Sorcerer
Posts: 24,905
Karma: 47303822
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
|
Beta: Site changes
As mentioned above, it appears that at some point FictionDB have changed how the site is hosted. The site stopped working as it was using CloudFlare for caching and protection. They have stopped using this, and the plugin can now work.
The attached plugin is updated to work with the site as it now is. Please test and report here how it goes. |
05-15-2022, 06:19 AM | #109 | ||
Connoisseur
Posts: 60
Karma: 10
Join Date: Apr 2013
Device: Kindle Paperwhite 3 (Manga)
|
Quote:
I have just tested it, and it doesn't seem to work for me? I disabled all other metadata sources and this is the error I get when I run metadata download for a book that I know has all the details on fictiondb: Quote:
https://www.fictiondb.com/title/the-...na~1209356.htm Please let me know if there is something I am doing wrong. Last edited by iamagloworm; 05-15-2022 at 06:24 AM. |
||
05-15-2022, 06:37 AM | #110 | |
Grand Sorcerer
Posts: 24,905
Karma: 47303822
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
|
Quote:
|
|
05-15-2022, 06:40 AM | #111 | |
Connoisseur
Posts: 60
Karma: 10
Join Date: Apr 2013
Device: Kindle Paperwhite 3 (Manga)
|
Quote:
Is there a fictiondb log saved somewhere? Edit: I added back default sources, and this appears in the log: Spoiler:
For the sake of completeness, here is my configuration: Spoiler:
Last edited by iamagloworm; 05-15-2022 at 06:52 AM. |
|
05-15-2022, 07:04 AM | #112 |
Connoisseur
Posts: 60
Karma: 10
Join Date: Apr 2013
Device: Kindle Paperwhite 3 (Manga)
|
Ok, I think I chose a poor example to test with. The title of the book is The Five Misfits but fictiondb is missing the "five".
I tried another example, and it works! https://www.fictiondb.com/title/a-pe...ell~880434.htm The missing bit of metadata I am looking for is still not coming through, it is the Age-Level. Is it possible to add Age-Level? Ideally, there is a way I can put it into a column other than Tags. Thanks! |
05-17-2022, 03:29 AM | #113 |
Connoisseur
Posts: 60
Karma: 10
Join Date: Apr 2013
Device: Kindle Paperwhite 3 (Manga)
|
I have been trying to figure out how to do this myself, but failing.
worker.py has... Code:
if cfg.plugin_prefs[cfg.STORE_NAME][cfg.KEY_GET_GENRE_AS_TAGS]: self._append_tags(root, 'Genre', calibre_tags, '//div[@class="row"]/div/div[@class="row"]/div/h4/../ul[@class="tagcloud-list"]') if cfg.plugin_prefs[cfg.STORE_NAME][cfg.KEY_GET_CLASSIFICATION_AS_TAGS]: self._append_tags(root, 'Classification', calibre_tags, '//div[@class="row"]/div/div[@class="row"]/div/h4/i[@class="fa fa-table"]/../../ul/li') if cfg.plugin_prefs[cfg.STORE_NAME][cfg.KEY_GET_TIME_PERIOD_AS_TAGS]: self._append_tags(root, 'Time Period', calibre_tags, '//div[@class="row"]/div/div[@class="row"]/div/h4/i[@class="fa fa-clock-o"]/../../ul/li') Code:
<div class="col-lg-8 col-sm-8 mb-20"> <ul class="project-details-list"> <li> <h6>Published:</h6> <div class="project-terms"> Oct-2014 <small>(Hardcover)</small> </div> </li> <li> <h6>Formats:</h6> <div class="project-terms"> Print / eBook </div> </li> <li> <h6>Rating:</h6> <div class="project-terms"> <svg class="bi text-secondary" width="12" height="12" fill="currentColor"><use xlink:href="../images/fdb-icons.svg#star-fill"></use></svg> <svg class="bi text-secondary" width="12" height="12" fill="currentColor"><use xlink:href="../images/fdb-icons.svg#star-fill"></use></svg> <svg class="bi text-secondary" width="12" height="12" fill="currentColor"><use xlink:href="../images/fdb-icons.svg#star-fill"></use></svg> <svg class="bi text-secondary" width="12" height="12" fill="currentColor"><use xlink:href="../images/fdb-icons.svg#star-fill"></use></svg> <svg class="bi text-secondary" width="12" height="12" fill="currentColor"><use xlink:href="../images/fdb-icons.svg#star-fill"></use></svg> </div> </li> <li> <h6>Pages:</h6> <div class="project-terms"> 40 </div> </li> <li> <h6>Age Level:</h6> <div class="project-terms"> 02-05 </div> </li> Last edited by iamagloworm; 05-17-2022 at 04:13 AM. |
05-17-2022, 04:00 AM | #114 |
Connoisseur
Posts: 60
Karma: 10
Join Date: Apr 2013
Device: Kindle Paperwhite 3 (Manga)
|
I tried this, but did not get any result. No tags show at all...
Code:
if cfg.plugin_prefs[cfg.STORE_NAME][cfg.KEY_GET_AGE_LEVEL_AS_TAGS]: self._append_tags(root, 'Age Level', calibre_tags, '//li/h6[text()[contains(.,"Age Level")]]/../div[@class="project-terms"]/a') Spoiler:
Actually, upon further testing, it seems that no genres/tags are being scraped, even after reverting to your beta. The same for classification and time period. Does this work for you? Log: Spoiler:
Edit: for reference, this is the full tags code from worker.py - I wonder if it is using an old method that needs to be updated? Spoiler:
Last edited by iamagloworm; 05-17-2022 at 04:31 AM. |
05-17-2022, 04:25 AM | #115 | ||
Grand Sorcerer
Posts: 24,905
Karma: 47303822
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
|
Quote:
Quote:
|
||
05-17-2022, 06:15 AM | #116 |
Grand Sorcerer
Posts: 24,905
Karma: 47303822
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
|
@iamagloworm: Attached is a beta of the plugin that should do what you want.
The issue with adding the "Age Level" in that way, was that it did not match the structure that "_append_tags" expected. I had to handle it separately. Also, the code for the Genre, Classification and Time period had changed, so they were not working either. The beta has the following changes:
Last edited by kiwidude; 10-16-2022 at 12:32 PM. Reason: Removed old version |
05-17-2022, 09:18 AM | #117 |
Connoisseur
Posts: 60
Karma: 10
Join Date: Apr 2013
Device: Kindle Paperwhite 3 (Manga)
|
Seems to work great, thank you!
Amazing! |
10-16-2022, 12:33 PM | #118 |
Calibre Plugins Developer
Posts: 4,673
Karma: 2162246
Join Date: Oct 2010
Location: Australia
Device: Kindle Oasis
|
FictionDB v1.3.0 Released
Release Notes:
https://github.com/kiwidude68/calibr...ctiondb-v1.3.0 |
11-01-2022, 12:13 PM | #119 |
Enthusiast
Posts: 39
Karma: 10
Join Date: Aug 2011
Location: Atlantic Beach, FL
Device: Amazon Fire HD 10
|
With the newest version, even when I check only "Include 'Genres' in the Tags column", I still get Age Level. Is that expected?
|
11-01-2022, 12:47 PM | #120 |
Calibre Plugins Developer
Posts: 4,673
Karma: 2162246
Join Date: Oct 2010
Location: Australia
Device: Kindle Oasis
|
Hi MegAnne - do you have the details of the book on their website? Also the log output would be especially helpful. It could be something about that web page which has the plugin scraping data incorrectly - or it is possible that FictionDB didn't classify things properly themselves...
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
[Metadata Source Plugin] BOL.com (NL) | Pr.BarnArt | Plugins | 505 | 12-14-2023 03:23 PM |
[Metadata Source Plugin] Skoob | rodrigoccurvo | Plugins | 11 | 06-13-2019 06:44 PM |
[Metadata Source Plugin] DIZZIE_NL | Pr.BarnArt | Plugins | 7 | 08-11-2014 01:48 PM |
[Metadata Source Plugin] catawiki | drMerry | Plugins | 0 | 06-28-2011 08:42 PM |
[Metadata Source Plugin] Amazon.it | nandocuci | Plugins | 2 | 05-18-2011 02:36 AM |