[GUI Plugin] FanFicFare

[ownedbycats]

Is there a way, maybe in longtext metadata column, to dfferentiate newly-downloaded fic from updated one after download?

[JimmXinu]

If you use log page and save numWords, you could look at words_added. That's my general indicator for new download vs update--my words_added column.

I also I use this, but the only place it's useful is in logpage_entries because logpage automatically leaves out unchanged values except on overwrite, so this indicates overwrite always vs 'lots of fields changed':

add_to_extra_valid_entries:,fulldownload
include_in_fulldownload:title
fulldownload_label:New Download

add_to_replace_metadata:
 fulldownload=>^.*$=>Yes

[Dudemanguy]

Been having problems with FFF for a few days now that i didn't have before, every time i try to download fics from ao3 using URL's from webpage feature i get the following error:
calibre, version 8.13.0
ERROR: Unhandled exception: <b>KeyError</b>:'href'

calibre 8.13 embedded-python: True
macOS-26.0.1-arm64-arm-64bit Darwin ('64bit', '')
('Darwin', '25.0.0', 'Darwin Kernel Version 25.0.0: Wed Sep 17 21:41:23 PDT 2025; root:xnu-12377.1.9~141/RELEASE_ARM64_T8122')
Python 3.11.14
OSX: ('26.0.1', ('', '', ''), 'arm64')
Interface language: None
EXE path: /Applications/calibre.app/Contents/MacOS/calibre
Successfully initialized third party plugins: Gather KFX-ZIP (from KFX Input) (2, 27, 0) && DeDRM (10, 0, 9) && Package KFX (from KFX Input) (2, 27, 0) && FanFicFare (4, 50, 0) && KFX metadata reader (from KFX Input) (2, 27, 0) && From KFX (2, 27, 0) && KFX Input (2, 27, 0) && Obok DeDRM (10, 0, 9)
Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 712, in get_urls_from_page_menu
frompage = self.get_urls_from_page(url)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 735, in get_urls_from_page
return get_urls_from_page(url,configuration)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/NAME/Library/Preferences/calibre/plugins/FanFicFare.zip/fanficfare/geturls.py", line 44, in get_urls_from_page
return adapter.get_urls_from_page(url,normalize)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/NAME/Library/Preferences/calibre/plugins/FanFicFare.zip/fanficfare/adapters/base_adapter.py", line 504, in get_urls_from_page
series = self.get_series_from_page(url,data,normalize)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/NAME/Library/Preferences/calibre/plugins/FanFicFare.zip/fanficfare/adapters/base_otw_adapter.py", line 688, in get_series_from_page
pageurls = [ a['href'] for a in pageas ]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/NAME/Library/Preferences/calibre/plugins/FanFicFare.zip/fanficfare/adapters/base_otw_adapter.py", line 688, in <listcomp>
pageurls = [ a['href'] for a in pageas ]
~^^^^^^^^
File "bs4/element.py", line 1573, in __getitem__
KeyError: 'href'

[JimmXinu]

I believe that is already addressed in the posted test version.

[Elaine T]

Originally Posted by JimmXinu

I believe that is already addressed in the posted test version.

FWIW, I just did a download from webpage and it behaved properly.

[HowWouldIKnow]

Hello there.
Is it possible to get Ratings, SCore, Favorites from
Literotica?

On a side note: Can I see somewhere what additional fields there are per website?

[JimmXinu]

Originally Posted by HowWouldIKnow

Hello there.
Is it possible to get Ratings, SCore, Favorites from
Literotica?

The adapter for literotica collects these site specific entries:

extra_valid_entries:eroticatags,averrating
eroticatags_label:Erotica Tags
averrating_label:Average Rating

If you open an issue about adding additional metadata entries (with details about what and where they appear), I can call it to the addition of the dev who works on the adapter for literotica lately. (No promises they would be interested in doing it, tho.)

Originally Posted by HowWouldIKnow

On a side note: Can I see somewhere what additional fields there are per website?

Look in defaults.ini and search for the site's section. Look at the extra_valid_entries setting.

[Mandabar]

I just noticed something today. If I'm following a story, say on royalroad, that like many others likes to stub itself. Deleting chapters to make them exclusively paid for, on Amazon KU is the usual place.

Used to be, I would just get an error on update, due to having more chapters in my book copy than are available online. I would remove in-progress from the story, and make a new book with the same url to continue grabbing the newer content.

I've been updating less frequently to prevent as many hits to the site and story, so more stubbing and updates since stubbing must've happened in a few stories. What I'm referring to is... hmm..
An example.

A story has chapters 1-100. Chapters 5-40 get removed. My copy has chapters 1-100. The author keeps releasing chapters. I attempt to update the story, which is now 1-5:41-200, and it updates fine with no error message; however, it deletes from my copy chapters 6-40. Since my copy had less than the online version.

Is this a change to how it used to work, never removing content from local copy and forcing manual edits? Not sure how many stories I might've lost chapters from instead of just making a new book for. Or is this how it always worked, that I just avoided because of more frequent update scraping?

(Noticed today, was a single update and checked before updating and clearly saw the TOC lost the first book and was able to recover from recently deleted formats)

I know this has always been an issue, that had to be delt with manually by making new books.

[HowWouldIKnow]

Originally Posted by JimmXinu

The adapter for literotica collects these site specific entries....
Look in defaults.ini and search for the site's section. Look at the extra_valid_entries setting.

Thank you!
So, extra_valid_entries are just those that are additionally available for this Website? Ahh and the same counts for extra_titlepage_entries, I see.
Does the order matter? ie.. Can I use the averrating in the custom_columns_settings, before the definition of the extra_valid_entires?

[JimmXinu]

Multi-reply

Originally Posted by Mandabar

An example.

A story has chapters 1-100. Chapters 5-40 get removed. My copy has chapters 1-100. The author keeps releasing chapters. I attempt to update the story, which is now 1-5:41-200, and it updates fine with no error message; however, it deletes from my copy chapters 6-40. Since my copy had less than the online version.

Update EPUB updates or not based just on the number of chapters. If there's more chapters on the site than in the epub, it assumes there are new chapters. It's always worked this way.

This whole business of authors deliberately removing chapters to encourage purchase is outside FanFicFare's paradigm. I am not interested in trying to work around it better for both technical and moral reasons. This has come up before.

Originally Posted by HowWouldIKnow

Thank you!
So, extra_valid_entries are just those that are additionally available for this Website? Ahh and the same counts for extra_titlepage_entries, I see.
Does the order matter? ie.. Can I use the averrating in the custom_columns_settings, before the definition of the extra_valid_entires?

As I recall, order of settings in the INI file doesn't matter. Order within a setting, like extra_titlepage_entries or replace_metadata matters a great deal.