[GUI Plugin] FanFicFare

[DBK]

Originally Posted by DBK

So then what would be the right way to download from qq, and then to update that ebook later on?

When I don't Overwrite for a QQ ebook I get FanFicFare doesn't recognize chapters in existing epub, epub is probably from a different source. Use Overwrite to force update

[ownedbycats]

Originally Posted by steltek

No, not just you.

Things appear to have just gotten worse the last few days than they were.

Beginning yesterday, I'm seeing failed SSL handshake errors every other attempt to download.

https://github.com/JimmXinu/FanFicFa...oblematicSites

[ownedbycats]

I'm starting to wonder if use_archiveofourown_gay:true should be default.

[JimmXinu]

New Test Version Posted

2025-05-27
- adapter_ficbooknet: Site changes, thanks dbhmw
- adapter_literotica: Fix date parsing. See #1208, thanks dbhmw
- Add Ctrl-Enter to AddDialog, consolidating code with INIEdit


FYI, monthly release will probably be a few days late.

[ownedbycats]

What does that last point do?

[JimmXinu]

Make 'ctrl-enter' while editing in the 'Download from URLs' dialog box equivalent to clicking 'OK'.

The INI edit dialog box has had it for a while and I was surprised when it didn't work in the 'Add' dialog.

[ThreeLizards]

Is there a fix for the anthology stuff? I keep getting an error every time I try to use it. And I'm using the alternate AO3 right now.

[JimmXinu]

Originally Posted by ThreeLizards

Is there a fix for the anthology stuff? I keep getting an error every time I try to use it. And I'm using the alternate AO3 right now.

???

What is "the anthology stuff"? And what error?

Update: I just did an anthology of an AO3 series with use_archiveofourown_gay:true and it worked fine.

[steltek]

Originally Posted by ownedbycats

https://github.com/JimmXinu/FanFicFa...oblematicSites

I'm fully aware of all of those issues. Was just verifying for @Arkeus that they weren't the only one.

I've also started to see the handshake issues using the "use_archiveofourown_gay:true" workaround. It has reached the point where it is even disrupting use of the browser cache as well.

Never, ever thought I'd see the day when A03 was working worse than FFN....

[ownedbycats]

What does 'outfile' (includes the single-quotations) mean in the download log? I was updating some fics and got an already-downloaded oneshot.

EDIT: I tried again, got Already contains 1 chapters.

[JimmXinu]

Originally Posted by ownedbycats

What does 'outfile' (includes the single-quotations) mean in the download log? I was updating some fics and got an already-downloaded oneshot.

EDIT: I tried again, got Already contains 1 chapters.

Can I have a bit more context? Maybe see the download log in question?

[ownedbycats]

Here:

-------------------------------------------------------------------------------- https://archiveofourown.org/works/65876869
FFF: DEBUG: 2025-05-28 17:32:03,033: configurable.py(639): config site:archiveofourown.org
FFF: DEBUG: 2025-05-28 17:32:03,050: story.py(762): use_browser_cache:true
FFF: DEBUG: 2025-05-28 17:32:03,059: configurable.py(1106): use_browser_cache:true
FFF: DEBUG: 2025-05-28 17:32:03,059: configurable.py(1108): browser_cache_path:D:\AppData\Vivaldi\User Data\Default\Cache\Cache_Data
FFF: DEBUG: 2025-05-28 17:32:03,068: browsercache_blockfile.py(53): Using BlockfileCache
FFF: DEBUG: 2025-05-28 17:32:03,069: configurable.py(1127): use_basic_cache:true
FFF: INFO: 2025-05-28 17:32:03,069: base_otw_adapter.py(142): url: https://archiveofourown.org/works/65876869/navigate?view_adult=true
FFF: INFO: 2025-05-28 17:32:03,069: base_otw_adapter.py(143): metaurl: https://archiveofourown.org/works/65876869?view_adult=true
FFF: DEBUG: 2025-05-28 17:32:03,070: cache_basic.py(116): 
========== HIT (GET) BasicCache
https://archiveofourown.gay/works/65876869/navigate?view_adult=true
FFF: DEBUG: 2025-05-28 17:32:03,071: requestable.py(55): Encoding:utf8
FFF: DEBUG: 2025-05-28 17:32:03,072: cache_basic.py(116): 
========== HIT (GET) BasicCache
https://archiveofourown.gay/works/65876869?view_adult=true
FFF: DEBUG: 2025-05-28 17:32:03,072: requestable.py(55): Encoding:utf8
FFF: DEBUG: 2025-05-28 17:32:03,211: base_otw_adapter.py(272): numChapters: (1)

(about 20 "Skipping replace_metadata on seriesUrl to prevent infinite recursion"s, cut them)

FFF: DEBUG: 2025-05-28 17:32:03,266: calibre_plugins.fanficfare_plugin.jobs(312): metadata newforanthology:
FFF: INFO: 2025-05-28 17:32:03,278: calibre_plugins.fanficfare_plugin.jobs(494): Exception: {'title': 'The Man Trap', 'author_sort': ['TVgirll1971'], 'author': ['TVgirll1971'], 'comments': '<div class="userstuff">\n              <p align="justify">As Dr. McCoy tries to record a log regarding the autopsy of the M-113 being, he can\'t stop thinking about the woman he once loved--Nancy Crater.</p>\n            </div>', 'good': False, 'status': 'Error', 'showerror': False, 'calibre_id': 9512, 'begin': None, 'end': None, 'comment': "'outfile'", 'url': 'https://archiveofourown.org/works/65876869', 'site': 'archiveofourown.org', 'series': 'After Mission Logs [3]', 'added': False, 'pubdate': datetime.datetime(2025, 5, 27, 0, 0, tzinfo=datetime.timezone(datetime.timedelta(days=-1, seconds=75600), 'Atlantic Daylight Time')), 'publisher': 'Archive of Our Own', 'uniqueurl': 'https://archiveofourown.org/works/65876869[None-None]', 'listorder': 2, 'collision': 'Update EPUB if New Chapters', 'is_adult': False, 'username': 'NoneGiven', 'password': '', 'totp': None, 'icon': 'dialog_error.png', 'all_metadata': {'category': 'Star Trek: The Original Series', 'genre': 'Episode: s01e05 The Man Trap, Gen', 'characters': 'Leonard "Bones" McCoy', 'ships': '', 'warnings': 'No Archive Warnings Apply', 'extratags': 'FanFiction', 'author': 'TVgirll1971', 'authorId': 'TVgirll1971', 'authorUrl': 'https://archiveofourown.org/users/TVgirll1971/pseuds/TVgirll1971', 'lastupdate': 'Last Update Year/Month: 2025/05, Last Update: 2025/05/27', 'series': 'After Mission Logs [3]', 'seriesUrl': 'https://archiveofourown.org/series/4838692', 'language': 'English', 'status': 'Completed', 'datePublished': '2025-05-27', 'dateUpdated': '2025-05-27', 'dateCreated': '2025-05-28 17:31:30', 'rating': 'General Audiences', 'numChapters': '1', 'numWords': '663', 'words_added': '', 'site': 'archiveofourown.org', 'publisher': 'Archive of Our Own', 'storyId': '65876869', 'title': 'The Man Trap', 'titleHTML': "<a class='titlelink' href='https://archiveofourown.org/works/65876869'>The Man Trap</a>", 'storyUrl': 'https://archiveofourown.org/works/65876869', 'sectionUrl': 'https://archiveofourown.org/works/65876869', 'description': '<div class="userstuff">\n              <p align="justify">As Dr. McCoy tries to record a log regarding the autopsy of the M-113 being, he can\'t stop thinking about the woman he once loved--Nancy Crater.</p>\n            </div>', 'formatname': '', 'formatext': '', 'siteabbrev': 'ao3', 'version': 'FanFicFare v4.45.6', 'authorHTML': "<a class='authorlink' href='https://archiveofourown.org/users/TVgirll1971/pseuds/TVgirll1971'>TVgirll1971</a>", 'seriesHTML': "<a class='serieslink' href='https://archiveofourown.org/series/4838692'>After Mission Logs [3]</a>", 'langcode': 'en', 'output_css': '', 'cover_image': '', 'newforanthology': '', 'fandoms': 'Star Trek: The Original Series', 'freeformtags': 'Episode: s01e05 The Man Trap', 'freefromtags': 'Episode: s01e05 The Man Trap', 'ao3categories': 'Gen', 'comments': '', 'chapterslashtotal': '1/1', 'chapterstotal': '1/1', 'kudos': '', 'hits': '15', 'bookmarks': '', 'collections': '', 'byline': 'TVgirll1971', 'bookmarked': '', 'bookmarktags': '', 'bookmarksummary': '', 'bookmarkprivate': '', 'bookmarkrec': '', 'subscribed': '', 'markedforlater': '', 'restricted': '', 'series00': 'After Mission Logs [3]', 'series01': '', 'series02': '', 'series03': '', 'series00Url': 'https://archiveofourown.org/series/4838692', 'series01Url': '', 'series02Url': '', 'series03Url': '', 'series00HTML': "<a class='series00link' href='https://archiveofourown.org/series/4838692'>After Mission Logs [3]</a>", 'series01HTML': '', 'series02HTML': '', 'series03HTML': '', 'oneshot': 'Oneshot', 'tagscategory': 'Fanfiction.Star Trek', 'covertype': '', 'subtitle': '', 'fictags': '', 'ao3chaps': '1', 'collectionUrl': '', 'titlebyauthor': ''}, 'savemetacol': '<p><span class=\'label\'>Adapter_Classes</span>: <div class=\'metadata list\' id=\'adapter_classes\'><ul>\n<li>ArchiveOfOurOwnOrgAdapter</li>\n</ul></div><p>\n\n<p><span class=\'label\'>AO3 Categories</span>: <div class=\'metadata list\' id=\'ao3categories\'><ul>\n<li>Gen</li>\n</ul></div><p>\n\n<p><span class=\'label\'>Author</span>: <div class=\'metadata list\' id=\'author\'><ul>\n<li>TVgirll1971</li>\n</ul></div><p>\n\n<p><span class=\'label\'>Authorhtml</span>: <div class=\'metadata\' id=\'authorHTML\'><a class=\'authorlink\' href=\'https://archiveofourown.org/users/TVgirll1971/pseuds/TVgirll1971\'>TVgirll1971</a></div><p>\n\n<p><span class=\'label\'>Author ID</span>: <div class=\'metadata list\' id=\'authorId\'><ul>\n<li>TVgirll1971</li>\n</ul></div><p>\n\n<p><span class=\'label\'>Author URL</span>: <div class=\'metadata list\' id=\'authorUrl\'><ul>\n<li>https://archiveofourown.org/users/TVgirll1971/pseuds/TVgirll1971</li>\n</ul></div><p>\n\n<p><span class=\'label\'>Byline</span>: <div class=\'metadata\' id=\'byline\'>TVgirll1971</div><p>\n\n<p><span class=\'label\'>Chapters/Total Chapters</span>: <div class=\'metadata\' id=\'chapterslashtotal\'>1/1</div><p>\n\n<p><span class=\'label\'>Characters</span>: <div class=\'metadata list\' id=\'characters\'><ul>\n<li>Leonard "Bones" McCoy</li>\n</ul></div><p>\n\n<p><span class=\'label\'>Packaged</span>: <div class=\'metadata datetime\' id=\'dateCreated\'>2025-05-28T17:31:30.150636</div><p>\n\n<p><span class=\'label\'>Published</span>: <div class=\'metadata datetime\' id=\'datePublished\'>2025-05-27T00:00:00</div><p>\n\n<p><span class=\'label\'>Updated</span>: <div class=\'metadata datetime\' id=\'dateUpdated\'>2025-05-27T00:00:00</div><p>\n\n<p><span class=\'label\'>Summary</span>: <div class=\'metadata\' id=\'description\'><div class="userstuff">\n              <p>As Dr. McCoy tries to record a log regarding the autopsy of the M-113 being, he can\'t stop thinking about the woman he once loved--Nancy Crater.</p>\n            </div></div><p>\n\n<p><span class=\'label\'>Fandoms</span>: <div class=\'metadata list\' id=\'fandoms\'><ul>\n<li>Star Trek: The Original Series</li>\n</ul></div><p>\n\n<p><span class=\'label\'>Freeform Tags</span>: <div class=\'metadata list\' id=\'freeformtags\'><ul>\n<li>Episode: s01e05 The Man Trap</li>\n</ul></div><p>\n\n<p><span class=\'label\'>Hits</span>: <div class=\'metadata\' id=\'hits\'>15</div><p>\n\n<p><span class=\'label\'>Langcode</span>: <div class=\'metadata\' id=\'langcode\'>en</div><p>\n\n<p><span class=\'label\'>Language</span>: <div class=\'metadata\' id=\'language\'>English</div><p>\n\n<p><span class=\'label\'>Lastupdate</span>: <div class=\'metadata list\' id=\'lastupdate\'><ul>\n<li>Last Update Year/Month: 2025/05</li>\n<li>Last Update: 2025/05/27</li>\n</ul></div><p>\n\n<p><span class=\'label\'>Chapters</span>: <div class=\'metadata int\' id=\'numChapters\'>1</div><p>\n\n<p><span class=\'label\'>Words</span>: <div class=\'metadata\' id=\'numWords\'>663</div><p>\n\n<p><span class=\'label\'>Python_Version</span>: <div class=\'metadata\' id=\'python_version\'>3.11.12 (main, Apr 15 2025, 19:55:57) [MSC v.1937 64 bit (AMD64)]</div><p>\n\n<p><span class=\'label\'>Rating</span>: <div class=\'metadata\' id=\'rating\'>General Audiences</div><p>\n\n<p><span class=\'label\'>Story URL Section</span>: <div class=\'metadata\' id=\'sectionUrl\'>https://archiveofourown.org/works/65876869</div><p>\n\n<p><span class=\'label\'>Series</span>: <div class=\'metadata list\' id=\'series\'><ul>\n<li>After Mission Logs [3]</li>\n</ul></div><p>\n\n<p><span class=\'label\'>Series00</span>: <div class=\'metadata\' id=\'series00\'>After Mission Logs [3]</div><p>\n\n<p><span class=\'label\'>Series</span>: <div class=\'metadata\' id=\'series00HTML\'><a class=\'series00link\' href=\'https://archiveofourown.org/series/4838692\'>After Mission Logs [3]</a></div><p>\n\n<p><span class=\'label\'>Series00Url</span>: <div class=\'metadata\' id=\'series00Url\'>https://archiveofourown.org/series/4838692</div><p>\n\n<p><span class=\'label\'>Additional Series</span>: <div class=\'metadata\' id=\'series01HTML\'></div><p>\n\n<p><span class=\'label\'>Additional Series</span>: <div class=\'metadata\' id=\'series02HTML\'></div><p>\n\n<p><span class=\'label\'>Additional Series</span>: <div class=\'metadata\' id=\'series03HTML\'></div><p>\n\n<p><span class=\'label\'>Series</span>: <div class=\'metadata\' id=\'seriesHTML\'><a class=\'serieslink\' href=\'https://archiveofourown.org/series/4838692\'>After Mission Logs [3]</a></div><p>\n\n<p><span class=\'label\'>Series URL</span>: <div class=\'metadata list\' id=\'seriesUrl\'><ul>\n<li>https://archiveofourown.org/series/4838692</li>\n</ul></div><p>\n\n<p><span class=\'label\'>Publisher</span>: <div class=\'metadata\' id=\'site\'>archiveofourown.org</div><p>\n\n<p><span class=\'label\'>Site Abbrev</span>: <div class=\'metadata\' id=\'siteabbrev\'>ao3</div><p>\n\n<p><span class=\'label\'>Status</span>: <div class=\'metadata\' id=\'status\'>Completed</div><p>\n\n<p><span class=\'label\'>Story ID</span>: <div class=\'metadata\' id=\'storyId\'>65876869</div><p>\n\n<p><span class=\'label\'>Story URL</span>: <div class=\'metadata\' id=\'storyUrl\'>https://archiveofourown.org/works/65876869</div><p>\n\n<p><span class=\'label\'>Title</span>: <div class=\'metadata\' id=\'title\'>The Man Trap</div><p>\n\n<p><span class=\'label\'>Titlehtml</span>: <div class=\'metadata\' id=\'titleHTML\'><a class=\'titlelink\' href=\'https://archiveofourown.org/works/65876869\'>The Man Trap</a></div><p>\n\n<p><span class=\'label\'>Downloader Version</span>: <div class=\'metadata\' id=\'version\'>FanFicFare v4.45.6</div><p>\n\n<p><span class=\'label\'>Warnings</span>: <div class=\'metadata list\' id=\'warnings\'><ul>\n<li>No Archive Warnings Apply</li>\n</ul></div><p>\n', 'tags': ['Fanfiction.Star Trek'], 'updatedate': datetime.datetime(2025, 5, 27, 0, 0, tzinfo=datetime.timezone(datetime.timedelta(days=-1, seconds=75600), 'Atlantic Daylight Time')), 'timestamp': datetime.datetime(2025, 5, 28, 17, 32, 3, 51669, tzinfo=datetime.timezone(datetime.timedelta(days=-1, seconds=75600), 'Atlantic Daylight Time'))}:'outfile'
Traceback (most recent call last):
  File "calibre_plugins.fanficfare_plugin.jobs", line 335, in do_download_for_worker
KeyError: 'outfile'
FFF: INFO: 2025-05-28 17:32:03,280: calibre_plugins.fanficfare_plugin.jobs(190): 
Download Results:
Update https://archiveofourown.org/works/65890285 Update epub completed, added 2 chapters for 4 total.
Update https://archiveofourown.org/works/64621624 Update epub completed, added 1 chapters for 4 total.
Error https://archiveofourown.org/works/65876869 'outfile'

Not sure what metadata newforanthology was for, I wasn't downloading to an anthology.

Settings:

[defaults]
## Browser cache settings
open_pages_in_browser:true
browser_cache_path:D:\AppData\Vivaldi\User Data\Default\Cache\Cache_Data

[archiveofourown.org]
use_archiveofourown_gay:true
slow_down_sleep_time:5

## Browser cache settings
use_browser_cache:true
use_browser_cache_only:false

[JimmXinu]

FFF: DEBUG: 2025-05-28 17:32:03,266: calibre_plugins.fanficfare_plugin.jobs(312): metadata newforanthology:

This is fine for 'not doing an anthology'--it would have True after if it was.

But that's not line 312 in the current jobs.py--it's line 320.

Which suggests your plugin zip file is out of date (from the current test version). Once in a blue moon we see evidence of plugin zip not updating or not updating completely. I did double check that the posted zip is up to date.

'outfile' is the key used for the temp file name during download/update. The last change to jobs.py involved passing metadata collection failures through the BG process so they don't just disappear.

My best current guess is that the 'outfile' error could be a failure for that URL in the initial metadata collection hitting the older jobs.py??

[ownedbycats]

I know I got the 05-19 test version, and probably the 05-23 (it was in my downloads folder but maybe not installed). I didn't get 05-27 yet because the changes weren't sites I used.

[JimmXinu]

Then try the latest and see if happens again.