[GUI Plugin] FanFicFare

[JimmXinu]

Originally Posted by mimicxz

There seems to be a misunderstanding
The URL I sent you, the story has 25 chapters, but FFF will only capture 19 chapters, not the rest.
How do I manually modify the number and order of captured chapters?
Thanks & Best Regards,

Duplicate Stories

The URL you posted was a literotica memberpage.php page; an author's page listing 4 stories. That author has posted the same story with the same chapter URLs twice, once stopping at 19 parts and then 24 parts(last named ch25).

FFF assumes that stories have unique URLs. And for literotica, FFF uses the first chapter URL for the story URL.

Personally, I would call this a site bug. I'm not planning to 'fix' it in FanFicFare.

Work Arounds

However, due to how the literotica adapter is coded, there are a couple work arounds you could try:

1. Download the story with FFF CLI, either installed with pip or using Calibre's debug CLI to run it from the plugin (no need to install anything else) using the last chapter URL in the longer version as the story URL.
   

   calibre-debug.exe --run-plugin FanFicFare -- [options] <storyurl>

   This will download the story to disk and you will need to manually add it to Calibre.
2. Change the story URL in Calibre's Ids url field to the last chapter URL in the longer version and update the story with Background Metadata? checked (check 'Show Download Options' on the 'Update Existing' dialog.

In both cases, FFF will still record the first chapter URL as the story URL. If the story is ever updated, you'd have to do this again.

How this works

The literotica adapter is coded to search for the URL as given, then collect the chapter list it is found in.

In normal operation, the plugin version gets the metadata from the site first, finding the first chapter URL to use as story URL. Then the background download process gets the metadata again, now using the first chapter/story URL and finds the first version of the story. FFF caches the HTML pages rather than the parsed metadata.

When using CLI or BG metadata, the metadata is only collected once, so the story list from the given URL is used.

This is a peculiarity of the literotica adapter, not something common.

[ronnie0602]

Hi JimmXinu!

If possible and if time allows, would you mind testing download of the following specific story from FFnet? I keep getting an Error 403 each time I try.

https://www.fanfiction.net/s/14274364/1/Dead-Ringer

FanFicFare Log:

Status: Error
Title: Unknown
Author: Unknown
Comment: HTTP Error in FFF '403 Client Error: Forbidden for url: https://www.fanfiction.net/s/1427436...inger'(403)
URL: https://www.fanfiction.net/s/14274364/1/Dead-Ringer


I cleared my cache, I did not go overboard with multiple or repeated downloads, and I'm not having any issues downloading other FFnet new stories or updating stories already existing in my Calibre.

Debug temp file attached.
Thank you very much,
Ronnie

[JimmXinu]

Originally Posted by ronnie0602

If possible and if time allows, would you mind testing download of the following specific story from FFnet? I keep getting an Error 403 each time I try.
...
I cleared my cache, I did not go overboard with multiple or repeated downloads, and I'm not having any issues downloading other FFnet new stories or updating stories already existing in my Calibre.

Works fine with Browser Cache for me.

Your log suggests that your browser didn't cache the page recently:

FFF: DEBUG: 2023-10-11 23:19:43,118: base_browsercache.py(100): age:2023-09-03 21:17:10
FFF: DEBUG: 2023-10-11 23:19:43,118: base_browsercache.py(101): now:2023-10-11 23:19:43.119000
FFF: DEBUG: 2023-10-11 23:19:43,118: base_browsercache.py(103): Cache entry found, rejected, past age limit

Is your FFF configured for the same browser you are using? Because a cache entry from last month doesn't look like a cleared cache...

Perhaps you didn't get the URL exactly right? We've also seen in-browser proxy/firewalls screw up caching.

I would suggest referring to the BrowserCacheFeature wiki page. Turning on open_pages_in_browser:true can help with getting the URLs cached correctly.

Personally, I use:

[www.fanfiction.net]
use_browser_cache:true
use_browser_cache_only:true
open_pages_in_browser:true

[ronnie0602]

Thank you!

Yes on the FFF config. Using the same browser. I assume if config were wrong I would have similar issues on other stories (new or chapter updates...).

Anyway, I'll clear the cache again, double-check browser path per BrowserCacheFeature wiki and add the additional browser options you suggested to my personal.ini - I think I only have use_browser_cache: true in my .ini.

I hope it works. I'll let you know.
Thanks again for taking the time JimmXinu.
I really appreciate it.

[ronnie0602]

Hmm

I cleared the cache again and downloaded successfully even before adding the suggested .ini options. I'll add them anyway - can't go wrong following expert advice...

Thanks again!
Best always,
Ronnie

[BetterRed]

Originally Posted by ronnie0602

Hmm

I cleared the cache again and downloaded successfully even before adding the suggested .ini options. I'll add them anyway - can't go wrong following expert advice...

Thanks again!
Best always,
Ronnie

You need to bump your post count above 10, post some replies in the Lounge

That'll thwart the anti-canned meat measure - and save me some work

BR

[ronnie0602]

Originally Posted by BetterRed

You need to bump your post count above 10, post some replies in the Lounge

That'll thwart the anti-canned meat measure - and save me some work

BR

I'm sorry for the extra work... I'm new here, I would expect a low post count (?). I'm not sure what Lounge is, but my inquiry was FFF specific and I have - now and on a previous occasion - received outstanding support/suggestions/advice.

Hopefully I won't create too big a headache for you; not my intention...
Sorry and thank you!
Ronnie

[ownedbycats]

I somehow suspect this isn't a FFF issue specifically, but does anybody know why sometimes I get an email notification about a fanfic update on AO3 but then when I go to download it the last-updated date is several weeks (or even months) old?

[ownedbycats]

How would I replace_metadata to insert some text (separate paragraph) at the beginning of description? I ended up accidentally overwriting the description which isn't quite what I wanted, lol.

This is for a series description, using seriesUrl as conditional.

[JimmXinu]

Pretty easy:

add_to_replace_metadata:
 description=>^(.*)$=>Prefix \1

If you have keep_summary_html:true (which is the default), you might want to use HTML.

[ownedbycats]

It worked! I was trying to do the same, I guess I made a typo in the regex.

[chicleeblair]

Since at least yesterday, if I’ve tried to get fics from my email, and the update has been a new chapter, FFF has told me that they’ve been skipped because they’re duplicate stories. All fits have been AO3, and if I go directly to them and update ePub there has been a new chapter, so for instance I had five chapters on this fic and it updated to six. I’ve updated to the latest version of the plug-in, still happened, and I’m on calibre 6.27

[ownedbycats]

AO3 update emails contain at least two link to the story, so you'll get at least one 'duplicate story' message. Are the fics actually getting updated?

[JimmXinu]

Originally Posted by chicleeblair

Since at least yesterday, if I’ve tried to get fics from my email, and the update has been a new chapter, FFF has told me that they’ve been skipped because they’re duplicate stories. All fits have been AO3, and if I go directly to them and update ePub there has been a new chapter, so for instance I had five chapters on this fic and it updated to six. I’ve updated to the latest version of the plug-in, still happened, and I’m on calibre 6.27

That sounds like you may have your default update mode (aka "If Story Already Exists?") set to Skip instead of Update. See wiki page for a full discussion of updates modes.

FYI, I do not see 'duplicate story' messages from duplicated story URLs when updating from AO3 emails.

[ownedbycats]

Originally Posted by JimmXinu

That sounds like you may have your default update mode (aka "If Story Already Exists?") set to Skip instead of Update. See wiki page for a full discussion of updates modes.

FYI, I do not see 'duplicate story' messages from duplicated story URLs when updating from AO3 emails.

I get it with drag and drop. There's a link for the main story, and one for the specific chapter.