[GUI Plugin] FanFicFare

[TaviCalderon]

Originally Posted by JimmXinu

I'd also change the first #multiseries in custom_columns_settings to 'r' mode to clear the pre-existing value on update. Otherwise, since it's a text column, you might end up with duplicates. (Depending on the custom column type. A 'tags' type text column could mask that.)

custom_columns_settings:
 series00=>#multiseries,r
 series01=>#multiseries,a
 series02=>#multiseries,a
 series03=>#multiseries,a
 series04=>#multiseries,a

this worked like a charm, thank you so much!!! i didn't realize i'd need to specify series00,series01,etc. instead of just using a generic "series" for replace_metadata lines...but in retrospect, duh. i knew it was something simple i just wasn't seeing. it always is, lol. clearing include_in_series also made things stop being wonky--i'm not sure where i even got that line from, but thank you for pointing that out.

noted, about the =~ for exclude_metadata_pre! i did not realize that was the prefered seperator, but i've fixed it for all of the other exclude_metadata_pre lines i have now.
i removed the Recommended Reading Order line from this section anyway, since i think your renaming convention under replace_metadata is a great idea. if i run into another series with a recommended reading order series tag and it does somehow manage to interfere/cause issues in the multiseries column, i'm sure i'll be circling back here anyway for assistance.

as for your final comment about the custom_columns_settings--this multiseries column i made is actually set up as a comma seperated text column, like tags, shown in the tag browser. i haven't seen duplicates like you're describing to date, even after fixing my ini and updating everything; i assume that's because i have it set up as a tags-type column. but do you think i should just keep it as "series00=>#multiseries,r" anyway? since clearing out pre-existing values on update is likely a good move regardless?? if you think so, i'll just keep it as ,r. let me know.

you're the best!! as always, thanks for the help!

[JimmXinu]

Originally Posted by TaviCalderon

but do you think i should just keep it as "series00=>#multiseries,r" anyway? since clearing out pre-existing values on update is likely a good move regardless?? if you think so, i'll just keep it as ,r. let me know.

A 'tags' like text column will automatically de-dup. I noticed it because I was testing with a non-tags like text column and got duplicates immediately.

Depends on what you want. If using 'a' for all of them, if you manually add a value to the column, it will be preserved. OTOH, if the story changes from "Series [1]" to "Series [2]", you end up with both on update.

[JimmXinu]

Originally Posted by watani

For example, in this story most chapters have small pictures used as section separators:
https://www.fimfiction.net/story/550...puppy-season-7

These images do not appear to get cached, so they fail to get downloaded when getting the story from cache.

Complicating matters is that embedded external images get their URLs "camouflaged", but it should be possible to extract the original image URL from the actual URL since they seem to follow the same general structure:

Example:
https://camo.fimfiction.net/XyZqEwTY...%2FmzLp1ln.png

where the original image URL is: https://i.ibb.co/8xvNY6K/mzLp1ln.png

If you don't set use_browser_cache_only:true, the BC feature will attempt to go to network for anything it doesn't find in cache. OTOH, that implicitly turns off open_pages_in_browser.

The Flaresolverr proxy code has a separate option for directimage, but that's because Flaresolverr doesn't download images at all anymore. And it looks like it's getting 403 blocked on direct images, too. So a direct download with Browser Cache wouldn't work, either.

Our code for images from xenforoforums (SB/SV/QQ/etc) stories can use the <img> tags' data-src or data-url attr.

The story you linked has a similar looking data-source attr. But I need a bigger sample set of stories with images to look at before I can confidently make that change for fimf. Hint-hint.

Also looks like the cover image download is broken--will try to fix.

[JimmXinu]

New Test Version Posted

2025-02-17
- adapter_fimfictionnet: Fix cover images and use data-source attr for img src.

watani got me some more story URLs to test with and my changes worked with them.

But only using Flaresolverr proxy with use_flaresolverr_proxy:directimages.

watani originally asked about browser cache--that still doesn't work. I'm not hugely interested in trying to figure out why not if Flaresolverr proxy works.

[Anyssia]

Originally Posted by JimmXinu

Re: CloudFlare

Originally Posted by Anyssia View Post
It works for chaptered fics, but does anyone knows if there is a way to force Calibre/FFF to make a ToC even for one-shot fanfics, please?


FFF only writes a TOC if there's more than one chapter--that's currently hard coded.

I could add an option to force TOC generation if that's something that's useful to people. I'd need to review what it might do to epub update and anthology generation.

yes, I would like that, if it's possible, thank you

[JimmXinu]

New Test Version Posted

2025-02-17
- Add include_tocpage:always option.
- adapter_fimfictionnet: Further cover fix

Originally Posted by Anyssia

yes, I would like that, if it's possible, thank you

Yes, you already said. I was asking more if anyone else would find it useful.

But it's a fairly small change that doesn't appear to affect anything else, so I went ahead with it.

## epub carries the TOC in metadata.
## mobi generated from epub by calibre will have a TOC at the end.
include_tocpage: false
## When set to 'true', tocpage is only included if there is more than
## one chapter in the story.  If set to 'always', tocpage will be
## included even if the story only has one chapter.
#include_tocpage: always

Note that:

1. Anthologies (and EpubMerge) reduces the anthology/merge ToC entry for single FFF chapter stories down to one entry, even if they have cover, title page and/or log page. It will not do that if there's a tocpage. If you've forced it on, I assume you want more ToC entries.
2. add_chapter_numbers still doesn't add a chapter number when there's only one chapter.

[JimmXinu]

New Test Version Posted

2025-02-20
- adapter_literotica: Get more story urls. #1159 Thanks, dbhmw

[agumon1123]

FFN chapters keep disappearing and reappearing when i use the normal URLs but when i use the old version of URLs without the story title i can always see the chapter. is there any way for Fanficfare to use the URLs without the story title in them as default like it used to? that way i don't have to check every 5 mins to see if the URL works or it stops working in the middle of downloading the story.

with story title:
https://www.fanfiction.net/s/1444077...ctly-Unplanned
https://www.fanfiction.net/s/1138615...We-Are-Revised

without story title:
https://www.fanfiction.net/s/14440772/1/
https://www.fanfiction.net/s/11386159/31/

[JimmXinu]

Originally Posted by agumon1123

FFN chapters keep disappearing and reappearing when i use the normal URLs but when i use the old version of URLs without the story title i can always see the chapter. is there any way for Fanficfare to use the URLs without the story title in them as default like it used to? that way i don't have to check every 5 mins to see if the URL works or it stops working in the middle of downloading the story.

Maybe?

FFF keeps the story title in the chapter URLs because that's how they're linked on the pages. The intention is for users to be able to pre-cache the chapter pages by just clicking through the chapters.

If we strip off the story title off chapter URLs, you become reliant on open_pages_in_browser--or manually removing the story title in browser.

And, as you say, it's random. /s/11386159/31/All-We-Are-Revised started working again as I was looking at this.

Is it possible that non-titled URLs can also fail and you just didn't bump into any?

[JimmXinu]

New Test Version Posted

2025-02-22
- adapter_fanfictionnet: Attempt chapter from m. (vs www) when chapter not found

Originally Posted by JimmXinu

And, as you say, it's random. /s/11386159/31/All-We-Are-Revised started working again as I was looking at this.

Is it possible that non-titled URLs can also fail and you just didn't bump into any?

FYI, while looking at the possibility of this, the first failing chapter I found failed both with and without story title in the URL. And then worked again minutes later.

However, somebody over on the mail list suggested trying m.ffnet. I have no guarantee it's any better, but at least I didn't immediately bump into the same problem while trying it.

[steltek]

Originally Posted by JimmXinu

Error log reported here show this specifically failing during login.

Does it work better without always_login:true? Or maybe it's worse on login-required stories?

Still nothing we can do to fix it, but it may be possible to avoid more.

I think there had been a previous discussion sometime in the past and the consensus was that it was best to leave always_login:true disabled unless you just had to have it for a fic that required you to log in. I can verify that not using always_login:true definitely doesn't help with the error situation as I have had it disabled all the time since that discussion, and turning it on or off doesn't seem to make a difference with the errors.

One curious thing I did just notice, though. I had some problems a little earlier tonight trying to download a couple of fics on A03 which was resulting in FFF throwing the continuous 525 Unhandled Exception errors. Not a single thing I tried that was previously discussed worked to fix it. And, one of the fics that was having problems was one that required you to be logged in to view it.

While trying to troubleshoot, I noticed that I was logged in to my A03 account in the web browser. When I logged out of my account in the browser, the metadata download in FFF immediately started working again.

That would seem to indicate that maybe one of the things Cloudflare is doing is monitoring and sometimes blocking simultaneous multiple device logins on the same account. It isn't always doing it, though, because I was apparently logged in to my account in the browser all day yesterday and didn't have any problems at all with about 12-14 total FFF downloads from A03 I did sporadically throughout the day yesterday. A couple of the URLs involved were also for fics that require you to be logged in to view them (which was why I happened to be logged in on account in the web browser in the first place).

[RoundRobbinReadz]

I think this is a simple ish question, but I can't find the answer. So, hence, my first post. I'll ask in two parts. This is using the Calibre plugin version of FanFicFare.

I created a custom column, in Calibre. Custom column name. Needs to be labeled in personal.ini. What's the code to do this? The label / name and any other lines of code needed?

Second part of the question:
Where would I look to find this information? Is there a wiki or FAQ I've missed? Any central location with links to the many resources designed to learn the basics of formatting custom columns in Calibre/FFF? Feels like I'm just missing a link tree or something similar.

Context:
Read primarily EPUBs from AO3, Downloaded from URL, using FFF, in Calibre.

I have followed a few different "Guides" but so far, none of them have actually contained this or it's not in the correct format. Probably got a mixed up somewhere in the Copy and Pasting of things. So, after researching, with no luck, I am going to the source! Thanks for any assistance.

[JimmXinu]

Originally Posted by RoundRobbinReadz

I think this is a simple ish question, but I can't find the answer. So, hence, my first post. I'll ask in two parts. This is using the Calibre plugin version of FanFicFare.

I created a custom column, in Calibre. Custom column name. Needs to be labeled in personal.ini. What's the code to do this? The label / name and any other lines of code needed?

I'm not sure what you mean, but I think you assume a greater degree of FFF-Calibre integration than exists.

I refer to the data FFF collects and handles as "metadata entries", which are separate from Calibre data, AKA columns. Simplifying a bit, FFF metadata entries are divided into 'standard' entries collected for most/all sites and 'site specific' entries that are only used by that site. For example, every site has title and author; snapeflavours is potionsandsnitches.org only.

If you want FFF to populate a Calibre custom column on download/update, you can set it in the FFF Custom Columns config tab (for standard metadata entries) in personal.ini with custom_columns_settings.

If you want a Calibre custom column to appear in your ebooks' title page on update (it's assumed the Calibre book is created during initial download), there's a checkbox in the FFF personal.ini config tab 'Pass Calibre Columns into FanFicFare on Update/Overwrite', and a button to show you want what FFF metadata entry names each column will be placed in. They will automatically be labeled the same as the Calibre Columns.

You can then used those metadata entry names in titlepage_entries or logpage_entries.

Originally Posted by RoundRobbinReadz

Second part of the question:
Where would I look to find this information? Is there a wiki or FAQ I've missed? Any central location with links to the many resources designed to learn the basics of formatting custom columns in Calibre/FFF? Feels like I'm just missing a link tree or something similar.

The FFF github project has a wiki which also has an FAQ.

A lot of INI settings are documented primarily in defaults.ini. You can see the defaults.ini for FFF Calibre plugin from the button on the FFF personal.ini config tab , or on github.

[JimmXinu]

New Test Version Posted

2025-02-23
- For adapter_mcstoriescom: Remove /../ from Get Story URLs from web page
- adapter_mcstoriescom: Suppress site URLs that look like stories but aren't. #1160

[ernand]

A problem that suddenly started happening to me is that FFF is asking for my AO3 login information to update my fics. I already have that information on the .ini, and I have not changed it.

I keep getting the Error: Failed to Login for URL: https://archiveofourown.org/works/57...iew_adult=true) with username: (Ernand)