[GUI Plugin] FanFicFare

[wildfire070]

What's the best update mode to use in order to implement edits to my personal.ini to format my fics?

In my case, I've updated my personal.ini to format my title page a certain way. I do see the new format when I add new fics or update a current fic.

However, I have thousands of fics in my library and afraid running a batch update will flag my IP address on AO3. Also I don't want to accidentally delete/mess up my existing fics since I know there's several where the links are dead or the author has deleted the fic off the site.

[ownedbycats]

Originally Posted by wildfire070

What's the best update mode to use in order to implement edits to my personal.ini to format my fics?

In my case, I've updated my personal.ini to format my title page a certain way. I do see the new format when I add new fics or update a current fic.

However, I have thousands of fics in my library and afraid running a batch update will flag my IP address on AO3. Also I don't want to accidentally delete/mess up my existing fics since I know there's several where the links are dead or the author has deleted the fic off the site.

Use Update Always as that'll update the title page but not story text.

a) Mark them all with @cleanup or some tag. Then go though them a few at a time and remove the tag to know you finished. Expect this to take weeks.

b) FFF won't update a deleted story, just skip over them. I mark those ones as Status: Abandoned. (I also have 'Dormant' for not updated in past 365 days.)

[wildfire070]

Originally Posted by ownedbycats

Use Update Always as that'll update the title page but not story text.

a) Mark them all with @cleanup or some tag. Then go though them a few at a time and remove the tag to know you finished. Expect this to take weeks.

b) FFF won't update a deleted story, just skip over them. I mark those ones as Status: Abandoned. (I also have 'Dormant' for not updated in past 365 days.)

Perfect! Thanks! Is there a way to update stories that have been abandoned/deleted by the author, with my new formatting in my personal.ini? I'm assuming since FFF skips over deleted stories, those will then have to be individually edited manually?

[ownedbycats]

No. If you have a longtext metadata column already filled, you can update the Calibre metadata, but not title page.

[JimmXinu]

New Test Version Posted

2025-06-10
- PI BG Jobs: Fix split without reconsolidate.

Addresses w4tchdoge's issue.



A bit off-topic, but related: I've spent the several days figuring out how I want to use Kobo Clara Colour and, eventually, KOReader, with FFF.

I thought I might share my thoughts and decisions before I forget it all, but I'm not sure where. Any suggestions?

[ownedbycats]

In-scope for the the FanFicFare and eReaders page?
https://github.com/JimmXinu/FanFicFa...e-and-eReaders

[w4tchdoge]

Originally Posted by ownedbycats

Are you using use_archive_transformativeworks_org? It doesn't have ability to login. use_archiveofourown_gay does.

No, I'm using use_archiveofourown_gay. For reference, here's the AO3 section of my ini file

Spoiler:

[archiveofourown.org]
username:XXXXXXXX
password:XXXXXXXX
#always_login:true
always_login:false
#use_browser_cache:true
#use_browser_cache_only:true
open_pages_in_browser:true

use_archiveofourown_gay:true

slow_down_sleep_time:4

#tweak_fg_sleep:true
#min_fg_sleep:1.5
#max_fg_sleep:2.2
#max_fg_sleep_at_downloads:1.5

#use_browser_cache:true
#use_browser_cache_only:true
#open_pages_in_browser:true
#use_flaresolverr_proxy:directimages

add_to_extratags:,From AO3
add_to_extra_valid_entries:,user_added_freeform_tags,fin_freeformtags,abr_rating,prefix_ships,prefix_fandom,prefix_category,prefix_characters,prefix_rating,prefix_status,prefix_wordcount,prefix_freeform_tags,dateRange,main_ship,main_fandom

warnings_label:Archive Warning
ao3categories_label:Category
fandoms_label:Fandom
freeformtags_label:Additional Tags
fin_freeformtags_label:Additional Tags
chapterslashtotal_label:Chapters

## Most of the following formatting is taken from https://www.mobileread.com/forums/showthread.php?p=4301621#post4301621 and has been modified to taste

include_in_prefix_ships:ships
include_in_prefix_fandom:category
include_in_prefix_category:ao3categories
include_in_prefix_characters:characters
## Freeform tags disabled so as to
## not clutter up the tag browser
## Except not anymore they aren't
include_in_fin_freeformtags:freeformtags
include_in_prefix_freeform_tags:fin_freeformtags
include_in_prefix_rating:rating
include_in_abr_rating:rating
include_in_prefix_status:status
include_in_prefix_wordcount:numWords
include_in_main_ship:ships
include_in_main_fandom:category

add_to_replace_metadata:
## Cleanup of some author names
 author=>.*(Obscura)_of_the_House_of_Moon_and_Star.*=>\1
 author=>.*(HeraGuin) .orphan_account..*=>\1
##
## Display only the Pseudonym instead of both the Pseud and the Main account name
## Disabled because I have decided to manually set whether the pseud or the main name is set on an author-by-author basis
# author=>^([^\(]+) \([^\)]+\)$=>\1
##
## Manual setting whether the pseud or the main name is used
 author=>(One Sin - One Grace) \(EverythingNarrative\)=>\1
 author=>(Agrippa) \([^\)]+Agrippa\)=>\1
 author=>SiNC Coauthor - (Aleph \(Immatrael\))=>\1
 author=>blackhawkscot \((blackbirdscot)\)=>\1
 author=>(Natalie the Cat) \(NatalieTheCat\)=>\1
 author=>Clarissa \((Clarissa13)\)=>\1
 author=>(AmeliaCF) \(Clarissa13\)=>\1
 author=>(Eva Grimm) \(elusivetruth\)=>\1
 author=>(ineffable_wife_Gaya) \(ineffable_wives\)=>\1
 author=>(Kinsfire) \(The_REAL_Kinsfire\)=>\1
 author=>(KnightSpark) \(BurstEdge\)=>\1
 author=>(Nemesis13) \(Melfice13\)=>\1
 author=>(Slider) \(TemporalKnight\)=>\g<1>214
 author=>(TheStellarJade) \(JaydrFamiliar\)=>\1
 author=>(Geas) \(Pulpygoblin\)=>\1
 author=>(Camelia_Sumori) \(Himecat\)=>\1
##
## Create abbreviated rating for use in titlepage
 abr_rating=>^$=>Not Rated
 abr_rating=>^.*(Not Rated).*$=>\1
 abr_rating=>^(General|Teen|Mature|Explicit)( ((And Up )?Audiences))?$=>\1
##
## Cleaning up some fandom tags
 category=>(?i)^.*?(Kantai Collection|Kancolle).*$=>Kantai Collection
 category=>(?i)^(original content \(parahumans series\)|w(orm(( (\(web serial\) \| wildbow|\| parahumans|\- wildbow|\- wilbow|series|verse)|: a complete web seriel| (web )?serial|verse)| \- fandom)|ildbow \- fandom|ard \- fandom)|parahuman series \- wildbow|worm \(web( (serial )?novel|novel)\)|parahumans \- fandom|worm \(web serial\)|worm \((web serie|parahuman)s\)|worm \(webseries\)|parahu(man)?|#worm)$=>Parahumans Series - Wildbow
 category=>(?i)^hololive English - Fandom$=>HoloEN
 category=>(?i)^((欢迎来到实力至上主义的教室|Classroom - fandom|Classroom of the)|(.*?(Classroom of the Elite).*))$=>Classroom of the Elite
 category=>(?i)^((Hibike|Sound)!? Euphonium|(吹响吧上低音号|響け! ユーフォニアム|高坂丽奈|黄前久美子)).*?$=>Hibike! Euphonium
 category=>(?i)^(86|Eighty.?Six)(-(エイティシックス|不存在的战区)| (- Fandom|Eighty Six|\| Eighty.?Six)).*?$=>86: Eighty Six
 category=>(?i)^((Miss Koba?yashi.?s Dragon Maid|Kobayashi-san Chi No Maid|Dragon Maid.?s)|(小林さんちのメイドラゴン|小林家的女僕龍|小林家的妹抖龍|小林家的龍女僕|小林家的龙女仆)).*?$=>Miss Kobayashi's Dragon Maid
 category=>(?i)^((崩坏3rd|honkai impact|honkai impact 3(rd)?|Honkaiimpact3rd|Ottonology|Revelation Impact 2nd)|(Eden/Elysia（崩壞第3彈）)|((Fu Hua|HI3|Honkai|KiaMei|Kiana Kaslana|Raiden Mei|Rita Rossweisse|奥托) - Fandom)|(为什么分类了|后崩坏书|奥莲|崩坏三|崩坏三rd|神州折剑录|第3 \| Honkai冲击第3（电子游戏）)).*?$=>Honkai Impact 3rd (Video Game)
 category=>(?i)^(((Mobile Suit )?Gundam:? (The )?Witch( (from|of) Mercury)?)|(The Witch from Mercury)|((G_?Witch|SuleMio)( - Fandom)?)|(機動戦士ガンダム 水星の魔女|水星の魔女)).*?$=>Mobile Suit Gundam: The Witch from Mercury
 category=>^.*?(Arknights).*$=>\1
 category=>^.*?(Arpeggio of Blue Steel|Aoki Hagane no Arpeggio).*$=>Arpeggio of Blue Steel
 category=>^.*?(Azur Lane( \((Anime|Video Game)\))?).*$=>Azur Lane
 category=>^.*?(Genshin Impact).*$=>\1
 category=>^.*?(Girls' Frontline).*$=>\1
 category=>^.*?(Honkai:? .*?\(.*\)).*$=>\1
 category=>^.*?(Jujutsu Kaisen).*$=>\1
 category=>^.*?(Love Hina).*$=>\1
 category=>^.*?(Mobile Suit Gundam: The Witch from Mercury).*$=>\1
 category=>^.*?(Moon Knight).*$=>\1
 category=>^.*?(My Hero Academia|Boku no Hero Academia).*$=>My Hero Academia
 category=>^.*?(My Next Life as a Villainess).*$=>\1
 category=>^.*?(Okami).*$=>\1
 category=>^.*?(One-Punch Man).*$=>\1
 category=>^.*?(Punishing: Gray Raven).*$=>\1
 category=>^.*?(Saga of Tanya the Evil|Youjo Senki).*$=>Saga of Tanya the Evil
 category=>^.*?(Sensitive Boy \(Manga\)).*$=>\1
 category=>^.*?(Shoujo Kageki Revue Starlight).*$=>\1
 category=>^.*?(YuYu Hakusho: Ghost Files).*$=>\1
 category=>^(.*?Dan[Mm]achi|Sword Oratoria \- Fujino Ōmori|Familial myth).*$=>DanMachi
 category=>^((我的青春恋爱物语果然有问题|戶塚彩加|果然我的青春戀愛喜劇搞錯了|比企谷 八幡|My Youth Romantic Comedy is Wrong as I Expected)|(.*?(My Teen Romantic Comedy SNAF[UY]|My Teen|((Hikigaya Hachiman|Totsuka Saika) - Fandom)|Oregairu|Yahari ore no [Ss]eishun love come(dy)? wa machigatteiru).*))$=>Yahari Ore no Seishun Love Come wa Machigatteiru
 category=>^Hololive$=>Hololive (Virtual Streamers)
##
## put these at the end of replace_metadata
 prefix_ships=>^(.*)=>[AO3] [p] \1
 prefix_fandom=>^(.*)=>[AO3] [f] \1
 prefix_category=>^(.*)=>[AO3] [c] \1
 prefix_characters=>^(.*)=>[AO3] [ch] \1
##
## Freeform tags disabled so as to
## not clutter up the tag browser
 prefix_freeform_tags=>^(.*)=>[AO3] [t] \1
 prefix_rating=>^(.*)=>[AO3] [r] \1
 prefix_status=>^(.*)=>[AO3] [s] \1
 prefix_wordcount=>^(\d+|([0-4],\d{3})*|5,000)$=>[AO3] [w] 0 - 5000
 prefix_wordcount=>^((?!5,000)([5-9],\d{3})*|10,000)$=>[AO3] [w] 5001 - 10000
 prefix_wordcount=>^((?!10,000)(1\d,\d{3})*|20,000)$=>[AO3] [w] 10001 - 20000
 prefix_wordcount=>^((?!20,000)([2-3]\d,\d{3})*|40,000)$=>[AO3] [w] 20001 - 40000
 prefix_wordcount=>^((?!40,000)([4-7]\d,\d{3})*|80,000)$=>[AO3] [w] 40001 - 80000
 prefix_wordcount=>^(?!80,000)(([89]\d)|(\d{3,})|\d(?=[\d,]{8,}))(,\d{3})+$=>[AO3] [w] 80000+
 main_fandom_LIST=>^(.*?)(\,.*)=>\1
 main_ship_LIST=>^(.*?), (.*)$=>\1

## ships, category, rating, status with the added prefixes in Calibre's tags, the freeform tags don't flood the tag browser

include_subject_tags:prefix_ships,prefix_fandom,prefix_category,prefix_characters,prefix_rating,prefix_status,prefix_wordcount,prefix_freeform_tags,extratags

include_in_dateRange:datePublished, dateUpdated

#add_to_exclude_metadata_post:
# ships=~^\(.*\)$

add_to_custom_columns_settings:
 category=>#ao3_fandom
 ao3categories=>#r_ao3_category
 characters=>#ao3_characters
 additional_characters=>#ao3_additional_characters
 dateRange=>#ao3_date
 dateUpdated=>#fff_dateupdated
 freeformtags=>#ao3_additional_tags
 numWords=>#fff_words
 rating=>#ao3_rating
 ships=>#ao3_ships
 numChapters=>#fff_chapter_count
 chapterslashtotal=>#ao3_chapterslashtotal
 main_ship=>#ao3_main_ship
 main_fandom=>#ao3_main_fandom
 status=>#fff_status

keep_in_order_category:true
keep_in_order_characters:true
keep_in_order_additional_characters:true
keep_in_order_dateRange:true
keep_in_order_fandoms:true
keep_in_order_freeformtags:true
keep_in_order_fin_freeformtags:true
keep_in_order_genre:true
keep_in_order_ships:true
keep_in_order_ao3categories:true

[JimmXinu]

Originally Posted by ownedbycats

In-scope for the the FanFicFare and eReaders page?
https://github.com/JimmXinu/FanFicFa...e-and-eReaders

At this point, probably not. It's just my thoughts and conclusions rather than practical information that could directly help others.

After I've used KOReader for a while (assuming I continue to), I might. But honestly, I don't want to end up trying to support other people using another package.

Originally Posted by w4tchdoge

No, I'm using use_archiveofourown_gay. For reference, here's the AO3 section of my ini file

Then I'm inclined to chalk it up to AO3's ongoing blocking / issues. Especially if you queued up enough updates to warrant walking away for the day.

[w4tchdoge]

Originally Posted by JimmXinu

New Test Version Posted

2025-06-10
- PI BG Jobs: Fix split without reconsolidate.

Addresses w4tchdoge's issue.

Thank you for the quick update. I've installed the newest test version and will check if it works when I next update my library with FFF.

[w4tchdoge]

Originally Posted by JimmXinu

New Test Version Posted

2025-06-10
- PI BG Jobs: Fix split without reconsolidate.

Addresses w4tchdoge's issue.

Just finished doing an update where I waited an hour before confirming, and everything's working perfectly w/ the new test version. Thanks again!

Originally Posted by JimmXinu

Then I'm inclined to chalk it up to AO3's ongoing blocking / issues. Especially if you queued up enough updates to warrant walking away for the day.

Yeah it looks like it was an issue on AO3's end, because I included the two fics I had an issue with and they updated normally this time round.

[JimmXinu]

New Test Version Posted

2025-06-11
- Change default base_xenforoforum minimum_threadmarks:1. See #1218
- Shutdown IMAP connection when done with it.
- Mildly kludgey fix for status bar notifications.

[Firedancer885]

Hi, is there a way to download "padlocked" stories from AO3? I already use the transformativeworks workaround.

Update: Ok, nevermind, sorry. Using use_archiveofourown_gay:true solved the issue.

[JimmXinu]

WARNING!!!

Don't update epubs containing images using the test version!

There was a bug introduced into the test version with:

2025-06-07
- Include Accept:image/* header when requesting an image url, thanks bellisk

... that BREAKS KEEPING EXISTING IMAGES when updating epubs.

I hope to have a fix shortly, but I don't have one yet.

In the meantime, I recommend everyone stop using the test version. I've even removed it from the usual post.

[ownedbycats]

I'm getting similar NoneType/gettext errors as in #10854

Restricted story, logged onto archiveofourown.gay in browser to get cahced pages. Then just from curiousity, disabled cache and tried again. It worked.

Not sure how logging in browser fixed it, or just weird timing. Might worth looking into.

Also: Any idea why updating fic sometimes minimizes Calibre?

[JimmXinu]

New Test Version Posted

2025-06-12
- Fix images from existing epub being discarded during update.

If you use the test version, upgrade to this last version before doing any epub updates!

This is in regards to my earlier panic:

Originally Posted by JimmXinu

WARNING!!!

Don't update epubs containing images using the test version!

On 2025-06-02(v4.46.2) a bug was introduced in the TEST version only of FFF that discarded existing images in epubs during update and marked them all as failedtoload. *New* images, or new downloads (not updates) were not affected.

Luckily, it was an easy fix. Unfortunately, it means you may need to fix or re-download some epubs. I know I do.

TL;DR - The simple solution is: Do Overwrite Always on any epubs containing images that you updated using that version.

Longer solution:

Spoiler:

If you know how, you can edit the affected epubs, searching for <img> tags src="failedtoload". Remove those files (or even just the <meta name="chapterurl" ...> line at the top of the file) and do Update Always on the epub.

Doing that can save a lot of page downloads for unaffected pages.

FYI, this is what I was using while testing this.

Spoiler:

There are a couple of truly broken images. Download with a [1-5] or whatever range, then update using URL with [1-7], etc.

[https://forums.spacebattles.com/threads/serass-dumpster-of-random-snippets.1143040/]
order_threadmarks_by_date:true
skip_threadmarks_categories: Threadmarks,Sidestory,Apocrypha,Informational,Staff Post