[GUI Plugin] FanFicFare

[ownedbycats]

What is (?:.*.)*?. even meant to match?

[icecold]

(?:.*.)*? is probably just me making a typo then copying and pasting that typo. (?:.*\.)*? is an very imperfect solution to crossovers and is supposed to match things like HP.HI3.Harry Potter and turn it to HP.Harry Potter

Real bad timing that I added that bad regex to my personal.ini right when ao3 started being more difficult to download from.

[JimmXinu]

New Test Version Posted

2025-04-28
- XF2: Add threadmarks_per_page setting
- Fix for alternatehistory.com changing threadmark date attr.
- adapter_literotica: get_urls_from_page - series have urls, thanks dbhmw
- Update translations.

Default value for threadmarks_per_page is set to the max each site will support. Sites all default to 25, max allowed: AH/Sietch:50, SB/SV:200, QQ:400.

Reduces network requests significantly during metadata when tons of threadmarks.

[ownedbycats]

Aside from cover_image, any way to check a fic has images? I to add "has illustrations" to fic tags.

[penumbria]

I have been trying to use the various workarounds for AO3. The browser cache opening pages in browser works great for adding or updating individual fics. But I run into issues with anthologies, updating or adding them. When it opens the pages in the browser (Chrome) for the anthologies, it says I am already logged in. Then the error comes up on FFF "Page not found or expired in Browser Cache."

So, I tried using the use_archive_transformativeworks_org with login commented out instead for anthologies which works for ones that aren't for registered users only. But for those ones, it doesn't work because you can't login.

So, I tried using "use_archiveofourown_gay:true" but it comes up as red in the personal.ini when I type it in. The use_archiveofourown_gay part is in red. What am I missing or doing wrong with that?

[ownedbycats]

Originally Posted by penumbria

So, I tried using "use_archiveofourown_gay:true" but it comes up as red in the personal.ini when I type it in. The use_archiveofourown_gay part is in red. What am I missing or doing wrong with that?

Did you install the test version yet?

[JimmXinu]

Originally Posted by ownedbycats

Aside from cover_image, any way to check a fic has images? I to add "has illustrations" to fic tags.

No. I don't think it's practical to add it, either. When doing 'Update metadata from site', FFF wouldn't have anyway of knowing if the text contained images or not.

Originally Posted by penumbria

So, I tried using "use_archiveofourown_gay:true" but it comes up as red in the personal.ini when I type it in. The use_archiveofourown_gay part is in red. What am I missing or doing wrong with that?

Install the test version--link in my signature. Or wait a couple days, I release new versions on the first of the month.

[TeaLover]

Hi, Questionable Questing is now asking for login to download stories. But I have had my account/password in my personal.ini for the last few years without issue.

Manually inputting my username and password into the box when prompted doesn't work, it just asks me to do it again infinitely.

Not sure what's happening.

[JimmXinu]

QQ downloading is working fine for me. Did you make a number of downloads before that? It might be blocking you if you did 'too many'.

[TeaLover]

I've waited 2 hours before trying it again and it's still asking me to login.

I'm going to try to remove QQ from my Personal.ini and then try again.

Edit: I think something went wrong with my Personal.ini. It's saying when I'm trying to save '72: always login not valid in section...'

I haven't touched it for nearly a year and don't know why this error is popping up now.

Spoiler:

I'm posting my Personal.ini without my passwords below:

## This is an example of what your personal configuration might look
## like. Uncomment options by removing the '#' in front of them.

[defaults]
## [defaults] section applies to all formats and sites but may be
## overridden at several levels. See
## https://github.com/JimmXinu/FanFicFare/wiki/INI-File for more
## details.

## Some sites also require the user to confirm they are adult for
## adult content. Uncomment by removing '#' in front of is_adult.
#is_adult:true

## Don't like the numbers at the start of chapter titles on some
## sites? You can use strip_chapter_numbers to strip them off. Just
## want to make them all look the same? Strip them off, then add them
## back on with add_chapter_numbers. Don't like the way it strips
## numbers or adds them back? See chapter_title_strip_pattern and
## chapter_title_add_pattern in defaults.ini.
#strip_chapter_numbers:true
#add_chapter_numbers:true


[epub]
## Include images from img tags in the body and summary of stories.
## Images will be converted to jpg for size if possible. Images work
## in epub format only. To get mobi or other format with images,
## download as epub and use Calibre to convert.
## true by default, uncomment and set false to not include images.
#include_images:true

## If set false, the summary will have all html stripped for safety.
## Both this and include_images must be true to get images in the
## summary.
## true by default, uncomment and set false to not keep summary html.
#keep_summary_html:true

## If set true, and there isn't a specific cover image, the first
## image found in the story will be made the cover image. If
## keep_summary_html is true, images in the summary will be before any
## in chapters.
## true by default, uncomment and set false to turn off
#make_firstimage_cover:true


## Most common, I expect will be using this to save username/passwords
## for different sites. Here are a few examples. See defaults.ini
## for the full list.

[www.twilighted.net]
#username:YourPenname
#password:YourPassword
## default is false
#collect_series: true

[forums.spacebattles.com]
username:gmail
password:

[forums.sufficientvelocity.com]
username:gmail
password:

[forum.questionablequesting.com]
username:gmail
password:
always_login:true

[www.alternatehistory.com]
username:gmail
password:
always_login:true

[www.fanfiction.net]
username:gmail
password:

[www.fimfiction.net]
#is_adult:true
#fail_on_password: false

[www.tthfanfic.org]
#is_adult:true
## tth is a little unusual--it doesn't require user/pass, but the site
## keeps track of which chapters you've read and won't send another
## update until it thinks you're up to date. If you set
## username/password, FFF will login to download. Then the site
## thinks you're up to date.
#username:YourName
#password:yourpassword


## This section will override anything in the system defaults or other
## sections here.
[overrides]
## default varies by site. Set true here to force all sites to
## collect series.
#collect_series: true

[JimmXinu]

If you got blocked, I'd expect it to take a couple days, not hours.

[JimmXinu]

New Test Version Posted

2025-04-30
- Transition finestories.com to new domain storyroom.com. Thanks, bpothier

Note that while the new adapter will accept old finestories.com URLs, if you are updating from a URL (like from an email notice), you'll need the 'Search by Title/Author' option on to match existing books.

[TeaLover]

Just noticed a banner on the QQ website, reads:

There is currently an issue logging in with the full Email Address For the time being, please use just your Username to login, not your full email address.

I'm assuming then, that me trying to login with my email and it not working was the reason.

Well, at least I found a reason! Thanks for helping.

[Homer55]

Originally Posted by TeaLover

Just noticed a banner on the QQ website, reads:

There is currently an issue logging in with the full Email Address For the time being, please use just your Username to login, not your full email address.

I'm assuming then, that me trying to login with my email and it not working was the reason.

Well, at least I found a reason! Thanks for helping.

I was having the exact same issue since yesterday, thanks for noticing the banner, I would have not paid attention to that

[w4tchdoge]

I'm trying out the

use_archiveofourown_gay:true

feature w/ the latest test version and while I don't get 525 errors anymore I do get the login popup that happens when FFF isnt able to login to the page. I've tried changing the username field to be my username instead of my email but i get the same error. I've also tried logging into archiveofourown.gay on a web browser which i can do. Do I have something set wrong in my ini file, or is it something else?

I've added the AO3 section of my ini file below, and have attached my debug log.

Spoiler:

[archiveofourown.org]
username:XXXXXXXX
password:XXXXXXXX
always_login:true
use_browser_cache:true
#use_browser_cache_only:true
open_pages_in_browser:true

use_archiveofourown_gay:true

slow_down_sleep_time:4

#tweak_fg_sleep:true
#min_fg_sleep:1.5
#max_fg_sleep:2.2
#max_fg_sleep_at_downloads:1.5

#use_browser_cache:true
#use_browser_cache_only:true
#open_pages_in_browser:true
#use_flaresolverr_proxy:directimages

add_to_extratags:,From AO3
add_to_extra_valid_entries:,user_added_freeform_tags,fin_freeformtags,abr_rating,prefix_ships,prefix_fandom,prefix_category,prefix_characters,prefix_rating,prefix_status,prefix_wordcount,prefix_freeform_tags,dateRange,main_ship,main_fandom

warnings_label:Archive Warning
ao3categories_label:Category
fandoms_label:Fandom
freeformtags_label:Additional Tags
fin_freeformtags_label:Additional Tags
chapterslashtotal_label:Chapters

## Most of the following formatting is taken from https://www.mobileread.com/forums/showthread.php?p=4301621#post4301621 and has been modified to taste

include_in_prefix_ships:ships
include_in_prefix_fandom:category
include_in_prefix_category:ao3categories
include_in_prefix_characters:characters
## Freeform tags disabled so as to
## not clutter up the tag browser
## Except not anymore they aren't
include_in_fin_freeformtags:freeformtags
include_in_prefix_freeform_tags:fin_freeformtags
include_in_prefix_rating:rating
include_in_abr_rating:rating
include_in_prefix_status:status
include_in_prefix_wordcount:numWords
include_in_main_ship:ships
include_in_main_fandom:category

add_to_replace_metadata:
## Cleanup of some author names
 author=>.*(Obscura)_of_the_House_of_Moon_and_Star.*=>\1
 author=>.*(HeraGuin) .orphan_account..*=>\1
##
## Display only the Pseudonym instead of both the Pseud and the Main account name
## Disabled because I have decided to manually set whether the pseud or the main name is set on an author-by-author basis
# author=>^([^\(]+) \([^\)]+\)$=>\1
##
## Manual setting whether the pseud or the main name is used
 author=>(One Sin - One Grace) \(EverythingNarrative\)=>\1
 author=>(Agrippa) \([^\)]+Agrippa\)=>\1
 author=>SiNC Coauthor - (Aleph \(Immatrael\))=>\1
 author=>blackhawkscot \((blackbirdscot)\)=>\1
 author=>(Natalie the Cat) \(NatalieTheCat\)=>\1
 author=>Clarissa \((Clarissa13)\)=>\1
 author=>(AmeliaCF) \(Clarissa13\)=>\1
 author=>(Eva Grimm) \(elusivetruth\)=>\1
 author=>(ineffable_wife_Gaya) \(ineffable_wives\)=>\1
 author=>(Kinsfire) \(The_REAL_Kinsfire\)=>\1
 author=>(KnightSpark) \(BurstEdge\)=>\1
 author=>(Nemesis13) \(Melfice13\)=>\1
 author=>(Slider) \(TemporalKnight\)=>\g<1>214
 author=>(TheStellarJade) \(JaydrFamiliar\)=>\1
 author=>(Geas) \(Pulpygoblin\)=>\1
 author=>(Camelia_Sumori) \(Himecat\)=>\1
##
## Create abbreviated rating for use in titlepage
 abr_rating=>^$=>Not Rated
 abr_rating=>^.*(Not Rated).*$=>\1
 abr_rating=>^(General|Teen|Mature|Explicit)( ((And Up )?Audiences))?$=>\1
##
## Cleaning up some fandom tags
 category=>(?i)^.*?(Kantai Collection|Kancolle).*$=>Kantai Collection
 category=>(?i)^(original content \(parahumans series\)|w(orm(( (\(web serial\) \| wildbow|\| parahumans|\- wildbow|\- wilbow|series|verse)|: a complete web seriel| (web )?serial|verse)| \- fandom)|ildbow \- fandom|ard \- fandom)|parahuman series \- wildbow|worm \(web( (serial )?novel|novel)\)|parahumans \- fandom|worm \(web serial\)|worm \((web serie|parahuman)s\)|worm \(webseries\)|parahu(man)?|#worm)$=>Parahumans Series - Wildbow
 category=>(?i)^hololive English - Fandom$=>HoloEN
 category=>(?i)^((欢迎来到实力至上主义的教室|Classroom - fandom|Classroom of the)|(.*?(Classroom of the Elite).*))$=>Classroom of the Elite
 category=>(?i)^((Hibike|Sound)!? Euphonium|(吹响吧上低音号|響け! ユーフォニアム|高坂丽奈|黄前久美子)).*?$=>Hibike! Euphonium
 category=>(?i)^(86|Eighty.?Six)(-(エイティシックス|不存在的战区)| (- Fandom|Eighty Six|\| Eighty.?Six)).*?$=>86: Eighty Six
 category=>(?i)^((Miss Koba?yashi.?s Dragon Maid|Kobayashi-san Chi No Maid|Dragon Maid.?s)|(小林さんちのメイドラゴン|小林家的女僕龍|小林家的妹抖龍|小林家的龍女僕|小林家的龙女仆)).*?$=>Miss Kobayashi's Dragon Maid
 category=>(?i)^((崩坏3rd|honkai impact|honkai impact 3(rd)?|Honkaiimpact3rd|Ottonology|Revelation Impact 2nd)|(Eden/Elysia（崩壞第3彈）)|((Fu Hua|HI3|Honkai|KiaMei|Kiana Kaslana|Raiden Mei|Rita Rossweisse|奥托) - Fandom)|(为什么分类了|后崩坏书|奥莲|崩坏三|崩坏三rd|神州折剑录|第3 \| Honkai冲击第3（电子游戏）)).*?$=>Honkai Impact 3rd (Video Game)
 category=>(?i)^(((Mobile Suit )?Gundam:? (The )?Witch( (from|of) Mercury)?)|(The Witch from Mercury)|((G_?Witch|SuleMio)( - Fandom)?)|(機動戦士ガンダム 水星の魔女|水星の魔女)).*?$=>Mobile Suit Gundam: The Witch from Mercury
 category=>^.*?(Arknights).*$=>\1
 category=>^.*?(Arpeggio of Blue Steel|Aoki Hagane no Arpeggio).*$=>Arpeggio of Blue Steel
 category=>^.*?(Azur Lane( \((Anime|Video Game)\))?).*$=>Azur Lane
 category=>^.*?(Genshin Impact).*$=>\1
 category=>^.*?(Girls' Frontline).*$=>\1
 category=>^.*?(Honkai:? .*?\(.*\)).*$=>\1
 category=>^.*?(Jujutsu Kaisen).*$=>\1
 category=>^.*?(Love Hina).*$=>\1
 category=>^.*?(Mobile Suit Gundam: The Witch from Mercury).*$=>\1
 category=>^.*?(Moon Knight).*$=>\1
 category=>^.*?(My Hero Academia|Boku no Hero Academia).*$=>My Hero Academia
 category=>^.*?(My Next Life as a Villainess).*$=>\1
 category=>^.*?(Okami).*$=>\1
 category=>^.*?(One-Punch Man).*$=>\1
 category=>^.*?(Punishing: Gray Raven).*$=>\1
 category=>^.*?(Saga of Tanya the Evil|Youjo Senki).*$=>Saga of Tanya the Evil
 category=>^.*?(Sensitive Boy \(Manga\)).*$=>\1
 category=>^.*?(Shoujo Kageki Revue Starlight).*$=>\1
 category=>^.*?(YuYu Hakusho: Ghost Files).*$=>\1
 category=>^(.*?Dan[Mm]achi|Sword Oratoria \- Fujino Ōmori|Familial myth).*$=>DanMachi
 category=>^((我的青春恋爱物语果然有问题|戶塚彩加|果然我的青春戀愛喜劇搞錯了|比企谷 八幡|My Youth Romantic Comedy is Wrong as I Expected)|(.*?(My Teen Romantic Comedy SNAF[UY]|My Teen|((Hikigaya Hachiman|Totsuka Saika) - Fandom)|Oregairu|Yahari ore no [Ss]eishun love come(dy)? wa machigatteiru).*))$=>Yahari Ore no Seishun Love Come wa Machigatteiru
 category=>^Hololive$=>Hololive (Virtual Streamers)
##
## put these at the end of replace_metadata
 prefix_ships=>^(.*)=>[AO3] [p] \1
 prefix_fandom=>^(.*)=>[AO3] [f] \1
 prefix_category=>^(.*)=>[AO3] [c] \1
 prefix_characters=>^(.*)=>[AO3] [ch] \1
##
## Freeform tags disabled so as to
## not clutter up the tag browser
 prefix_freeform_tags=>^(.*)=>[AO3] [t] \1
 prefix_rating=>^(.*)=>[AO3] [r] \1
 prefix_status=>^(.*)=>[AO3] [s] \1
 prefix_wordcount=>^(\d+|([0-4],\d{3})*|5,000)$=>[AO3] [w] 0 - 5000
 prefix_wordcount=>^((?!5,000)([5-9],\d{3})*|10,000)$=>[AO3] [w] 5001 - 10000
 prefix_wordcount=>^((?!10,000)(1\d,\d{3})*|20,000)$=>[AO3] [w] 10001 - 20000
 prefix_wordcount=>^((?!20,000)([2-3]\d,\d{3})*|40,000)$=>[AO3] [w] 20001 - 40000
 prefix_wordcount=>^((?!40,000)([4-7]\d,\d{3})*|80,000)$=>[AO3] [w] 40001 - 80000
 prefix_wordcount=>^(?!80,000)(([89]\d)|(\d{3,})|\d(?=[\d,]{8,}))(,\d{3})+$=>[AO3] [w] 80000+
 main_fandom_LIST=>^(.*?)(\,.*)=>\1
 main_ship_LIST=>^(.*?), (.*)$=>\1

## ships, category, rating, status with the added prefixes in Calibre's tags, the freeform tags don't flood the tag browser

include_subject_tags:prefix_ships,prefix_fandom,prefix_category,prefix_characters,prefix_rating,prefix_status,prefix_wordcount,prefix_freeform_tags,extratags

include_in_dateRange:datePublished, dateUpdated

#add_to_exclude_metadata_post:
# ships=~^\(.*\)$

add_to_custom_columns_settings:
 category=>#ao3_fandom
 ao3categories=>#r_ao3_category
 characters=>#ao3_characters
 additional_characters=>#ao3_additional_characters
 dateRange=>#ao3_date
 dateUpdated=>#fff_dateupdated
 freeformtags=>#ao3_additional_tags
 numWords=>#fff_words
 rating=>#ao3_rating
 ships=>#ao3_ships
 numChapters=>#fff_chapter_count
 chapterslashtotal=>#ao3_chapterslashtotal
 main_ship=>#ao3_main_ship
 main_fandom=>#ao3_main_fandom
 status=>#fff_status

keep_in_order_category:true
keep_in_order_characters:true
keep_in_order_additional_characters:true
keep_in_order_dateRange:true
keep_in_order_fandoms:true
keep_in_order_freeformtags:true
keep_in_order_fin_freeformtags:true
keep_in_order_genre:true
keep_in_order_ships:true
keep_in_order_ao3categories:true

[archiveofourown.org:epub]
add_to_keep_html_attrs:,align,class

#titlepage_entries: rating,warnings,ao3categories,fandoms,ships,characters,freeformtags,language,seriesHTML,collections,status,datePublished,dateUpdated,dateCreated,numWords,chapterslashtotal,publisher,description
#titlepage_entries:<div class="inline">,rating,warnings,ao3categories,fandoms,</div>,ships,characters,fin_freeformtags,<div class="inline">,series00HTML,series01HTML,series02HTML,series03HTML,collections,</div>
titlepage_entries:<div class="inline">,warnings,ao3categories,fandoms,</div>,ships,characters,fin_freeformtags,<div class="inline">,series00HTML,series01HTML,series02HTML,series03HTML,collections,</div>
wide_titlepage_entries:

use_workskin:true
# ↓ taken and modified from https://www.mobileread.com/forums/showpost.php?p=4360732&postcount=84
add_to_output_css:
 .hr-sect {
  display: flex;
  flex-basis: 100%%;
  align-items: center;
  text-align: center;
  margin: 5px 0;
  padding: 0 0 0.75em 0;
 }
 .hr-sect:before,
 .hr-sect:after {
  content: "";
  flex-grow: 1;
  height: 1px;
  border: 0;
  border-top: 1px solid;
  border-bottom: 1px solid;
  font-size: 0;
  line-height: 0;
#  margin: 0px 8px;
 }
 .hr-sect:before { margin: 0 8px 0 32px; }
 .hr-sect:after { margin: 0 32px 0 8px; }
 .fff_titlepage hr { border-top: 1px; border-style: solid none none none; }
 .fff_titlepage [id="underTitle-horRule"] { border-top: medium; border-style: solid none none none; }
 .fff_titlepage dd { margin-left: 1em; }

titlepage_start:<?xml version="1.0" encoding="UTF-8"?>
 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd">
 <html xmlns="http://www.w3.org/1999/xhtml">
 <head>
 <title>${title} by ${author}</title>
 <link href="stylesheet.css" type="text/css" charset="UTF-8" rel="stylesheet"/>
 </head>
 <body class="fff_titlepage">
 <div class="title">
 <h2><a href="${storyUrl}">${title}</a> by ${authorHTML}</h2>
 </div>
 <hr id="underTitle-horRule"/>
 <dl class="tags">

titlepage_entry:
 <dt><b>${label}:</b></dt> <dd>${value}</dd>

titlepage_wide_entry:

titlepage_no_title_entry:

## metadata
titlepage_end:
 <dl class="stats">
 <dt><b>Status:</b> ${status}</dt>
 <dt><b>Date Published:</b> ${datePublished}</dt>
 <dt><b>Date Updated:</b> ${dateUpdated}</dt>
 <dt><b>Date Packed:</b> ${dateCreated}</dt>
# <dt><b>Words & Chapters:</b> ${numWords} &bull; ${chapterslashtotal}</dt>
 </dl>
 </dl>
# <hr/>
# ↓ taken and modified from https://www.mobileread.com/forums/showpost.php?p=4360732&postcount=84
 <div class="hr-sect">${abr_rating} ◈ ${numWords} words ◈ ${chapterslashtotal}</div>
# <div class="hr-sect">${abr_rating} &bull; ${numWords} words &bull; ${chapterslashtotal}</div>
 <div class="tag-summary-content">${description}</div>
 </body>
 </html>