[GUI Plugin] FanFicFare

[ownedbycats]

From what I recall, calibre's ebook-viewer supports animated GIFs, though I believe this is a bit of a happy accident from the rendering engine. I'm not sure if ePub standard supports animations (gifs or apngs).

[baba_marta]

Hello,

If I may, a couple of unrelated questions/suggestions, I hope it's okay to put them all in one post.

1. Regarding empty <p> tags on AO3 (and probably other sites):

On the one hand, these are used by authors as section breaks. On the other hand, they're often just messy HTML and result in space lines where none should be, i.e. after every single paragraph. keep_empty_tags will deal with the latter but also break the former. I saw that this topic had been discussed on Github in a now closed thread.

Could a kind of optional restriction for keep_empty_tags be a solution? Something along the lines of: If an empty tag occurs more than x times per chapter, remove it. Otherwise keep it, as it's likely a legitimate section marker.

2. Another HTML issue on AO3 that's caused by their own text importer and is often overlooked by authors:

<em> tags are sometimes split off into newlines with a whole lot of whitespace around them. The "frontend" result is faulty-looking punctuation, i.e. spaces where none should be, either before or after the italicised text in question.

I hope I'm making sense here -- it's essentially something like this: \n\s*<em>\n\s* or \n\s*<\/em>\n\s* resulting in: " Text." or "Text ."

Is there any way to find and fix this directly using regex? The only option I've found is replace_metadata, which comes close but (probably?) doesn't look at chapter content.

3. I'm a bit of a neurotic minimalist when it comes to opfs. I take it that what's included in them is hardcoded? I haven't been successful in adjusting any of it without going directly into writer_epub.py and commenting out what I don't need -- inelegant, this, so maybe there's a better solution.

[JimmXinu]

Multi-reply

Originally Posted by Redshifter

I can't get animated GIFs from Archive of Our Own to load into EPUB format. They show as still images. Is there some specific setting I'm supposed to setup? Thanks for all the help you provide.

By default, FFF automatically resizes images if they are bigger than a configurable size which (probably) breaks animated gifs.

Set no_image_processing:true in personal.ini under an appropriate section ([defaults] for every story, [archiveofourown.org] for every AO3 story, or [<storyUrl>] for individual stories) to get the image exactly as on the web site.

The other suggestions given before may also be true.

Originally Posted by baba_marta

1. Regarding empty <p> tags on AO3 (and probably other sites):

On the one hand, these are used by authors as section breaks. On the other hand, they're often just messy HTML and result in space lines where none should be, i.e. after every single paragraph. keep_empty_tags will deal with the latter but also break the former. I saw that this topic had been discussed on Github in a now closed thread.

Could a kind of optional restriction for keep_empty_tags be a solution? Something along the lines of: If an empty tag occurs more than x times per chapter, remove it. Otherwise keep it, as it's likely a legitimate section marker.

Similar to the replace_br_with_p feature (which uses some heuristics to find and replace br paragraphs with p tags while preserving scene breaks), I will accept contributed code (ideally as a github PR & FFF needs to be py2/py3 compatible still) for such a feature. But I'm not interested in implementing that myself.

I would suggest instead of a simple x times per chapter it should take into account chapter length. x breaks per word count or even char count. I routinely see chapter lengths from 300-30,000+ words.

Originally Posted by baba_marta

2. Another HTML issue on AO3 that's caused by their own text importer and is often overlooked by authors:

<em> tags are sometimes split off into newlines with a whole lot of whitespace around them. The "frontend" result is faulty-looking punctuation, i.e. spaces where none should be, either before or after the italicised text in question.

I hope I'm making sense here -- it's essentially something like this: \n\s*<em>\n\s* or \n\s*<\/em>\n\s* resulting in: " Text." or "Text ."

Is there any way to find and fix this directly using regex? The only option I've found is replace_metadata, which comes close but (probably?) doesn't look at chapter content.

I believe I've looked into that before. As I recall, trying to apply something like that introduced as many problems as it fixed, removing spaces that should be there.

FYI, it is a deliberate design decision that FFF does not offer generalize automated editing of story text. I judge it too likely that people will damage their text--a single mistake could easily result in no output at all. Or arguably worse, remove text while looking correct to a cursory inspection.

Plus testing it would involved downloading over and over again, stressing our favorites sites.

Originally Posted by baba_marta

3. I'm a bit of a neurotic minimalist when it comes to opfs. I take it that what's included in them is hardcoded? I haven't been successful in adjusting any of it without going directly into writer_epub.py and commenting out what I don't need -- inelegant, this, so maybe there's a better solution.

The content.opf file of the epub? That 99.99% of users never see and is entirely intended to be machine readable metadata?

Aside from what <dc:subject> tags to include (see setting include_subject_tags), it is not configurable as such. Metadata that doesn't exist for a particular story generally isn't included.

If you have cases of the contents of FFF's generated content.opf causing actual problems with an epub reader, I'd like to hear about it. But I'm not interested in changing it for reasons of personal aesthetics.

[scarlettruin]

Hi,

Under 'Check for Existing Series Anthologies Books' on 'Configure Fanficfare', it says it won't work if "Collect Metadata in Background" is selected. It doesn't seem to be working when I click it, so I assume I have the metadata selected but I don't know which tickbox it is referring to?

Thanks in advance!

[JimmXinu]

Each time you update existing books, one of the options at the bottom of the dialog (may be hidden by "Show Download Options") is "Background Metadata?", and on the General tab towards the top is the option "Default Background Metadata?" which will be the default value for the setting each download.

"Background metadata" only possible when you are updating existing books seleced from your library, not when checking by URL from email or Get Stories by URL.

[Tommy24]

Hi,

I've unlocked all chapters of the stories i'm reading on webnovel. But FFF still only downloads to where there used to the locked chapters.
Do I have to add something to the personel.ini to download all chapter my account has access to?

Thanks.

[JimmXinu]

Originally Posted by Tommy24

I've unlocked all chapters of the stories i'm reading on webnovel. But FFF still only downloads to where there used to the locked chapters.
Do I have to add something to the personel.ini to download all chapter my account has access to?

FFF doesn't do login on webnovel.com, so 'locked' chapters aren't available.

I've said before:

Originally Posted by JimmXinu

FFF doesn't do login for webnovel.com. Nor is it likely to be added. I'm very leery of downloading user/pass protected material from original/translated content sites.

[scarlettruin]

Originally Posted by JimmXinu

Each time you update existing books, one of the options at the bottom of the dialog (may be hidden by "Show Download Options") is "Background Metadata?", and on the General tab towards the top is the option "Default Background Metadata?" which will be the default value for the setting each download.

"Background metadata" only possible when you are updating existing books seleced from your library, not when checking by URL from email or Get Stories by URL.

So is there a way, when adding/downloading a new anthology, to be alerted if it already exists? I've tried changing the download options and still nothing

[JimmXinu]

Originally Posted by scarlettruin

So is there a way, when adding/downloading a new anthology, to be alerted if it already exists? I've tried changing the download options and still nothing

A new anthology? As in, using 'Make Anthology Epub from Web Page' or the 'For Anthology Epub' button from 'Get Story URLs from Web Page' with a series URL?

There isn't currently an option to check for an existing anthology book in that case. I'll look to see how feasible that might be.

[JimmXinu]

New Test Version Posted

2022-04-05
- PI: Check for existing anthology ebook on new anthology from series URL.

Now checks for existing anthology ebook 'Make Anthology Epub from Web Page' or the 'For Anthology Epub' button from 'Get Story URLs from Web Page' with a series URL.

Switched on and off by the same "Check for existing Series Anthology books?" setting as individual stories and will apply "Mark Matching Anthologies?" setting. "Reject Without Confirmation?" is not applied.

Should I change the tooltip text on "Check for existing Series Anthology books?" to mention this specifically?

[Kite013]

For one fanfiction I am getting the error HTTP Error in FFF 403 client, but have no idea why when I can download other fanfiction's from fanfiction.net fine.
here is the fanfiction in question.
https://www.fanfiction.net/s/1403069...gear-One-shots

[scarlettruin]

Originally Posted by JimmXinu

New Test Version Posted

2022-04-05
- PI: Check for existing anthology ebook on new anthology from series URL.

Now checks for existing anthology ebook 'Make Anthology Epub from Web Page' or the 'For Anthology Epub' button from 'Get Story URLs from Web Page' with a series URL.

Switched on and off by the same "Check for existing Series Anthology books?" setting as individual stories and will apply "Mark Matching Anthologies?" setting. "Reject Without Confirmation?" is not applied.

Should I change the tooltip text on "Check for existing Series Anthology books?" to mention this specifically?

Thank you!!!

[JimmXinu]

Originally Posted by Kite013

For one fanfiction I am getting the error HTTP Error in FFF 403 client, but have no idea why when I can download other fanfiction's from fanfiction.net fine.
here is the fanfiction in question.
https://www.fanfiction.net/s/1403069...gear-One-shots

fanfiction.net has been blocking most automated access with CloudFlare for a year or so now.

See the Browser Cache Feature wiki page and the ProxyFeatures wiki page for ways you can work around it.

[ownedbycats]

I'm very surprised that ffnet access has been working at all for Kite.

[HowWouldIKnow]

Hi, could you help me to format my epub?

Scribblehub:
It adds fandom, Words and Views to the end of the Titlepage. How do I add it above Publisher?

ao3: Freeform tags shows the same values as the Tags Point.
And in Calibre it adds all the Characters and Fandom tags into the Tags Column, additionally.

## Items to include in the title page
## Empty metadata entries will *not* appear, unless .SHOW_EMPTY is
titlepage_entries: category,genre,extratags,language,characters,ships ,status,datePublished,dateUpdated,dateCreated,rati ng,warnings,numChapters,numWords,publisher,descrip tion



[www.archiveofourown.org]
use_basic_cache:true

always_login:false
slow_down_sleep_time:2

use_view_full_work:true
##use AO3 Downloader

## default is false
#collect_series: true
extratags_label:AO3
extratags:AO3


exclude_metadata_pre:
freeformtags,genre==Other Additional Tags to Be Added
warnings==Creator Chose Not To Use Archive Warnings
warnings==No Archive Warnings Apply
## Removes "CharacterName" if Male or Female CharacterName is already present.
characters=~^CharacterName&&characters=~^(Male|Fem ale) CharacterName

exclude_notes:authorheadnotes,chapterheadnotes,cha pterfootnotes,authorfootnotes,inspiredlinks,chapte rsummary



titlepage_entries: rating,warnings,ao3categories,fandoms,ships,charac ters,genre,freeformtags,language,status,chaptersla shtotal,datePublished,dateUpdated,dateCreated,numW ords,publisher,description


##comments,,chapterstotal,kudos,hits,bookmarks,boo kmarked,bookmarktags,bookmarksummary,series01HTML, series02HTML,series03HTML

replace_metadata:
category,fandoms=> (- All Media Types|- Fandom|\(Movies\)|\(Movie [0-9]+\)|\(Comics\)|\(TV\)|\(Video Games\))$=>
characters=>\(mentions of\) =>
characters=> \([Ch]haracter\)=>
characters=> ?\((cameo|briefly|if you squint|sort of|mentioned)\)=>
characters=> - Character=>
characters=>^Other mentions$=>

## fandoms=> (- All Media Types|- Fandom|\(Movies\)|\(Movie [0-9]+\)|\(Comics\)|\(TV\)|\(Video Games\))$=>

ships=>(.*)[/&](.*) \(?[Ff]riendship(?: only)\)?=>\1 & \2
ships=> - Relationship=>

genre=>\(mentions of\) =>
genre=>\(mention of\) =>


custom_columns_settings:
characters=>#characters
fandoms=>#fandoms
ao3categories=>#categories
kudos=>#kudos
hits=>#hits
bookmarks=>#bookmarks
comments=>#comments


[www.scribblehub.com]
#use_basic_cache:true
#extra_valid_entries:views, averageWords, fandoms
#views_label:Views
#averageWords_label:Average Words (Chapter)
#add_to_titlepage_entries:,views, averageWords, fandoms

## Scribble Hub chapters can include author's notes, news blocks, spoilers,
## and inline footnotes. We've traditionally included them all in the chapter
## text, but this allows you to customize which you include. Copy this
## parameter to your personal.ini and list the ones you don't want.
exclude_notes:authornotes,newsboxes,spoilers,footn otes