[GUI Plugin] FanFicFare

[JimmXinu]

Originally Posted by chrisric

Is there a way to save partial chapter downloads of books/novels? I can't see the option, I might be blind though.

I thought I seen a "save failed downloads" option (timeout/not all chapters downloaded etc) once but now I can't see it. Might be wishful thinking.

There isn't anything that will save a partial chapter.

But continue_on_chapter_error:true will save the chapters that succeeded and mark the chapters that failed in a download.

You can manually save a partial story download by specifying a chapter range after the storyURL[1-5].

There's also the ignore_chapter_url_list setting, but that's getting a bit esoteric.

[JimmXinu]

Originally Posted by Emerald_Lilies

I've been going through the forum (and slowly teaching myself regex) and I haven't been able to figure this out. I have my personal.ini set up with onlyromships to only include pairings with a "/". When I get a fic that only has an "&" gen pairing in ships, it won't remove that pairing.

You are very nearly there.

You need to define onlyromships so FFF knows it's there, and you need to do something with onlyromships so it's visible somewhere.

Some options shown below.

[archiveofourown.org]

## add onlyromships as well as ships2chars
add_to_extra_valid_entries:,ships2chars,onlyromships

## Adds to Calibre's Tags.  
add_to_include_subject_tags:,onlyromships

## Although you'd likely want to set it instead to replace ships
include_subject_tags: extratags, genre, category, characters, onlyromships, status

## Adds to Title Page:
add_to_extra_titlepage_entries:,onlyromships
## And a nice label:
onlyromships_label:Romantic Ships

## Set in a custom column:
add_to_custom_columns_settings:
 onlyromships=>#your_onlyromships_column

[Emerald_Lilies]

Originally Posted by JimmXinu

You are very nearly there.

You need to define onlyromships so FFF knows it's there, and you need to do something with onlyromships so it's visible somewhere.

So I did have some of that in already, but didn't think to copy it in the post. I added what I was missing (except the Title Page section - I use the original ships for that). Here is the whole of my AO3 section (the only place I use onlyromships):

Spoiler:

[archiveofourown.org]
username:XXXXXXXX
password:XXXXXXXX
is_adult:true
always_login:true

## Some adapters collect additional meta information beyond the
## standard ones.  They need to be defined in extra_valid_entries to
## tell the rest of the FanFicFare system about them.  They can be
## used in include_subject_tags, titlepage_entries,
## extra_titlepage_entries, logpage_entries, extra_logpage_entries,
## and include_in_* config items.  You can also add additional entries
## here to build up composite metadata entries.
## archiveofourown.org, for example, fills genre (a standard
## entry) as the composite of freeformtags, ao3categories in
## include_in_genre.  If there's ever more than 4 series, add
## series04,series04Url etc.
extra_valid_entries:fandoms, freeformtags, freefromtags,
 ao3categories, comments, chapterslashtotal, chapterstotal, kudos,
 hits, bookmarks, collections, byline, bookmarked, bookmarktags,
 bookmarksummary, bookmarkprivate, bookmarkrec, restricted, series00,
 series01, series02, series03, series00Url, series01Url, series02Url,
 series03Url, series00HTML, series01HTML, series02HTML, series03HTML,
 ships2chars,onlyromships
fandoms_label:Fandoms
freeformtags_label:Freeform Tags
freefromtags_label:Freeform Tags
ao3categories_label:AO3 Categories
comments_label:Comments
chapterslashtotal_label:Chapters/Total Chapters
chapterstotal_label:Total Chapters
kudos_label:Kudos
hits_label:Hits
collections_label:Collections
## Count of bookmarks on story by all users
bookmarks_label:Bookmarks
## Tags & Summary from *your* bookmark on the story.  Only collected
## if always_login:true
bookmarked_label:I Bookmarked Story
bookmarktags_label:My Bookmark Tags
bookmarksummary_label:My Bookmark Summary
bookmarkprivate_label:My Bookmark Private
bookmarkrec_label:My Bookmark Rec
restricted_label:Restricted to Registered Users
series00HTML_label:Series
series01HTML_label:Additional Series
series02HTML_label:Additional Series
series03HTML_label:Additional Series

## Assume entryUrl, apply to "<a class='%slink' href='%s'>%s</a>" to
## make entryHTML.
make_linkhtml_entries:series00,series01,series02,series03

## chapterslashtotal contains 1/3 or 1/1 or 3/? etc as reported by AO3.
## chapterstotal is just the total chapters part after the /
include_in_chapterstotal:chapterslashtotal.NOREPL
add_to_replace_metadata:
 chapterstotal=>^([0-9])+/(.+)$=>\2

keep_in_order_freeformtags:true
keep_in_order_ao3categories:true
keep_in_order_fandoms:true
keep_in_order_genre:true
keep_in_order_category:true
keep_in_order_characters:true
keep_in_order_ships:true

## AO3 doesn't have anything it calls 'genre'.  The adapter used to be
## hardcoded to include the site specific metadata freeformtags &
## ao3categories in the standard metadata field genre.  By making it
## configurable, users can change it.
include_in_genre: freeformtags, ao3categories

## AO3 uses the word 'category' differently than most sites.  The
## adapter used to be hardcoded to include the site specific metadata
## fandom in the standard metadata field category.  By making it
## configurable, users can change it.
include_in_category:fandoms

## freeformtags was previously typo'ed as freefromtags.  This way,
## freefromtags will still work for people who've used it.
include_in_freefromtags:freeformtags

## adds to titlepage_entries instead of replacing it.
#extra_titlepage_entries: fandoms,freeformtags,ao3categories,comments,
#chapterslashtotal,kudos,hits,bookmarks,bookmarked,bookmarktags,
#bookmarksummary,series01HTML,series02HTML,series03HTML
titlepage_entries: seriesHTML,rating,warnings,ao3categories,fandoms,
 ships,characters,freeformtags,status,datePublished,dateUpdated,
 numWords,chapterslashtotal,comments,kudos,hits,bookmarks,bookmarked,
 bookmarktags,bookmarksummary,series01HTML,series02HTML,series03HTML,
 site,description

## adds to include_subject_tags instead of replacing it.
extra_subject_tags:fandoms,freeformtags,ao3categories,onlyromships

include_in_onlyromships:ships

add_to_include_metadata_post:
 onlyromships=~[ ]*/[ ]*

#add_to_exclude_metadata_post:
#onlyromships=~&amp;

include_in_ships2chars:ships.NOREPL
# NOREPL prevents any ships patterns from being applied to ships2chars.

add_to_replace_metadata:
 ships2chars=>[ ]*/[ ]*=>/
 ships2chars=>[ ]*&amp;[ ]*=>/
 ships2chars=>([^/]+)/([^/]+)/([^/]+)/(.+)=>\1\,\2\,\3\,\4
 ships2chars=>([^/]+)/([^/]+)/(.+)=>\1\,\2\,\3
 ships2chars=>([^/]+)/(.+)=>\1\,\2

include_in_characters:characters,ships2chars

add_to_custom_columns_settings:	
 chapterslashtotal=>#chapters
 freeformtags=>#freeformtags
 onlyromships=>#ships
 ships=>#gcships
 description=>#description
 bookmarked=>#bookmarked

extra_logpage_entries:fandoms,freeformtags,ao3categories,comments,
 chapterslashtotal,kudos,hits,bookmarks,collections,byline,bookmarked,
 bookmarktags,bookmarksummary,bookmarkprivate,bookmarkrec,restricted,series00,
 series01,series02,series03

I still can't get it to work with the fic I linked last post. It works fine for other fics, as long as the "&" ship isn't the only one. Like it works for this fic:
https://archiveofourown.org/works/35839024

But not this fic (the first fic under the Gen tag on AO3 currently):
https://archiveofourown.org/works/35...pters/87480472

I'm feeling very confused lol. Will it just not let you leave a blank field?

[JimmXinu]

Emerald_Lilies,

I copied your code into an empty library, commented out always_login:true, and changed the column for onlyromships to one I already had, and downloaded those three stories.

I got 'Jaskier | Dandelion/Yennefer z Vengerbergu | Yennefer of Vengerberg' for Jarring Realities and nothing for the other two.

I believe that's what you wanted, yes? It looks like it's working to me.

Do you have a custom_columns_settings for #ships in a different section like [defaults]? You may be setting it twice.

[Emerald_Lilies]

Originally Posted by JimmXinu

Do you have a custom_columns_settings for #ships in a different section like [defaults]? You may be setting it twice.

That's what it was! Under Configure FanFicFare>Custom Columns, I had the drop down for my ships columns set wrong. And it wouldn't actually update the column until I deleted and then redownloaded the fic. I tried all the different update modes and none would update it, including with Keep Existing Tags When Updating Metadata? unchecked, but downloading fresh worked. I don't understand this stuff nearly enough to understand why though.

[JimmXinu]

Have you read the wiki page about UpdateModes?

[JimmXinu]

New Test Version Posted

2022-01-20
- Fix for py2 for base_xenforoforum tagsfromtitle. Thanks hseg for the help. See #791
- Extend base_xenforoforum tagsfromtitle for ')(' ']['

See https://www.mobileread.com/forums/sh...postcount=6819

[John Maverick]

When trying to update or download any stories from www.wuxiaworld.com FFF give an error:

Example URLs:

https://www.wuxiaworld.com/novel/genius-detective
https://www.wuxiaworld.com/novel/rmji
https://www.wuxiaworld.com/novel/above-your-head

FanficFare Register:

Spoiler:

Estado
Título
Autor
Comentario
URL
Error
Unknown
Unknown
'author'
https://www.wuxiaworld.com/novel/above-your-head

SO: Linux Mint 20.3 “Una”
Calibre v5.34.0
FanFicFare v4.9.0

I think this web changed something and because of that FFF isn't working in it now.

Thanks in advance.

[JimmXinu]

Originally Posted by John Maverick

When trying to update or download any stories from www.wuxiaworld.com FFF give an error:

I'm not sure that is fixable. The site is now requiring your browser to download and run a sizeable obfuscated javascript file. And another 100+ other JS files??

FFF doesn't have a javascript engine, and just using FlareSolverr proxy doesn't work either.

[John Maverick]

Originally Posted by JimmXinu

I'm not sure that is fixable. The site is now requiring your browser to download and run a sizeable obfuscated javascript file. And another 100+ other JS files??

Over 100 JS files per pageload? That insane.

Originally Posted by JimmXinu

FFF doesn't have a javascript engine, and just using FlareSolverr proxy doesn't work either.

Could Browser Cache be enabled for this site?

[JimmXinu]

Originally Posted by John Maverick

Could Browser Cache be enabled for this site?

I doubt it would help--I believe the cached file will still be the HTML calling for JS, not the post JS rendered page.

[estherflails]

Hello!
I've been trying to add my own adapter for personal use (the site is in Hungarian so I doubt many people would use it) but I'm having some trouble.

It's an eFiction based site, version 3.5.
Story example: https://merengo.hu/viewstory.php?sid=134752

My code, based on other eFiction adapters:

Spoiler:

from __future__ import absolute_import
from .base_efiction_adapter import BaseEfictionAdapter

class MerengoHuAdapter(BaseEfictionAdapter):

    @staticmethod
    def getSiteDomain():
        return 'merengo.hu'

    @classmethod
    def getSiteAbbrev(self):
        return 'merengo'

    @classmethod
    def getDateFormat(self):
        return "%Y.%m.%d"

def getClass():
    return MerengoHuAdapter

I also added the site to __init__.py.
This is the error I get when I try to download something: 'NoneType' object has no attribute 'find'

Can anyone tell me what I'm missing or doing wrong? I don't actually have much coding knowledge so this is a little beyond me. 😅 Thank you!

[serpi]

Hi!
Every fic on AO3 I finish I give a kudos and bookmark, using either of these can I set up a column for read and unread in my library, so I can keep everything organised?

[JimmXinu]

New Test Version Posted

2022-01-23
- New site: merengo.hu (Hungarian), thanks estherflails
- Remove site: fanfic.hu (moved to merengo.hu, storyIds don't appear to be the same)



You've actually gotten pretty close, and for many sites that would have been enough.

merengo.hu is a successor to fanfic.hu/merengo, which FFF supported until it moved. Not reading Hungarian, my notes show I didn't follow up any further than 'eFiction doesn't work immediately'.

merengo.hu is an eFiction site, but it also has a custom "consent" click through link: /tizennyolc.php?consent=true that needs to be called

Here's the version I used, if you'd like to see it.

[JimmXinu]

Originally Posted by serpi

Hi!
Every fic on AO3 I finish I give a kudos and bookmark, using either of these can I set up a column for read and unread in my library, so I can keep everything organised?

FFF collects kudos counts, but not whether you've left kudos or not.

FFF also does collect bookmarked, IE, whether you have bookmarked a story or not. You have to have always_login:true in personal.ini for [archiveofourown.org] and you have to use custom_columns_settings in personal.ini to populate a Calibre column with it.

The big limitation with that is you would then have to manually run 'update always' or 'update metadata from site' on those stories in your library after bookmarking them in AO3.

FFF has built-in features to add new/updated stories to a 'To Read' list in the Reading List plugin and a special action to help you remove them when read.

I believe this wiki page PluginWithReadingList is still reasonable accurate.