[GUI Plugin] FanFicFare

[vargr]

Originally Posted by JimmXinu

Hmmm. I'm a bit surprised that's not something currently collected. adapter_archiveofourownorg determines In-Progress/Completed by comparing Chapter: X/Y after all.

I can add it, but I wonder if it should be as "5/33" or as a separate "33". I'm thinking as the original string, since it can also be "2/?".

I'm also at a loss what to name it. chapterratio?

Oops, sorry, didn't realize you replied so fast! (I usually get an email notification...)

Either way would probably work for my purposes, though I think having the current chapters and total chapters (which could also be "?") as separate items might be more flexible.

Thanks for considering this!

[JimmXinu]

New Test Version Posted

2019-11-08
- Add site specific chapterslashtotal and chapterstotal for adapter_archiveofourownorg.

chapterslashtotal is populated with 1/3, 1/1, 3/? etc, whatever AO3 says after "Chapter:"

chapterstotal is created from it in defaults.ini because that's just easier than going the other way.

Included in defaults.ini:

chapterslashtotal_label:Chapters/Total Chapters
chapterstotal_label:Total Chapters
## chapterslashtotal contains 1/3 or 1/1 or 3/? etc as reported by AO3.
## chapterstotal is just the total chapters part after the /
include_in_chapterstotal:chapterslashtotal.NOREPL
add_to_replace_metadata:
 chapterstotal=>^([0-9])/(.+)$=>\2

Neither new entry will show up by default anywhere until you configure them to. Be that with custom_columns_settings or titlepage_entries.

[nhgbslik]

Hi JimmXinu. I wrote here a week or so ago with a bug report about ficbook.net not working properly, where it was giving a 404 error for any new chapters. Today I spent some time doing diffs between versions and found the culprit.

It is the following line in fanficfare\configurable.py that is causing the issue:

url = quote_plus(ensure_binary(url),safe=';/?:@&=+$,%&')

I added # to it and it seems to work now:
url = quote_plus(ensure_binary(url),safe=';/?:@&=+$,%&#')

Please check if it's the proper way to fix it and if so put it in your code so I don't have to change it with every update.

Thank you.

[JimmXinu]

New Test Version Posted (plus other notes--read below)

2019-11-09
- Don't escape # in URLs, causes problems with ficbook.net.
- Bypass expired SSL cert by not using SSL. adapter_thehookupzonenet
- Bypass expired SSL cert by not using SSL. adapter_spikeluvercom
- Remove site twilightarchives.com - Closed as per web site.
- Remove site lotrfanfiction.com - Closed as per web site.
- Remove site www.13hours.org. Moved to AO3.

@nhgbslik - Not sure if I missed your post or what, but sorry about that.

Support Site Cleanup

As above, sites with expired SSL certs(both expired in Aug2019) that work again (as far as I can tell) without https:

• thehookupzone.net
• spikeluver.com

As above, sites already removed:

• lotrfanfiction.com
• www.twilightarchives.com
• www.13hours.org

These sites no longer have DNS records and haven't worked since late 2018. They're next on the block.

• fanfic.castletv.net
• nfacommunity.com
• fannation.shades-of-moonlight.com

No longer has DNS, but worked in May 2019. Not going away immediately, but it's on the list.

• www.fictionalley.org

These sites are 'there', but are giving errors that prevent FFF from working.

• www.deandamage.com
• sinful-dreams.com
• archive.shriftweb.org

If you care about FFF supporting any of these sites enough to get in touch with the owner about fixing it, now's the time.

[ownedbycats]

Originally Posted by JimmXinu

Tag mapper is not automatically called by FFF if that's what you're asking.

I looked into it about a year ago--I'll direct you to look at that because I've forgotten everything I knew about it then.

Thanks. Looks a bit of a mess.

A new question: I have a Yes/No column for my reading status. Is there any way to set it back to "no" when I update a fic? Under Custom Columns, there was only "in-progress" and "completed."

[JimmXinu]

Originally Posted by ownedbycats

A new question: I have a Yes/No column for my reading status. Is there any way to set it back to "no" when I update a fic? Under Custom Columns, there was only "in-progress" and "completed."

Sure. You can explicitly set it to No for any FFF update:

custom_columns_settings:
 "N"=>#read

(You need to use your custom column id, of course, as well as add that line to the list if you already have custom_columns_settings.)

[JimmXinu]

New Test Version Posted

2019-11-11
- Add some code to handle 24 hr clocks w/o changing adapters.

[AndersW]

fimfiction has added a bunch of tags that aren't getting picked up. https://www.fimfiction.net/tags lists all the tags currently in use.

[JimmXinu]

Originally Posted by AndersW

fimfiction has added a bunch of tags that aren't getting picked up. https://www.fimfiction.net/tags lists all the tags currently in use.

Please provide a story URL that exhibits the issue and describe in detail what you think should be different.

[AndersW]

https://www.fimfiction.net/story/452518/ Isn't picking up the Death, Narcotics, or Profanity tags. None of the warning or series tags are being picked up. When you sort the tags by type you can find them at the bottom easily. https://www.fimfiction.net/tags?sear...=all&sort=type. Example of the series tags not being picked up.

Unrelated to that, the tags Cutie Mark Crusaders and Original Character are being shortened to "CMCs" and "OC". https://www.fimfiction.net/story/56826/ for an example of both.

[JimmXinu]

Originally Posted by AndersW

https://www.fimfiction.net/story/452518/ Isn't picking up the Death, Narcotics, or Profanity tags. None of the warning or series tags are being picked up. When you sort the tags by type you can find them at the bottom easily. https://www.fimfiction.net/tags?sear...=all&sort=type. Example of the series tags not being picked up.

Unrelated to that, the tags Cutie Mark Crusaders and Original Character are being shortened to "CMCs" and "OC". https://www.fimfiction.net/story/56826/ for an example of both.

FimF's color coded tags are collected, but they are divided into several different metadata lists:
genre(blue)
warnings(red)
fandoms AKA series(purple)
characters(green)
content(black)

Death, Narcotics, & Profanity are in warnings; 'series' as FimF calls in fandoms, etc.

FFF already uses the metadata name series for 'series this story is a part of'. FFF had precedent for using fandoms from AO3, so the FimF adapter did too when that code was added.

Arguably, fandoms should be included in category. And you can do that in personal.ini. FFF defaults.ini already includes content in genre, for example.

As for OC and CMCs... That's what the tags on the story page say. You can change them with replace_metadata if you like.

FimF defaults.ini:

Spoiler:

[www.fimfiction.net]
## Some sites do not require a login, but do require the user to
## confirm they are adult for adult content.  In commandline version,
## this should go in your personal.ini, not defaults.ini.
#is_adult:true

## fimfiction.net stories can be locked requiring individual
## passwords.  If fail_on_password is set, the downloader will fail
## when a password is required rather than prompting every time.
#fail_on_password: false

## fimfiction.net stories allow chapters to be added out of order.  So
## the newest chapter may not be the last one.  FanFicFare update doesn't
## like that.  If do_update_hook is uncommented and set true, the
## adapter will discard all existing chapters from the newest one on
## when updating to enforce accurate chapters.
#do_update_hook:false

## fimfiction.net is reported to misinterprete some BBCode with
## blockquotes incorrectly.  This fixes those instances and defaults
## to on, but can be switched off if it is found to cause problems.
fix_fimf_blockquotes:true

## fimfiction.net stories can have 'prequels' which it indicates by
## putting a link in the description.  By default, those are removed
## in favor of the 'prequel' site specific metadata items.  Setting
## keep_prequel_in_description:true will keep it instead.
#keep_prequel_in_description:false

## fimfiction.net chapters can have author notes attached to them.
## Setting include_author_notes:true will include them with the
## chapter text.
#include_author_notes:false

## some sites include images that we don't ever want becoming the
## cover image.  This lets you exclude them.
cover_exclusion_regexp:/images/emoticons/

## Site dedicated to these categories/characters/ships
extracategories:My Little Pony: Friendship is Magic

## Extra metadata that this adapter knows about.  See [archiveofourown.org]
## for examples of how to use them.
extra_valid_entries:likes,dislikes,views,total_views,short_description,groups,groupsUrl,groupsHTML,prequel,prequelUrl,prequelHTML,sequels,sequelsUrl,sequelsHTML,comment_count,coverSource,coverSourceUrl,coverSourceHTML,authorLastLogin,content,fandoms
likes_label:Likes
dislikes_label:Dislikes
views_label:Highest Single Chapter Views
total_views_label:Total Views
short_description_label:Short Summary
groups_label:Groups
groupsUrl_label:Groups URLs
groupsHTML_label:Groups
prequel_label:Prequel
prequelUrl_label:Prequel URL
prequelHTML_label:Prequel
sequels_label:Sequels
sequelsUrl_label:Sequel URLs
sequelsHTML_label:Sequels
comment_count_label:Comment Count
coverSource_label:Cover Source
coverSourceUrl_label:Cover Source URL
coverSourceHTML_label:Cover Source
authorLastLogin_label:Author Last Logged In
content_label:Content
fandoms_label:Fandoms

keep_in_order_sequels:true
keep_in_order_sequelsUrl:true
keep_in_order_groups:true
keep_in_order_groupsUrl:true

## Assume entryUrl, apply to "<a class='%slink' href='%s'>%s</a>" to
## make entryHTML.
make_linkhtml_entries:prequel,sequels,groups,coverSource

## What are now content tags used to be included in genre.  Copy to
## genre by default.
include_in_genre:genre,content

## What fimfiction.net has labeled 'fandoms', FFF historically calls
## 'category'.  Commented out by default due to "My Little Pony:
## Friendship is Magic" from extracategories vs "MLP: FiM" in fandoms.
#include_in_category:category,fandoms

[AndersW]

I got fandoms and warnings to work by adding "include_in_category:category,fandoms,warnings " to my personal.ini

Can you give me an example of how to use replace_metadata.

[JimmXinu]

Originally Posted by AndersW

I got fandoms and warnings to work by adding "include_in_category:category,fandoms,warnings " to my personal.ini

Can you give me an example of how to use replace_metadata.

There's a wiki page, you can search the thread for past examples, and here's a very basic example:

[www.fimfiction.net]
add_to_replace_metadata:
 characters=>^CMCs$=>Cutie Mark Crusaders
 characters=>^OC$=>Original Character

[JimmXinu]

If anyone here is interested, I've just started a discussion of the future of the FanFicFare Web Service on the Google group.

Since the web service isn't really relevant to the plugin, let's keep that discussion over there, thanks.

[JimmXinu]

New Version Released

Version 3.13.0 - 15 Nov 2019
- Add some code to handle 24 hr clocks w/o changing adapters.
- Don't escape # in URLs, causes problems with ficbook.net.
- Bypass expired SSL cert by not using SSL. adapter_thehookupzonenet
- Bypass expired SSL cert by not using SSL. adapter_spikeluvercom
- Remove site twilightarchives.com - Closed as per web site.
- Remove site lotrfanfiction.com - Closed as per web site.
- Remove site www.13hours.org. Moved to AO3.
- Add site specific chapterslashtotal and chapterstotal for adapter_archiveofourownorg.
- Fixes for adapter_webnovelcom site changes to JSON.
- Add parentforums site specific metadata for base_xenforo, include partial list in category.
- Add user/pass to adapter_fictionhuntcom, required to see chapter text now.
- Discard cookie cache on library change--might use different users/settings.
- At least one efiction site said Completed: Completed instead of Yes.
- Adding some html class attrs to epub output for ease of CSS.
- Add --no-output CLI option. Closes #443
- Save cookiejar between downloads during same calibre session, including BG jobs.
- Avoid post URLs in XenForo notification emails for QQ & AH too.
- Avoid post URLs in XenForo notification emails better w/o catching post in thread title. Probably.
- Fix for 404 error on XF always_login. Closes #438
- Fix for CLI update fail on one story causing all subsequent to also skip update. Issue #438
- Avoid post URLs in XenForo notification emails better.
- Treat spacebattles /post/ URLs in emails the same as sufficientvelocity to avoid extra URLs in thread notifications.