[GUI Plugin] FanFicFare

[John Maverick]

Originally Posted by JimmXinu

Are you sufficiently python savvy to try testing it with a basic script? Or investigating if it's a per-program security thing?

While I'm a programmer, I never used python.

For whatever is worth, running this in the command line open the browser:

python3 -m webbrowser -t "https://www.python.org"

But Calibre comes with it's own python installed, right?

I also tried to run the following python script with calibre-debug to see what happens:

import webbrowser

url="https://www.python.org"

print('Trying opening this url: '+url)
webbrowser.open(url)

The browser isn't opened, only the print is shown. But I don't know if the issue here is what it's happening with FFF, or something that is wrong in my script.

[JimmXinu]

New Test Version Posted

2024-11-17
- Call Calibre's safe_open_url for open_pages_in_browser


Perfect--that's exactly the sort of testing I meant.

This shows that it's something to do with running from Calibre's python, not python in general or FFF specifically.

Give this test version a try.

I blame general 'I'm tired' reasons for not realizing yesterday that I don't need to duplicate Calibre's code, I can just call it.

[John Maverick]

Originally Posted by JimmXinu

New Test Version Posted

2024-11-17
- Call Calibre's safe_open_url for open_pages_in_browser

Originally Posted by JimmXinu

Give this test version a try.

Now it's working perfectly. Actually it works even better than before the bug because now I can use a different browser to open the pages than the default of the OS. By choosing the browser that Calibre use in the settings, that it's used to open the pages by FFF. I preffer to have a browser that I only use for FFF

Originally Posted by JimmXinu

I blame general 'I'm tired' reasons for not realizing yesterday that I don't need to duplicate Calibre's code, I can just call it.

It can happen to the best of us. Again, thanks for your help and fast response

[ownedbycats]

[https://archiveofourown.org/works/59278108]
decode_emails:true

Failure here - still getting [email protected]. Any ideas?

EDIT: I was using 'update always' instead of overwrite.

ANOTHER EDIT: Is there any riskin putting this in the AO3 section rather than a story-specific section?

Also, another question: How does a one-chapter story have a publish date of 2024-09-28, but a last updated of 2024-09-27? Timezone oddities?

[Ghostcat]

I use the Browser Cache method to access FFN.

I have an Omnibus consisting of a significant number of one-shots.

Is it possible to add stories to the Omnibus without having to download all the existing books into the cache?

[JimmXinu]

Originally Posted by ownedbycats

[https://archiveofourown.org/works/59278108]
decode_emails:true

Failure here - still getting [email protected]. Any ideas?

EDIT: I was using 'update always' instead of overwrite.

ANOTHER EDIT: Is there any riskin putting this in the AO3 section rather than a story-specific section?

I hope not--it's set true in defaults.ini.

Originally Posted by ownedbycats

Also, another question: How does a one-chapter story have a publish date of 2024-09-28, but a last updated of 2024-09-27? Timezone oddities?

Replaced chapter, story created the day before chapter uploaded, manually set by author, who knows. Ask the author or the site if you really want to know.

Originally Posted by Ghostcat

I use the Browser Cache method to access FFN.

I have an Omnibus consisting of a significant number of one-shots.

Is it possible to add stories to the Omnibus without having to download all the existing books into the cache?

Unfortunately, not using FFF's anthology feature.

You could, instead, download the new stories individually, use EpubMerge plugin's UnMerge feature to split the existing anthology, and make a new anthology from the individual stories, both old and new. Then delete the old anthology.

[ownedbycats]

Originally Posted by JimmXinu

I hope not--it's set true in defaults.ini.

That's odd— unless it was explictly set to false in personal, it should've just worked instead of having to add it.

[Cybermidas]

Hi Everyone

I am trying to get another URL to work with the plugin. It is in a unicode language but the structure is same as RoyalRoad.

Anyone got any guidelines or how to document on making this? I can do a little simple coding and should be able to manage html.

This is URL of the site. https://www.ebanglalibrary.com

and this is book is an example of what it looks like. https://www.ebanglalibrary.com/books...7%81%e0%a6%ae/

[JimmXinu]

The FAQ about adding sites links to an issue comment from a few years ago that has some basic advice.

[Lemur4000]

DailyAlice, I've been trying to implement this but to no success. What sections do I put each change in?
Thanks,
Sophie
I've deleted the irrelevant items from my personal.ini. I want to try to show how I have it set up. I am trying to feed the fulltags column into clean tags, with the cleantags column using the cleaned up parameters.

Spoiler:

[defaults]
[archiveofourown.org]

extra_valid_entries:fandoms, freeformtags, freefromtags, ao3categories, tags, cleantags, fulltags
fandoms_label:Fandoms
freeformtags_label:Freeform Tags
freefromtags_label:Freeform Tags
ao3categories_label:AO3 Categories
cleantags_label:Clean Tags
fulltags_label:Full Tags

keep_in_order_freeformtags:true
keep_in_order_ships:true

add_to_custom_columns_settings:
freeformtags=>#fulltags
fulltags=>#fulltags
cleantags=>#cleantags

sort_ships:true

replace_metadata:
#this replaces metadata with what I want
category,genre,freefromtags,freeformtags,tags=>^[Ff]luff [Aa]nd [Aa]ngst$=>Fluff\,Angst
category,genre,freefromtags,freeformtags,tags=>^[Aa]ngst [Aa]nd [Hh]umo(u)?r$=>Humor\,Angst

[defaults]
custom_columns_settings:
freeformtags=>#fulltags
cleantags=>#cleantags

include_in_cleantags:fulltags
include_in_cleantags:freeformtags
cleantags_label:Clean Tags

add_to_exclude_metadata_pre:
##category,genre==Other Additional Tags to Be Added
warnings==Creator Chose Not To Use Archive Warnings
warnings==No Archive Warnings Apply
category,genre,freefromtags,tags,cleantags==Other Additional Tags to Be Added
category,genre,freefromtags,tags,cleantags=~^I .*
category,genre,freefromtags,tags,cleantags=~^[Aa]dditional.*
category,genre,freefromtags,tags,cleantags=~^[Aa]uthor.*

add_to_include_metadata_post:
cleantags==Action/Adventure
cleantags==Angst
cleantags==Crack
cleantags==Drama

Originally Posted by dailyalice

Giving up entirely on AO3's freeform tags is a reasonable thing to do (you don't even have to download them).

I stopped working on my guide to FanFicFare and calibre for a few months and I suspect some of that was because I started a section on normalizing metadata and got a bit overwhelmed. There's a ton you can do! But is it worth it? Key is figuring out which data you find most useful and would find useful in your library.

As far as AO3's tags go, I have two columns in my fic library that are filled using freeformtags.

The first column includes all of the messy AO3 tags: I put them in a separate column and don't touch them. So they're there if I want to search them or use them, but I can also easily ignore them.

I have this under add_to_custom_columns_settings in the AO3 section of my personal.ini:

 freeformtags=>#freeformtags

And I have a custom column in calibre of the tag type with a lookup name of "freeformtags" and column heading of "Tags (AO3)"

But I also use the freeformtags somewhere else. In the [defaults] section of my personal.ini, I have:

custom_columns_settings:
 tags=>#tags

include_in_tags:freeformtags

tags_label:Tags (Edited)

And I've created yet another custom tags column in calibre for that data (tags type, lookup name of tags, column heading of "Tags (Edited)" though I'm not wild about that name and may change it.

And then I do some tag normalization under replace_metadata using the metakey of "tags" to clean up some of those freeformtags.

Thrilling stuff like:

 tags=>^[Ff]luff [Aa]nd [Aa]ngst$=>Fluff\,Angst
 tags=>^[Aa]ngst [Aa]nd [Hh]umo(u)?r$=>Humor\,Angst
 tags=>^[Aa]ngst [Aa]nd [Ff]luff$=>Fluff\,Angst
 tags=>^[Ff]langst$=>Fluff\,Angst

I also do some stuff with tag hierarchies so tags that are specific to certain fandoms wind up being in tag hierarchies. MCU.Post-Endgame, MCU.Shrunkyclunks, and stuff like that. A person can easily go overboard.

But the real key to the whole enterprise is that then I use include_metadata_post to indicate the only tags I want to see in that Tags (Edited) column. They can be some that I normalized a bit using replace_metadata and some of the more useful ones from AO3 that I keep as is.

include_metadata_post:
 tags==Action/Adventure
 tags==Angst
 tags==Crack
 tags==Drama
 tags==Established Relationship
 tags==Fluff
 tags==Humor

You can choose to keep whichever tags from the AO3 freeformtags that you find most useful. If you already have a library, you can use the tag browser to see which tags are used most often; there are also lists online of the most popular tags on AO3. They can be a good starting point, though most folks know which tags they find most helpful.

In one of my bigger calibre fic libraries, I have over 30,000 tags in my Tags (AO3) column (GOOD GRIEF) and about 400 in my Tags (Edited) column.

I've kept these all separate from calibre's main tags column/field which I use for other things.

(Step by step instructions, with screenshots & code you can copy, will be in my guide if I ever get it done and figure out how/where to post it.) (The Google doc was well over 500 pages when last I checked and then there are separate docs on other topics like normalizing metadata.)

[JimmXinu]

And I'm not getting MR notifications again. Joy.

Originally Posted by Lemur4000

DailyAlice, I've been trying to implement this but to no success. What sections do I put each change in?
Thanks,
Sophie
I've deleted the irrelevant items from my personal.ini. I want to try to show how I have it set up. I am trying to feed the fulltags column into clean tags, with the cleantags column using the cleaned up parameters.

First, use [code] tags to preserve spacing when posting here. Some spacing matters.

I've tried to clean up your posted INI code and comment why:

[defaults]
[archiveofourown.org]

##extra_valid_entries:fandoms, freeformtags, freefromtags,  ao3categories, tags, cleantags, fulltags 
## This basically removes a bunch of other AO3 entries from defaults.ini
## Instead only add your new metadata entries:
add_to_extra_valid_entries:tags, cleantags, fulltags 
## Although it doesn't look like fulltags is used.

cleantags_label:Clean Tags
fulltags_label:Full Tags

## Keeping in order may not work when you get to a Calibre column,
## several kinds auto-sort.
keep_in_order_freeformtags:true
keep_in_order_ships:true

add_to_custom_columns_settings:
 freeformtags=>#fulltags
 fulltags=>#fulltags
 cleantags=>#cleantags

sort_ships:true

## removed 'tags', doesn't appear to be used, 
## and you don't need to worry about freefromtags.
replace_metadata:
#this replaces metadata with what I want
 category,genre,freeformtags=>^[Ff]luff [Aa]nd [Aa]ngst$=>Fluff\,Angst
 category,genre,freeformtags=>^[Aa]ngst [Aa]nd [Hh]umo(u)?r$=>Humor\,Angst


##[defaults]
## Keep in [archiveofourown.org] -- freeformtags and cleantags aren't 
## defined for most sites.  add_to_ in case you have other custom_columns_settings in 
## [defaults].
add_to_custom_columns_settings: 
 freeformtags=>#fulltags
 cleantags=>#cleantags

##include_in_cleantags:fulltags
##I assume you meant to populate full tags:
include_in_fulltags:freeformtags
include_in_cleantags:freeformtags

add_to_exclude_metadata_pre:
##category,genre==Other Additional Tags to Be Added
 warnings==Creator Chose Not To Use Archive Warnings
 warnings==No Archive Warnings Apply
 category,genre,cleantags==Other Additional Tags to Be Added
 category,genre,cleantags=~^I .*
 category,genre,cleantags=~^[Aa]dditional.*
 category,genre,cleantags=~^[Aa]uthor.*
 
add_to_include_metadata_post:
    cleantags==Action/Adventure  
    cleantags==Angst  
    cleantags==Crack  
    cleantags==Drama

Without specific story URLs to test (and what you consider 'wrong' with what you're getting), it's difficult to help much more.

[SilentShadow123]

I am trying to add fanfiction from fanfiction.net, but I am getting this error. I have already cleared my cache. What do I do from here? This is the first time I am having this issue after a few years.

"Browser Cache Failed to Load with error ''utf-8' codec can't decode byte 0xbc in position 0: invalid start byte'"

I am on an old 2020 macbook with v6.29 calibre.

[JimmXinu]

Back in August we saw a similar issue on Mac with Chrome that was fixed. Have you updated FFF?

Otherwise, I'll need to see a debug log to help.

[nornik0]

Hello! I'm new to this site so I don't even know if this is the correct way to make a "post" since I'm replying to a thread... I just started experimenting with FFF this evening and I noticed that whatever I did the Content Ratiing tag from Ao3 wouldn't appear in my custom column. I did everything I could find on the internet, so I copied the lookout name #ratin_label from the personal.ini and gave it to my custom column, and then gave the Rating metadata value through FFF configuration so the colum could be automatically filled. Still it just shows the numbers of chapters???

[JimmXinu]

If you just want Rating (ie, "Teen And Up Audiences", etc) in a custom Column, you should be able to do that in FFF's config, on the Custom Columns tab. Find your column, select Rating. That will affect all sites, not just AO3.

To use custom_columns_settings, also on the Custom Columns tab, towards the bottom, there's a checkbox to allow custom_columns_settings in personal.ini to override the GUI selections.

Make sure that you have the FFF metadata entry names and your custom column names correct. The FFF standard metadata entry 'rating' and the exact name of your custom column, including the '#'.

You also have to use a custom column of an appropriate type--you can't put a rating in an Integer column, for example.