[GUI Plugin] FanFicFare

[LittleBit]

I did a quick search and didn't find any answers, so I'm not sure if it's just me having this problem, but I started having this problem with downloading from from AO3 and chrome a few weeks ago. Every attempt at downloading via browser cache has given me

Browser Cache Failed to Load with error 'HTTP Error in FFF 'open_pages_in_browser_tries_limit exceeded for site (archiveofourown.org), assuming site is off line.'(428)

I haven't changed any settings, the path is still set and so are the use browser cache and open pages in browser. The pages don't open in browser and then the failed to download dialog box pops up. I can use #use_archive_transformativeworks_org:true and #use_archiveofourown_gay:true to download most other stories but there are a few I can't update with either of those options. How can I get this working again?

[Tharos]

Since authors sometimes use different author names on various websites, I would like to harmonize them in Calibre. I use the following for individual names.

add_to_replace_metadata:
 author=>JustBored21 =>JB21Q

What doesn't work is changing to two names. The following does not work. What do I need to adjust?

add_to_replace_metadata:
 author=>JustBored21 =>JustBored21 & JB21Q

I would like the "JustBored21 & JB21Q" to appear in the author column.

[HowWouldIKnow]

How can I expose the AO3 tags (kuds, comments, bookmarks) to calibre?
I have it set up like this:

[archiveofourown.org]
use_browser_cache:true
#use_browser_cache_only:true
#open_pages_in_browser:true

extratags: AO3

add_to_custom_column_settings:
kudos=>#kudos,
hits=>#hits,
bookmarks=>#bookmarks,
comments=>#comments

But I still don´t see those in the calibre columns. Same with "Packaged".
I see them in the book.

[Tharos]

Originally Posted by HowWouldIKnow

extratags: AO3

I have added the following to AO3:

[archiveofourown.org]
extragenres:
extracategories:
extratags:
 
custom_columns_settings:
# category => Fandoms/Serien
# genre => Categories/Additional Tags
# ships => ???
# characters = > Character
# fandoms => Fandoms/Serien
# freeformtags => Additional Tags
# ao3categories => Categories
 category=>#ts
 fandoms=>#ts

It seems to work. #ts is a separate column for series. And behind the # are the specifications, as I understand the automatic assignment of tags for AO3.

[JimmXinu]

Multiple replies.

Originally Posted by SilentShadow123

Hello, are there any fixes for fanfiction on Archiveofourown (AO3) that are archive locked (blue lock icon)? I'm noticing that all these archive locked fanfiction are giving me the error: "HTTP Error in FFF '403 Client Error: Forbidden for url: https://archiveofourown.gay/users/login'(403)" when I try to download them.

Look at ProblematicSites wiki page, toward the bottom for AO3 and Browser Cache.

Originally Posted by LittleBit

I did a quick search and didn't find any answers, so I'm not sure if it's just me having this problem, but I started having this problem with downloading from from AO3 and chrome a few weeks ago. Every attempt at downloading via browser cache has given me

open_pages_in_browser_tries_limit is a recently added feature to keep from retrying forever. If you're using Chrome, you may need the latest test version--there was a change to caching.

Originally Posted by Tharos

Since authors sometimes use different author names on various websites, I would like to harmonize them in Calibre. I use the following for individual names.

add_to_replace_metadata:
 author=>JustBored21 =>JB21Q

What doesn't work is changing to two names. The following does not work. What do I need to adjust?

add_to_replace_metadata:
 author=>JustBored21 =>JustBored21 & JB21Q

I would like the "JustBored21 & JB21Q" to appear in the author column.

Multiple issues here. First, for historical reasons, you need & not just &. At that point, FFF will consider it one author with "JustBored21 & JB21Q" Second, as I recall, when FFF gives that to Calibre, Calibre may split it into two. (Or change the &, I don't remember.)

Third, if you want two author entries in FFF, use \, to separate them See here. But (fourth), if you do that, you also need to add another entry to authorUrl to match the new author name for authorHTML to still work correctly.

My recommendation: Use "JustBored21 aka JB21Q"

Originally Posted by HowWouldIKnow

How can I expose the AO3 tags (kuds, comments, bookmarks) to calibre?

Do you have 'Allow custom_columns_settings from personal.ini' checked?
Each line to be included in custom_columns_settings needs a leading space.
Columns have to already exist.
See the comment in defaults.ini: https://github.com/JimmXinu/FanFicFa...aults.ini#L356

[HowWouldIKnow]

Originally Posted by JimmXinu

Do you have 'Allow custom_columns_settings from personal.ini' checked?
Each line to be included in custom_columns_settings needs a leading space.
Columns have to already exist.
See the comment in defaults.ini: https://github.com/JimmXinu/FanFicFa...aults.ini#L356

Thanks.
I have both checked, the one in the personal.ini tab and the one in custom columns tab.

I just saw that I have used: "add_to_custom_columns:", I have now changed it to the one in the example personal.ini, added one blank before each command and removed the commas after each command.
But it still does not populate the columns.

Is there a command that can interfere with this one?

And yes, the lookup names are : #kudos and #bookmarks

extratags: AO3

custom_columns_settings:
 kudos=>#kudos
 hits=>#hits
 bookmarks=>#bookmarks
 comments=>#comments

[JimmXinu]

Originally Posted by HowWouldIKnow

Thanks.
I have both checked, the one in the personal.ini tab and the one in custom columns tab.

I just saw that I have used: "add_to_custom_columns:", I have now changed it to the one in the example personal.ini, added one blank before each command and removed the commas after each command.
But it still does not populate the columns.

Use [code], not [quote] for ini sections--it preserves whitespace.

And here's a wiki on add_to_, FYI.

The only things that come to mind are:
a) all ini settings need to be under a [section] line, [archiveofourown.org] in this case,
b) if you have more than one copy of the same setting, (possibly under another copy of the [section]), the last one take precedence,
c) on the off-chance you don't know, those column updates don't happen magically--you need to run an FFF update again for them to work, and;
d) most people don't change it anymore, but there's an over-all 'Update Calibre Metadata' checkbox on each update. It's default value can be set on FFF's General config tab.

[SilentShadow123]

[QUOTE=JimmXinu;4538556]Multiple replies.

Look at ProblematicSites wiki page, toward the bottom for AO3 and Browser Cache.

Hi Jimm, thanks for the help, but I have a few questions if you don't mind.

1. So you are saying that I have to use Browser Cache now that using archiveofourown.gay won't let me download restricted works?

2. In trying to use the Browser Cache Method, I don't understand "While using Browser Cache Feature with AO3, you should comment out always_login and username under [archiveofourown.org] in personal.ini." I don't have a section for [archiveofourown.org] in my personal.ini or either of these.

3. Where would I place "open_pages_in_browser:true" in my personal.ini? Is it required for downloading restricted works, or just adult works?

4. Is the Browser Cache Method the same as what we do for Fanfiction.net? The method where we open up each page of a fanfiction to collect the cache?

Thanks again.

[BurnedCupcake]

Good day! I'm relatively new to both Calibre and FanFicFare and have been really enjoying the plugin! However, I'd like to be able to filter based on tags that are listed on the websites I download stories from, specifically from StoriesOnline.

This seems like a super simple thing but I've read through the FAQ and the metadata pages and I haven't been able to find the option to enable this feature.

I'm a total newb here so any help would be appreciated.

[wildfire070]

Is anyone noticing when running an "update if new chapters" on an existing epub, that extra line breaks are added to the beginning of existing chapters?

Some epubs after the update will have an added line break, some epubs end up with two extra "<br/>"s, and a few will have a string of extra line breaks.

I've tried to trace it back to when it started....seems like fics that I've downloaded/updated from beginning of August until now. I've gone back through and removed the extra line breaks with an "overwrite always" on all the fics I saw with it. But today, running an "update if new chapters" causes the extra line breaks to reappear on the fics that I just recently did the "overwrite" on.

[JimmXinu]

Originally Posted by BurnedCupcake

Good day! I'm relatively new to both Calibre and FanFicFare and have been really enjoying the plugin! However, I'd like to be able to filter based on tags that are listed on the websites I download stories from, specifically from StoriesOnline.

This seems like a super simple thing but I've read through the FAQ and the metadata pages and I haven't been able to find the option to enable this feature.

I'm a total newb here so any help would be appreciated.

BurnedCupcake, I've moved your post to the FFF thread, plugin questions should go in that plugin's thread.

Re: your question, I don't understand what you're asking for. Please be more specific. (And FYI, mobileread doesn't want NSFW links in public posts.)

[JimmXinu]

Originally Posted by wildfire070

Is anyone noticing when running an "update if new chapters" on an existing epub, that extra line breaks are added to the beginning of existing chapters?

I don't see that and I have some stories that are updating multiple times a day...

My first suspicion would be your chapter_start setting includes <br> tags and that's where it's coming from.

From CustomOutput wiki page:

When an epub chapter is read back in during update, everything outside the <body> tag is discarded, as well as the first <h3>, the first <h2> tag (for historical reasons), and any tag with class skip_on_ffdl_update. That way you can include additional items in chapter_start inside the <body> tag that will be replaced each update. This is useful for sites that have additional chapter info, like chapter word counts or chapter dates.

[BurnedCupcake]

Originally Posted by JimmXinu

BurnedCupcake, I've moved your post to the FFF thread, plugin questions should go in that plugin's thread.

Re: your question, I don't understand what you're asking for. Please be more specific. (And FYI, mobileread doesn't want NSFW links in public posts.)

Thanks for moving the thread! I figured that's what happened. Most story websites (e.g. AO3, SoL, etc) have story tags that indicate what themes are present in the story. Things like "Coming of Age" or "School Setting". I'd like these tags to be added to calibre so that I can filter stories with those tags, just like I would on their respective website.

I would think this would be a default function of the plugin. The only tags that are loaded in Calibre are "Complete" and the genre (e.g. Fantasy, Romantic, etc) but not the actual tags.

[JimmXinu]

Originally Posted by BurnedCupcake

I would think this would be a default function of the plugin. The only tags that are loaded in Calibre are "Complete" and the genre (e.g. Fantasy, Romantic, etc) but not the actual tags.

For historical reasons, the include_subject_tags setting controls what collected metadata is automatically populated into Calibre's Tags field.

The default value for include_subject_tags contains only 'standard' metadata entries:

include_subject_tags: extratags, genre, category, characters, ships, lastupdate, status

The 'standard' entries are those common to most sites and were set before sites starting having generic 'tags' instead of genre, category, etc.

'Site specific' metadata entries can be added in personal.ini like so:

[storiesonline.net]
add_to_include_subject_tags:,sitetags

[BurnedCupcake]

Originally Posted by JimmXinu

'Site specific' metadata entries can be added in personal.ini like so:

[storiesonline.net]
add_to_include_subject_tags:,sitetags

I had sitetags listed under extra_subject_tags. But after adding the line you suggested, I updated the stories and made sure I selected "Update Calibre Metadata from Web Site".

Tags are now there! Thank you!