[GUI Plugin] FanFicFare

[ILB]

Originally Posted by JimmXinu

Some AO3 stories have a 'byline' when some is archiving a story for a different author. (OTW is the software AO3 runs on, BTW.)

You can find examples by googling site:archiveofourown.org "archived by"

The only doc for it in FFF is in defaults.ini:

## OTW allows users to archive stories they didn't write in certain
## cases.  These are indicated by showing a byline such as:
## 'Orig Author [archived by Archivist Author]'
## If use_archived_author is set true (and there's only one author
## listed), author will be set to 'Orig Author' instead of 'Archivist
## Author'.  authorUrl will still point to the Archivist Author's page.
#use_archived_author:false

Would it be possible to add both in author: 'Orig Author' and 'Archivist Author' ?
Or maybe the whole phrase: 'Orig Author' [archived by 'Archivist Author']

[JimmXinu]

Originally Posted by ILB

Would it be possible to add both in author: 'Orig Author' and 'Archivist Author' ?
Or maybe the whole phrase: 'Orig Author' [archived by 'Archivist Author']

That's what byline contains.

In the existing code:

By default, author contains Archivist Author. When use_archived_author:true, author will contain Orig Author.

You can replace author with byline using include_in_author:byline, but you'd have to do by specific story URLs, since byline is usually empty.

If you used include_in_author:author,byline, then for author you will get "Archivist Author, Orig Author [archived by Archivist Author]" when byline was present. And I suppose you could then remove the '[archived by ...]' parts with replace_metadata.

However, the second author link in title page will be broken because there isn't an authorUrl for it. That could be addressed by include_in_authorUrl:authorUrl,storyUrl. Author is one of the few places FFF does not sort the list alphabetically, BTW, specifically so authors and their URLs will line up.

So this appears to work and I don't think it will hurt AO3 stories without a byline:

[archiveofourown.org]
include_in_author:author,byline
include_in_authorUrl:authorUrl,storyUrl
add_to_replace_metadata:
 author=> \[archived by.*\]=>

(Note the lack of space after 'by' in the regexp--the space gets eaten somewhere and I don't care to find it.)

[darth1]

What's the difference between fanficfare v3.29.1 and 4.1.5?

because v3.29.1 works with higher mb files and the later versions don't.

example - https://forums.spacebattles.com/thre...ection.772633/

it's over 40mb in size but doesn't work whereas a lower one with 9mb does - https://forums.spacebattles.com/thre...ece-si.356819/

what caused it?

[ILB]

Originally Posted by JimmXinu

So this appears to work and I don't think it will hurt AO3 stories without a byline:

[archiveofourown.org]
include_in_author:author,byline
include_in_authorUrl:authorUrl,storyUrl
add_to_replace_metadata:
 author=> \[archived by.*\]=>

(Note the lack of space after 'by' in the regexp--the space gets eaten somewhere and I don't care to find it.)

Thanks!

Only

add_to_replace_metadata:
 author=> \[archived by.*\]=>

doesn´t work for me. But I don't need/use it anyway.

However a story with two authors becomes three:
Author "A", Author "B" and Author "A,B"
(example https://archiveofourown.org/works/30271371)

[JimmXinu]

Originally Posted by darth1

What's the difference between fanficfare v3.29.1 and 4.1.5?
...

See release history in the first post of this thread or here on github.

Without seeing an error log, I cannot comment on what specifically might make the difference.

Most of the time in past when we've had an 'out of memory' complaint, switching from Calibre 32bit to 64bit fixed it.

Originally Posted by ILB

Thanks!

Only

add_to_replace_metadata:
 author=> \[archived by.*\]=>

doesn´t work for me. But I don't need/use it anyway.

However a story with two authors becomes three:
Author "A", Author "B" and Author "A,B"
(example https://archiveofourown.org/works/30271371)

My mistake--I assumed the tag <h3 class="byline heading"> was only present for "archived by" stories; instead it's present for all stories.

This only uses byline values that contain "\[archived by.*\]":

include_in_author:author,byline
include_in_authorUrl:authorUrl,storyUrl
add_to_include_metadata_pre:
 byline=~\[archived by.*\]
add_to_replace_metadata:
 author=> \[archived by.*\]=>

I don't know why the replace_metadata doesn't work for you, but if you don't need it, it doesn't matter.

[ILB]

[ownedbycats]

Any idea why this sometimes says two stories downloading? it usually happens when I am running an update always to fix a title page.

Also: Without feeding a custom category into a temp column, is there any way to see what it outputs? I'm trying to troubleshoot a tagcategory issue (fics keep ending up in Fanfiction.Other rather than Fanfiction.Disney and I'm not sure what step it's breaking down).

[ownedbycats]

Originally Posted by ownedbycats

Also: Without feeding a custom category into a temp column, is there any way to see what it outputs? I'm trying to troubleshoot a tagcategory issue (fics keep ending up in Fanfiction.Other rather than Fanfiction.Disney and I'm not sure what step it's breaking down).

Also this is something I'm a little stumped on. Here's a fic.

replace_metadata: 
 category=>^Rescuers$=>The Rescuers

## Sorts anything other than a few selected categories into "Fanfiction.Other"
 tagscategory=>^(?!.*(Half-Life|Portal|Mass Effect|The Elder Scrolls|Disney|Crossover)).*$=>Other

## Adds Fanfiction. to the beginning of tagcategory
 tagscategory=>^(.*)$=>Fanfiction.\1

## Some more tagcategory standardization
## Note that I had more than one fandom in here, I just temporarily removed them to check regexes
 tagscategory=>(The Rescuers)=>Disney

# 'add_to_' concats on to existing param, thus the leading comma
add_to_extra_valid_entries:,tagscategory

# tagscategory is a copy category for Fanfiction.category in tags
include_in_tagscategory:category
include_subject_tags: tagscategory

I tracked it down to specifically the line:
tagscategory=>^(?!.*(Half-Life|Portal|Mass Effect|The Elder Scrolls|Disney|Crossover)).*$=>Other

Commenting that out makes it sort into Fanfiction.Disney. However, that line works perfectly fine for all the other listed categories. Any idea why it's breaking down just for Disney?

[mrEd]

Just a heads up for storiesonline, again. Keep getting 503 errors for the index pages.
Logging in at the top of doExtractChapterUrlsAndMetadata fixes it.

adapter_storiesonlinenet.py, line 159, insert:

        self.performLogin(url)

[davidfor]

Originally Posted by mrEd

Just a heads up for storiesonline, again. Keep getting 503 errors for the index pages.
Logging in at the top of doExtractChapterUrlsAndMetadata fixes it.

adapter_storiesonlinenet.py, line 159, insert:

        self.performLogin(url)

Looking at what is happening, I think that is a problem on the site. The other sites that derive from it are not failing. So, it is probably better to add 503 to the list of status codes in line 164. That will trigger a login when "needToLoginCheck" is called a few lines later.

[Ascello]

How do I make Calibre think that new_entry (whatever name, really) is an ebook title, while having the titlepage still show an actual title?

Example: This random fic: https://archiveofourown.org/works/30676157.

I want the ebook title in Calibre to be ABC but inside ebook titlepage should have actual title by actual author.

[ownedbycats]

Originally Posted by ownedbycats

Also this is something I'm a little stumped on. Here's a fic.

replace_metadata: 
 category=>^Rescuers$=>The Rescuers

## Sorts anything other than a few selected categories into "Fanfiction.Other"
 tagscategory=>^(?!.*(Half-Life|Portal|Mass Effect|The Elder Scrolls|Disney|Crossover)).*$=>Other

## Adds Fanfiction. to the beginning of tagcategory
 tagscategory=>^(.*)$=>Fanfiction.\1

## Some more tagcategory standardization
## Note that I had more than one fandom in here, I just temporarily removed them to check regexes
 tagscategory=>(The Rescuers)=>Disney

# 'add_to_' concats on to existing param, thus the leading comma
add_to_extra_valid_entries:,tagscategory

# tagscategory is a copy category for Fanfiction.category in tags
include_in_tagscategory:category
include_subject_tags: tagscategory

I tracked it down to specifically the line:
tagscategory=>^(?!.*(Half-Life|Portal|Mass Effect|The Elder Scrolls|Disney|Crossover)).*$=>Other

Commenting that out makes it sort into Fanfiction.Disney. However, that line works perfectly fine for all the other listed categories. Any idea why it's breaking down just for Disney?

I think I figured it out. The regexes are running in the opposite order than I thought; it's changing The Rescuers to Other before it can get changed into Disney.

Unfortunately I am not sure how to fix this—moving the ## Some more tagcategory standardization portion above the others didn't seem to work.

[Ascello]

Another questions, with same story, cuz why not: https://archiveofourown.org/works/30676157

Ok, so why code:

replace_metadata: 
 publisher=>^.*$=>ABC.com&&genre=>^.*Wizengamot.*$

And all is fine. Now, how do I delete the genre Wizengamot from the ebook while still having publisher be ABC.com? And yes, I need to have the conditional, since I want this to work on books with this particular genre, not the others.

[ownedbycats]

Originally Posted by Ascello

How do I make Calibre think that new_entry (whatever name, really) is an ebook title, while having the titlepage still show an actual title?

Example: This random fic: https://archiveofourown.org/works/30676157.

I want the ebook title in Calibre to be ABC but inside ebook titlepage should have actual title by actual author.

I think you can use a custom_column_setting to put a new_entry to a column and it shouldn't touch the title page.

[JimmXinu]

Multi-reply

Originally Posted by ownedbycats

Any idea why this sometimes says two stories downloading? it usually happens when I am running an update always to fix a title page.

No idea. I would guess duplicate story URLs? Can you duplicate? If so, how?

Originally Posted by ownedbycats

Also: Without feeding a custom category into a temp column, is there any way to see what it outputs? I'm trying to troubleshoot a tagcategory issue (fics keep ending up in Fanfiction.Other rather than Fanfiction.Disney and I'm not sure what step it's breaking down).

Title page would the other option. Or CLI -m/--meta-only. I frequently use CLI with -mz and --save-cache for testing meta editing.

Originally Posted by Ascello

How do I make Calibre think that new_entry (whatever name, really) is an ebook title, while having the titlepage still show an actual title?

Example: This random fic: https://archiveofourown.org/works/30676157.

I want the ebook title in Calibre to be ABC but inside ebook titlepage should have actual title by actual author.

Make a copy of the title using (add_to_)extra_valid_entries:newtitle, set the value using include_in_newtitle:title.NOREPL, change title using replace_metadata. Customize title page to show newtitle. (Internal epub metadata will probably still show title.)

Alternatively, check 'New Only' for title in FFF config Standard Columns tab and manually set the title after first download.

Originally Posted by Ascello

Another questions, with same story, cuz why not: https://archiveofourown.org/works/30676157

Ok, so why code:

replace_metadata: 
 publisher=>^.*$=>ABC.com&&genre=>^.*Wizengamot.*$

And all is fine. Now, how do I delete the genre Wizengamot from the ebook while still having publisher be ABC.com? And yes, I need to have the conditional, since I want this to work on books with this particular genre, not the others.

Make a copy of genre using (add_to_)extra_valid_entries: origgenre, set the value using include_in_origgenre:genre.NOREPL and use that for the conditional.

Re: adapter_storiesonlinenet login: I'm not seeing any problems. Transient site issue?

I vaguely recall hitting the site manually in a browser 'primes' it some how and makes downloads work again?