[GUI Plugin] FanFicFare

[ackomb]

Originally Posted by theducks

New/recent users can go into (anti-SPAM) moderation under certain cases. You triggered a case.
Please give the Moderators time to show up and review the posts before attempting again.
Your posts have been released (and I deleted the dup)

Thanks for letting me know, I'll keep that in mind next time.

[JimmXinu]

@ackomb - It's hard to make out what parts of your post are quoted code and not, and to see the whitespace; which does make a difference in regexp..

Please use [code] tags around code blocks, such as your INI lines and italic or underline to show which parts of your prose are specific strings.

Example:

replace_metadata:
 characters=>^Brian \(The 100\)$=>Bryan (the 100)&&category==the 100
 characters=>^Brian \(The 100\)$=>Bryan (the 100 )&&category==the 100

You can quote other peoples posts to see what codes they used even if you don't post the reply.

[ackomb]

Originally Posted by JimmXinu

@ackomb - It's hard to make out what parts of your post are quoted code and not, and to see the whitespace; which does make a difference in regexp..

Please use [code] tags around code blocks, such as your INI lines and italic or underline to show which parts of your prose are specific strings.

Example:

replace_metadata:
 characters=>^Brian \(The 100\)$=>Bryan (the 100)&&category==the 100
 characters=>^Brian \(The 100\)$=>Bryan (the 100 )&&category==the 100

You can quote other peoples posts to see what codes they used even if you don't post the reply.

Hi Jimm,

Sorry, I had some issues last night and I forgot to include my .ini

Spoiler:

## [defaults] section applies to all formats and sites but may be overridden at several levels.
[defaults]
is_adult:true
include_titlepage: true

## Add this to genre if there's more than one category.
add_genre_when_multi_category: #Crossover

[www.archiveofourown.org]
#username:***
#password:***

use_view_full_work:true

add_to_extra_valid_entries:,ships2chars
#include_in_ships2chars:ships.NOREPL

add_to_replace_metadata:
ships2chars=>[ ]*/[ ]*=>/
ships2chars=>[ ]*&[ ]*=>/
ships2chars=>([^/]+)/([^/]+)/([^/]+)/(.+)=>\1\,\2\,\3\,\4
ships2chars=>([^/]+)/([^/]+)/(.+)=>\1\,\2\,\3
ships2chars=>([^/]+)/(.+)=>\1\,\2
include_in_characters:characters,ships2chars

## Tells which tags from the site to include in calibre
include_subject_tags: extratags, genre, category, characters, ships
include_in_genre: freeformtags, ao3categories
include_in_category: fandoms

add_to_include_subject_tags:,tagsfromtitle.SPLIT

## Tells which tags from the site to include on the titlepage
titlepage_entries: series,category,genre,characters,status,datePublis hed,dateUpdated,rating,numChapters,numWords,site,d escription

## Tells which tags goes to which customs column
custom_columns_settings:
genre=>#genre,a
category=>#show,a
characters=>#m_char,a
ships=>#m_pair,a

## Excludes entire tags before being processed further
exclude_metadata_pre:
freeformtags,genre==Other Additional Tags to Be Added
warnings==Creator Chose Not To Use Archive Warnings
warnings==No Archive Warnings Apply

replace_metadata:
## Regular cleanup
## Replaces & with / in 'ships' and 'genre'
ships,genre,category,characters=> & =>/
ships,genre,category,characters=>&=>/
ships,genre,category,characters=> \| =>/

category=>^The 100 \(TV\)$=>the 100
characters=>^Abigail "Abby" Griffin$|^Abby$|^Abby Griffin$|^Abbie$|^Abby \(The 100\)$|^Abigail Griffin$=>Abigail "Abby" Griffin&&category==the 100
characters=>^Bellamy Blake$|^Bellamy$|^Bellamy Blake \(mentioned\)$|^Bellamy Black$|^Bob Morley$|^bellamie$=>Bellamy Blake&&category==the 100
characters=>^Bryan \(the 100\)$|^Brian \(The 100\)$|^Bryan \(The 100\)$=>Bryan (the 100)&&category==the 100
characters=>^Clarke Griffin - Wanheda$|^Clark Griffin$|^Clarke - Character$|^Clarke Griffin \(mentioned\)$|^Clarke Griffin\/Madi - Character$|^Clarke is grieving - Character$|^Clarke Griffin$|^Sad Clarke - Character$|^Clarke \(The 100\)$|^Clarke Cullen$=>Clarke Griffin - Wanheda&&category==the 100
characters=>^Finn Collins$|^Finn$|^Fin Collins$=>Finn Collins&&category==the 100
characters=>^Harper McIntyre$|^Harper \(The 100\)$|^Harper$=>Harper McIntyre&&category==the 100
characters=>^Indra \(the 100\)$|^Indra$|^Indra \(The 100\)$=>Indra (the 100)&&category==the 100
characters=>^Jake Griffin$|^Jake$|^Jack Griffin$=>Jake Griffin&&category==the 100
characters=>^Jasper Jordan$|^Jasper$=>Jasper Jordan&&category==the 100
characters=>^Lexa \(the 100\) - Heda$|^Commander Lexa - Character$|^Lexa$|^Heda Lexa - Character$|^Fine Stud Lexa - Character$|^lexa woods$|^Lexa's tribute$|^One year since lexa died$|^Lexa \(The 100\)$|^Lexa \(The 100\) \(mentioned\)$|^leksa - Character$|^Alycia Debnam-Carey$=>Lexa (the 100) - Heda&&category==the 100
characters=>^Lincoln \(the 100\)$|^Lincoln \(mentioned\)$|^One Year since Lincoln died$|^Lincoln Burrows$|^Lincoln Woods$|^Lincoln's tribute$|^Lincoln$|^Lincoln \(The 100\)$|^Lincoln \(The 100\) \(mentioned\)$=>Lincoln (the 100)&&category==the 100
characters=>^Monty Green$|^Monty$|^Monty Greene$|^Monte$=>Monty Green&&category==the 100
characters=>^Nathan Miller$=>Nathan Miller&&category==the 100
characters=>^Octavia Blake$|^Octavia$|^Octavia Blake \(mentioned\)$|^Octavia is grieving - Character$|^Sad Octavia - Character$|^Octavia \(The 100\)$=>Octavia Blake&&category==the 100
characters=>^Raven Reyes$|^Raven$|^Raven Reyes \(mentioned\)$|^Raven Cullen$=>Raven Reyes&&category==the 100

## This section will override anything in the system defaults or other sections here.
[overrides]
## default varies by site. Set true here to force all sites to collect series.
collect_series: true
extratags:

As for the lines I'd higlighted in my post, this is just a variation I tried to see it was actually replacing anything or not, the answer is yes.

[JimmXinu]

Originally Posted by ackomb

Hi Jimm,

Sorry, I had some issues last night and I forgot to include my .ini
...
As for the lines I'd higlighted in my post, this is just a variation I tried to see it was actually replacing anything or not, the answer is yes.

Okay, so we have your INI code (still not in [code] tags ), and you previously posted what the issue was (I think)--Bryan (The 100) vs Bryan (the 100).

And I had to go find the story URL in the big block'O metadata. But I was able to test it.

I don't think there's anything wrong with your FFF settings. I see Bryan (the 100).

What I think you may be seeing is a Calibre effect:

Calibre tries to help with tag (upper/lower)case; if that column already contains Bryan (The 100), it will not be changed when FFF tries to set it to Bryan (the 100). Because, ignoring case, they are the same value.

But if you first clear the column (or even just that value from the column), it should be good.

[ownedbycats]

A somewhat similar problem can also occur with trailing spaces. Calibre removes them for the column, but FFF sees them as different categories.

[ackomb]

Originally Posted by JimmXinu

Okay, so we have your INI code (still not in [code] tags ), and you previously posted what the issue was (I think)--Bryan (The 100) vs Bryan (the 100).

And I had to go find the story URL in the big block'O metadata. But I was able to test it.

I don't think there's anything wrong with your FFF settings. I see Bryan (the 100).

What I think you may be seeing is a Calibre effect:

Calibre tries to help with tag (upper/lower)case; if that column already contains Bryan (The 100), it will not be changed when FFF tries to set it to Bryan (the 100). Because, ignoring case, they are the same value.

But if you first clear the column (or even just that value from the column), it should be good.

Again sorry, I do try to follow up on your sugestions and I will use [code] in stead of [spoiler] as well as underlining the strings.

I’ve tried your suggestions, starting with just removing the character from the column, then emptying the whole column, then removing the entire story and adding it again from scratch . None of those worked, however the last hail Mary was to delete the entire character from all stories and it worked.

Is there any way to turn off this setting in which Calibre is trying to be helpful but actually isn’t (in my opnion)? I know it has nothing to do with FFF but if anyone knows...

And once again thank you.

[ownedbycats]

As far as I'm aware, no. Calibre columns are case-insensitive.

[JimmXinu]

Originally Posted by ackomb

...
None of those worked, however the last hail Mary was to delete the entire character from all stories and it worked.

Sorry, I knew that but failed communicate it to you. (I was testing in an empty library with just one book, so clearing the column did remove it from all stories.)

I believe you might also be able to change the 'canonical' spelling Calibre uses in Calibre's tag browser?

I, too, am not aware of anyway to change Calibre behavior about this.

[ownedbycats]

Originally Posted by JimmXinu

I believe you might also be able to change the 'canonical' spelling Calibre uses in Calibre's tag browser?

You can do this by using the Category Editor that's available in the Tag Browser menu.

[JimmXinu]

New Test Version Posted

2021-01-28
- Get cloudscraper 1.2.56 changes, but keep py2 compat.

If you're not getting cloudscraper errors, don't bother with this update.

[ownedbycats]

New bug, unsure if it's a change in FFF or ffnet's email notifications: Dragging and dropping an FFNet email in from Thunderbird results in the path to the .eml being dropped instead. I'll PM you the email file as it contains my email address.

[Tharos]

I need some help (ok, a lot of help) with the metadata. Maybe someone has time to look into my problems.
What is it about. I am trying to change the metadata of several pages via [defaults]. And then later to modify it page specific.

Q1: Although I exclude "Cunning; resourceful and ambitious" via several lines, it continues to be listed in the tags. What am I doing wrong?

Q2: I want to always delete all tags that contain "Cunning". What is the correct entry here? I am trying 4 different ways. None of them works. Why?

Q3: In [defaults] I would like to delete "Arthur Weasley". The entry here does not work. Why?

Q4: What is the difference between "^(Manipulative(.*)?)$" and "^Manipulative$"? I want to delete or change all tags that start with this word. I can't figure out from the examples here in the forum what the right way is.

Many questions, I know. But maybe someone has some time to look over it. I am grateful for any help.

[defaults]
is_adult:true
view_adult=true
keep_summary_html:false
include_images:true
make_firstimage_cover:true
never_make_cover:false
include_subject_tags:sitetags,genre,category,eroticatags,characters,extratags,fandoms,tags
add_to_custom_columns_settings:
 fandoms=>#ts
extratags:
 
exclude_metadata_pre:
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags==^(Cunning(.*)?)$
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags==^(Manipulative(.*)?)$
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags==^Cunning$
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags==^Manipulative$
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags==Allgemein
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags==Cunning; resourceful and ambitious
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags==Arthur Weasley
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags==Justin Finch-Fletchley
 
exclude_metadata_post:
 
add_to_replace_metadata:
# Status anpassen
 status=>In-Progress=>unvollständig
 status=>In-progress=>unvollständig
# Webseitenadresse anpassen
 site=>www.hpfanficarchive.com=>hpfanficarchive.com
# Metadaten für Allgemeines ändern
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags=>^(Naruto(.*)?)$=>Naruto Uzumaki\,Naruto
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags=>^Harem$=>Harem/Multiple Partners
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags=>^Multiple$=>Harem/Multiple Partners
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags=>^Naruto$=>Naruto Uzumaki\,Naruto
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags=>Spider-Man=>Spiderman
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags=>The Legend of Zelda=>Legend of Zelda
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags=>Harry James Potter=>Harry Potter
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags=>Action\/Adventure=>Action\,Adventure
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags=>Science Fiction=>Sci-Fi
  
[epub]
 
[hpfanficarchive.com]
# Metadaten löschen
exclude_metadata_pre:
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags==After Hogwarts
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags==AT - Alternative Timeline
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags==Bashing
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags==Before Hogwarts - Dursley's years
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags==Cunning; resourceful and ambitious
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags==Cunning\; resourceful and ambitious
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags==Dark
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags==Dark Fic\/Character
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags==During the Marauders
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags==During years at Hogwarts
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags==Hogwarts - Year 1
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags==Hogwarts Heir
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags==Weasleys bashing
# Metadaten ändern
replace_metadata:
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags=>Adventure\/Action=>Adventure\,Action
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags=>Bellatrix Black-Lestrange=>Bellatrix Lestrange
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags=>HP\/Stargate=>Harry Potter\,Stargate SG1
 sitetags,genre,category,characters,eroticatags,extratags,fandoms,tags=>Narcissa Black-Malfoy=>Narcissa Malfoy

[JimmXinu]

Originally Posted by Tharos

I need some help (ok, a lot of help) with the metadata. Maybe someone has time to look into my problems.
What is it about. I am trying to change the metadata of several pages via [defaults]. And then later to modify it page specific.

Requests for assistance are almost always easier to help with when example story URLs showing the problem are given.

In this case, I can point out what I see that's wrong, but I'm not going to be able to test with stories to try.

• In exclude_metadata_pre lines: you are using '==' which matches exact string, but giving regexp patterns for several. Change '==' to '=~', or don't use regexp patterns there.
  
• It's your choice, but changing the value of status can prevent FFF's Custom Column settings from working when assigning to a boolean column using the GUI config page.
  
• Changing site (or storyId or storyUrl) can cause subtle problems because those values are used internally. I'd use publisher instead; that's what gets set in Calibre Publisher column.
  
• exclude_metadata_pre settings under [site] sections are overriding those in [defaults]. Use add_to_exclude_metadata_pre in the [site] sections to add instead of replace. See https://github.com/JimmXinu/FanFicFare/wiki/INI-File
  
• Not a problem, just a way to save some text: replace_metadata lines will be applied to all metadata entries if you skip the list. Example:

  replace_metadata:
   Adventure\/Action=>Adventure\,Action

  That doesn't work with include/exclude lines.

Originally Posted by Tharos

Q4: What is the difference between "^(Manipulative(.*)?)$" and "^Manipulative$"? I want to delete or change all tags that start with this word. I can't figure out from the examples here in the forum what the right way is.

Regular expressions can be difficult to understand for new users, but they are powerful and already available in most programming languages. There are many tutorials and introductory pages out there: Google regexp or regular expressions. FFF uses Python regexp in the few cases it makes a difference.

Very briefly:

^ means start of string and $ means end of string.

So ^Manipulative$ matches the string "Manipulative" and nothing else.

Parens: ( and ) are the grouping mechanism which is used to make more complex patterns and to pass part of the matched expression into the replacement using \1, \2 etc for each set of parens left to right.

The dot . in regexp matches any character. Star * means "0 or more of the previous character or grouping". ? means "0 or 1 of the previous character or grouping".

Effectively, ^(Manipulative(.*)?)$ matches any string that starts with "Manipulative". The parens in this case are unneeded. ^Manipulative.*$ is equivalent. And it renders ^Manipulative$ redundant.

[JimmXinu]

Originally Posted by ownedbycats

New bug, unsure if it's a change in FFF or ffnet's email notifications: Dragging and dropping an FFNet email in from Thunderbird results in the path to the .eml being dropped instead. I'll PM you the email file as it contains my email address.

I've seen that happen once in a great while. I think it's a thunderbird thing.

Nothing about that code has changed recently in FFF and I'm not seeing it.

[ownedbycats]

I just did a bit more testing. Other email notifications work (I had a few saved), just the one I sent you isn't. The only thing that seems different is that the glitchy one is the only one over 100 chapters (maybe some pattern-matching issue? But I figure you would've already accounted for something like that.)

If it happens again with another email I'll post again.