View Single Post
Old 05-10-2019, 12:47 PM   #3413
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 7,043
Karma: 4604637
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by Silbermieze View Post
I'm trying to organize fanfictions in calibre with a few custom columns. Now, those columns are already set (see attachment) and most of them work with the fetched metadata, but I can't get the data for words and chapters from either site. I'm not sure if I just don't get the right "label" for it or if it doesn't work at all? I know the plugin "count pages", but I could never make sense of those numbers, so if there's a chance I can get the original data from FF.net and AO3, I'd prefer them.
For most metadata, it's usually easier to use the 'Custom Columns' tab in the GUI. That will prevent issues like you have with numChapters and numWords -- note the 'num' plus capital C and W. But I can understand wanting to have them all together.

Quote:
Originally Posted by Silbermieze View Post
Secondly, while I looked around this thread I found the possibility to exclude relationships with an "&", but I can't get that to work either. Maybe I put something in my personal.ini that clashes against each other?
You copied it from somebody who wanted both ships with and without 'friends'. Which is why it used onlyromships, but you didn't do anything with onlyromships after setting it. Example below shows excluding all ships with &. That should work while not catching names with other html & entities.

Quote:
Originally Posted by Silbermieze View Post
I guess I overshoot a bit with those "extra valid entries" and "labels" (which I don't understand at all), but those were my first tries to get the metadata I want and now I don't know any more what I can and can't delete to have everything still working.
<entry>_label settings are only used inside FFF on the title page and log page--they have no effect on Calibre columns. (Well, okay, they also appear in Saved Metadata Column.)

INI entries that are in defaults.ini (and not commented out) do not need to be copied to your personal.ini. So for example, you don't need those extra_valid_entries entries. ships2chars is the only added entry for additional processing you need right now.

Our code for ffnet doesn't login, there's no need for your user/pass there. Admittedly, user/pass is needed for many other sites.

Quote:
Originally Posted by Silbermieze View Post
And thirdly, I have one column for genre, which works perfectly for FF.net, but not AO3 (for obvious reasons). I guess there's no further breakdown of the tags beneath characters, ships, and freeformtags? So I have to either fill in the genre manually or remove the other tags manually?
AO3 lets authors enter basically anything and everything. And authors do.

Normalizing AO3 tags is a subject that comes up here regularly; basically I will help with specific problems you may have, but I don't consider it my job to try and fix that design decision on AO3's part. That includes adding code to walk AO3's tag pages to get normalized tag values. I've seen stories with dozens if not hundreds of tags, I'm not adding extra network hits for them all.

Quote:
Originally Posted by Silbermieze View Post
Also: Can I move the tags from the original tags-section to my "genre" column so they won't appear in both sections?
Calibre's Tags column is set from FFF by include_subject_tags. I've shown how in the example below how to remove items from it.

You can also use the 'New Only' checkbox under Standard (and Custom) Columns tabs in FFF config to manually manage columns after initial story add. The equivalent in custom_columns_settings is a ,n after the column name.

personal.ini with changes discussed:

Spoiler:
Code:
[defaults]

# moved to defaults to apply to all sites.
is_adult:true

# changed from default values
sort_ships:true
keep_in_order_characters:true
keep_in_order_ships:true

# common std entries in defaults to apply to all sites.
# all of these could be set using FFF config GUI
# append ,n to only populate on new book add
custom_columns_settings:
 status=>#status
 ships=>#pairings
 rating=>#rating
 numWords=>#wordcount
 numChapters=>#chapters
 characters=>#characters
 category=>#categories
 genre=>#genre

[www.fanfiction.net]
# site specific values -- add_to_ mechanism adds to more general
# settings from [defaults]
add_to_custom_columns_settings:
 favs=>#kudos
 follows=>#bookmarks
 reviews=>#comments

[archiveofourown.org]
username:XXXXXXXX
password:XXXXXXXX

# exclude '&' ships -- onlyromships version was for a user who was saving both
# note: only effects AO3 here--move to [defaults] for other sites.
add_to_exclude_metadata_post:
 ships=~&amp;

add_to_extra_valid_entries:,ships2chars

include_in_ships2chars:ships.NOREPL
# NOREPL prevents any ships patterns from being applied to ships2chars.

add_to_replace_metadata:
 ships2chars=>[ ]*/[ ]*=>/
 ships2chars=>[ ]*&amp;[ ]*=>/
 ships2chars=>([^/]+)/([^/]+)/([^/]+)/(.+)=>\1\,\2\,\3\,\4
 ships2chars=>([^/]+)/([^/]+)/(.+)=>\1\,\2\,\3
 ships2chars=>([^/]+)/(.+)=>\1\,\2

include_in_characters:characters,ships2chars

# controls what goes in Calibre's tags column
# need to set entire value to remove entries category & genre
include_subject_tags: extratags, characters, ships, status

exclude_notes:authorheadnotes,chaptersummary,chapterheadnotes,chapterfootnotes,authorfootnotes,inspiredlinks

# site specific values
add_to_custom_columns_settings:
 kudos=>#kudos
 bookmarks=>#bookmarks
 comments=>#comments
JimmXinu is online now   Reply With Quote