Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 04-23-2023, 04:43 PM   #8371
applegaa
Connoisseur
applegaa has learned how to buy an e-book online
 
applegaa's Avatar
 
Posts: 70
Karma: 76
Join Date: Apr 2019
Device: none
Quote:
Originally Posted by JimmXinu View Post
applegaa, the word 'tags' is ambiguous, and metadata entries are not the same thing as what ends up in Calibre's Tags column, aka 'subject tags'. So I'm not 100% sure I know what you are saying. But I will make an attempt.

I think this does it:
Code:
[www.scribblehub.com]

# Remove genre & extratags from Calibre Tags.
include_subject_tags: category, characters, ships, status

# Add a custom column setting to the list for genre,
# flag 'r' for replace to overwrite more generic setting
add_to_custom_columns_settings:
 genre=>#yourcategorycol,r
If that doesn't help, please provide a concrete example with story URL (SFW please) and exactly which values you want and don't want where.
I'm not sure how to even test this, as it only does half of what I want. Maybe...

I have already figured out how to move the metadata from one predefined variable to another. It's swapping the values that is failing as I either get two copies of one set or I get one set and a blank.


An example would be this URL:

https://www.scribblehub.com/series/6...isekai-litrpg/

The Details page on ScribbleHub has the following listed under Genre:
Code:
Action
Adventure
Comedy
Fantasy
Isekai
LitRPG
Slice of Life
It also has the following under Tags:
Code:
Alternate World
Dragons
Dwarfs
Elemental Magic
Elves
Female Protagonist
Game Elements
Game Ranking System
Legends
Level System
Magic
Monsters
Multiple POV
Multiple Realms
Overpowered Protagonist
Protagonist Strong from the Start
I have added a custom column in Calibre called Category which I map to the predefined Category metadata in the FanFicFare Custom Columns configuration tab.

Now, if I load this story using the default configuration, the Tags column in Calibre gets "Action, Adventure, Comedy, Fantasy, Isekai, LitRPG, Slice of Life" (aka ScribbleHub Genre) while the Category column gets "Alternate World, Dragons, Dwarfs, Elemental Magic, Elves, Female Protagonist, Game Elements, Game Ranking System, Legends, Level System, Magic, Monsters, Multiple POV, Multiple Realms, Overpowered Protagonist, Protagonist Strong from the Start" (aka ScribbleHub Tags).

What I want is the opposite. I want the 7 entries that ScribbleHub calls Genre in the Category column and I want the 16 entries that ScribbleHub calls Tags in the Tags column.

- Andrew
applegaa is offline   Reply With Quote
Old 04-23-2023, 05:40 PM   #8372
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,988
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by applegaa View Post
I'm not sure how to even test this, as it only does half of what I want. Maybe...
...
I have added a custom column in Calibre called Category which I map to the predefined Category metadata in the FanFicFare Custom Columns configuration tab.
...
What I want is the opposite. I want the 7 entries that ScribbleHub calls Genre in the Category column and I want the 16 entries that ScribbleHub calls Tags in the Tags column.
And you want that swap for all ScribbleHub stories, not just that one, right?

The personal.ini settings I gave before should do it, assuming you also checked the 'Allow custom_columns_settings from personal.ini to override' checkbox on the Custom Columns tab.

The GUI setting for your Category column would apply for most sites, and ScribbleHub would use the one in personal.ini.

Is that the only site you use? Because it looks to me like you are the one who has a non-standard definition of 'Genre', not ScribbleHub.
JimmXinu is offline   Reply With Quote
Advert
Old 04-23-2023, 09:54 PM   #8373
applegaa
Connoisseur
applegaa has learned how to buy an e-book online
 
applegaa's Avatar
 
Posts: 70
Karma: 76
Join Date: Apr 2019
Device: none
Quote:
Originally Posted by JimmXinu View Post
And you want that swap for all ScribbleHub stories, not just that one, right?

The personal.ini settings I gave before should do it, assuming you also checked the 'Allow custom_columns_settings from personal.ini to override' checkbox on the Custom Columns tab.

The GUI setting for your Category column would apply for most sites, and ScribbleHub would use the one in personal.ini.

Is that the only site you use? Because it looks to me like you are the one who has a non-standard definition of 'Genre', not ScribbleHub.
Yes, I want to use it for all of ScribbleHub. I have other sites that use categories and tags rather than genres and tags, so I'd have to swap the values on more sites if I standardized with the ScribbleHub default.

I apologize for not properly testing your suggestion before responding. Looking back through my failed attempts to the ones where I tried using the custom columns directly, I was missing the ",r" so I'm guessing that's why my attempts failed and I thought I had already tried what you suggested.

Is there someplace where these flags are documented? Even now, with the full knowledge of the correct answer, my Google searches have only returned one post where you told somebody else to use "r" instead of "a" on one line. From that I now know there are at least 2 flags and I'm pretty sure the "a" is for add...


TL;DR: It worked. Thanks!

- Andrew
applegaa is offline   Reply With Quote
Old 04-23-2023, 10:01 PM   #8374
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,988
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by applegaa View Post
Is there someplace where these flags are documented?
Yeah, I've never been fond of writing documents. In this case, it's in the comments in defaults.ini, where I see I used 'mode' instead of 'flag':
Spoiler:
Code:
## (Plugin Only) - You can also populate calibre custom columns with
## the site specific metadata using custom_columns_settings (but only
## if 'Allow custom_columns_settings from personal.ini' is checked in
## the plugin GUI config.)  There are three parts, the entry name,
## then the label of the calibre custom column, then (optionally) a
## 'mode'.  'r' to Replace any existing values, 'a' to Add to existing
## value (use with tag-like columns), and 'n' for setting on New books
## only.  (Default is 'r'.)

## Literal strings can be set into custom columns using double quotes.
## Each metadata=>column mapping must be on a separate line and each
## needs to have one space at the start of each line.  There is also a
## special case for Integer and Float type custom columns: The static
## value "None" will clear the column.

## 'r_anthaver' and 'n_anthaver' can be used to indicate the same as
## 'r' and 'n' for normal downloads, but to average the metadata for
## the differents story in an anthology before setting in integer and
## float type custom columns.  This can be useful for a averrating
## column, for example.
## 'r_anthmax' and 'n_anthmax' indicate 'r' and 'n' for normal
## downloads, but to use the highest value for the metadata from the
## differents story in an anthology in integer and float type custom
## columns.
## Default is to sum the values of all stories, and numChapters and
## numWords are always summed.

#custom_columns_settings:
# cliches=>#acolumn
# themes=>#bcolumn,a
# timeline=>#ccolumn,n
# "FanFiction"=>#collection
# averrating=>#averrating,r_anthaver
JimmXinu is offline   Reply With Quote
Old 04-23-2023, 11:14 PM   #8375
ownedbycats
Custom User Title
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 11,025
Karma: 75555555
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
For future reference:

Would a story-section include_in_customentry override the one in defaults?

Example:

For my subtitle tweak, I replace 'title' and then copy the original to fulltitle, which is displayed on the titlepage. But if I do want to edit the title:

Code:
[defaults]

# fulltitle copies unedited title for titlepages
include_in_fulltitle:title.NOREPL 

[http://test1.com?sid=12345]
add_to_replace_metadata:
 title=>^.*=>edited title

include_in_fulltitle:"edited title"
ownedbycats is offline   Reply With Quote
Advert
Old 04-23-2023, 11:39 PM   #8376
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,988
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Yes, it's more visible if you set them to different values. Changes in bold.
Code:
[defaults]

add_to_extra_valid_entries:,fulltitle
add_to_titlepage_entries:,fulltitle

# fulltitle copies unedited title for titlepages
include_in_fulltitle:title.NOREPL 

[http://test1.com?sid=12345]
add_to_replace_metadata:
 title=>^.*=>edited title

include_in_fulltitle:"static title"
JimmXinu is offline   Reply With Quote
Old 04-27-2023, 09:39 AM   #8377
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,988
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
New Test Version Posted

2023-04-27
- adapter_deviantartcom: Another detect login string. #947
JimmXinu is offline   Reply With Quote
Old 04-27-2023, 02:45 PM   #8378
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,988
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
New Test Version Posted

2023-04-27
- Change force_img_referer to force_img_self_referer_regexp See #940 #941
- adapter_deviantartcom: Another detect login string. #947

Code:
## If set, and the img tag's URL matches the regular expression, FFF
## will use the img tag's own src URL as the HTTP Referer instead of
## the page URL.  This is useful for some image hosting sites that
## watermark or return HTML instead of image data without it.
#force_img_self_referer_regexp:gelbooru.com|photobucket.com
Changed to a regexp instead of a simple switch so it can be more finely controlled and put in more generally than [storyURL] sections.
JimmXinu is offline   Reply With Quote
Old 04-27-2023, 07:08 PM   #8379
ownedbycats
Custom User Title
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 11,025
Karma: 75555555
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
Thanks for implementing my suggestion
ownedbycats is offline   Reply With Quote
Old 04-27-2023, 11:31 PM   #8380
ownedbycats
Custom User Title
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 11,025
Karma: 75555555
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
@JimmXinu - While trying to use it for something else, I found that WebToEpub crashes the Vivaldi browser. I found a github issue that confirms it so I added a note to the browser cache page.
ownedbycats is offline   Reply With Quote
Old 04-28-2023, 05:05 AM   #8381
Ghostcat
Connoisseur
Ghostcat ought to be getting tired of karma fortunes by now.Ghostcat ought to be getting tired of karma fortunes by now.Ghostcat ought to be getting tired of karma fortunes by now.Ghostcat ought to be getting tired of karma fortunes by now.Ghostcat ought to be getting tired of karma fortunes by now.Ghostcat ought to be getting tired of karma fortunes by now.Ghostcat ought to be getting tired of karma fortunes by now.Ghostcat ought to be getting tired of karma fortunes by now.Ghostcat ought to be getting tired of karma fortunes by now.Ghostcat ought to be getting tired of karma fortunes by now.Ghostcat ought to be getting tired of karma fortunes by now.
 
Posts: 61
Karma: 582370
Join Date: Apr 2023
Device: Kobo Clara 2E
Quote:
Originally Posted by ownedbycats View Post
@JimmXinu - While trying to use it for something else, I found that WebToEpub crashes the Vivaldi browser. I found a github issue that confirms it so I added a note to the browser cache page.
I have just checked and WebToEpub works OK with the Brave Browser. Thanks for this by-the-way, I thought it was a Firefox only extension :-(

I have noticed that on FFN, WebToEpub pauses somewhere between 20 and 25 pages. If left it will eventually continue on its own. This can be avoided by setting "Manual Throttle|Delay per chapter" to 5 Secs/Chapter.
Ghostcat is offline   Reply With Quote
Old 04-28-2023, 07:08 PM   #8382
riothamus
Connoisseur
riothamus rocks like Gibraltar!riothamus rocks like Gibraltar!riothamus rocks like Gibraltar!riothamus rocks like Gibraltar!riothamus rocks like Gibraltar!riothamus rocks like Gibraltar!riothamus rocks like Gibraltar!riothamus rocks like Gibraltar!riothamus rocks like Gibraltar!riothamus rocks like Gibraltar!riothamus rocks like Gibraltar!
 
Posts: 97
Karma: 100000
Join Date: Nov 2010
Device: KOA3, KV, KOA2
So I used to be fairly tech savvy and I can still usually figure things out. But I'm a little stumped getting started with flaresolverr and FFF. I use windows 10 first off. I know the flaresolverr page says it's best to use docker, but it appears the docker instructions are for linux and there's a precompiled binary for flaresolverr for windows. What I can't figure out is if I should still use docker in windows (which I found by googling). A little help to get started? If it was just ff.net I'd stick with browser cache, but I have a story I'm following on scribblehub now too (he had to remove it from royalroad due to smut content).

Thanks!
riothamus is offline   Reply With Quote
Old 04-28-2023, 07:19 PM   #8383
ownedbycats
Custom User Title
ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.ownedbycats ought to be getting tired of karma fortunes by now.
 
ownedbycats's Avatar
 
Posts: 11,025
Karma: 75555555
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
You don't need docker for Windows. Just download it and launch it.
ownedbycats is offline   Reply With Quote
Old 04-28-2023, 07:39 PM   #8384
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 6,988
Karma: 4604635
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
I use the pre-compiled binary for windows when I use it. I find it much easier.
JimmXinu is offline   Reply With Quote
Old 05-01-2023, 10:30 AM   #8385
riothamus
Connoisseur
riothamus rocks like Gibraltar!riothamus rocks like Gibraltar!riothamus rocks like Gibraltar!riothamus rocks like Gibraltar!riothamus rocks like Gibraltar!riothamus rocks like Gibraltar!riothamus rocks like Gibraltar!riothamus rocks like Gibraltar!riothamus rocks like Gibraltar!riothamus rocks like Gibraltar!riothamus rocks like Gibraltar!
 
Posts: 97
Karma: 100000
Join Date: Nov 2010
Device: KOA3, KV, KOA2
Quote:
Originally Posted by ownedbycats View Post
You don't need docker for Windows. Just download it and launch it.
Quote:
Originally Posted by JimmXinu View Post
I use the pre-compiled binary for windows when I use it. I find it much easier.
Hey thanks. I was still a little confused about how to make sure FFF could call flaresolverr but I figured out that I just launch flaresolverr and then run FFF per normal. Much appreciated.
riothamus is offline   Reply With Quote
Reply

Tags
fanfiction


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 523 07-15-2025 06:45 PM
[GUI Plugin] Open With kiwidude Plugins 404 02-21-2025 05:42 AM
[GUI Plugin] Marvin XD Philantrop Plugins 126 01-29-2017 12:48 PM
[GUI Plugin] KiNotes -axel- Plugins 0 07-14-2013 06:39 PM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 12:27 PM


All times are GMT -4. The time now is 03:25 PM.


MobileRead.com is a privately owned, operated and funded community.