[GUI Plugin] FanFictionDownLoader

[MiniMouse]

Another question... now that I'm starting to optimize my personal.ini

I'm trying to create something like the following: Fill my column 'pairing' with the text "slash" if the 'ships' is filled with Arthur/Merlin.

I tried this:
add_to_custom_columns_settings:
"slash"=>${ships}=>.*Arthur/Merlin.*=>#pairing

But that didn't work.

Soooo, how do I do that?
And can I put it everywhere in my personal.ini or should it stand under the sides like ff.net?

A very thankful for your help,

Mini

P.S. I LOVE THE FANFICTIONDOWNLOADHELPER!!!!!
This is such a greate Plugin

[JimmXinu]

Originally Posted by MiniMouse

I'm trying to create something like the following: Fill my column 'pairing' with the text "slash" if the 'ships' is filled with Arthur/Merlin.

Here's an example of one way to do it:

[test1.com]
# creates a new metadata entry 'pairing'
add_to_extra_valid_entries:,pairing

# populates pairing with the same values as ships.
include_in_pairing:ships

# replace pairings with straight or slash as you prefer.
add_to_replace_metadata:
 pairing=>Jane/Thor=>straight
 pairing=>Arthur/Merlin=>slash

# only include slash or straight in pairing, discarding any 
# that weren't replaced.
add_to_include_metadata_post:
 pairing==slash
 pairing==straight

# populate custom column
add_to_custom_columns_settings:
 pairing=>#timeline

You could add that code to [defaults] to effect all sites, or to only certain sites in their sections. Adding it to site test1.com is shown.

[MiniMouse]

Originally Posted by JimmXinu

Here's an example of one way to do it:

[test1.com]
# creates a new metadata entry 'pairing'
add_to_extra_valid_entries:,pairing

# populates pairing with the same values as ships.
include_in_pairing:ships

# replace pairings with straight or slash as you prefer.
add_to_replace_metadata:
 pairing=>Jane/Thor=>straight
 pairing=>Arthur/Merlin=>slash

# only include slash or straight in pairing, discarding any 
# that weren't replaced.
add_to_include_metadata_post:
 pairing==slash
 pairing==straight

# populate custom column
add_to_custom_columns_settings:
 pairing=>#timeline

You could add that code to [defaults] to effect all sites, or to only certain sites in their sections. Adding it to site test1.com is shown.

for the fast feedback

I have by now the feeling for templates for my custom columns built from other columns and use them a lot but I'm still not sure I understand how the personal.ini works. Your feedback helps me to understand it more

Because in the end I will try to optimize my personal.ini as I did my custom columns. At least that's my goal.

Let's see how long that takes...

Mini

[ladyro7]

I've been using FFDL with Calibre for awhile now and I have a few questions/problems. I should say that instead of creating a separate library for FF, I use tags to distinguish fics from other books, because separate libraries would mess up my cloud backup.

1. When I try to update multiple existing fics at once, I get a message like this with 24 fics for example "FFDL has found 1 good and 23 bad updates". I then have to exclude the updated fic from the list and run FFDL over and over again until I get 0 bad updates. Please fix this.

2. Please create a way to schedule automatic background updates on a specified list of existing FF books, similar to the Fetch News plugin.

Thanks

[JimmXinu]

Originally Posted by ladyro7

1. When I try to update multiple existing fics at once, I get a message like this with 24 fics for example "FFDL has found 1 good and 23 bad updates". I then have to exclude the updated fic from the list and run FFDL over and over again until I get 0 bad updates. Please fix this.

If you report the errors you receive with which story URLs, ideally with debug logging, I will look into your errors. As posted, you have not given any information useful for diagnosing problems.

Originally Posted by ladyro7

2. Please create a way to schedule automatic background updates on a specified list of existing FF books, similar to the Fetch News plugin.

At this time, that is not possible due to calibre architecture limitations.

And even if it was, I remain of the opinion that FFDL should not be used to poll for updates. I recommend that you follow/subscribe/watch stories on your fic sites to receive emails when there are updates and then update only the stories that have changed.

[MiniMouse]

Originally Posted by JimmXinu

Here's an example of one way to do it:

[test1.com]
# creates a new metadata entry 'pairing'
add_to_extra_valid_entries:,pairing

# populates pairing with the same values as ships.
include_in_pairing:ships

# replace pairings with straight or slash as you prefer.
add_to_replace_metadata:
 pairing=>Jane/Thor=>straight
 pairing=>Arthur/Merlin=>slash

# only include slash or straight in pairing, discarding any 
# that weren't replaced.
add_to_include_metadata_post:
 pairing==slash
 pairing==straight

# populate custom column
add_to_custom_columns_settings:
 pairing=>#timeline

You could add that code to [defaults] to effect all sites, or to only certain sites in their sections. Adding it to site test1.com is shown.

Is there a way to more simplify the following?

## replace pairings with het or slash as you prefer.
add_to_replace_metadata:
pairing=>Arthur/Merlin=>slash
pairing=>Arthur,Merlin=>slash
pairing=>Merlin/Arthur=>slash
pairing=>Merlin,Arthur=>slash
pairing=>Sherlock Holmes/John Watson=>slash
pairing=>Sherlock Holmes&John Watson=>slash
pairing=>John/Sherlock=>slash

Because there are a lot of variations out there...

Mini

[JimmXinu]

Originally Posted by MiniMouse

Is there a way to more simplify the following?

First, you were told before about using sort_ships:true so you only have one order for each to worry about (although sort_ships only works on '/' separated ships.)

We use regular expressions exactly because they can be used to match many different strings. For example, your previous example can be reduced several ways. Here's one:

## replace pairings with het or slash as you prefer.
add_to_replace_metadata:
 pairing=>Arthur[/,&]Merlin=>slash
 pairing=>Merlin[/,&]Arthur=>slash
 pairing=>John( Watson)?/Sherlock( Holmes)?=>slash

[/,&] will match any one of '/' ',' or '&'.

( Watson)? groups ' Watson' and the ? indicates it can be present or absent.

Regular expressions are very powerful, but complex. If you want to get the best benefit, you should read up on them a bit. Search for something like:
https://www.google.com/search?q=regu...+for+beginners

[MiniMouse]

Originally Posted by JimmXinu

First, you were told before about using sort_ships:true so you only have one order for each to worry about (although sort_ships only works on '/' separated ships.)

We use regular expressions exactly because they can be used to match many different strings. For example, your previous example can be reduced several ways. Here's one:

## replace pairings with het or slash as you prefer.
add_to_replace_metadata:
 pairing=>Arthur[/,&]Merlin=>slash
 pairing=>Merlin[/,&]Arthur=>slash
 pairing=>John( Watson)?/Sherlock( Holmes)?=>slash

[/,&] will match any one of '/' ',' or '&'.

( Watson)? groups ' Watson' and the ? indicates it can be present or absent.

Regular expressions are very powerful, but complex. If you want to get the best benefit, you should read up on them a bit. Search for something like:
https://www.google.com/search?q=regu...+for+beginners

You are again very fast and very helpful

And yes, I will try to learn more about regular expressions. I like to understand the stuff I do, if possible.



Mini

[MiniMouse]

Originally Posted by JimmXinu

First, you were told before about using sort_ships:true so you only have one order for each to worry about (although sort_ships only works on '/' separated ships.)

We use regular expressions exactly because they can be used to match many different strings. For example, your previous example can be reduced several ways. Here's one:

## replace pairings with het or slash as you prefer.
add_to_replace_metadata:
 pairing=>Arthur[/,&]Merlin=>slash
 pairing=>Merlin[/,&]Arthur=>slash
 pairing=>John( Watson)?/Sherlock( Holmes)?=>slash

[/,&] will match any one of '/' ',' or '&'.

( Watson)? groups ' Watson' and the ? indicates it can be present or absent.

Regular expressions are very powerful, but complex. If you want to get the best benefit, you should read up on them a bit. Search for something like:
https://www.google.com/search?q=regu...+for+beginners

I don't understand ALL of it yet but I found a better way to get all the different forms for one and the same pairing in one line. Because sometimes you have too many different forms for the same pairing, like

Rodney M./John S.
Rodney McKay & John Sheppard
John, Rodney

This line doesn't care if Rodney or John is namend first and what is in between the two names.

add_to_replace_metadata:
pairing=>^(?=.*\bRodney\b)(?=.*\bJohn).*$=>slash

Only got a bit tricky with DiNozzo from NCIS because he is sometimes named Anthony or Tony. For him I use this line.

pairing=>^(?=.*\b.*ony\b)(?=.*\bZiva).*$=>het

Works like a charm

I also found a good side to test regular expressions here

Mini

[Techmo]

Is it possible to download only certain chapters of a story in AO3? For example, I want to download chapters 4-10 or 1,3-10. I used another program that had this feature, but it hasn't been updated in a while and AO3 made some changes so the authors are missing in the download.

[JimmXinu]

Originally Posted by Techmo

Is it possible to download only certain chapters of a story in AO3? For example, I want to download chapters 4-10 or 1,3-10. I used another program that had this feature, but it hasn't been updated in a while and AO3 made some changes so the authors are missing in the download.

You can specify a single chapter or a range of chapters by putting it in square brackets after the URL in the Add From URL dialog:

http://test1.com?sid=55[2]
http://test1.com?sid=55[2-4]
http://test1.com?sid=55[2-]
http://test1.com?sid=55[-2]

FFDL isn't capability of using [1,3-10]. In fact, it treats ',' and '-' the same, so [1,5] will yield 1-5.

You could, however, download a book with just 1, then another with 3-10 and then EpubMerge them.

[Techmo]

Originally Posted by JimmXinu

You can specify a single chapter or a range of chapters by putting it in square brackets after the URL in the Add From URL dialog:

http://test1.com?sid=55[2]
http://test1.com?sid=55[2-4]
http://test1.com?sid=55[2-]
http://test1.com?sid=55[-2]

FFDL isn't capability of using [1,3-10]. In fact, it treats ',' and '-' the same, so [1,5] will yield 1-5.

You could, however, download a book with just 1, then another with 3-10 and then EpubMerge them.

Awesome! Thank you.

[BookJunkieLI]

Originally Posted by JimmXinu

You can specify a single chapter or a range of chapters by putting it in square brackets after the URL in the Add From URL dialog:

http://test1.com?sid=55[2]
http://test1.com?sid=55[2-4]
http://test1.com?sid=55[2-]
http://test1.com?sid=55[-2]

FFDL isn't capability of using [1,3-10]. In fact, it treats ',' and '-' the same, so [1,5] will yield 1-5.

You could, however, download a book with just 1, then another with 3-10 and then EpubMerge them.

That's pretty cool. And great for drabble collections where I only want the fandoms I'm familiar with.

Any reason though why you couldn't just use the Make Anthology option instead of importing individually and then merging with EpubMerge?

Edit:
Ah. Apparently it will only accept one valid copy of a url and ignores the chapter numbers in the brackets once it determines they're from the same source story.

[JimmXinu]

Originally Posted by BookJunkieLI

That's pretty cool. And great for drabble collections where I only want the fandoms I'm familiar with.

Any reason though why you couldn't just use the Make Anthology option instead of importing individually and then merging with EpubMerge?

FFDL detects when the same story URL is given more than once and rejects duplicates.

It's a rather obscure corner case. I'd be more likely to attempt to expand the [] feature to allow things like [1,4-5,9]. But I'm unlikely to do either, since both screw up epub update.

[BookJunkieLI]

No problem. I've only used the Make Anthology option on a couple of occasions and drabble collections are low on the list of things I'm concerned about. I just figured if it could save a step... It's still a great thing to know about.