[GUI Plugin] FanFictionDownLoader

[JimmXinu]

It's working fine for me and the 'Reason for update' comment on the plugin index thread is: Last edited by kovidgoyal; Today at 01:09 AM. Reason: Fix FanFiction release date

So I think it's fixed now.

[kovidgoyal]

Yeah, I added the missing semi-colon, forgot to post here, sorry.

[SuzanneTF]

I have a question about the Anthology feature. Is there a way to set the title of Anthology. It seems to default to the title of the first file in the anthology. I can change it manually in the metadata, of course. But whenever I update the anthology it reverts back.

Thanks for your help!

---

Edit: Maybe I'm doing it in the wrong order...

[JimmXinu]

Originally Posted by SuzanneTF

I have a question about the Anthology feature. Is there a way to set the title of Anthology. It seems to default to the title of the first file in the anthology. I can change it manually in the metadata, of course. But whenever I update the anthology it reverts back.

I suspect you are changing the 'Title sort' field and not the 'Title' field.

FFDL on updating an existing anthology uses the 'Title' as set in the DB and essentially sets it again. It appears that calibre the automatically then updates 'Title sort' from 'Title' based on it's default sort algorithms.

If you changed 'Title', it will be used. If only changed 'Title sort', it will be overwritten by the 'Title' from the DB--not from the download.

If that's not the case, please detail exactly what steps you go through when you have the problem.

[JimmXinu]

Version 1.7.35 - 06 Aug 2013

• Remove some debugging output.
• Minor optimizations for adapter lookup.
• Get story url lists from sites with adapter, get urls from non-fic sites in CLI.
• Warning on update if existing epub has no recognizable chapters.

[Jade Aislin]

I am currently having a little problem with the sort feature.

After the ships are sorted, I want to add my hierarchical categories. However, at the moment it is not sorting until after the hierarchical part has been added.

My code currently looks like this:

add_to_replace_metadata:
 characters,ships=>Bilbo B=>Bilbo Baggins&&category=>LOTR
 
 characters,ships=>^(Bofur|Bilbo Baggins)=>Book/Comics.LOTR.\1&&category=>LOTR

sort_ships:true

Currently, when I test 'Bofur/Bilbo B', it looks like my code is doing this:
1. correct character names (Bilbo Baggins)
2. add hierarchical tag (Book/Comics.LOTR.Bofur/Bilbo Baggins)
3. sort ships (Bilbo Baggins/Book/Comics.LOTR.Bofur)

I want it to do this:
1. correct character names (Bilbo Baggins)
2. sort ships (Bilbo Baggins/Bofur)
3. add hierarchical tag (Book/Comics.LOTR.Bilbo Baggins/Bofur)

Is there a way to tell it when to sort the ships? Does it matter where the sort_ships is? Should I place the hierichal code after the sort_ship? Or should I be using ships_LIST when trying to add the hierarchical code?

[JimmXinu]

Is there a way to tell it when to sort the ships?

story.py, line 455. After all replace_metadata lines applicable to 'ships' are run.

Does it matter where the sort_ships is?

Only what section. Changing it above or below replace_metadata will not matter.

Should I place the hierichal code after the sort_ship?

Doesn't matter.

Or should I be using ships_LIST when trying to add the hierarchical code?

ships_LIST replace_metadata is done after ships replace_metadata, sort_ships and application of join_string_ships. So that is an option.

[anacreon]

I've decided to use the kobotouchextended plugin for all my annotated epubs, because it is the only comfortable way to get annotations. Also for very big "omnibuses", such as the Pynch editions, I like to know where I am, so the kepub footer is the best answer.

But I've had problem with Addison and Steele's Spectator, found on Project Gutenberg, though at 2.2 MB and 2208 pages it isn't that different from another epub at 2.8 MB (before conversion => 3.4 MB after conversion) and 2109 pages which works fine.

Does anyone knows whether this problem is addressed somewhere?

EDIT: I use the kobo Aura, and I have the latest versions of everything (kobo, calibre, plugins).

EDIT2: I've had problems with Pynch's Kafka's Gesammelte Werke (everything in italics), so I cancelled it, desactivated the koboextended plugin, and sent it back to the device, with others collected works, and they all are kepubs. I've had the problem before, but desactivating mostly works.

[JimmXinu]

Originally Posted by anacreon

I've decided to use the kobotouchextended plugin for all my annotated epubs, because it is the only comfortable way to get annotations. ...

I think you've posted this in the wrong forum. I don't think your problem has anything to do with the FFDL plugin.

[davidfor]

I haven't played much with this lately, but I was trying something the other day. In the "replace_metadata" section, I can rename a category on the site to match a tag that I am using. But, I had a case where I wanted to create two tags. In particular, it was a category for the story that was two words. I wanted to split them to have a tag for each word. Any way to do this?

[Linwe]

Originally Posted by JimmXinu

It's possible, but it's not necessarily simple.

However, if you want only to have the abbreviations in the Fandom column, you need to Allow custom_columns_settings (towards the bottom of the FFDL Custom Column tab) and include something like this in personal.ini:

Spoiler:

[defaults]
# Adds a new 'extra' valid entry
add_to_extra_valid_entries:,fandom

# copy category to fandom
include_in_fandom:category

# replace with abbrevs in fandom
replace_metadata:
 fandom=>Ouran High School Host Club=>OHC
 fandom=>How To Train Your Dragon=>HTTYD

# set custom column with fandom value.
custom_columns_settings:
 fandom=>#fandom

replace_metadata can be quite complex.

A little tweaking (used add_to_replace_metadata for # replace with abbrevs in fandom section) and it's working near-perfectly now. I just have one itsy-bitsy-teeny-weeny problem left, and I'm not sure what I'm doing wrong this time.

I have a few crossover fics and I want the "predominant" fandom listed in my custom column. For example, I have both Labyrinth/Harry Potter and Yugioh/Harry Potter crossovers, and a few 'pure' Harry Potter fics; the Laby/HP I want listed as Labyrinth, the YGO/HP listed as YGO, and obviously the HP to remain as the single fandom they are.

I'm using the following code:

# copy category to fandom
include_in_fandom:category

# replace with abbrevs in fandom
add_to_replace_metadata:
fandom=>Yu-Gi-Oh=>YGO
fandom=>Harry Potter=>Labyrinth&&category=>Labyrinth
fandom=>YGO=>Harry Potter&&category=>YGO

# set custom column with fandom value.
custom_columns_settings:
fandom=>#fandom

The Labyrinth/HP crossovers come out as I want them, but the Yugioh crossovers are still listing as "Harry Potter, YGO" in my custom columns.

Using " fandom=>Harry Potter=>YGO&&fandom=>YGO" changes both YGO crossover and just HP fics to YGO in custom columns.

My understanding of regexp and the five part lines is basic for the simpler expressions and gets sketchier as they become more complex.

Any and all help is appreciated of course, but I have few crossovers so manual edits aren't a huge chore if something isn't feasible. Sorry for the long post too.

Edit: I grabbed random old stories to test on like these: YGO/HP Crossover and Harry Potter

[shesgottaread]

Hi there and thank you again for all the work that is involved with developing & maintaining FFDL.

I've spent a bunch of my day today reading this thread (well, first 500+ and last 600+ posts) as well as other Calibre-related threads here. I wanted to see if I could find answers to a couple of questions which recently came up. So if you don't mind, here are my top two that I couldn't find answers for.

1. Author sort: is it possible for me to tell FFDL to override the Calibre author_sort value with author? I keep fanfic in a separate library, and think of authors by name not last name, so sorting by author can be frustrating when "B of Ericaland" author_sort becomes "Ericaland, B of".

2. I read the discussion abt the new duplicate stories checking/warnings starting back in (April? June?) and would like to know if there is a way I can turn this off (maybe through personal.ini?) I've recently run into this when an author deleted then reposted story (warning abt same title, diff. url) and when trying to download stories that are posted on two sites. I always want to keep the originals, and want to have the "dupes" d/l'ed. I will review them at a later time, but having to click the buttons means I can't let FFDL run in the background while I go do something else.

I've got other things I'm trying to figure out, but think if I read and re-read Jade Aislin's posts some more I may not to have to bother you all with them.

Thanks for your time and for FFDL.
--sgr

[JimmXinu]

Originally Posted by davidfor

I haven't played much with this lately, but I was trying something the other day. In the "replace_metadata" section, I can rename a category on the site to match a tag that I am using. But, I had a case where I wanted to create two tags. In particular, it was a category for the story that was two words. I wanted to split them to have a tag for each word. Any way to do this?

Have you tried the obvious? Something like:

replace_metadata:
 characters=>Bob Smith=>Bob, Smith

It will still be considered one string "Bob, Smith" for any replace_metadata lines included after it, but when it hits calibre or is included in title_page, it will just be another comma separated item.

[JimmXinu]

Originally Posted by Linwe

I have a few crossover fics and I want the "predominant" fandom listed in my custom column. For example, I have both Labyrinth/Harry Potter and Yugioh/Harry Potter crossovers, and a few 'pure' Harry Potter fics; the Laby/HP I want listed as Labyrinth, the YGO/HP listed as YGO, and obviously the HP to remain as the single fandom they are.

First, you can't use fandom in the conditional part of a replace_metadata for fandom. That causes an infinite loop as it evaluating fandom calls for the value of fandom, which needs to evaluate fandom, etc. So FFDL ignores replace_metadata conditionals that cause loops.

add_to_replace_metadata:
 fandom=>Yu-Gi-Oh=>YGO
 fandom=>Harry Potter=>Labyrinth&&category=>Labyrinth
 fandom=>YGO=>Harry Potter&&category=>YGO

You're still getting "Harry Potter, YGO" using this because category contains Yu-Gi-Oh, not YGO.

[JimmXinu]

Originally Posted by shesgottaread

Hi there and thank you again for all the work that is involved with developing & maintaining FFDL.

Thanks, glad you like it.

Originally Posted by shesgottaread

I've spent a bunch of my day today reading this thread (well, first 500+ and last 600+ posts) as well as other Calibre-related threads here. I wanted to see if I could find answers to a couple of questions which recently came up. So if you don't mind, here are my top two that I couldn't find answers for.

Sure.

Originally Posted by shesgottaread

1. Author sort: is it possible for me to tell FFDL to override the Calibre author_sort value with author? I keep fanfic in a separate library, and think of authors by name not last name, so sorting by author can be frustrating when "B of Ericaland" author_sort becomes "Ericaland, B of".

Good question. The code shows that FFDL does attempt to set author_sort to be the same as author, but clearly it isn't. I'll look into that, as well as making it configurable.

Originally Posted by shesgottaread

2. I read the discussion abt the new duplicate stories checking/warnings starting back in (April? June?) and would like to know if there is a way I can turn this off...

That's a reasonable request. I'll put it on the to-do list for the next version.