[GUI Plugin] FanFictionDownLoader

[iluvenisciryatan]

noob here. I just wanted to thank whoever created the FFDL plugin! I was dl-ing books one by one from archiveofourown.org by the built-in dl button on the site and I had finished about 400+ stories. That is nowhere near a fourth of the total stories that I wanted to put on my (super new)Kobo Aura. Also the metadata (tags) weren't showing up on the calibre column.
Then I got this plugin and boom, bulk downloading is doing great, and all the tags are showing up properly!

[Tanjamuse]

How do I avoid that

Replace Metadata:
characters=>Wesley W.P.=>Wesley Wyndham-Pryce

Becomes: Wesley Wyndam-Prycendham-Pryce?

[JimmXinu]

@iluvenisciryatan -- Glad you like it.

Just don't go too overboard dong mass downloads. Some times the sites will block you for excessive traffic.

[JimmXinu]

Originally Posted by Tanjamuse

How do I avoid that

Becomes: Wesley Wyndam-Prycendham-Pryce?

By itself, it doesn't. You must have another replacement that's also being applied.

It would probably avoid it if you properly escaped the '.' characters in your regex. In regex '.' means 'any character'. Try:

characters=>Wesley W\.P\.=>Wesley Wyndham-Pryce

That's really something you should do for all your regular expresssions.

[Tanjamuse]

Can I add a rule in my personal.ini that specifies the Fandom to which the characters belong, because there are more than one Percy W. in my list

[cryzed]

The plugin default configuration file has quite a bit of documentation regarding that:

## Use regular expressions to find and replace (or remove) metadata.
## For example, you could change Sci-Fi=>SF, remove *-Centered tags,
## etc. See http://docs.python.org/library/re.html (look for re.sub)
## for regexp details.
## Make sure to keep at least one space at the start of each line and
## to escape % to %%, if used.
## Two, three or five part lines. Two part effect everything.
## Three part effect only those key(s) lists.
## *Five* part lines. Effect only when trailing conditional key=>regexp matches
## metakey[,metakey]=>pattern=>replacement[&&conditionalkey=>regexp]
## Note that if metakey == conditionalkey the conditional is ignored.

So appending your condition after the replacement for the right category or column with a regexp that should match (in this case the name of your fandom) should do the trick. Two examples:

# characters=>Sam W\.=>Sam Witwicky&&category=>Transformers
# characters=>Sam W\.=>Sam Winchester&&category=>Supernatural

[Tanjamuse]

I'm sorry that's very confusing for me. Could you maybe give me an example?

One of the fandoms where there are one of the Percy W. is Harry Potter.

[cryzed]

There are two examples at the bottom of the post. However:

characters=>Percy W\.=>Wesley Wyndham-Pryce&&category=>Buffy
characters=>Percy W\.=>Percy Weasley&&category=>Harry Potter

Something like that. That's the only clash of names I can imagine in your situation -- note that it is Wesley and Weasley. Make sure that the category actually matches what you enforce it to be (IIRC you replace all the buffy category variations to one unique name) or what it is.

[JimmXinu]

Originally Posted by cryzed

I am definitely for the name change, ...
Ficfare -- a composite word of the terms: "Fic" as in fiction or fanfiction and "Fare" as the fare in gastronomy (food) or in transportation (carriage, haul, load), which I thought was a neat combination of words that approximately conveyed what it was supposed to do, i.e. provide you with fiction for "nourishment" or help transport it to you, or you to it.
...

Expanding on this idea a bit, what do people think of Fanficfare or FanFicFare (abbrev FFF)?

I like having 'fanfic' right in the name and cryzed likes the near hit to 'fanfare'. We disagree about CamelCasing.

[Tanjamuse]

FanFicFare would get my vote

[cryzed]

Originally Posted by Tanjamuse

FanFicFare would get my vote

(╯°□°)╯︵ ┻━┻

[firefoxxy]

Hi!

I like FFF, too. Or maybe F3? lol

---------

I hate to have to go back to this old issue, but I still am not able to get the plugin to use those little icons from fanfiction.net to make a cover.

I set the options in the FFDL (see image)
image

I do have only one configuration in the "Generate Cover" plugin, which is the "default". I did activate the option that the personal.ini overwrites the plugin. (Sorry if this is garbled, but I run the German version and have to re-translate.)

My personal.ini says:

[defaults]
is_adult:true
include_images:true
keep_summary_html:true
make_firstimage_cover:true
image_max_size: 580, 725
#grayscale_images: false

[www.fanfiction.net]
## fanfiction.net's 'cover' images are really just tiny thumbnails.
## Change this to false to use them anyway.
never_make_cover: false

Do you have an idea what I am doing wrong?

Thank you anyway for your help in advance!

[cryzed]

On an entirely unrelated note, I wrote a Python 3 version of the follow script for fanfiction.net I published here a while ago. You can find it here -- same warnings as the last time apply, use at your own peril (I have no clue what fanfiction.net thinks about this, so it might get your account banned, although I doubt it). Dependencies are BeautifulSoup 4, click, PIL or Pillow and the requests library. The only real advantage is that this is potentially faster and doesn't require any third-party browser to be installed.

@firefoxxy Sorry I can't help out with your problem, my configuration looks nearly identical and it works for me.

[Tanjamuse]

Would it be possible to collect the Meta tags on AO3?

http://archiveofourown.org/tags/Allen%20Francis%20Doyle

[JimmXinu]

Originally Posted by Tanjamuse

Would it be possible to collect the Meta tags on AO3?

http://archiveofourown.org/tags/Allen%20Francis%20Doyle

Unless it's displayed in the story's metadata, probably not. Doing another page request for each tag on an AO3 story is prohibitive--many stories have 10 or more tags.