[GUI Plugin] FanFictionDownLoader

[JimmXinu]

@Firedancer885 - That is going to be challenging to parse.

adapter_archiveskyehawkecom.py looks like it deals with something similar. I didn't write that one, so I'm guessing a little.

[cryzed]

This might help.

[Firedancer885]

Thanks

[iakovl]

ok,
just setup calibre from scratch in my new pc
had some problems but sorted out most of them

still have few issues
1. i can't seem to make online library so i just made dropbox folder as "main device" so it exports to it, anyway to auto send updated/new fics to it?
2. some covers don't have names on it, anyway to add the fic name to the cover without loosing cover image?

[JimmXinu]

Originally Posted by iakovl

1. i can't seem to make online library so i just made dropbox folder as "main device" so it exports to it, anyway to auto send updated/new fics to it?

I don't know anything about using dropbox as a device, but this page documents a way to use the Reading List plugin with FFDL to auto-send to real devices.

Originally Posted by iakovl

2. some covers don't have names on it, anyway to add the fic name to the cover without loosing cover image?

The Generate Cover plugin can generate a cover from the cover image already in a book and add text to it.

[cryzed]

Attached are 2 patches for the plugin. One adds an adapter for http://voracity2.e-fic.com/ and the other is a patch to pretty-print specifically downloaded metadata when using the CLI.

@Firedancer885 I was half-finished when I realized that you were trying to develop your own adapter, so I just finished mine. I hope that it will still help you learn Python.

[JimmXinu]

Attached is a test version with cryzed's changes.

They look good and work for me, so they'll be in the next version; assuming nobody else has problems when they use them.

Thanks, cryzed.

[cryzed]

No problem! Quick notice, I sneakily changed one of the patches and re-attached it. You might want to re-patch it before committing to the repository (I changed the _customized_fetch_url and _login method slightly), sorry about that.

[Firedancer885]

Thanks cryzed I stuggled for a time and then gave up. I realized I don't have the necessary knowledge yet to develop an adapter that needs more than the basic changes.

[cryzed]

Just keep trying, Python is an awesome programming language . It would probably help if you focused on reading and learning the BeautifulSoup documentation first instead of directly trying to write an adapter with it for an existing codebase.

I heard great things about http://learnpythonthehardway.org/ and it seems to be the way to go if you really want to get into Python programming nowadays. Don't let the name deter you, it's actually aimed at beginners. (And don't be confused by the price tag, it's free for you to read online)

That reminds me: Is there any reason why you are not updating the BeautifulSoup version Jimm? All the changes should be backwards-compatible and the new BeautifulSoup 4 has some new useful features and is more pythonic generally.

[JimmXinu]

I agree that Python is a nice language.

And I'll admit that FFDL isn't necessarily a great project to learn python with because a lot of FFDL reflects my personal C/Perl/Java background and isn't properly 'pythonic'. It's the project I learned python on.

Originally Posted by cryzed

That reminds me: Is there any reason why you are not updating the BeautifulSoup version Jimm? All the changes should be backwards-compatible and the new BeautifulSoup 4 has some new useful features and is more pythonic generally.

I recall two reasons off hand: the version that's included in FFDL has been mildly modified and newer versions are packaged--they have to be installed via pip or equivalent into the python environment. Neither the user or I have control of the python environment in calibre or in the web service version.

So I've stuck with what I know works rather than try to work around proper packaging of new BeautifulSoup versions to include it directly.

[cryzed]

Oh I see, I didn't know there were modifications made to the module. Also BeautifulSoup 4 being packaged would be no problem in itself, you could just include the whole folder ("bs4" in the "site-packages" folder) in the project, unless I misunderstood what you meant by packaging.

Also I didn't mean to criticize the codebase, I'm sorry if it came off like that. I was rude enough the first time around and I'm really just glad that it works as well as it does currently.

[JimmXinu]

Originally Posted by cryzed

Oh I see, I didn't know there were modifications made to the module. Also BeautifulSoup 4 being packaged would be no problem in itself, you could just include the whole folder ("bs4" in the "site-packages" folder) in the project, unless I misunderstood what you meant by packaging.

I recall trying that once and it didn't work out. I don't remember the exact details about why.

Originally Posted by cryzed

Also I didn't mean to criticize the codebase, I'm sorry if it came off like that. I was rude enough the first time around and I'm really just glad that it works as well as it does currently.

No problem, it was a valid question.

FFDL is largely in maintenance mode for me these days--if something's not actively broken, I don't have a lot of ambition to change it. I especially welcome it when other people write new site adapters.

[Amalthia]

Hi,

I am using FFDL to download fic from Archive of our own and I am having trouble figuring out if there is a way to exclude all the extra tags and characters that are added to the tag field? I am reading across multiple fandoms so I am looking for something that'll exclude everything in the Characters and Additional Tags fields.

I'd appreciate any and all help.

Thanks,
Amalthia

[JimmXinu]

Originally Posted by Amalthia

I am using FFDL to download fic from Archive of our own and I am having trouble figuring out if there is a way to exclude all the extra tags and characters that are added to the tag field? I am reading across multiple fandoms so I am looking for something that'll exclude everything in the Characters and Additional Tags fields.

There are some options, but it's a bit complicated depending on exactly what you want to accomplish.

What are the specific story URL and the tags you want to exclude? Or what tags do you want to include (excluding everything else)?