[GUI Plugin] FanFictionDownLoader

[Jessica_June]

Originally Posted by JimmXinu

FYI, the adapter for that site was written by one of the other developers. I've asked them to take a look at it when they can, but it may be a while.

Thank you.

[cryzed]

@Jessica_June: Try the attached file.

[mehetabelo]

I have one other questions specifically regarding storiesonline again. Is there a code to allow the download of the 'score'? I'm figuring that it is no, since in order to see it from the story starting page, you have to go to 'More details' or see it. I just decided it wouldn't hurt to ask. I did looked through the defaults.ini pretty extensively to double check that there wasn't an option.

[davidfor]

mehetabelo: At the moment no. It is on the story list page for the author which is already accessed, so it isn't hard to get.

In fact, adding the following to the adapter at about line 195 will do it:

        score = lc2.findNext('th', {'class' : 'num'}).text
        if score != '-':
            self.story.setMetadata('score', score)

And "score_label:Score" needs to be added to the ini file in the storiesonline.net section.

Maybe the score should be converted to a number.

And maybe something other than "score" should be used. That's what the site uses, but, there might be a more common term used in FFDL. Though I couldn't find one.

[JimmXinu]

Attached is a test version with davidfor's score collecting change for storiesonline. Remember that you'll need to add it to your config before it will appear. To see it on the title page, something like:

extra_titlepage_entries:size,universeHTML,sitetags,notice,score

[Jessica_June]

Originally Posted by cryzed

@Jessica_June: Try the attached file.

After a little fiddling about that did the trick, thank you.

I did notice that there are two versions of a story on the site:

http://fictionmania.tv/stories/readt...l?storyID=1234

and

http://fictionmania.tv/stories/readx...l?storyID=1234

the down loader doesn't want to have anything to do with the second one.

[cryzed]

I'll take care of that as soon as I'm home.

[mehetabelo]

Awesome. It's working out great, and now that I understand the ini file setup a bit more I've done some additional custom columns for various websites.

[mehetabelo]

If you can't tell by now, I'm spending some time customizing calibre for downloads and the like. I've been meaning to do it for a long time.
Now, I'm trying to figure out how to customize the publisher name. IE instead of saying www.fanfiction.net saying ff.net or something similar. I've gone through the default.ini looking for a setting, and I can't find one.

Though, I did find siteabbrev_label:Site Abbrev ... but I don't know what that's used for. I did test to see if I was reading it wrong, and if that was the option, but it wasn't.

I also tried doing it with "ff.net"=>Publisher in custom column settings, just to see if it worked even though those were specifically for custom columns. It didn't, of course. So, is there a setting to allow for this? If there isn't, that's fine. It's not hurting me, was just curious if it was possible.

One last thing, specific to ff.net. I noticed in the default.ini that dramione.org has an option for follows and favs. I have tried a couple variations for ff.net, and nothing worked. Is this an option for ff.net as well?

[chrnno]

What you are looking for(or at least one way of doing it) is replace metadata, specifically like this with a few other examples that first came to mind:

replace_metadata:
 site=>archiveofourown.org=>Archive of Our Own
 site=>www.fanfiction.net=>FanFiction.net
 site=>www.fictionpress.com=>FictionPress
 site=>www.tthfanfic.org=>Twisting the Hellmouth

In case it doesn't show up properly or it is not clear you need the initial space so it has to be ' site' instead of 'site' at the beginning.

As for favs I use under "[www.fanfiction.net]" this:

custom_columns_settings:
 favs=>#favs
 follows=>#follows
 reviews=>#reviews

Just don't forget to create the custom columns in calibre preferences so it has a place to write to.

[JimmXinu]

Originally Posted by chrnno

What you are looking for(or at least one way of doing it) is replace metadata, specifically like this with a few other examples that first came to mind:

replace_metadata:
 site=>archiveofourown.org=>Archive of Our Own
 site=>www.fanfiction.net=>FanFiction.net
 site=>www.fictionpress.com=>FictionPress
 site=>www.tthfanfic.org=>Twisting the Hellmouth

...

Correct--'site' is what's populated into the Publisher field.

[Lantz]

Good day I seem to be having a problem as I can no longer download stories from any sites (have tried 4) the following is the error message I receive but have no clue what to do any ideas?

calibre, version 2.9.0 (win32, isfrozen: True)
Failed to Download Stories: Failed: Download FanFiction Book

Download FanFiction Book
FFDL:INFO:calibre_plugins.fanfictiondownloader_plu gin.jobs(36):FanFictionDownLoader v2.0.9
FFDL:INFO:calibre_plugins.fanfictiondownloader_plu gin.jobs(40):Adding jobs for URLs:
FFDL:INFO:calibre_plugins.fanfictiondownloader_plu gin.jobs(42):http://ficwad.com/story/167434
FFDL:INFO:calibre_plugins.fanfictiondownloader_plu gin.jobs(78):Logfile for book ID None (Harry Potter and the east wing of Hogwarts)
FFDL:INFO:calibre_plugins.fanfictiondownloader_plu gin.jobs(79):urlhttp://ficwad.com/story/167434) idNone)
Python function terminated unexpectedly
u'plugin_path' (Error Code: 1)
Traceback (most recent call last):
File "site.py", line 132, in main
File "site.py", line 109, in run_entry_point
File "site-packages\calibre\utils\ipc\worker.py", line 193, in main
File "site-packages\calibre\utils\ipc\worker.py", line 133, in arbitrary_n
File "calibre_plugins.fanfictiondownloader_plugin.jobs" , line 99, in do_download_for_worker
KeyError: u'plugin_path'

Python function terminated unexpectedly
'NoneType' object has no attribute '__getitem__' (Error Code: 1)
Traceback (most recent call last):
File "site.py", line 132, in main
File "site.py", line 109, in run_entry_point
File "site-packages\calibre\utils\ipc\worker.py", line 193, in main
File "site-packages\calibre\utils\ipc\worker.py", line 133, in arbitrary_n
File "calibre_plugins.fanfictiondownloader_plugin.jobs" , line 83, in do_download_worker
File "calibre_plugins.fanfictiondownloader_plugin.jobs" , line 83, in <lambda>
TypeError: 'NoneType' object has no attribute '__getitem__'

Thank you for any help,
lance

[cryzed]

We had a very similar error report recently. Could you try and follow the advice given by Jimm on the linked page?

[mehetabelo]

Originally Posted by chrnno

As for favs I use under "[www.fanfiction.net]" this:

custom_columns_settings:
 favs=>#favs
 follows=>#follows
 reviews=>#reviews

Just don't forget to create the custom columns in calibre preferences so it has a place to write to.

*Blush* When I said I tried it, I had... just apparently I'd put it under the wrong website, so when I kept making changes, and then trying using the 'Update Metadata' option, and it wasn't working, I didn't think that was an option under fanfiction.net. After going back and seeing the mistake, I feel like an idiot.

As for the site option, it works wonderfully! Thanks chrnno! And JimmXinu for verifying it.

[ThatLibraryRat]

Thank you for creating this useful plugin!

I have a weird problem with it lately. I use the portable version on a key. It work just fine everywhere but on my personal computer =/
I installed calibre x64 one time long ago (because I was tired and didn't have the eyes open enough to see the big '64' smack on the logo) but have reinstalled the x86 version since.

And 80% of the 'update checking function' times... I keep receive this:

calibre, version 2.12.0
ERREUR : Exception non gérée: <b>UnicodeDecodeError</b>:'utf8' codec can't decode byte 0xfb in position 41: invalid start byte

calibre 2.12 Portable isfrozen: True is64bit: False
Windows-7-6.1.7601-SP1 Windows ('32bit', 'WindowsPE')
('Windows', '7', '6.1.7601')
Python 2.7.8
Windows: ('7', '6.1.7601', 'SP1', 'Multiprocessor Free')
Successfully initialized third party plugins: FanFictionDownLoader && Kobo Utilities
Traceback (most recent call last):
File "calibre_plugins.fanfictiondownloader_plugin.dialo gs", line 610, in do_loop
UnicodeDecodeError: 'utf8' codec can't decode byte 0xfb in position 41: invalid start byte

I really don't know how or what to do after deleting calibre on the computer with CCleaner and co.

It's most annoying when trying to check the update of my extensive (a little over 800) library.

Please help T.T

Also, does anyone know how to create a column to see witch epub was created with FanFictionDownloader or not?
It would help with my management =)

(If I'm butchering English, I'm deeply sorry. I'm kinda French and not really bright with languages =/ )

Thank for reading until this point!