[GUI Plugin] FanFictionDownLoader

[matteo65]

@Cryzed

I have a request for a new site, which is the biggest hungarian language fanfic collection. Please add it when you have the time:
http://fanfic.hu/merengo/index.php

Thank you!

[cryzed]

Well, I can try. It's of course going to be a bit challenging, since I don't speak Hungarian. No promises though.

[matteo65]

Thank you! If you need I can help you with the translation.
I found one more hungarian site, maybe you can check them together?
http://fanfiction.csodaidok.hu/index.php
http://fanfic.hu/merengo/index.php

Originally Posted by cryzed

Well, I can try. It's of course going to be a bit challenging, since I don't speak Hungarian. No promises though.

[cryzed]

Easy there tiger, let me take care of http://fanfic.hu/ first. I can't spend all day doing this either :P. I'll take a look at the second page some other time.

[cryzed]

@matteo65
Attached is a test version of the plugin with an adapter for http://fanfic.hu/. Please test it thoroughly and report back to let me know how it performs.

I'll take a look at the other site at a later date.

@Tanjamuse
This version also has some slight fixes for the http://nocturnal-light.net/ adapter.

[cryzed]

@Jimm
I just tested the http://fanfic.hu/ adapter with the 100 latest stories which worked without any errors I could discern. I also tested the http://nocturnal-light.net/ adapter with 200 stories without any problems. If you want to, you can release a new version.

[matteo65]

Thanks, you are very fast... :-)

Sorry, I got the message with any links from fanfic.hu:
No valid story URLs entered.

For example I tried these:
http://fanfic.hu/merengo/viewstory.php?sid=52175&i=1
http://fanfic.hu/merengo/viewstory.php?sid=105526
http://fanfic.hu/merengo/viewstory.php?sid=111715

Originally Posted by cryzed

@matteo65
Attached is a test version of the plugin with an adapter for http://fanfic.hu/. Please test it thoroughly and report back to let me know how it performs.

I'll take a look at the other site at a later date.

@Tanjamuse
This version also has some slight fixes for the http://nocturnal-light.net/ adapter.

[cryzed]

Did you actually install the attached version? All three stories work for me. You'll possibly have to restart Calibre before it works.

[matteo65]

Thanks, now it works! Problem was that I had to close the Calibre in the taskbar too, not only restart it.

A little problem, that it set the language TAG to English instead of Hungarian for all of the downloaded books. But I can change it later manually, no problem.

Thank you!

Originally Posted by cryzed

You'll possibly have to restart Calibre before it works.

[cryzed]

Fixed in the attached version.

[matteo65]

For a single chapter it works with the language TAG.

But I used Get Story URLs to Download... it downloaded all of the chapters, but when it tries to merge I got an error message, and got no file in Calibre:

calibre, version 1.39.0
HIBA: Ismeretlen hiba történt: <b>ValueError</b>:invalid literal for int() with base 10: ''

calibre 1.39 [64bit] isfrozen: True is64bit: True
Windows-7-6.1.7601-SP1 Windows ('64bit', 'WindowsPE')
('Windows', '7', '6.1.7601')
Python 2.7.5
Windows: ('7', '6.1.7601', 'SP1', 'Multiprocessor Free')
Traceback (most recent call last):
File "site-packages\calibre\gui2\proceed.py", line 123, in do_ask_question
File "calibre_plugins.fanfictiondownloader_plugin.ffdl_ plugin", line 1358, in do_download_merge_update
File "calibre_plugins.fanfictiondownloader_plugin.ffdl_ plugin", line 1992, in merge_meta_books
ValueError: invalid literal for int() with base 10: ''

Originally Posted by cryzed

Fixed in the attached version.

[cryzed]

I'm not sure what you did or you are asking. What is it trying to merge with? Please try simply deleting the already downloaded stories completely and re-downloading them.

[matteo65]

There are 16 chapters in a book, each chapter have a different link.
I select: "Get Story URLs to Download from web page"

Insert the main link, which lists all of the chapters:
http://fanfic.hu/merengo/viewstory.php?sid=11993

Select the button: "For Anthology Epub"

After the 16 chapters downloaded the plug-in ask to "Proceed with updating this anthology and your library?"

After selecting "Yes" it automatically starts to merge the files into one anthology, but it fails at the end. I got an error message:

ValueError: invalid literal for int() with base 10: ''

It is a problem related to EpubMerge plug-in...?

Originally Posted by cryzed

I'm not sure what you did or you are asking. What is it trying to merge with? Please try simply deleting the already downloaded stories completely and re-downloading them.

[cryzed]

I never used the Anthology feature before, but isn't it supposed to combine several different stories into a single file? What you are trying to do is merge different chapters together, I'm pretty sure you need to use the author URL. Please note that you need to manually collect the URLs here because some are only accessible through JavaScript. It still doesn't seem to work though. I'll have to ask JimmXinu when he's around, sorry about that.

EDIT 2: I possibly found the error, looking into it.

EDIT 3: Hey, so first off: an Anthology is a combination of different stories. It basically creates a single book with multiple stories in it. Trying to combine chapters of the same story into an Anthology doesn't make sense. So what you could do is,

Put these:

• http://fanfic.hu/merengo/viewstory.php?sid=11993
• http://fanfic.hu/merengo/viewstory.php?sid=12981
• http://fanfic.hu/merengo/viewstory.php?sid=11773

Into the window that opens when you click on this menu entry and you'll get a book like this.

If you simply want to do download a single story just choose "Add New from URL(s)" and paste a story URL in, for example: http://fanfic.hu/merengo/viewstory.php?sid=11993. It will download the complete story with all chapters into a single book, you don't need the Anthology feature for that.

But I did discover two bugs, thanks for helping me find them. The attached version should work.

@Jimm
I'm pretty sure that this is still a bug relating to merging the stories though. Why does an adapter need to provide "numWords"? There's a bug somewhere in "merge_meta_books" in the "ffdl_plugin.py" line 1992. Somehow the standard story metadata has a bunch of default keys, like "numWords" and "numChapters" with empty values. In the method it now runs into an error, because it expects both fields to have a valid value just because the keys are contained in the metadata. I think the easiest way would be to check "if book['all_metadata'][k] and b['all_metadata'][k]" before working with the values in the method -- your call! Also attached is a possible fix, it seems to work for me.

[Amalthia]

Hi,

I was looking into the view defaults (plugin-defaults.ini) text file and I ran across some information on applying Generate Covers to ebooks.

I tried it and I can't seem to make it work.

This is the code I am currently trying.

generate_cover_settings:
 ${category} => Star Trek => StarTrek3

Was I supposed to change the information in {category}? If so, what am I supposed to change it out with?

My tag = Star Trek
Cover name = StarTrek3