[GUI Plugin] FanFictionDownLoader

[FaceDeer]

As a workaround until that's fixed, you can use Sigil to edit the epub and do a global search and replace of

longdesc="//

for

longdesc="http://

and hopefully that'll fix the conversion issue for that epub. (Sigil can search and replace in "all HTML files", so that should be just a single operation per epub - hopefully not too onerous)

I'm not as familiar with the part of FFDL that actually generates the epub file as I am with the metadata adapters, but if Jimm doesn't beat me to it I'll take a look when I get back home this evening and maybe see if I can figure out that problem.

[FaceDeer]

Think I've got a fix, just running some local testing before sending it off to Jimm. There turned out to be a nice place to slip in special case "clean up source HTML" code into site-specific adapters.

I used http://www.fimfiction.net/story/224372/ as my test case, it's much smaller and just has four emoticon images in the author's note - a lot easier to iterate on than the Godzilla story. I noticed that converting it to MOBI and AZW3 did work even with the "broken" longdescs, it just took a little while for the converter to give up on them (it seems to be trying to access each URL sequentially, waiting for a while before declaring each a failure). For a story like that Godzilla one with so many embedded images that might have looked like it had hung permanently.

[watani]

Alright, thanks for your work. I look forward to when the updated plugin shows up!

[JimmXinu]

Test version containing:

• FimFiction changes for sites changes and for images (thanks FaceDeer and cryzed)
• Login on potterfics.com for high rated fics
• Change thewriterscoffeeshop.com to twcslibrary.net

[DownWithIcarus]

Hello! These are requests for tweaks for the FanFiction Downloader:

Request/Query 1:

As FanFiction beta, I am always reading 'the reviews' as a way to gauge the story's success, and reader reactions are invaluable to see if the intentions of the author worked.

I use StoryMaster for this, but I was wondering if downloading the FanFiction reviews using the URL might also be possible. Writers and betas find this information invaluable.

Request/Query 2:

Sometimes a story gets pulled story, and I get the dreaded 'bad update', which is fine.

I am particularly frustrated, however, when an author 'tricks' the system by replacing chapters with just one sentence. This way the author keeps their chapter reviews posted, but the original text is erased/overwritten, leaving a 'strawman doc'.

Is there a way to have some sort of trigger that shows the 'new update' on FanFiction Downloader plugin has less (wordcount/ kbs/?) than the prior update, to prevent this inadvertent 'erasing'?

P.S. Thank you for making this program such a joy.

[lumlydwt]

the ficwad login for ffdownloader doesn't seem to work quite right

example http://ficwad.com/story/228271 has 9 chapts ffdownloader say it has 1
(seems like it can't log in to see the rest)

but here's the kicker if you go to chapt 9 and use its url http://ficwad.com/story/232355
it will work (after asking to change the url and if you want another copy)

is there a variation from the standard login in personal.ini I need to use to make it less of a hassle?

thanks

[JimmXinu]

Originally Posted by lumlydwt

the ficwad login for ffdownloader doesn't seem to work quite right

example http://ficwad.com/story/228271 has 9 chapts ffdownloader say it has 1
(seems like it can't log in to see the rest)

but here's the kicker if you go to chapt 9 and use its url http://ficwad.com/story/232355
it will work (after asking to change the url and if you want another copy)

ficwad changed their lay out a bit recently. Also, this business of rating each individual chapter instead of the whole story is (as I recall) unique to ficwad.

Attached is a new test version that works for me on that story.

[lumlydwt]

Originally Posted by JimmXinu

ficwad changed their lay out a bit recently. Also, this business of rating each individual chapter instead of the whole story is (as I recall) unique to ficwad.

Attached is a new test version that works for me on that story.

success!...(checked multiple stories) thanks

[JimmXinu]

One more test version today. This one has everything that's gone before plus fixes for fimfiction.net password protected stories. Thanks, facedeer!

[baggins41]

Man, I've been using this plugin on FimFiction for a while and it really, really stunk not having it available! Thanks for getting this stuff fixed so quickly!

Quick question- I noticed when I was downloading e-books directly of FimFic that the cover art was showing up in my Calibre library automatically as soon as I import them. For as long as I've used FFDL, I've always had to manually add in the cover art to the book metadata after downloading (even though it shows up in the epub itself if I view it in the calibre reader).

Is there some setting I may have screwed up somewhere that is causing this?

[FaceDeer]

Fimfiction recently updated its epub-generating code, perhaps they weren't marking the cover image with a "cover" semantic flag before.

Personally, I've only ever downloaded the epub from Fimfiction when I'm away from my home computer, so that I could tell FFDL to "update-overwrite" it when I got back. So I haven't been paying a lot of attention to their format changes.

[DoctorOhh]

Originally Posted by DownWithIcarus

Hello! These are requests for tweaks for the FanFiction Downloader:

Request/Query 1:

As FanFiction beta, I am always reading 'the reviews' as a way to gauge the story's success, and reader reactions are invaluable to see if the intentions of the author worked.

I use StoryMaster for this, but I was wondering if downloading the FanFiction reviews using the URL might also be possible. Writers and betas find this information invaluable.

Request/Query 2:

Sometimes a story gets pulled story, and I get the dreaded 'bad update', which is fine.

I am particularly frustrated, however, when an author 'tricks' the system by replacing chapters with just one sentence. This way the author keeps their chapter reviews posted, but the original text is erased/overwritten, leaving a 'strawman doc'.

Is there a way to have some sort of trigger that shows the 'new update' on FanFiction Downloader plugin has less (wordcount/ kbs/?) than the prior update, to prevent this inadvertent 'erasing'?

P.S. Thank you for making this program such a joy.

Moderator Notice
@JimmXinu Moved this post (#3440) to this thread so you could address the request.

[firefoxxy]

Thank you chrnno for your help. I have not yet tried your solution, but I will.

Another problem occured today concerning AO3. I tried to download a series but got an error. Can you help?

The url I used is http://archiveofourown.org/series/134526

The error is:

calibre, version 2.8.0
FEHLER: Nicht abgefangener Fehler: <b>error</b>:nothing to repeat

calibre 2.8 Portable isfrozen: True is64bit: False
Windows-8-6.2.9200 Windows ('32bit', 'WindowsPE')
32bit process running on 64bit windows
('Windows', '8', '6.2.9200')
Python 2.7.8
Windows: ('8', '6.2.9200', '', 'Multiprocessor Free')
Successfully initialized third party plugins: Modify ePub && Reading List && Generate Cover && FanFictionDownLoader && Count Pages
Traceback (most recent call last):
  File "calibre_plugins.fanfictiondownloader_plugin.ffdl_plugin", line 403, in get_urls_from_page_menu
  File "calibre_plugins.fanfictiondownloader_plugin.ffdl_plugin", line 419, in get_urls_from_page
  File "calibre_plugins.fanfictiondownloader_plugin.fanficdownloader.geturls", line 37, in get_urls_from_page
  File "calibre_plugins.fanfictiondownloader_plugin.fanficdownloader.adapters.__init__", line 195, in getAdapter
  File "calibre_plugins.fanfictiondownloader_plugin.fanficdownloader.adapters.adapter_archiveofourownorg", line 39, in __init__
  File "calibre_plugins.fanfictiondownloader_plugin.fanficdownloader.adapters.base_adapter", line 98, in __init__
  File "calibre_plugins.fanfictiondownloader_plugin.fanficdownloader.story", line 315, in __init__
  File "calibre_plugins.fanfictiondownloader_plugin.fanficdownloader.story", line 426, in setReplace
  File "re.py", line 190, in compile
  File "re.py", line 244, in _compile
error: nothing to repeat

Addition: It seems I broke something in my ini-file when playing with my tagging... Now I cannot download any story from AO3 (same error)

Status
Titel
Autor
Kommentar
URL
Ungeeignet
Unknown
Unknown
nothing to repeat
http://archiveofourown.org/works/2191530

[JimmXinu]

Originally Posted by baggins41

... For as long as I've used FFDL, I've always had to manually add in the cover art to the book metadata after downloading (even though it shows up in the epub itself if I view it in the calibre reader).

Is there some setting I may have screwed up somewhere that is causing this?

There are tons of settings in FFDL. The three I've highlighted below should all be on to update the metadata cover, as I recall.

[JimmXinu]

Originally Posted by DoctorOhh

@JimmXinu Moved this post (#3440) to this thread so you could address the request.

Thanks, Doc.

As FanFiction beta, I am always reading 'the reviews' as a way to gauge the story's success, and reader reactions are invaluable to see if the intentions of the author worked.

I use StoryMaster for this, but I was wondering if downloading the FanFiction reviews using the URL might also be possible. Writers and betas find this information invaluable.

I've very reluctant to do that. ffnet especially puts only a few reviews on each page, so there are often dozens of pages of reviews for even relatively short stories. Since you already have a tool that gets reviews, I'm even more reluctant.

Sometimes a story gets pulled story, and I get the dreaded 'bad update', which is fine.

I am particularly frustrated, however, when an author 'tricks' the system by replacing chapters with just one sentence. This way the author keeps their chapter reviews posted, but the original text is erased/overwritten, leaving a 'strawman doc'.

Is there a way to have some sort of trigger that shows the 'new update' on FanFiction Downloader plugin has less (wordcount/ kbs/?) than the prior update, to prevent this inadvertent 'erasing'?

If you use 'Update EPUB if New Chapters', that should essentially be the default behavior. It only fetches new (additional) chapters, keeping the old text for chapters it already has. (The exception is AO3 when 'do_update_hook' is set to true because it allows new chapters to be inserted in the middle of existing stories.)