[GUI Plugin] FanFictionDownLoader

[JimmXinu]

Originally Posted by Feynor

url:http://www.tthfanfic.org/Story-19451
FFDL: V 1.8.1
...

What an odd problem. TtH doesn't show that story on the author's list unless you're logged in.

Attached is a version that will ask for login if it can't find the story on the author list.

[Feynor]

Originally Posted by JimmXinu

What an odd problem. TtH doesn't show that story on the author's list unless you're logged in.

Attached is a version that will ask for login if it can't find the story on the author list.

Ah, I see what happened now. When not logged in, the rating selector in the upper right corner defaults to FR 15 or 17, blocking the story.

[JimmXinu]

Originally Posted by Feynor

Ah, I see what happened now. When not logged in, the rating selector in the upper right corner defaults to FR 15 or 17, blocking the story.

Good catch--I stopped thinking about it after figuring out 'login' worked, but clearly that was the wrong approach. Thanks for figuring this out.

Attached is a version that instead does an is_adult check if the story doesn't appear on the author list.

A logged in user with a particularly low setting (say FR7) will trigger it for non-adult stories, but I'm prepared to live with that.

UPDATE Dec 2, 2013 - Remove obsolete beta versions

[Feynor]

Originally Posted by JimmXinu

Good catch--I stopped thinking about it after figuring out 'login' worked, but clearly that was the wrong approach. Thanks for figuring this out.

Attached is a version that instead does an is_adult check if the story doesn't appear on the author list.

A logged in user with a particularly low setting (say FR7) will trigger it for non-adult stories, but I'm prepared to live with that.

That works nicely, thanks

[canadianfolk]

Hello, I hope I'm in the right spot. Can this site be added:
http://www.extraordinarylines.com/index.php

[JimmXinu]

Originally Posted by canadianfolk

Hello, I hope I'm in the right spot. Can this site be added:
http://www.extraordinarylines.com/index.php

That site could be supported if somebody wants to write an adapter, but it's pretty small, not many stories.

[JimmXinu]

Here's a test version with some updates for the German translations plus a fix for finding existing stories by identifer:url.

Let me know if you have problems with it.

UPDATE Dec 2, 2013 - Remove obsolete beta versions

[DavidBrookes]

I am not sure if this is a problem with Calibre or with the FanFictionDowloader plugin but when I went to update my FanFiction.Net library tonight (what I normally do is copy and paste all of my bookmarked pages into a text file and then copy then into the plugin so it can determine what has been updated and add any new stories plus let me know at the end what stories have been removed) but tonight it claim that there were 3218 out of 3220 stories to be updated/added and I know that there have not that many emails from FanFiction.Net nor new stories. It did something similar last week but that was mainly author name changes that updated for a few more than usual. I have attached how I have setup the FanFictionDownloader plugin in .jpg format and a copy of the personal.ini file as well. I am going to try with another site to see if I get the same result.

[DavidBrookes]

Originally Posted by DavidBrookes

I am not sure if this is a problem with Calibre or with the FanFictionDowloader plugin but when I went to update my FanFiction.Net library tonight (what I normally do is copy and paste all of my bookmarked pages into a text file and then copy then into the plugin so it can determine what has been updated and add any new stories plus let me know at the end what stories have been removed) but tonight it claim that there were 3218 out of 3220 stories to be updated/added and I know that there have not that many emails from FanFiction.Net nor new stories. It did something similar last week but that was mainly author name changes that updated for a few more than usual. I have attached how I have setup the FanFictionDownloader plugin in .jpg format and a copy of the personal.ini file as well. I am going to try with another site to see if I get the same result.

Update: Issue seems to only occurring with FanFiction.Net as I am having no problems with updating my Twisting the Hellmouth library. I am going to try with a couple of other sites as well.

[JimmXinu]

Originally Posted by DavidBrookes

I am not sure if this is a problem with Calibre or with the FanFictionDowloader plugin but when I went to update my FanFiction.Net library tonight (what I normally do is copy and paste all of my bookmarked pages into a text file and then copy then into the plugin so it can determine what has been updated and add any new stories plus let me know at the end what stories have been removed) but tonight it claim that there were 3218 out of 3220 stories to be updated/added and I know that there have not that many emails from FanFiction.Net nor new stories. It did something similar last week but that was mainly author name changes that updated for a few more than usual. I have attached how I have setup the FanFictionDownloader plugin in .jpg format and a copy of the personal.ini file as well. I am going to try with another site to see if I get the same result.

First, I do not recommend using FFDL the way you are. Checking for updates on thousands of stories at once causes excessive traffic on the source site. fanfiction.net in particular has been known to block people's IP address if they generate too much traffic.

Instead, I highly recommend that you 'follow' stories and use the site's email notifications to inform you about updates and then update those specific stories. I also recommend using Update EPUB, not Overwrite, unless you have reason to believe that a particular story has changes in previous chapters.

Also, if the stories to update are already in your library, why keep the URL list somewhere else? FFDL has a feature to update existing books.

I don't know what's caused this behavior for you specifically, but I have a couple ideas.

There have been changes to fanfiction.net lately; they've switched to using https:// URLs instead of http:// and Update and Published dates now include time as well as date.

Also, the last version versions of calibre have had a change to how identifiers (the story URL) are stored. FFDL has had to fall back to matching by title & author which is sufficient in most cases.

The most recently posted test version has fixes for both http vs https and the changes to identifier URLs. You might try it. It will be released for general use shortly--I'm waiting to see if there are any problems reported with the German translation.

I must repeat, doing mass updates like this is not recommended.

[JimmXinu]

Another test version before release--this one improved Overwrite if Newer to use time in addition to date when comparing if available (like ffnet has now).

UPDATE Dec 4, 2013 -- Remove obsolete beta versions

[ktredshoes]

If a site is listed as under consideration, does that mean more information is needed? If so, what's needed? Or does that mean it's in the works, or something else altogether? Specifically, I'm wondering about Trekiverse, which is undergoing a conversion to eFiction, and the new site is listed on the "under consideration" list (at trekiverse.org/efiction). I'm on the archive team working on the conversion, and we anticipate going live with the new site in 7 to 10 days. If FFDL support is in the works, we'd love to be able to mention that in the announcement. Thanks!

[JimmXinu]

Originally Posted by ktredshoes

If a site is listed as under consideration...
trekiverse.org/efiction

Basically, "under consideration" means that it's a good candidate, but none of the developers have been interested in coding it yet.

But since it's one of the site admin asking for it this time, I'll add support for trekiverse.org/efiction.

[ktredshoes]

Originally Posted by JimmXinu

Basically, "under consideration" means that it's a good candidate, but none of the developers have been interested in coding it yet.

But since it's one of the site admin asking for it this time, I'll add support for trekiverse.org/efiction.

That's the best news I've had in a week! Thank you! Let me know if any questions come up - it's basically a straight eFiction installation, but there have been some (mostly) minor changes made under the hood.

I should add that learning to use FFDL with Calibre to feed my son's Fanfiction.net habit is actually one of the factors that ultimately led to the Trekiverse conversion to eFiction...so this is pretty cool.

Katie Redshoes

[JimmXinu]

Test version with all fixes from before plus first try at support for trekiverse.org/efiction

UPDATE Dec 4, 2013 -- Remove obsolete beta versions