[GUI Plugin] FanFictionDownLoader

[Depletion]

Uploaded the new debug data.

I really appreciate your time in looking into this by the way, as well as your continued support of the plugin in general.

[JimmXinu]

Originally Posted by Depletion

Uploaded the new debug data.

I really appreciate your time in looking into this by the way, as well as your continued support of the plugin in general.

I'm just a perfectionist that way.

What do you have in your personal.ini in the fimfiction.net section? Especially, do you have anything for extra_valid_entries? Because while groups are being collected, group URLs are not; and the defaults.ini configuration includes both.

[Depletion]

extracategories:My Little Pony: Friendship is Magic
do_update_hook:false

Should be the only two site-specific.

Attached my personal.ini

[BaconButty]

Hi...

I tried to update 20 or so fics from FFN this morning and they all returned a similar error message:

One was declined because:
'utf8' codec can't decode byte 0xe9 in position 43: invalid continuation byte

All the others came up with:
'utf8' codec can't decode byte 0xe9 in position 58: invalid continuation byte

Is it me?

I'm on calibre 1.14 and using Downloader 1.8.2.
Thanks for your help...



EDIT: I restarted calibre, downloaded the fics and they all updated without any problem.
Can anyone shed a light on what happened?

Thanks in advance.

[JimmXinu]

Originally Posted by Depletion

...
Attached my personal.ini

Got it. The problem is the extra_valid_entries line in your personal.ini. It's overriding the one in defaults.ini and removing groupsURL. Remove that line and it will work.

In fact, you could/should remove all of these, as they're already in defaults.ini:

## Site dedicated to these categories/characters/ships
extracategories:My Little Pony: Friendship is Magic

## Extra metadata that this adapter knows about.  See [dramione.org]
## for examples of how to use them.
extra_valid_entries:likes,dislikes,views,total_views,short_description,groups
likes_label:Likes
dislikes_label:Dislikes
views_label:Highest Single Chapter Views
total_views_label:Total Views
short_description_label:Short Summary
groups_label:Groups

I will also include code in the next release so it fails gracefully in this case instead of aborting.

I should probably also change the order defaults.ini lists options so the ones mostly likely to be copied are right after the section heading...

[JimmXinu]

Originally Posted by BaconButty

...
'utf8' codec can't decode byte 0xe9 in position 58: invalid continuation byte

Is it me?

...
EDIT: I restarted calibre, downloaded the fics and they all updated without any problem.
Can anyone shed a light on what happened?

It's not you--but it was your computer.

Tracking down the exact cause of a problem when it's not happening anymore is extremely difficult. If it happens frequently, I'd try reinstalling calibre and FFDL and if it happens after that, running a memory tester program to check the computer's memory.

[BaconButty]

Originally Posted by JimmXinu

It's not you--but it was your computer.

Tracking down the exact cause of a problem when it's not happening anymore is extremely difficult. If it happens frequently, I'd try reinstalling calibre and FFDL and if it happens after that, running a memory tester program to check the computer's memory.

Thank you for the quick reply.
I'll get cleaning...

[Firedancer885]

Jimm,

please check this story:http://archiveofourown.org/works/972937
I think chapters can be added out of order, because after the last update I have 2 appendix chapters at the end of the story, and chapter 142 should be another update not identical to the last chapter.

[JimmXinu]

Originally Posted by Firedancer885

please check this story:http://archiveofourown.org/works/972937
I think chapters can be added out of order, because after the last update I have 2 appendix chapters at the end of the story, and chapter 142 should be another update not identical to the last chapter.

Yes, some sites allow chapters to be added out of order. But on most sites it's very rare for authors to do so.

The adapter for fimfiction.net has an optional feature that can detect when the newest chapter isn't the last one and download all chapter from that point on. I'll look into adding that feature to the AO3 adapter, too.

For now, you'll have to do 'Overwrite Always' or delete the book and re-add it.

[Firedancer885]

Originally Posted by JimmXinu

Yes, some sites allow chapters to be added out of order. But on most sites it's very rare for authors to do so.

The adapter for fimfiction.net has an optional feature that can detect when the newest chapter isn't the last one and download all chapter from that point on. I'll look into adding that feature to the AO3 adapter, too.

For now, you'll have to do 'Overwrite Always' or delete the book and re-add it.

Thanks

[JimmXinu]

This is a test version that adds a chapter date detecting hook to the adapter for AO3.

If you add this to your personal.ini:

[archiveofourown.org]
do_update_hook:true

...on update, it will look at the dates of all the chapters and download all chapters from the newest dated chapter on.

That should generate correct epubs even when the author adds chapters in the middle while still reusing as much content as possible.

UPDATE Jan 4, 2013 - Remove obsolete beta versions

[Firedancer885]

Originally Posted by JimmXinu

This is a test version that adds a chapter date detecting hook to the adapter for AO3.

Thank you I can only check it tomorrow, when the next story update is due.

[Firedancer885]

Jimm,

which version of the plugin did you modify? I just got a plugin update notice, when I restarted Calibre after installing the beta version you posted.

[JimmXinu]

Originally Posted by Firedancer885

which version of the plugin did you modify? I just got a plugin update notice, when I restarted Calibre after installing the beta version you posted.

I usually don't bump the plugin version number until I build it for release, but this time I did early because I was also bumping up the minimum calibre version. So the current release is 1.8.2, the posted test version is 1.8.3 and I'll bump it to 1.8.4 when I release it next.

[Firedancer885]

Originally Posted by JimmXinu

I usually don't bump the plugin version number until I build it for release, but this time I did early because I was also bumping up the minimum calibre version. So the current release is 1.8.2, the posted test version is 1.8.3 and I'll bump it to 1.8.4 when I release it next.

No. I got a notice because the version I installed registered as 1.8.1. I had 1.8.2 installed previously. Please check.