[GUI Plugin] FanFictionDownLoader

[AndersW]

On fimfiction.net commas are appearing as "’" when the description is downloaded and set as the stories comment. http://www.fimfiction.net/story/122954/ is a story that has 2 examples.

[Tanjamuse]

Originally Posted by Tanjamuse

Now, it pick up the first link, I would love to have to avoid the copy-paste of the rest. If there is that function, I haven't found it

I hope this clarifies:

I've checked the box marked: Take URLS from clipboard? (as you can see)

But it only works for the first link, not the next ones.

[cryzed]

That's strange, it should work for every link. But I didn't do anything regarding the GUI, you'll have to wait for Jimm to answer.

@AndersW same for you -- I didn't write this adapter and there's some funky encoding going on somehow.

[JimmXinu]

Originally Posted by JimmXinu

Definitely buggy.

...

I have some ideas I'm going to pursue, but I thought I'd report back my progress now that I actually understand what's going on.

Attached is a test version that (I believe) fixes the problems mentioned before with splitting values, infinite recursions and handling \, correctly for custom columns vs tags.

[JimmXinu]

Originally Posted by AndersW

On fimfiction.net commas are appearing as "’" when the description is downloaded and set as the stories comment. http://www.fimfiction.net/story/122954/ is a story that has 2 examples.

That sounds like an encoding issue. And I'm not seeing it happen.

I'm running out of battery, so I'll have to look at that and Tanjamuse's issue later.

[Amalthia]

Originally Posted by cryzed

Oh, good to know. I suppose Jimm left in the "{{,}}" for backwards compatibility.

Actually, no the "{{,}}" didn't work.

[Amalthia]

Hi,

I have a Yes/No custom column for unread/read stories. Is it possible to automatically update this column when I download new stories into Calibre?

I also have a custom columns for Warnings at A03, using the "Comma separated text, like tags, shown in the tag browser" option.

Some authors are using the option "Author Chose Not To Use Archive Warnings," is it possible to have these not added to the Warnings custom column?

Thanks,
Amalthia

[JimmXinu]

Originally Posted by Amalthia

I have a Yes/No custom column for unread/read stories. Is it possible to automatically update this column when I download new stories into Calibre?

FFDL can add new/updated stories to a 'To Read' list in the Reading List plugin. That plugin can update a custom column. I use that because then I can also add it to 'Send to Devices' lists that are configured to automatically update my devices when I connect them.

You can also set it directly from FFDL by adding a static custom_columns_settings line:

custom_columns_settings:
  "True"=>#read

If you want to apply it to all sites, but also want to control other columns separate per site, use this:

[defaults]
add_to_custom_columns_settings:
  "True"=>#read

Originally Posted by Amalthia

I also have a custom columns for Warnings at A03, using the "Comma separated text, like tags, shown in the tag browser" option.

Some authors are using the option "Author Chose Not To Use Archive Warnings," is it possible to have these not added to the Warnings custom column?

Yep:

[archiveofourown.org]
exclude_metadata_pre:
 warnings==Author Chose Not To Use Archive Warnings

[JimmXinu]

Originally Posted by Tanjamuse

I hope this clarifies:

I've checked the box marked: Take URLS from clipboard? (as you can see)

But it only works for the first link, not the next ones.

This is still working fine for me on Win8. That code hasn't been touched in some time.

What are your exact steps when you see a problem? What page and program are you copying from and how? What OS?

I do know that I can't drag more than one email out of Thunderbird onto the FFDL button at a time anymore, but that's a Thunderbird bug and they weren't interested when I reported it.

[JimmXinu]

Originally Posted by AndersW

On fimfiction.net commas are appearing as "’" when the description is downloaded and set as the stories comment. http://www.fimfiction.net/story/122954/ is a story that has 2 examples.

Nope, I'm not seeing any problem with that story with default settings.

But that sort of thing is classic for a wrong encoding setting. Do you have website_encodings set in your personal.ini for [defaults], [www.fimfiction.net] or [overrides]?

[Amalthia]

Originally Posted by JimmXinu

You can also set it directly from FFDL by adding a static custom_columns_settings line:

custom_columns_settings:
  "True"=>#read

If you want to apply it to all sites, but also want to control other columns separate per site, use this:

[defaults]
add_to_custom_columns_settings:
  "True"=>#read

Yep:

[archiveofourown.org]
exclude_metadata_pre:
 warnings==Author Chose Not To Use Archive Warnings

Thank you! Both settings worked. I've never used the Reading List Plugin. I'll read up about it and see what I can do with it.

Best Regards,
Amalthia

[JimmXinu]

Originally Posted by Amalthia

Thank you! Both settings worked. I've never used the Reading List Plugin. I'll read up about it and see what I can do with it.

It's a bit dated, but I wrote some instructions for FFDL with Reading Lists.

[JimmXinu]

Attached is another test version, has all the same changes as the last one, but also will check story URLs with and without www. with both http and https now.

This was reported along with a patch for ffnet, but I implemented it more generally.

[AndersW]

Originally Posted by JimmXinu

Nope, I'm not seeing any problem with that story with default settings.

But that sort of thing is classic for a wrong encoding setting. Do you have website_encodings set in your personal.ini for [defaults], [www.fimfiction.net] or [overrides]?

One, I was an idiot and said comma instead of apostrophe in my original post. Sorry about that.

Two, I didn't have any website_encodings set. But after the first couple responses I went and fiddled with that to try and fix it. When I manually set the encodings to Windows-1252 the apostrophes don't appear at all. This is odd because when I look at the page source it lists the encodings as Utf-8. And even that setting doesn't fix the apostrophes for other stories like http://www.fimfiction.net/story/78582/.

[JimmXinu]

Originally Posted by AndersW

One, I was an idiot and said comma instead of apostrophe in my original post. Sorry about that.

Two, I didn't have any website_encodings set. But after the first couple responses I went and fiddled with that to try and fix it. When I manually set the encodings to Windows-1252 the apostrophes don't appear at all. This is odd because when I look at the page source it lists the encodings as Utf-8. And even that setting doesn't fix the apostrophes for other stories like http://www.fimfiction.net/story/78582/.

Sites aren't always good about forcing authors to upload to upload their content in the correct encoding. But these are two stories by different authors.

The exact mis-coding depends on what's around it. I do see "’" for http://www.fimfiction.net/story/78582/ (and Sombra’s for http://www.fimfiction.net/story/122954/)--but only if I force the encoding to Windows-1252 (ISO-8859-1 comes out slightly differently for 78582).

What's your OS? Do you use a US version or some other national localization?