[GUI Plugin] FanFicFare

[JimmXinu]

(yet more) New Test Version Posted

2018-10-11
- Fix adapter_wuxiaworldco date format for 24 hour clock. Closes #345
- Change adapter_lightnovelgatecom to adapter_novelonlinefullcom for site change. Closes #346

[FaceDeer]

Originally Posted by baggins41

Lately, any time I download a single chapter story from FimFiction (e.g. this one), the chapter title is no longer displayed before the text in the resultant epub. The chapter title is present in the metadata and in the table of contents, but it doesn't show up as a header in the actual text at the start of the chapter, as it used to.

I've just noticed that FanFicFare doesn't seem to be downloading cover images for stories from Fimfiction any more, and that this started around September 18 (based on the publication date where the cutoff seems to be). If the site made some change to their formatting to remove those chapter headers perhaps it happened around the same time as whatever they did to stop cover images from being recognized.

Unfortunately my RL schedule is crazy busy, I won't be able to take a peek at what's going on under the hood until Sunday at the earliest. But hopefully once these changes find fixes that will help find books in need of an update.

[JimmXinu]

Originally Posted by FaceDeer

I've just noticed that FanFicFare doesn't seem to be downloading cover images for stories from Fimfiction any more
...

I can take a look at it if you give me some story URLs. My one FimF story in my test library downloads a cover image still.

[FaceDeer]

Originally Posted by JimmXinu

I can take a look at it if you give me some story URLs. My one FimF story in my test library downloads a cover image still.

I tried re-downloading (from scratch) an old story I had that FFF had previously downloaded a cover for, https://www.fimfiction.net/story/394371/, and it didn't get a cover this time.

Tried two newly published stories - https://www.fimfiction.net/story/417890/ and https://www.fimfiction.net/story/421685/ - and also this old-but-newly-updated multi-chapter story just in case multichapter made a difference: https://www.fimfiction.net/story/65539/

FFF does retain cover art when updating an existing story, though. No problem with that. What's your test case? I can try downloading that too, to see if it's something weird with my setup in particular (I've got a lot of custom columns and configuration tweaks, though I haven't changed anything about that in quite a while).

Edit: Oh, hey, maybe this is just my own installation that's acting up. I went and found a random fanfiction.net story with cover art, https://www.fanfiction.net/s/12888721/1/, and it didn't download a cover for that either. A strong hint that it's something in how I've got FFF set up locally. No further time to investigate today, though. So don't dig too deeply, this might be a false alarm.

[JimmXinu]

My test story URL is https://www.fimfiction.net/story/244372/

I got a cover image for all four of those, which were all internally marked cover:'specific', meaning they where set with setCoverImage().

My thoughts are that perhaps you've changed your settings in some fashion, or that you have username/password set (I don't) and that effects it--possibly from using a different skin?

[FaceDeer]

Well, I'm narrowing the problem down, at least.

I tried wiping my personal.ini completely, no effect. There's no username and password in my settings.

But then I finally had the idea to actually open one of the epubs I'd downloaded in the course of all this testing, and there it was - the cover was downloaded and stored inside the epub just fine. I'd be more embarrassed about that oversight if I'd had time to do any real reading in the past month.

Anyway, going "edit metadata in bulk -> change cover -> set from e-book files" causes Calibre to get the cover from the book as you'd expect. So whatever's going wrong for me is just in the step where Calibre's displayed cover is updated from the downloaded epub. That's good, it means there's no data loss and I won't need to update the whole stash of books I've been accumulating for my next reading spree. I've tried various permutations of "Update Calibre Cover (from EPUB)" and "Generate Calibre Cover" FFF settings without getting any covers showing up in Calibre, even with both set to "always". Very puzzling, I'll poke at it some more and see if I can figure anything else out.

I was at version 3.30.0 of Calibre and tried updating to the latest 3.32.0. Maybe I could try downgrading to an earlier version from over a month ago to see if that's part of the problem.

[JimmXinu]

Originally Posted by FaceDeer

...
I've tried various permutations of "Update Calibre Cover (from EPUB)" and "Generate Calibre Cover" FFF settings without getting any covers showing up in Calibre, even with both set to "always".
...

"Yes, Always" for "Update Calibre Cover (from EPUB)" and "No" for "Generate Calibre Cover" are the most basic settings to use.

Other possible blockers:
- Must download epub format
- 'Update Calibre Metadata' checkbox must be checked on download (default in settings Basic)

[rishidiams]

I'm currently importing fics into Calibre by "get story URLs from web page". Once it gathers the URLs if the story already exists, I want it to Update Calibre Metadata from Web Site. I've noticed that if I choose this and a book appears within an anthology story I already have, it will give me the skip option, but otherwise I will end up with duplicates entries in my database, same author name, same title, same URL.

If I choose Update EPUB if New Chapters, it will skip stories with the same author name, same title, and same URL, but even though Update Calibre metadata is checked, the metadata for existing books is not updated.

Also, some of the stories in my database are from Fanfiction.net and I would prefer to have AO3's metadata, so if given the option to update the URL to AO3's I always choose yes, but the stories are not being updated with the new URL either.

[Tanjamuse]

How do I switch the two series when there are multiple series?

example: https://archiveofourown.org/works/9561221

[JimmXinu]

Originally Posted by Tanjamuse

How do I switch the two series when there are multiple series?

example: https://archiveofourown.org/works/9561221

For a finished story like that, I would just manually edit them. But you can also do it in replace_metadata:

[https://archiveofourown.org/works/9561221]
add_to_replace_metadata:
 series=>^.*$=>Range of a Teaspoon [1]
 seriesUrl=>^.*$=>https://archiveofourown.org/series/673751
 series01=>^.*$=>Fresh Pickled Toad [31]
 series01Url=>^.*$=>https://archiveofourown.org/series/441613

@rishidiams - I need to sit down this week when I have a couple hours to concentrate to look at your issues. I think there are two or three mostly unrelated things going on there.

[dakota1979]

Hello,

Fanficfare metadata download (updating fanfics from fanfiction.net) in the last few days gives the below message and stops the download.

UnicodeDecodeError: 'utf8' codec can't decode byte 0xf3 in position 38: invalid continuation byte

What could be the problem? Anyone have sloution?

[Tanjamuse]

Is it all stories, because I updated a couple of hours ago and they went through fine.

[JimmXinu]

Originally Posted by dakota1979

Hello,

Fanficfare metadata download (updating fanfics from fanfiction.net) in the last few days gives the below message and stops the download.

UnicodeDecodeError: 'utf8' codec can't decode byte 0xf3 in position 38: invalid continuation byte

What could be the problem? Anyone have sloution?

Story URL(s)? I've not seen any problems with ffnet downloads.

[dakota1979]

this is what it says could it help?

calibre 3.32 [64bit] embedded-python: True is64bit: True
Windows-7-6.1.7601-SP1 Windows ('64bit', 'WindowsPE')
('Windows', '7', '6.1.7601')
Python 2.7.12+
Windows: ('7', '6.1.7601', 'SP1', u'Multiprocessor Free')
Interface language: hu
Successfully initialized third party plugins: FanFicFare (3, 0, 0) && Find Duplicates (1, 6, 3) && Reading List (1, 6, 6)
Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.dialogs", line 688, in do_loop
UnicodeDecodeError: 'utf8' codec can't decode byte 0xe9 in position 17: invalid continuation byte

[JimmXinu]

Originally Posted by dakota1979

this is what it says could it help?

With only that to work with, I would assume it's a bad unicode character in that particular story.

If you aren't willing to share the story URL, I cannot help you any further.