[GUI Plugin] FanFicFare

[Mieeka]

I'm Also getting the version Num Error (same as MerlinMama).

Spoiler:

calibre 2.62 [64bit] embedded-python: True is64bit: True
Windows-8-6.2.9200 Windows ('64bit', 'WindowsPE')
('Windows', '8', '6.2.9200')
Python 2.7.9
Windows: ('8', '6.2.9200', '', 'Multiprocessor Free')
Successfully initialized third party plugins: DeDRM (6, 4, 3) && Kindle and Mobipocket DeDRM (0, 4, 13) && K4PC, K4Mac, Kindle Mobi and Topaz DeDRM (0, 4, 1) && Ignoble Epub DeDRM (0, 2, 5) && Inept PDF DeDRM (0, 1, 9) && Inept Epub DeDRM (0, 2, 0) && eReader PDB 2 PML (0, 0, 8) && Quality Check (1, 9, 11) && Count Pages (1, 6, 9) && Fantastic Fiction (1, 1, 6) && FanFicFare (2, 3, 6) && Modify ePub (1, 3, 13) && Generate Cover (1, 5, 21) && EpubMerge (2, 0, 14) && Find Duplicates (1, 6, 2) && Reading List (1, 6, 6) && Kindle Collections (1, 7, 17) && DOC Input (1, 0, 1)
Traceback (most recent call last):
File "site-packages\calibre\gui2\preferences\plugins.py", line 316, in add_plugin
File "site-packages\calibre\customize\ui.py", line 417, in add_plugin
File "site-packages\calibre\customize\ui.py", line 55, in load_plugin
File "site-packages\calibre\customize\zipplugin.py", line 195, in load
File "site-packages\calibre\customize\zipplugin.py", line 179, in load_module
File "calibre_plugins.fanficfare_plugin.__init__", line 36, in <module>
ImportError: cannot import name __version_num__

[JimmXinu]

Originally Posted by Mieeka

I'm Also getting the version Num Error (same as MerlinMama).

Spoiler:

calibre 2.62 [64bit] embedded-python: True is64bit: True
Windows-8-6.2.9200 Windows ('64bit', 'WindowsPE')
('Windows', '8', '6.2.9200')
Python 2.7.9
Windows: ('8', '6.2.9200', '', 'Multiprocessor Free')
Successfully initialized third party plugins: DeDRM (6, 4, 3) && Kindle and Mobipocket DeDRM (0, 4, 13) && K4PC, K4Mac, Kindle Mobi and Topaz DeDRM (0, 4, 1) && Ignoble Epub DeDRM (0, 2, 5) && Inept PDF DeDRM (0, 1, 9) && Inept Epub DeDRM (0, 2, 0) && eReader PDB 2 PML (0, 0, 8) && Quality Check (1, 9, 11) && Count Pages (1, 6, 9) && Fantastic Fiction (1, 1, 6) && FanFicFare (2, 3, 6) && Modify ePub (1, 3, 13) && Generate Cover (1, 5, 21) && EpubMerge (2, 0, 14) && Find Duplicates (1, 6, 2) && Reading List (1, 6, 6) && Kindle Collections (1, 7, 17) && DOC Input (1, 0, 1)
Traceback (most recent call last):
File "site-packages\calibre\gui2\preferences\plugins.py", line 316, in add_plugin
File "site-packages\calibre\customize\ui.py", line 417, in add_plugin
File "site-packages\calibre\customize\ui.py", line 55, in load_plugin
File "site-packages\calibre\customize\zipplugin.py", line 195, in load
File "site-packages\calibre\customize\zipplugin.py", line 179, in load_module
File "calibre_plugins.fanficfare_plugin.__init__", line 36, in <module>
ImportError: cannot import name __version_num__

A second user reporting this issue made me start thinking in different directions than before and I think I understand what was happening now. I'm not certain that this fix is what will be released next, but I believe it will work for you.

New test version posted (direct link)

2016-09-18 Take 2
- Fix for version number issue.

[MerlinMama]

Originally Posted by JimmXinu

A second user reporting this issue made me start thinking in different directions than before and I think I understand what was happening now. I'm not certain that this fix is what will be released next, but I believe it will work for you.

New test version posted (direct link)

2016-09-18 Take 2
- Fix for version number issue.

This installed for me without trouble

[JimmXinu]

Originally Posted by MerlinMama

This installed for me without trouble

Oh good. Sorry about that.

[JimmXinu]

New test version posted (direct link)

2016-09-20
- Fix for poor HTML in some nfacommunity.com descs - Thanks GComyn for finding that.
- Fix for calibre series w/injectseries always being applied when doing BG metadata.

[JimmXinu]

New test version posted (direct link)


2016-09-21
- New site: fictionhunt.com - Archive of ffnet HP fics.

This is a site that was requested here back in January, and a web service user brought up again today. I had some time (and ambition) today, so I've added support for it.

However, fictionhunt.com has several limitations that most sites don't:

• fictionhunt.com is an archive site of stories saved from fanfiction.net. Everything on it is or was posted to ffnet.
• The site (apparently) only saves Harry Potter stories. Accordingly, 'categories' is always set 'Harry Potter'.
• The site doesn't have author pages, but it does have links to the original ffnet author pages, so FanFicFare uses those.
• The site doesn't provide the individual chapter titles, so FanFicFare can't collect and use them.
• Story descriptions appear to only be visible in 'search' results. I didn't see any way to search for an individual book, so all stories have only a short message: (Story descriptions not available on fictionhunt.com)

[Loba]

I feel like there is probably a way to do this, but I'm not sure.

Is there a way to make it so if two tags are present it adds a third? Basically I need a boolean AND, but I can't seem to find a good way to do it.
If, say, both hunter!Cas and angel!Dean are present (not either/or) in freeformtags then it would add reverse!verse and AU and keep hunter!Cas and angel!Dean as well. I've considered the below, but it doesn't work as I have it written.

freeformtags,category,genre=>^[Rr]everse.[Vv]erse|(angel!Dean)(hunter!Cas)$=>reverse!verse\,AU\ ,\1\,\2

I've fudged around with this for awhile, but am stumped. Thoughts?

Edit:
Also, there is a minorly inconvenient thing where whenever I make a fic series into an anthology it repeats the ship name and fandom name for each entry in the series. Like, an anthology with five parts of Harry/Draco fic would have the ship entry as Harry/Draco,Harry/Draco,Harry/Draco,Harry/Draco,Harry/Draco and I have to pop in manually and delete that and replace it with just Harry/Draco. I briefly entertained the idea that my ship column was the wrong type, but it doesn't seem to be that. I've only attempted anthologies pulled from ao3.

[JimmXinu]

Originally Posted by Loba

Is there a way to make it so if two tags are present it adds a third? Basically I need a boolean AND, but I can't seem to find a good way to do it.
If, say, both hunter!Cas and angel!Dean are present (not either/or) in freeformtags then it would add reverse!verse and AU and keep hunter!Cas and angel!Dean as well. I've considered the below, but it doesn't work as I have it written.

 freeformtags,category,genre=>^[Rr]everse.[Vv]erse|(angel!Dean)(hunter!Cas)$=>reverse!verse\,AU\,\1\,\2

I've fudged around with this for awhile, but am stumped. Thoughts?

Hrm... That's not going to work because replace_metadata operates on individual values. So it can only see one of angel!Dean or hunter!Cas at a time.

Unless you use <metadata>_LIST. The following works for me, but it assumes that freeformtags is sorted and that it's okay for the freeformtags entry in the title page to be out of order and possibly have duplicates of AU and reverse!verse. Calibre's Tags column and tag-like columns automatically order and remove duplicates.

 freeformtags_LIST=>(angel!Dean.*hunter!Cas)=>reverse!verse,AU,\1

(Note that using \, in _LIST substs is undefined. I'm not sure what it does exactly in that case.)

Originally Posted by Loba

Edit:
Also, there is a minorly inconvenient thing where whenever I make a fic series into an anthology it repeats the ship name and fandom name for each entry in the series. Like, an anthology with five parts of Harry/Draco fic would have the ship entry as Harry/Draco,Harry/Draco,Harry/Draco,Harry/Draco,Harry/Draco and I have to pop in manually and delete that and replace it with just Harry/Draco. I briefly entertained the idea that my ship column was the wrong type, but it doesn't seem to be that. I've only attempted anthologies pulled from ao3.

That suggests that your column is a text type, not a tag-like text type (see attached).

The anthology code concatenates most metadata items as strings (with ', ' between them) and counts on tag-like Calibre columns to automatically remove duplicates and alphabetize.

[Loba]

Originally Posted by JimmXinu

Hrm... That's not going to work because replace_metadata operates on individual values. So it can only see one of angel!Dean or hunter!Cas at a time.

That's too bad. _List does do the trick, but with how insanely long my freeformtags list is it's probably best to just match either/or.

Originally Posted by JimmXinu

That suggests that your column is a text type, not a tag-like text type (see attached).

For some reason when I looked at the column last night I could have sworn it was that type, but sure enough it's the "ampersand separated" one. It was pretty late I guess. It doesn't seem that one can edit the column type after it's created so I'll have to delete it, re-create, and then re-scrape the metadata? That's going to be fun.

Thanks a ton for the prompt and detailed reply! I can hardly even think of what my fic collection was like before this plugin. Keep up the awesome work!

[JimmXinu]

Originally Posted by Loba

...
It doesn't seem that one can edit the column type after it's created so I'll have to delete it, re-create, and then re-scrape the metadata? That's going to be fun.

If you set up a Saved Metadata column, then you can change your custom columns and replace_metadata settings and use FanFicFare's Update from Saved Metadata Column without having to scrape again in future. See attached.

[Loba]

Originally Posted by JimmXinu

If you set up a Saved Metadata column, then you can change your custom columns and replace_metadata settings and use FanFicFare's Update from Saved Metadata Column without having to scrape again in future. See attached.

Oh man that is awesome. I was just wondering what the saved metadata column was for the other day and totally didn't make that connection at all. Thanks again!

[JimmXinu]

Originally Posted by Loba

Oh man that is awesome. I was just wondering what the saved metadata column was for the other day and totally didn't make that connection at all. Thanks again!

Fair warning: If you do 'Update from Saved Metadata' on a story that doesn't have saved metadata, it will go scrape the site instead. So don't go using it on large numbers of books without considering that.

[JimmXinu]

New version released:

Version 2.4.0 - 30 Sep 2016
- Adding Update Existing Only option to Email URL Fetch. (plugin only)
- Add support for Pillow (vs PIL) image lib in CLI.
- Adding CLI options for --imap and download from imap and list.
- Add 'Reject w/o Confirm' option for Series Anthology Check. (plugin only)
- Improvements to CLI/defaults.ini suggested by MrTyton.
- Fix for poor HTML in some nfacommunity.com descs - Thanks GComyn for finding that.
- Fix for calibre series w/injectseries always being applied when doing BG metadata. (plugin only)
- Fix for webservice over-long error msgs causing problems, specific errmsg for unknown site.
- Need to provide 'more info' on failure with individual URL in CLI.
- New site: fictionhunt.com
- Update translations.
- New version updating tool.
- Bump versions--start bumping minor per version instead of micro.

[JDesat]

Not sure if you're aware of this or not, and I'm really not sure how far back the issue goes (though as far as I know it's new with the 2.4.0 version of FFF) but the Storiesonline site isn't downloading stories properly. It seems to be skipping chapters.

No errors popped up in downloading, it just didn't seem to download the whole story (I'm unsure if there are further chapters missing as well though it doesn't appear to be the case, it's just missing the first chapter or two of several stories I downloaded).

I know SOL is coded weird, the chapter numbers aren't sequential, etc. but I'm really hoping you can fix this since I prefer FFF downloaded epubs to the ones you can get from the site itself.

Edit: I'm not sure when new versions of FFF were updated, but I just looked back at some other stories downloaded and the last time I got something that downloaded completely was September 26. So it's not just the most recent version. I don't know if there was a change in version around then or if SOL has done something on their end.

[JimmXinu]

Originally Posted by JDesat

Not sure if you're aware of this or not, and I'm really not sure how far back the issue goes (though as far as I know it's new with the 2.4.0 version of FFF) but the Storiesonline site isn't downloading stories properly. It seems to be skipping chapters. For example the following story link starts at chapter 3 instead of chapter 1
(URL REMOVED)
...

The FanFicFare code for Storiesonline hasn't changed, but perhaps their chapter URLs can now contain additional parts. Or those stories have never come up.

FYI, you should edit your previous post and remove the story link. MobileRead doesn't like links to NSFW content.

New test version posted (direct link)

2016-10-01
- Fix for unusual (changed?) chapter URLs on storiesonline.net.