[GUI Plugin] FanFicFare

[JimmXinu]

@AleTheLadyInRed - My time for FFF is limited this week, but I'll look when I can. Please provide a story URL that exhibits the problem.

[eschwartz]

Originally Posted by JimmXinu

FFF expects Calibre to have made an html5lib available. Plus Calibre 3.21 is from Fri Apr 6 07:37:41 2018. I'd try installing the current Calibre version.

Apparently, Ubuntu is once again broken -- they package calibre without a dependency on html5lib, and with an ancient enough version of mechanize that that does not pull in html5lib either.

And of course they do not execute the testsuite which would report a failure during the build, if html5lib is missing.

Moral of the story: do not use Debian/Ubuntu distro packages of calibre, they're pretty much always totally unreliable.

[Kammal]

Hi,

'forums.sufficientvelocity.com' is not working correctly, when there are a lot of threadmarks, the site shortens it, and the plugin does expand the list to download more, but it only does it one time, if the site shortens it multiple times due to the number of threadmarks, it will only work the first time.

I didn't test it, but it maybe happening with 'forum.spacebattles.com' too, since they use the same system to shorten the threadmarks list.

Here are some threads that this problem happens:

https://forums.sufficientvelocity.co...ossover.27579/
https://forums.sufficientvelocity.co...n-quest.35001/
https://forums.sufficientvelocity.co...t-quest.32005/

[JimmXinu]

Originally Posted by Kammal

Hi,

'forums.sufficientvelocity.com' is not working correctly, when there are a lot of threadmarks, the site shortens it, and the plugin does expand the list to download more, but it only does it one time, if the site shortens it multiple times due to the number of threadmarks, it will only work the first time.

I didn't test it, but it maybe happening with 'forum.spacebattles.com' too, since they use the same system to shorten the threadmarks list.

Here are some threads that this problem happens:

I do see this; or at least something preventing collecting all 4000+ threadmarks on that first thread.

Unfortunately, I'm not able to spend much time on FFF right now.

I've seen stories with 100s of threadmarks work, so hopefully it's only 1000s that have a problem.

SV has recently changed to a newer version of Xenforo, SB hasn't yet, so this is likely unique to SV right now.

[JimmXinu]

New Test Version Posted

2019-07-22
- Add always_include_first_post_chapters to base_xenforoforum_adapter
- XF posts can include a tags without href, look for href searching for links. Closes #417
- Add work around to fix XF2 issue with multiple '...' in threadmarks.

Fixes issue brought up by Kammal.

[ILB]

I get the following error message if I try to use "Get Story URLs from Email":

Spoiler:

calibre, version 3.46.0
ERROR: Unhandled exception: <b>error</b>:command SEARCH illegal in state AUTH, only allowed in states SELECTED

calibre 3.46 [64bit] embedded-python: True is64bit: True
Windows-10-10.0.17134-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.17134')
Python 2.7.15+
Windows: ('10', '10.0.17134', 'SP0', u'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: Find Duplicates (1, 6, 3) && SmartEject (2, 2, 0) && FanFicFare (3, 9, 9) && Generate Cover (1, 5, 21) && Copy Cover To Device (2, 0, 0) && KoboTouchExtended (3, 1, 5) && Manage Series (1, 2, 8) && Annotations (1, 9, 2) && Count Pages (1, 8, 2) && Similar Stories (1, 0, 58) && Reading List (1, 6, 6) && EpubMerge (2, 5, 0) && Quick Preferences (1, 4, 1) && Read MP3 AudioBook metadata (1, 0, 79)
Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 478, in get_urls_from_imap_menu
File "calibre_plugins.fanficfare_plugin.fanficfare.getu rls", line 227, in get_urls_from_imap
File "imaplib.py", line 774, in uid
error: command SEARCH illegal in state AUTH, only allowed in states SELECTED

[JimmXinu]

Originally Posted by ILB

I get the following error message if I try to use "Get Story URLs from Email":

Spoiler:

calibre, version 3.46.0
ERROR: Unhandled exception: <b>error</b>:command SEARCH illegal in state AUTH, only allowed in states SELECTED

calibre 3.46 [64bit] embedded-python: True is64bit: True
Windows-10-10.0.17134-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.17134')
Python 2.7.15+
Windows: ('10', '10.0.17134', 'SP0', u'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: Find Duplicates (1, 6, 3) && SmartEject (2, 2, 0) && FanFicFare (3, 9, 9) && Generate Cover (1, 5, 21) && Copy Cover To Device (2, 0, 0) && KoboTouchExtended (3, 1, 5) && Manage Series (1, 2, 8) && Annotations (1, 9, 2) && Count Pages (1, 8, 2) && Similar Stories (1, 0, 58) && Reading List (1, 6, 6) && EpubMerge (2, 5, 0) && Quick Preferences (1, 4, 1) && Read MP3 AudioBook metadata (1, 0, 79)
Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 478, in get_urls_from_imap_menu
File "calibre_plugins.fanficfare_plugin.fanficfare.getu rls", line 227, in get_urls_from_imap
File "imaplib.py", line 774, in uid
error: command SEARCH illegal in state AUTH, only allowed in states SELECTED

From my testing, that indicates that you don't have a valid/correct 'IMAP Folder Name' set. Default is INBOX.

IE, you have authenticated, so state AUTH, but the command to select a folder (aka label in Gmail) didn't work.

I'll look into adding better error reporting for that.

[ILB]

Thanks!

[JimmXinu]

New Test Version Posted

2019-07-25
- Additional error checking and output for IMAP4 fetch.
- Finish inclusion of always_include_first_post_chapters feature.

This is probably going to be the last test before the next release.

[JimmXinu]

New Version Released

Version 3.10.0 - 27 Jul 2019
- Additional error checking and output for IMAP4 fetch.
- Add always_include_first_post_chapters to base_xenforoforum_adapter
- XF posts can include a tags without href, look for href searching for links. Closes #417
- Add work around to fix XF2 issue with multiple '...' in threadmarks.
- Tweak getting URLs from email for SV XF2 changes, don't get post URLs.
- Changes to adapter_forumssufficientvelocitycom for XenForo2 migration.
- Fix for Plugin: Group reported results better for meta-only updates.
- Plugin: Group reported results better.
- Add a de-dup check to XF threadmark collection due to at least one SB story having TM bug.
- Adjust reader_posts_per_page for forum.questionablequesting.com.
- adapter_wuxiaworldco: Don't include grayed out 'In preparation' chapters
- Move BS version debug so it doesn't appear in CLI without -d.

[Matt Harris]

Thank you for the update; it is nice to be able to download from sufficient velocity again.

I am getting error messages now when downloading from fanfiction.net, "The read operation timed out'". The fics are available via the browser.

It looks like it happens if I try and update more than one fanfiction.net fic at a time. Doing them one at a time works. I have attached text file showing some of the log output.


Also, do you have patreon or something similar? I've supported Calibre, but the main reason I use Calibre is for this plugin.

[JimmXinu]

Originally Posted by Matt Harris

I am getting error messages now when downloading from fanfiction.net, "The read operation timed out'". The fics are available via the browser.

FAQ Why am I having errors downloading from fanfiction.net?

Also see this FAQ.

EDIT: I've never accepted donations for FanFicFare or it's predecessor because I don't feel comfortable accepting money for basically packaging other people's work (fanfics) that is itself based on other-other people's work.

I used to have a PayPal link for my other plugins, but I stopped that because it made my taxes complicated when I was a contractor.

I suggest directing your money to the authors, source sites, original works and Calibre. But thanks for thinking of me.

[Matt Harris]

Fair enough. Thank you for all of your hard work.

[edeniz]

I now have the latest version of FFF (3.10.0). But now IMAP stopped working?

This is the error message I get:

Spoiler:

calibre, version 3.46.0
ERROR: Unhandled exception: <b>AttributeError</b>:'NoneType' object has no attribute 'group'

calibre 3.46  embedded-python: True is64bit: True
Linux-4.4.0-154-generic-x86_64-with-debian-stretch-sid Linux ('64bit', 'ELF')
('Linux', '4.4.0-154-generic', '#181-Ubuntu SMP Tue Jun 25 05:29:03 UTC 2019')
Python 2.7.15
Linux: ('debian', 'stretch/sid', '')
Interface language: None
Successfully initialized third party plugins: EpubMerge (2, 5, 0) && Diaps Editing Toolbag (0, 3, 5) && Quality Check (1, 9, 11) && Recipe Reader (1, 0, 1) && BigOven Recipe Reader (1, 0, 1) && Reading List (1, 6, 6) && Author Book Count (2, 1, 7) && Unplugged (1, 0, 0) && Save To Format (0, 0, 6) && Manage Series (1, 2, 8) && Generate Cover (1, 5, 21) && BOL_DE (0, 7, 5) && Fantastic Fiction Adults (1, 1, 0) && Find Duplicates (1, 6, 3) && FanFicFare (3, 10, 0) && all recipes Recipe Reader (1, 0, 1) && EpubSplit (2, 7, 0) && Consolidate All Library Metadata (2, 0, 33) && BBC GoodFood Recipe Reader (1, 1, 0) && Medical Reader (1, 0, 1) && EpubCheck (0, 1, 9) && Fantastic Fiction (1, 3, 0) && Open With (1, 5, 10) && food network Recipe Reader (1, 0, 2) && Goodreads (1, 4, 0) && Similar Stories (1, 0, 58) && CalibreSpy (1, 0, 73) && MultiColumnSearch (1, 0, 75) && Media File Importer (1, 0, 21) && Overdrive Link (2, 33, 0) && Search The Internet (1, 7, 6) && Modify ePub (1, 3, 13) && Wiki Reader (2, 1, 0) && Count Pages (1, 8, 2) && Recoll Full Text Search (1, 0, 1) && English Noun Frequency (1, 0, 10) && Read MP3 AudioBook metadata (1, 0, 79) && Overdrive Link* (2, 33, 0)
Traceback (most recent call last):
  File "calibre_plugins.fanficfare_plugin.fff_plugin", line 478, in get_urls_from_imap_menu
  File "calibre_plugins.fanficfare_plugin.fanficfare.geturls", line 228, in get_urls_from_imap
AttributeError: 'NoneType' object has no attribute 'group'

[Tharos]

Originally Posted by JimmXinu

I used to have a PayPal link for my other plugins, but I stopped that because it made my taxes complicated when I was a contractor.

Is the amazon wish list also a tax problem?