[GUI Plugin] FanFicFare

[icecold]

I seem to be having issues downloading stories from SB/SV/QQ

Spoiler:

calibre, version 5.0.1 (win32, embedded-python: True)
Failed to Download Stories: Failed: Download 1 FanFiction Book(s)

Download 1 FanFiction Book(s)
FFF: INFO: 2021-05-02 05:34:19,293: calibre_plugins.fanficfare_plugin.jobs(49): CPUs:3
FFF: INFO: 2021-05-02 05:34:19,295: calibre_plugins.fanficfare_plugin.jobs(52): FanFicFare v4.2.0
FFF: INFO: 2021-05-02 05:34:19,295: calibre_plugins.fanficfare_plugin.jobs(68): Launch background process for site forums.sufficientvelocity.com:
https://forums.sufficientvelocity.co...or-btvs.53169/
FFF: INFO: 2021-05-02 05:34:21,220: calibre_plugins.fanficfare_plugin.jobs(130):

================================================== ============================== siteforums.sufficientvelocity.com)
Traceback (most recent call last):
File "runpy.py", line 194, in _run_module_as_main
File "runpy.py", line 87, in _run_code
File "site.py", line 89, in <module>
File "site.py", line 84, in main
File "site.py", line 55, in run_entry_point
File "site-packages\calibre\utils\ipc\worker.py", line 215, in main
File "site-packages\calibre\utils\ipc\worker.py", line 146, in arbitrary_n
File "calibre_plugins.fanficfare_plugin.jobs", line 186, in do_download_site
File "calibre_plugins.fanficfare_plugin.jobs", line 199, in do_download_for_worker
File "<frozen importlib._bootstrap>", line 991, in _find_and_load
File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 655, in _load_unlocked
File "<frozen importlib._bootstrap>", line 618, in _load_backward_compatible
File "site-packages\calibre\customize\zipplugin.py", line 184, in load_module
File "calibre_plugins.fanficfare_plugin.dialogs", line 69, in <module>
File "<frozen importlib._bootstrap>", line 991, in _find_and_load
File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 655, in _load_unlocked
File "<frozen importlib._bootstrap>", line 618, in _load_backward_compatible
File "<frozen zipimport>", line 259, in load_module
File "C:\Users\cody2\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\geturls.py", line 33, in <module>
File "<frozen importlib._bootstrap>", line 991, in _find_and_load
File "<frozen importlib._bootstrap>", line 971, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 914, in _find_spec
File "<frozen importlib._bootstrap_external>", line 1342, in find_spec
File "<frozen importlib._bootstrap_external>", line 1316, in _get_spec
File "<frozen importlib._bootstrap_external>", line 1297, in _legacy_get_spec
File "<frozen importlib._bootstrap>", line 414, in spec_from_loader
File "<frozen importlib._bootstrap_external>", line 649, in spec_from_file_location
File "<frozen zipimport>", line 191, in get_filename
File "<frozen zipimport>", line 713, in _get_module_code
File "<frozen zipimport>", line 647, in _compile_source
File "C:\Users\cody2\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\bs4\__init__.py", line 52
'You are trying to run the Python 2 version of Beautiful Soup under Python 3. This will not work.'<>'You need to convert the code, either by installing it (`python setup.py install`) or by running 2to3 (`2to3 -w bs4`).'
^
SyntaxError: invalid syntax

Traceback (most recent call last):
File "runpy.py", line 194, in _run_module_as_main
File "runpy.py", line 87, in _run_code
File "site.py", line 89, in <module>
File "site.py", line 84, in main
File "site.py", line 55, in run_entry_point
File "site-packages\calibre\utils\ipc\worker.py", line 215, in main
File "site-packages\calibre\utils\ipc\worker.py", line 146, in arbitrary_n
File "calibre_plugins.fanficfare_plugin.jobs", line 134, in do_download_worker
TypeError: 'NoneType' object is not iterable

[bigwoof]

Originally Posted by JimmXinu

Question for Plugin Users

I only change update mode now and then as well. Usually it is set to update, sometimes I use overwrite when authors do crazy things to their stories..

[Atherton25]

Originally Posted by icecold

I seem to be having issues downloading stories from SB/SV/QQ

Just downloaded that story in your code with no issues.

Edit. Also running same FFF version (latest) but I am running calibre 5.16

[icecold]

I updated Calibre to the latest version (5.17) and that seems to have fixed the issue.

[JimmXinu]

Originally Posted by icecold

I seem to be having issues downloading stories from SB/SV/QQ

calibre, version 5.0.1 (win32, embedded-python: True)
...
  File "C:\Users\cody2\AppData\Roaming\calibre\plugins\FanFicFare.zip\bs4\__init__.py", line 52
    'You are trying to run the Python 2 version of Beautiful Soup under Python 3. This will not work.'<>'You need to convert the code, either by installing it (`python setup.py install`) or by running 2to3 (`2to3 -w bs4`).'

You appear to be running an outdated version of calibre (v5.0.1) that is trying to use FFF's bundled copy of Beautiful Soup (for pre-v5 versions of calibre) instead of calibre's copy.

And either you removed the debug output that would report the platform or you are using a version that doesn't report it.

I speculate that you are using a version of calibre from some linux variant's software repo instead of Kovid's official calibre release. I suggest using Kovid's official calibre release instead.

[Anyssia]

Originally Posted by watani

So this error message that I got previously has reared its ugly head again. Restarting Calibre doesn't fix the problem.

I've attached the Calibre debug log to see if that helps figure out what's wrong.

Edit: The error is definitely tied to how FFF is reading the Firefox cache. Once I disabled the setting for FFF to use the cache to update FF.net chapters, the error message went away.

Re: Watani's message:

I just had the "'utf-8' codec can't decode byte 0xe9 in position 14: invalid continuation byte" error message today too.

I came here to look it up and turned cache to false as they mentioned, and now FFnet let's me update again. Before, I got the error message barely a few seconds after hitting update fic (with "overwrite always" setting)
I use Calibre 5.17 and FFF 4.2.0

[JimmXinu]

Hmmm. A second user hitting suggests I should at least catch the exception and report it better.

I'm still not going to be able to fix it without seeing for myself--and maybe not even then. We didn't develop the cache reading code, we 'borrowed' it.

[ownedbycats]

Could the version of Firefox be a possible factor? I am unsure whether the devs made any changes to the cache though.

[JimmXinu]

Unlikely. I'm using current Firefox myself.

[leckadams]

Originally Posted by JimmXinu

Question for Plugin Users

A number of FFF's settings and defaults come from the early days ~10 years ago when users didn't trust FFF to set Calibre metadata and wanted options not to.

There are several options available on every download/update:

1. Output Format
2. Update Mode
3. Update Calibre Metadata
4. Update EPUB Cover
5. Background Metadata (updates only)

Most are self explanatory. 'Update Calibre Metadata' if unchecked, prevents FFF from updating any Calibre metadata--except for the explicit 'Update Calibre Metadata' modes which do anyway.

Which are these settings are actually useful today on every download/update?

Personally, the only one I ever change is Update Mode.

For example, does anyone run with 'Update Calibre Metadata' unchecked? Or change output format on individual downloads?

The only I change is Update Mode and that's not even every time

[riothamus]

Originally Posted by JimmXinu

Question for Plugin Users

A number of FFF's settings and defaults come from the early days ~10 years ago when users didn't trust FFF to set Calibre metadata and wanted options not to.

There are several options available on every download/update:

1. Output Format
2. Update Mode
3. Update Calibre Metadata
4. Update EPUB Cover
5. Background Metadata (updates only)

Most are self explanatory. 'Update Calibre Metadata' if unchecked, prevents FFF from updating any Calibre metadata--except for the explicit 'Update Calibre Metadata' modes which do anyway.

Which are these settings are actually useful today on every download/update?

Personally, the only one I ever change is Update Mode.

For example, does anyone run with 'Update Calibre Metadata' unchecked? Or change output format on individual downloads?

I occasionally change the Update Mode and check/uncheck the metadata box.

[JimmXinu]

New Test Version Posted

2021-05-04
- Catch exceptions in word count.
- Add CLI --color option for warns and fails. Closes #692
- Report browser cache load fail as such.

[ackomb]

Hey Guy's,

I have another mystery (to me at least) I have "Keep Existing Tags when Updating Metadata" checked and all "New Only" boxes unchecked. So there is this story where I've manually amended the character cause it's a character from an untagged show which is why my regex setup isn't working, no biggy. However every time I update the story it adding the old tag and removes the tag I've added.

So I'm guessing there is some setting I have wrong, but I can't figure out which.

I don't want to check "New Only" in the customs columns because that would mean I don't get the tags that might be added by the writer after the initial download.

An example for a story is:https://archiveofourown.org/works/28121997

The character is Addison Montgomery which I change into Addison Forbes Montgomery

Usually I use below code, but it doesn't work since Grey's Anatomy isn't tagged as a show

 characters=>^Addison Montgomery$=>Addison Forbes Montgomery&&category==Grey's Anatomy Universe

What I want it do do is keep the tags I've added or amended but update any new ones added by the writer.

[Zerubel]

Hello all! I've been lurking and reading here for a while and wanted to ask if there is, perhaps, a more comprehensive page or wiki somewhere detailing normalizing tags between ffnet and ao3, splitting tags, etc; I've been searching and backreading as much as I can, but with 393 pages spanning years, it's a bit tricky to find what I'm looking for.

If that isn't the case then of course I'll keep trying to find other posts where my questions have been answered! just wanted to make sure i haven't missed something.

quick edit: i have seen https://github.com/JimmXinu/FanFicFa...eplaceMetadata but have had mixed results - character replacement works, genre seems to stubbornly stay "humor" instead of joining the ranks of "comedy".

[ownedbycats]

Just posting this in hopes that it'll get rid of the phantom post that's reported on my forum subscriptions page...

EDIT: It worked. Feel free to delete.