[GUI Plugin] FanFicFare - Page 392

icecold · 05-02-2021, 06:39 AM

I seem to be having issues downloading stories from SB/SV/QQ

Spoiler:

bigwoof · 05-02-2021, 08:28 AM

Quote:

Originally Posted by JimmXinu

Question for Plugin Users

I only change update mode now and then as well. Usually it is set to update, sometimes I use overwrite when authors do crazy things to their stories..

Atherton25 · 05-02-2021, 09:50 AM

Quote:

Originally Posted by icecold

I seem to be having issues downloading stories from SB/SV/QQ

Just downloaded that story in your code with no issues.

Edit. Also running same FFF version (latest) but I am running calibre 5.16

icecold · 05-02-2021, 10:25 AM

I updated Calibre to the latest version (5.17) and that seems to have fixed the issue.

JimmXinu · 05-02-2021, 10:27 AM

Quote:

Originally Posted by icecold

I seem to be having issues downloading stories from SB/SV/QQ

Code:

calibre, version 5.0.1 (win32, embedded-python: True)
...
  File "C:\Users\cody2\AppData\Roaming\calibre\plugins\FanFicFare.zip\bs4\__init__.py", line 52
    'You are trying to run the Python 2 version of Beautiful Soup under Python 3. This will not work.'<>'You need to convert the code, either by installing it (`python setup.py install`) or by running 2to3 (`2to3 -w bs4`).'

You appear to be running an outdated version of calibre (v5.0.1) that is trying to use FFF's bundled copy of Beautiful Soup (for pre-v5 versions of calibre) instead of calibre's copy.

And either you removed the debug output that would report the platform or you are using a version that doesn't report it.

I speculate that you are using a version of calibre from some linux variant's software repo instead of Kovid's official calibre release. I suggest using Kovid's official calibre release instead.

Anyssia · 05-03-2021, 02:25 PM

Quote:

Originally Posted by watani

So this error message that I got previously has reared its ugly head again. Restarting Calibre doesn't fix the problem.

I've attached the Calibre debug log to see if that helps figure out what's wrong.

Edit: The error is definitely tied to how FFF is reading the Firefox cache. Once I disabled the setting for FFF to use the cache to update FF.net chapters, the error message went away.

Re: Watani's message:

I just had the "'utf-8' codec can't decode byte 0xe9 in position 14: invalid continuation byte" error message today too.

I came here to look it up and turned cache to false as they mentioned, and now FFnet let's me update again. Before, I got the error message barely a few seconds after hitting update fic (with "overwrite always" setting)
I use Calibre 5.17 and FFF 4.2.0

JimmXinu · 05-03-2021, 06:08 PM

Hmmm. A second user hitting suggests I should at least catch the exception and report it better.

I'm still not going to be able to fix it without seeing for myself--and maybe not even then. We didn't develop the cache reading code, we 'borrowed' it.

ownedbycats · 05-03-2021, 06:54 PM

Could the version of Firefox be a possible factor? I am unsure whether the devs made any changes to the cache though.

JimmXinu · 05-03-2021, 10:32 PM

Unlikely. I'm using current Firefox myself.

leckadams · 05-04-2021, 01:44 PM

Quote:

Originally Posted by JimmXinu

Question for Plugin Users

A number of FFF's settings and defaults come from the early days ~10 years ago when users didn't trust FFF to set Calibre metadata and wanted options not to.

There are several options available on every download/update:

Output Format
Update Mode
Update Calibre Metadata
Update EPUB Cover
Background Metadata (updates only)

Most are self explanatory. 'Update Calibre Metadata' if unchecked, prevents FFF from updating any Calibre metadata--except for the explicit 'Update Calibre Metadata' modes which do anyway.

Which are these settings are actually useful today on every download/update?

Personally, the only one I ever change is Update Mode.

For example, does anyone run with 'Update Calibre Metadata' unchecked? Or change output format on individual downloads?

The only I change is Update Mode and that's not even every time

riothamus · 05-04-2021, 01:56 PM

Quote:

Originally Posted by JimmXinu

Question for Plugin Users

A number of FFF's settings and defaults come from the early days ~10 years ago when users didn't trust FFF to set Calibre metadata and wanted options not to.

There are several options available on every download/update:

Output Format
Update Mode
Update Calibre Metadata
Update EPUB Cover
Background Metadata (updates only)

Most are self explanatory. 'Update Calibre Metadata' if unchecked, prevents FFF from updating any Calibre metadata--except for the explicit 'Update Calibre Metadata' modes which do anyway.

Which are these settings are actually useful today on every download/update?

Personally, the only one I ever change is Update Mode.

For example, does anyone run with 'Update Calibre Metadata' unchecked? Or change output format on individual downloads?

I occasionally change the Update Mode and check/uncheck the metadata box.

JimmXinu · 05-04-2021, 02:52 PM

New Test Version Posted

2021-05-04
- Catch exceptions in word count.
- Add CLI --color option for warns and fails. Closes #692
- Report browser cache load fail as such.

ackomb · 05-04-2021, 05:00 PM

Hey Guy's,

I have another mystery (to me at least) I have "Keep Existing Tags when Updating Metadata" checked and all "New Only" boxes unchecked. So there is this story where I've manually amended the character cause it's a character from an untagged show which is why my regex setup isn't working, no biggy. However every time I update the story it adding the old tag and removes the tag I've added.

So I'm guessing there is some setting I have wrong, but I can't figure out which.

I don't want to check "New Only" in the customs columns because that would mean I don't get the tags that might be added by the writer after the initial download.

An example for a story is:https://archiveofourown.org/works/28121997

The character is Addison Montgomery which I change into Addison Forbes Montgomery

Usually I use below code, but it doesn't work since Grey's Anatomy isn't tagged as a show

Code:

 characters=>^Addison Montgomery$=>Addison Forbes Montgomery&&category==Grey's Anatomy Universe

What I want it do do is keep the tags I've added or amended but update any new ones added by the writer.

Zerubel · 05-04-2021, 05:16 PM

Hello all! I've been lurking and reading here for a while and wanted to ask if there is, perhaps, a more comprehensive page or wiki somewhere detailing normalizing tags between ffnet and ao3, splitting tags, etc; I've been searching and backreading as much as I can, but with 393 pages spanning years, it's a bit tricky to find what I'm looking for.

If that isn't the case then of course I'll keep trying to find other posts where my questions have been answered! just wanted to make sure i haven't missed something.

quick edit: i have seen https://github.com/JimmXinu/FanFicFa...eplaceMetadata but have had mixed results - character replacement works, genre seems to stubbornly stay "humor" instead of joining the ranks of "comedy".

ownedbycats · 05-04-2021, 06:12 PM

Just posting this in hopes that it'll get rid of the phantom post that's reported on my forum subscriptions page...

EDIT: It worked. Feel free to delete.

05-02-2021, 06:39 AM	#5866
icecold Enthusiast Posts: 45 Karma: 10 Join Date: Mar 2020 Device: Android,	I seem to be having issues downloading stories from SB/SV/QQ Spoiler: calibre, version 5.0.1 (win32, embedded-python: True) Failed to Download Stories: Failed: Download 1 FanFiction Book(s) Download 1 FanFiction Book(s) FFF: INFO: 2021-05-02 05:34:19,293: calibre_plugins.fanficfare_plugin.jobs(49): CPUs:3 FFF: INFO: 2021-05-02 05:34:19,295: calibre_plugins.fanficfare_plugin.jobs(52): FanFicFare v4.2.0 FFF: INFO: 2021-05-02 05:34:19,295: calibre_plugins.fanficfare_plugin.jobs(68): Launch background process for site forums.sufficientvelocity.com: https://forums.sufficientvelocity.co...or-btvs.53169/ FFF: INFO: 2021-05-02 05:34:21,220: calibre_plugins.fanficfare_plugin.jobs(130): ================================================== ============================== siteforums.sufficientvelocity.com) Traceback (most recent call last): File "runpy.py", line 194, in _run_module_as_main File "runpy.py", line 87, in _run_code File "site.py", line 89, in <module> File "site.py", line 84, in main File "site.py", line 55, in run_entry_point File "site-packages\calibre\utils\ipc\worker.py", line 215, in main File "site-packages\calibre\utils\ipc\worker.py", line 146, in arbitrary_n File "calibre_plugins.fanficfare_plugin.jobs", line 186, in do_download_site File "calibre_plugins.fanficfare_plugin.jobs", line 199, in do_download_for_worker File "<frozen importlib._bootstrap>", line 991, in _find_and_load File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 655, in _load_unlocked File "<frozen importlib._bootstrap>", line 618, in _load_backward_compatible File "site-packages\calibre\customize\zipplugin.py", line 184, in load_module File "calibre_plugins.fanficfare_plugin.dialogs", line 69, in <module> File "<frozen importlib._bootstrap>", line 991, in _find_and_load File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 655, in _load_unlocked File "<frozen importlib._bootstrap>", line 618, in _load_backward_compatible File "<frozen zipimport>", line 259, in load_module File "C:\Users\cody2\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\fanficfare\geturls.py", line 33, in <module> File "<frozen importlib._bootstrap>", line 991, in _find_and_load File "<frozen importlib._bootstrap>", line 971, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 914, in _find_spec File "<frozen importlib._bootstrap_external>", line 1342, in find_spec File "<frozen importlib._bootstrap_external>", line 1316, in _get_spec File "<frozen importlib._bootstrap_external>", line 1297, in _legacy_get_spec File "<frozen importlib._bootstrap>", line 414, in spec_from_loader File "<frozen importlib._bootstrap_external>", line 649, in spec_from_file_location File "<frozen zipimport>", line 191, in get_filename File "<frozen zipimport>", line 713, in _get_module_code File "<frozen zipimport>", line 647, in _compile_source File "C:\Users\cody2\AppData\Roaming\calibre\plugins\Fa nFicFare.zip\bs4\__init__.py", line 52 'You are trying to run the Python 2 version of Beautiful Soup under Python 3. This will not work.'<>'You need to convert the code, either by installing it (`python setup.py install`) or by running 2to3 (`2to3 -w bs4`).' ^ SyntaxError: invalid syntax Traceback (most recent call last): File "runpy.py", line 194, in _run_module_as_main File "runpy.py", line 87, in _run_code File "site.py", line 89, in <module> File "site.py", line 84, in main File "site.py", line 55, in run_entry_point File "site-packages\calibre\utils\ipc\worker.py", line 215, in main File "site-packages\calibre\utils\ipc\worker.py", line 146, in arbitrary_n File "calibre_plugins.fanficfare_plugin.jobs", line 134, in do_download_worker TypeError: 'NoneType' object is not iterable

05-04-2021, 05:00 PM	#5878
ackomb Zealot Posts: 106 Karma: 4486 Join Date: Mar 2020 Location: Netherlands Device: i-pad	Update Tags Hey Guy's, I have another mystery (to me at least) I have "Keep Existing Tags when Updating Metadata" checked and all "New Only" boxes unchecked. So there is this story where I've manually amended the character cause it's a character from an untagged show which is why my regex setup isn't working, no biggy. However every time I update the story it adding the old tag and removes the tag I've added. So I'm guessing there is some setting I have wrong, but I can't figure out which. I don't want to check "New Only" in the customs columns because that would mean I don't get the tags that might be added by the writer after the initial download. An example for a story is:https://archiveofourown.org/works/28121997 The character is Addison Montgomery which I change into Addison Forbes Montgomery Usually I use below code, but it doesn't work since Grey's Anatomy isn't tagged as a show Code: characters=>^Addison Montgomery$=>Addison Forbes Montgomery&&category==Grey's Anatomy Universe What I want it do do is keep the tags I've added or amended but update any new ones added by the writer.

05-04-2021, 05:16 PM	#5879
Zerubel Customization Addict Posts: 8 Karma: 10 Join Date: Mar 2018 Device: Android Tablet	Hello all! I've been lurking and reading here for a while and wanted to ask if there is, perhaps, a more comprehensive page or wiki somewhere detailing normalizing tags between ffnet and ao3, splitting tags, etc; I've been searching and backreading as much as I can, but with 393 pages spanning years, it's a bit tricky to find what I'm looking for. If that isn't the case then of course I'll keep trying to find other posts where my questions have been answered! just wanted to make sure i haven't missed something. quick edit: i have seen https://github.com/JimmXinu/FanFicFa...eplaceMetadata but have had mixed results - character replacement works, genre seems to stubbornly stay "humor" instead of joining the ranks of "comedy". Last edited by Zerubel; 05-04-2021 at 05:18 PM.

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
[GUI Plugin] KindleUnpack - The Plugin	DiapDealer	Plugins	527	08-15-2025 02:36 PM
[GUI Plugin] Open With	kiwidude	Plugins	404	02-21-2025 06:42 AM
[GUI Plugin] Marvin XD	Philantrop	Plugins	126	01-29-2017 01:48 PM
[GUI Plugin] KiNotes	-axel-	Plugins	0	07-14-2013 07:39 PM
[GUI Plugin] Plugin Updater Deprecated	kiwidude	Plugins	159	06-19-2011 01:27 PM

05-02-2021, 10:25 AM	#5869
icecold Enthusiast Posts: 45 Karma: 10 Join Date: Mar 2020 Device: Android,	I updated Calibre to the latest version (5.17) and that seems to have fixed the issue.

05-03-2021, 06:08 PM	#5872
JimmXinu Plugin Developer Posts: 7,136 Karma: 5005503 Join Date: Dec 2011 Location: Midwest USA Device: Kobo Clara Colour running KOReader	Hmmm. A second user hitting suggests I should at least catch the exception and report it better. I'm still not going to be able to fix it without seeing for myself--and maybe not even then. We didn't develop the cache reading code, we 'borrowed' it.

05-03-2021, 06:54 PM	#5873
ownedbycats Custom User Title Posts: 11,359 Karma: 79528341 Join Date: Oct 2018 Location: Canada Device: Kobo Libra H2O, formerly Aura HD	Could the version of Firefox be a possible factor? I am unsure whether the devs made any changes to the cache though.

05-03-2021, 10:32 PM	#5874
JimmXinu Plugin Developer Posts: 7,136 Karma: 5005503 Join Date: Dec 2011 Location: Midwest USA Device: Kobo Clara Colour running KOReader	Unlikely. I'm using current Firefox myself.

05-04-2021, 02:52 PM	#5877
JimmXinu Plugin Developer Posts: 7,136 Karma: 5005503 Join Date: Dec 2011 Location: Midwest USA Device: Kobo Clara Colour running KOReader	New Test Version Posted 2021-05-04 - Catch exceptions in word count. - Add CLI --color option for warns and fails. Closes #692 - Report browser cache load fail as such.

05-04-2021, 06:12 PM	#5880
ownedbycats Custom User Title Posts: 11,359 Karma: 79528341 Join Date: Oct 2018 Location: Canada Device: Kobo Libra H2O, formerly Aura HD	Just posting this in hopes that it'll get rid of the phantom post that's reported on my forum subscriptions page... EDIT: It worked. Feel free to delete.