[GUI Plugin] FanFicFare

[slantybard]

Originally Posted by JimmXinu

Question for Plugin Users

A number of FFF's settings and defaults come from the early days ~10 years ago when users didn't trust FFF to set Calibre metadata and wanted options not to.

There are several options available on every download/update:

1. Output Format
2. Update Mode
3. Update Calibre Metadata
4. Update EPUB Cover
5. Background Metadata (updates only)

Most are self explanatory. 'Update Calibre Metadata' if unchecked, prevents FFF from updating any Calibre metadata--except for the explicit 'Update Calibre Metadata' modes which do anyway.

Which are these settings are actually useful today on every download/update?

Personally, the only one I ever change is Update Mode.

For example, does anyone run with 'Update Calibre Metadata' unchecked? Or change output format on individual downloads?

I always uncheck the update calibre metadata since I have customized metadata.

[HowWouldIKnow]

ahh sorry, seems that I have not posted the right output.

Failed to download 11 stories
....
...

Traceback (most recent call last):
File "runpy.py", line 194, in _run_module_as_main
File "runpy.py", line 87, in _run_code
File "site.py", line 82, in <module>
File "site.py", line 77, in main
File "site.py", line 49, in run_entry_point
File "calibre\utils\ipc\worker.py", line 216, in main
File "calibre\utils\ipc\worker.py", line 151, in arbitrary_n
File "calibre_plugins.fanficfare_plugin.jobs", line 139, in do_download_worker
TypeError: 'NoneType' object is not iterable

[JimmXinu]

HowWouldIKnow, I can't tell what caused that from the reduced error log.

I suggest that you:

a) Download and install the latest plugin test version, link in my sig.
b) Run Calibre in debug mode (under calibre preferences drop down).
c) Post the entire debug log, preferably as a text (or zipped text) attachment.

[ILB]

Originally Posted by JimmXinu

Question for Plugin Users

A number of FFF's settings and defaults come from the early days ~10 years ago when users didn't trust FFF to set Calibre metadata and wanted options not to.

There are several options available on every download/update:

1. Output Format
2. Update Mode
3. Update Calibre Metadata
4. Update EPUB Cover
5. Background Metadata (updates only)

Most are self explanatory. 'Update Calibre Metadata' if unchecked, prevents FFF from updating any Calibre metadata--except for the explicit 'Update Calibre Metadata' modes which do anyway.

Which are these settings are actually useful today on every download/update?

Personally, the only one I ever change is Update Mode.

For example, does anyone run with 'Update Calibre Metadata' unchecked? Or change output format on individual downloads?

1. Output Format
I don´t know if I ever changed this since I changed it from azw3 (or was it mobi ) to epub several years ago.

2. Update Mode
Standard is "Update EPUB if new chapters"
Sometimes I use "update EPUB always": If want some data on the titlepage from custom columns that I changed manually or if I know the author changed things inside the story (without adding new chapters)
And sometimes "Update Metadata"

3. Update Calibre Metadata
Always checked

4. Update EPUB Cover
Always checked

5. Background Metadata (updates only)
This is always unchecked - because I never know nor check if there are stories included that are adult stories or stories that require username/password.


Why are you asking about this? Do you consider to change something?

[JimmXinu]

Originally Posted by ILB

Why are you asking about this? Do you consider to change something?

I spent an hour the other day trying to figure out a cover generation issue to finally trace it back (for me, anyway) to the per-download 'Update EPUB Cover' setting that I had completely forgotten even exists and defaults to off.

If you will allow me the metaphor, there strata of different settings in FFF layered atop each other that have accreted over the years. I'm considering consolidating some things.

[ILB]

Yeah, I know something like that. One work-around added because of X, another because of Y, a request from Z and so on.
And then something will cross and cancel out each other...

At some point then comes the consideration of whether it might not be more sensible to make new from scratch to integrate all requirements in a meaningful way. Which brings it´s own problems with it.

[JimmXinu]

New Test Version Posted

2021-04-20
- Add New Site: novelfull.com (#688 & #689) - Thanks, AlexRiina!
- Need to set logger.setLevel() again with import changes to see debugs in plugin.

[slantybard]

I am not sure if this is a bug or not, but I've noticed that the speed for downloading FFics is now incredibly slow on FFNet - for example, it has taken more than 40 minutes to download 6 fictions from FFNet.

For reference, I am using 5.16 with latest FanFicFare plugin.

[ownedbycats]

That's intended. There was a bug/feature in earlier versions that essentially doubled the number of worker processes, resulting in parallel downloads that made Cloudflare unhappy. This was changed.

[Ascello]

Is there a way to modify calibre column "Ids" using replace_metadata?

[JimmXinu]

Originally Posted by Ascello

Is there a way to modify calibre column "Ids" using replace_metadata?

FFF fills Identifer/Ids with url:<storyUrl>. It's technically possible to change storyUrl, but I strongly discourage it.

FFF's update code assumes Ids contains url:<storyUrl> and will probably fail if it's changed.

[Ascello]

Originally Posted by JimmXinu

FFF fills Identifer/Ids with url:<storyUrl>. It's technically possible to change storyUrl, but I strongly discourage it.

FFF's update code assumes Ids contains url:<storyUrl> and will probably fail if it's changed.

Ok, thx a lot!

[HowWouldIKnow]

Here is the error log.

[JimmXinu]

Originally Posted by HowWouldIKnow

Here is the error log.

calibre Debug log
calibre 5.14  embedded-python: True is64bit: False
Windows-10-10.0.19041 Windows ('32bit', 'WindowsPE')
32bit process running on 64bit windows
...
Traceback (most recent call last):
  File "calibre_plugins.fanficfare_plugin.jobs", line 398, in do_download_for_worker
  File "calibre_plugins.fanficfare_plugin.wordcount", line 37, in get_word_count
  File "calibre_plugins.fanficfare_plugin.wordcount", line 68, in _get_epub_standard_word_count
  File "calibre\utils\wordcount.py", line 94, in get_wordcount_obj
  File "calibre\utils\wordcount.py", line 73, in get_wordcount
  File "calibre\utils\wordcount.py", line 60, in nonj_len
  File "calibre\utils\wordcount.py", line 60, in <listcomp>
MemoryError

FFF calls Calibre's wordcount, which apparently is running out of memory.

Downloading and installing 64 bit Calibre for windows (instead of the 32bit you are now using) will almost certainly solve your problem. I don't recall ever seeing a memory issue except with 32bit.

Turning off Word Count in FFF might solve your problem, but it's not as certain.

[ownedbycats]

Question: using conditionals, is it possible to search for a phrase/phrases in the story description and do a replace_metadata based on them?