[GUI Plugin] FanFicFare

[ownedbycats]

Question: What options are there to deal with Zalgo? My Kobo renders it as a bunch of overlapping notdef squares.

[applegaa]

Originally Posted by applegaa

It looks like Scribblehub changed something today that stops FFF from working.

I'm not sure what was going on, but it's working again now.

- Andrew

[JimmXinu]

Originally Posted by applegaa

It looks like Scribblehub changed something today that stops FFF from working.
...

Originally Posted by applegaa

I'm not sure what was going on, but it's working again now.

Scribblehub uses CloudFlare, as do many other sites. I would not be surprised if behavior on one site can affect throttling/blocking on an unrelated site these days. I have no proof of that, but it's technilogically possible.

Scribblehub works for me with Calibre plugin, but not FFF CLI. No idea why. Nor would I currently be able to pursue the issue. Last time there were Scribblehub issues, somebody else fixed them.
https://github.com/JimmXinu/FanFicFare/pull/900

Originally Posted by ownedbycats

Question: What options are there to deal with Zalgo? My Kobo renders it as a bunch of overlapping notdef squares.

From defaults.ini:

## Some authors use 'Zalgo' text--arbitrary and often excessive
## added/combined unicode markings--to indicate 'noise' of some kind.
## While a critical part of some languages, when over used it can also
## cause problems for some ebook readers, such as Kindle.
## https://stackoverflow.com/questions/6579844/how-does-zalgo-text-work
## This setting will reduce the number 'Zalgo' characters.  Set to 0
## to remove all of them, -1 or leave undefined for no limit.
## Note: This will also remove other 'marked' unicode characters. If
## set to 0, café will become cafe, déjà -> deja, etc.  1 will keep
## single marks and is the recommended setting if you use it.
#max_zalgo:1

[ownedbycats]

Thanks. I didn't think to search 'Zalgo' itself

[Amalthia]

Hello,

I have a question about my "replace_metadata:" settings.

 
 fandoms=>.*陈情令 \|\ The Untamed.*=>陈情令 | The Untamed
 fandoms=>.*魔道祖师 \|\ Módào Zǔshī.*=>魔道祖师 | Módào Zǔshī
 fandoms=>.*魔道祖师 - 墨香铜臭 \|\ Módào Zǔshī - Mòxiāng Tóngxiù.*=>魔道祖师 - 墨香铜臭 | Módào Zǔshī - Mòxiāng Tóngxiù
 fandoms=>.*(陈情令 \|\ The Untamed|魔道祖师 - 墨香铜臭 \|\ Módào Zǔshī - Mòxiāng Tóngxiù|魔道祖师 \|\ Módào Zǔshī).*=>\1\,陈情令 | The Untamed

This code works in that it adds the tag "陈情令 | The Untamed" to all the Untamed fics from AO3, even if they don't have "The Untamed" in the fandom tag.

I still want to keep "Módào Zǔshī" tags because they can tell me if the primary source for the fan fiction is from the novel or comic. However, I'm adding "The Untamed" tag so I can locate all fics from this fandom with one tag.

The concern I have with my method is when I ran Calibre in Debug mode I got this error line:

FFF: INFO: 2023-02-17 11:50:25,615: story.py(883): Skipping replace_metadata line 'fandoms=>(陈情令 \|\ The Untamed|魔道祖师 - 墨香铜臭 \|\ Módào Zǔshī - Mòxiāng Tóngxiù|魔道祖师 \|\ Módào Zǔshī)=>\1\,陈情令 | The Untamed' on fandoms to prevent infinite recursion.

Is there a better way to run my replace_metadata: without potentially causing an infinite recursion, or needing 4 lines of code?

Thanks,
Amalthia

[JimmXinu]

Originally Posted by Amalthia

I have a question about my "replace_metadata:" settings.
...

FFF: INFO: 2023-02-17 11:50:25,615: story.py(883): Skipping replace_metadata line 'fandoms=>(陈情令 \|\ The Untamed|魔道祖师 - 墨香铜臭 \|\ Módào Zǔshī - Mòxiāng Tóngxiù|魔道祖师 \|\ Módào Zǔshī)=>\1\,陈情令 | The Untamed' on fandoms to prevent infinite recursion.

Is there a better way to run my replace_metadata: without potentially causing an infinite recursion, or needing 4 lines of code?

You don't need to worry about an infinite recursion, the system is already preventing it. It's only an 'INFO' level message.

I believe what's happening is your "陈情令 | The Untamed" string is also matched by the pattern. I believe you could remove the "陈情令 \|\ The Untamed|" part of the pattern to prevent that INFO msg without hurting anything.

[Amalthia]

Originally Posted by JimmXinu

You don't need to worry about an infinite recursion, the system is already preventing it. It's only an 'INFO' level message.

I believe what's happening is your "陈情令 | The Untamed" string is also matched by the pattern. I believe you could remove the "陈情令 \|\ The Untamed|" part of the pattern to prevent that INFO msg without hurting anything.

thanks! I'll update my code.

[sios00]

Hi, what's the latest version of flaresolverr https://github.com/FlareSolverr/FlareSolverr that works with FanficFare? I just downloaded the latest version v3.0.2 using Docker Desktop Windows (docker pull flaresolverr/flaresolverr) and then starting it, but it doesnt seem to work. It's serving on http://0.0.0.0:8191. Is 8191 the correct port?

in my personal.ini, I have use_flaresolverr_proxy:true

Thanks!

[sios00]

is there any way to add my password with apostrophes to AO3 in the personal.ini?

My password has the % symbol in it, and it results in this error (password slightly modified)

"calibre, version 6.13.0
ERROR: Unhandled exception: <b>InterpolationSyntaxError</b>:'%' must be followed by '%' or '(', found: "%x5'"

calibre 6.13  embedded-python: True
Windows-10-10.0.19045-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.19045')
Python 3.10.1
Windows: ('10', '10.0.19045', 'SP0', 'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: DeDRM (10, 0, 3) && Count Pages (1, 12, 1) && EpubMerge (2, 15, 0) && FanFicFare (4, 20, 4) && Generate Cover (2, 3, 2) && Goodreads (1, 7, 3) && KePub Input (3, 6, 3) && KePub Metadata Reader (3, 4, 3) && KePub Metadata Writer (3, 4, 3) && KePub Output (3, 6, 3) && Kindle hi-res covers (0, 5, 0) && Kobo Utilities (2, 16, 6) && KoboTouchExtended (3, 6, 3) && Manage Series (1, 5, 0) && View Manager (1, 10, 2)
Traceback (most recent call last):
  File "calibre_plugins.fanficfare_plugin.dialogs", line 1398, in accept
  File "calibre_plugins.fanficfare_plugin.fff_util", line 48, in test_config
  File "C:\Users\name\AppData\Roaming\calibre\plugins\FanFicFare.zip\fanficfare\configurable.py", line 931, in test_config
  File "configparser.py", line 860, in items
  File "configparser.py", line 860, in <listcomp>
  File "configparser.py", line 856, in <lambda>
  File "configparser.py", line 395, in before_get
  File "configparser.py", line 442, in _interpolate_some
configparser.InterpolationSyntaxError: '%' must be followed by '%' or '(', found: "%x5'"

[JimmXinu]

Originally Posted by sios00

Hi, what's the latest version of flaresolverr https://github.com/FlareSolverr/FlareSolverr that works with FanficFare? I just downloaded the latest version v3.0.2 using Docker Desktop Windows (docker pull flaresolverr/flaresolverr) and then starting it, but it doesnt seem to work. It's serving on http://0.0.0.0:8191. Is 8191 the correct port?

I have briefly tested FlareSolverr 3.0.2 with Docker without issue, but only with FlareSolverr on a different computer (I didn't want to install Docker on mine). Yes, 8191 is the expected port.

I wouldn't be surprised if there's a firewall or other protective program blocking you.

Originally Posted by sios00

My password has the % symbol in it, and it results in this error (password slightly modified)

Percent(%) signs need to be doubled up to be escaped. For example:

## Date formats used by FanFicFare.  Published and Update don't have time.
## See http://docs.python.org/library/datetime.html#strftime-strptime-behavior
## Note that ini format requires % to be escaped as %%.
dateCreated_format:%%Y-%%m-%%d %%H:%%M:%%S
datePublished_format:%%Y-%%m-%%d
dateUpdated_format:%%Y-%%m-%%d

[sios00]

Thanks for the reply! I think it's a Flaresolverr issue, I switched to running the Python file and it works.

Also, I think there's a bug in downloading long series from AO3.
For example, when I download "Get story URLs from web page" the series https://archiveofourown.org/series/1344409 , the series numbers don't match with those found on AO3.

For example, 2 stories are downloaded with [74] in the series, and no [73]. Also, the series number that gets downloaded doesnt match with the one on Ao3. For example, [64] that gets downloaded by Fanficfare ends up being "Hangover", but in AO3, it's supposed to be number 65. And Fanficfare doesn't download 65 at all.

It also downloads 2 different stories and labels them as 67. One of those downloaded as 67 is listed as 68 on AO3, "A pint of bitter and a cider".

These are just some of the examples.

[JimmXinu]

Originally Posted by sios00

Also, I think there's a bug in downloading long series from AO3.

I was all ready to call you crazy, but for thoroughness sake, I downloaded the series. And sure enough, it's full of mis-numberings.

But it's AO3 that's mis-numbering them. See attached example of two stories showing the same series number.

I don't know how this would happen or how it could be fixed in AO3, but FFF can only use the data given it by the site.

I would suggest the Plugin Manage Series as an easy way to correct the series numbers in Calibre.

FYI, Unlike most sites that show, but block access to adult content, AO3 hides them entirely unless you are logged in. This particular series only shows 76 stories when not logged in.

I suggest you turn on the setting: always_login:true under [archiveofourown.org] in personal.ini. Note that leading '#' chars are commented out lines and should be removed:

[archiveofourown.org]
## Some sites require login (or login for some rated stories) The
## program can prompt you, or you can save it in config.  In
## commandline version, this should go in your personal.ini, not
## defaults.ini.
#username:YourName
#password:yourpassword

## In order to get bookmarktags and bookmarksummary, you need to login
## all the time.  This defaults to off to save time and network
## traffic.  Requires valid AO3 username and password when true.
#always_login:false

[sios00]

Thanks! I just realised that the numbers when you open the story are wrong, but when you view it on the series page, it's mostly correct.

Seems like Fanficfare follows the numbers in the story itself, instead of the one on the series list.

[ownedbycats]

Is there any practical limit to the number of story-url sections in personal.ini? I've found myself using them often (all sorts of various reasons).

[ownedbycats]

Bug report?

[https://archiveofourown.org/works/44088169]
always_reload_first_chapter:true
add_category_when_multi_category:false
never_make_cover:true

When downloading as new book or overwriting, I get a "Cannot insert None into a tag" unless I comment always_reload_first_chapter. It doesn't happen when updating.

EDIT: Another story by the same author instead gets a 'NoneType' object has no attribute 'find' error when I attempt to overwrite with always_reload.