[GUI Plugin] FanFicFare - Page 740

08-07-2025, 09:11 PM

#11086

JimmXinu

Plugin Developer

Posts: 6,997

Karma: 4604635

Join Date: Dec 2011

Location: Midwest USA

Device: Kobo Clara Colour running KOReader

On sites with unique chapter URLs, FFF will handle it automatically. You could even use ignore_chapter_url_list to exclude the offending 'chapter'.

And the mark_new_chapters feature is specifically for indicating which chapter(s) are new.

Spoiler:

On sites with simple numbered chapter URLs (like ffnet), I think you'll have to manage it manually. What I'd probably do in such a situation is use Calibre's 'Edit book' and remove chapter after downloading.

That's about as much as I can say without knowing story URLs.

08-07-2025, 09:18 PM	#11087
MidnightRose Junior Member Posts: 7 Karma: 10 Join Date: Feb 2025 Device: Kindle Colorsoft	Hm. I'm not sure either of those options would work, because week 1's "bad" chapter becomes week 2's latest, correct, chapter, in the same URL. Since FFF only downloads the new chapters, any updates after the initial download will just have the bad chapter repeated at the end, since it won't download modified chapters. The story URL is https://www.royalroad.com/fiction/48...thout-a-system

Advert

Yesterday, 05:09 AM

#11088

Tharos

Connoisseur

Posts: 70

Karma: 10

Join Date: Jul 2010

Device: Pocketbook InkPad Color 3, Kindle Oasis 2, Moon+ Reader pro

The Sietch has Cloudflare in ‘siege mode’. According to the information displayed, the reason for this is extremely heavy bot traffic. In addition, a login is required for downloads with FFF. However, when you log in, you get a 403 client error with FFF.

Quote:

HTTP Error in FFF '403 Client Error: Forbidden for url: https://www.the-sietch.com/index.php?login'(403)
https://www.the-sietch.com/index.php...tletech.10785/

Yesterday, 05:54 AM

#11089

zeusosphere

Member

Posts: 13

Karma: 10

Join Date: May 2019

Device: Kindle PW3, Marvin 3 on iPhone X

Hi, I'm back again because FFF has broken even more for me lately. It seems to only be able to download 2 chapters of a fic (first and last, which it opens the URLs in the browser for) and all the others fail, and while previously I could manually open the failed chapters in my browser (firefox) and update using the URL (instead of just selecting the fic and choosing 'update'), even this no longer works for me. Please tell me what tests I could try to isolate the issue or where I could look for help. I know nothing about Python nor anything about Qt but I managed to dig up the last time you had this discussion which seemed to have been solved by the test version calling Calibre's safe_open_url? Also, does this plugin support using fanfictiondownloader's cache, and if so could you please point me to the cache path? ~/Users/REDACTED/Library/Caches/fanficdownloader/QtWebEngine/Default/Cache just fails completely.

Here's an example of me trying to download the last 42 chapters of a fic (I tried downloading 93 chapters at once after loading the pages manually and somehow the first 40 or so chapters worked before the method failed):

Spoiler:

Just in case, I tried updating another fic with failed chapters with use_browser_cache_only:false and here's the log:

Spoiler:

And here's where something similar last came up:

Quote:

Originally Posted by John Maverick

Now it's working perfectly. Actually it works even better than before the bug because now I can use a different browser to open the pages than the default of the OS. By choosing the browser that Calibre use in the settings, that it's used to open the pages by FFF. I preffer to have a browser that I only use for FFF

Last edited by zeusosphere; Yesterday at 10:01 AM.

Yesterday, 09:09 AM	#11090
Tharos Connoisseur Posts: 70 Karma: 10 Join Date: Jul 2010 Device: Pocketbook InkPad Color 3, Kindle Oasis 2, Moon+ Reader pro	Could it be that you entered the age limit incorrectly? Or is it missing? Try “browser_cache_age_limit:10.0” under [defaults].

Advert

Yesterday, 09:57 AM

#11091

zeusosphere

Member

Posts: 13

Karma: 10

Join Date: May 2019

Device: Kindle PW3, Marvin 3 on iPhone X

Quote:

Originally Posted by Tharos

Could it be that you entered the age limit incorrectly? Or is it missing?

Try “browser_cache_age_limit:10.0” under [defaults].

I've got "browser_cache_age_limit:12" at the moment and I've also tried clearing Firefox's cache before trying again (with and without freshly loading the chapters manually).

Yesterday, 03:43 PM	#11092
SilentShadow123 Member Posts: 19 Karma: 10 Join Date: Jun 2021 Device: none	I'm sure this is unlikely, but I'd like to confirm whether it's possible to download unlocked chapters off wuxiaworld.com using FanFicFare? Can someone please tell me if it is possible or not?

Yesterday, 04:27 PM	#11093
veviara Junior Member Posts: 9 Karma: 10 Join Date: Dec 2021 Device: Kobo Libra 2	Month and date switches for custom columns I just discovered the oddest bug: I import date values into two custom columns (createdDate to #packaged and (dateUpdated into #last_updated). I also import Published and Date values. When I do this, the date and month values on my custom columns are switched such that fics I have downloaded today (9 august) appear to have been downloaded in september (8 september). What makes it even weirder: This seems to only be the case for date values where there actually is a corresponding month i.e. the story i downloaded last month correctly reads 28-07-2025 in both date and Packaged columns This is not a "just stories downloaded today" thing -- as far as I can tell it is every single story that is downloaded on a date 1-12 of any month I've tried fiddling with the presentation of the value in the custom column and this is NOT an issue of Calibre representing the date wrong. If I edit the format to print the month it prints september and if I manually edit the date value it puts the date in september. The date in saved metadata is absolutely correct The date on the titlepage is correct These are my settings from personal ini: Code: Date_format: %%d-%%m-%%Y %%H:%%M:%%S dateCreated_format:%%d-%%m-%%Y datePublished_format:%%d-%%m-%%Y dateUpdated_format:%%d-%%m-%%Y custom_columns_settings: dateUpdated=>#last_updated,r dateCreated=>#packaged,r These are the "format for dates" settings on the columns: dd-MM-yyyy If it is in any way relevant I also have the following tweak active to control appearance of standard columns: Code: gui_pubdate_display_format = 'dd-MM-yyyy' gui_timestamp_display_format = 'dd-MM-yyyy' gui_last_modified_display_format = 'dd-MM-yyyy' Example from a fic i downloaded today: Titlepage looks like this: Published: 09-07-2025 Updated: 09-07-2025 Packaged: 09-08-2025 12:26:00 Calibre columns look like this: Published 09-07-2025 // right Updated 07-09-2025 // wrong Date 09-08-2025 // right Packaged 08-09-2025 //wrong Saved metadata looks like this: Code: <p><span class='label'>Packaged</span>: <div class='metadata datetime' id='dateCreated'>2025-08-09T12:26:00.498288</div><p> So clearly there is some issue with the way the date gets loaded into the custom columns in calibre but I am at a complete loss as to what I should do to fix it? Am I missing something obvious? Anybody experience the same problem?

Yesterday, 05:13 PM

#11094

Elaine T

Connoisseur

Posts: 60

Karma: 33664

Join Date: Jun 2015

Device: kindle paperwhite

Quote:

Originally Posted by SilentShadow123

I'm sure this is unlikely, but I'd like to confirm whether it's possible to download unlocked chapters off wuxiaworld.com using FanFicFare? Can someone please tell me if it is possible or not?

Did you check the supported site list?
https://github.com/JimmXinu/FanFicFa...Supportedsites

It's a long list, but the site you name is on it, under 'supported' (unless I missed something).

Yesterday, 06:05 PM

#11095

JimmXinu

Plugin Developer

Posts: 6,997

Karma: 4604635

Join Date: Dec 2011

Location: Midwest USA

Device: Kobo Clara Colour running KOReader

Multi-reply!

Quote:

Originally Posted by Tharos

Sounds like a lot of other sites. If none of the existing workarounds work and it's still blocked in a week or so, ask again.

Quote:

Originally Posted by zeusosphere

Hi, I'm back again because FFF has broken even more for me lately. ...

I really don't have the energy to troubleshoot all the intricacies of using Browser Cache for each user anymore. Sorry.

See wiki pages:
https://github.com/JimmXinu/FanFicFa...oblematicSites
https://github.com/JimmXinu/FanFicFa...erCacheFeature

Quote:

Originally Posted by SilentShadow123

I'm sure this is unlikely, but I'd like to confirm whether it's possible to download unlocked chapters off wuxiaworld.com using FanFicFare? Can someone please tell me if it is possible or not?

wuxiaworld.com support removed in 2022 when the site change significantly and nobody came forward to update FFF for it.

Quote:

Originally Posted by veviara

I just discovered the oddest bug: I import date values into two custom columns (createdDate to #packaged and (dateUpdated into #last_updated).
...

This is actually kind of an interesting issue.

FFF calls Calibre's set_custom() using the date string as formatted by your dateX_format setting from personal.ini.

I think what's happening is that Calibre looks at your formatted date and makes assumptions about it, trying multiple possible formats and keeping the first one in its list that works. And mon-day-year is before day-mon-year in that list.

This sounds kinda familar; I think we've seen something like it before. But good luck finding it...

Calibre's Published and Date columns are built-in and FFF populates them with the 'raw' date values, removing any confusion. The tweaks only apply to them.

Quote:

Originally Posted by Elaine T

Did you check the supported site list?
https://github.com/JimmXinu/FanFicFa...Supportedsites

It's a long list, but the site you name is on it, under 'supported' (unless I missed something).

wuxiaworld.com != wuxiaworld.xyz -- as far as I know.

Today, 02:45 AM

#11096

veviara

Junior Member

Posts: 9

Karma: 10

Join Date: Dec 2021

Device: Kobo Libra 2

Quote:

Originally Posted by JimmXinu

FFF calls Calibre's set_custom() using the date string as formatted by your dateX_format setting from personal.ini.

I think what's happening is that Calibre looks at your formatted date and makes assumptions about it, trying multiple possible formats and keeping the first one in its list that works. And mon-day-year is before day-mon-year in that list.

This sounds kinda familar; I think we've seen something like it before. But good luck finding it...

Calibre's Published and Date columns are built-in and FFF populates them with the 'raw' date values, removing any confusion. The tweaks only apply to them.

That makes sense. For now I have edited my .ini date formats to be in ISO-format which at least takes care of the issue of calibre importing a blatantly wrong date (also lets file this one under yet-another-time-the-saved-metadata-column saved my ass).

Me thinks a better solution might be to always use ISO dates for import and date formats just for titlepage. If I were to go have a look at the code to make that change would it be wanted? (or are there a thousand other intricacies that I am blatantly unaware of when thinking up this approach?)

Today, 03:20 AM	#11097
SilentShadow123 Member Posts: 19 Karma: 10 Join Date: Jun 2021 Device: none	[QUOTE=JimmXinu;4529972]Multi-reply! wuxiaworld.com support removed in 2022 when the site change significantly and nobody came forward to update FFF for it. Is it possible to try adding the site from my end, or would you be concerned with the legalities surrounding this? I only want to find a way to download the unlocked chapters, since I don't like the reader settings on wuxiaworld. If not FanFicFare, would you be able to advise me on anything related that I can script or use? Absolutely no problem if you can't.

Today, 11:08 AM

#11098

JimmXinu

Plugin Developer

Posts: 6,997

Karma: 4604635

Join Date: Dec 2011

Location: Midwest USA

Device: Kobo Clara Colour running KOReader

Multi-reply

Quote:

Originally Posted by veviara

Me thinks a better solution might be to always use ISO dates for import and date formats just for titlepage. If I were to go have a look at the code to make that change would it be wanted? (or are there a thousand other intricacies that I am blatantly unaware of when thinking up this approach?)

The code is here. In theory it's possible to use getMetadataRaw() to get the underlying datetime object instead.

But it is more complex than just that:

FFF's internals at that point have the post-processed versions of all metadata.
FFF's internals also allow for anthology books, which would need to be addressed.
There are some site-specific datetime metadata entries.
I don't know if Calibre would accept a datetime object for set_custom(). Presumably ISO 8601 format would work.
Users may deliberately manipulate the datetimes in replace_metadata. For example, to only save month/year and discard day of month and time. Or 'hard coding' a date for a story that has the 'wrong' date.

I could add new code to create copies of all datetime metadata entries that only used ISO 8601 format.

But that adds user-facing complexity either in the form of "Why are there two different metadata entries for each date?" or, if it's hidden, "Why don't my changes to dates show up in custom columns?"

I suspect how Calibre interprets the date as string will change depending on your locale setting. I don't know if that's Calibre code or something Calibre calls. Do you use date formatting that disagrees with your locale setting?

Because honestly, if this is only a problem when you mismatch with your own locale setting, I'm inclined to ignore it.

Quote:

Originally Posted by SilentShadow123

Is it possible to try adding the site(wuxiaworld.com) from my end, or would you be concerned with the legalities surrounding this? I only want to find a way to download the unlocked chapters, since I don't like the reader settings on wuxiaworld. If not FanFicFare, would you be able to advise me on anything related that I can script or use? Absolutely no problem if you can't.

I'm not interested in supporting site , if:

The site hosts original content that you pay for, or the author is paid for;
The site hosts copyrighted content(legitimately or not) that is sold elsewhere;
You're not signing on also do the continuing dev work to keep the site working over time.

Your repeated mentioning of 'only unlocked chapters' suggests to me that there's paid content involved...

The browser plugin WebToEpub says it supports the site.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
[GUI Plugin] KindleUnpack - The Plugin	DiapDealer	Plugins	523	07-15-2025 06:45 PM
[GUI Plugin] Open With	kiwidude	Plugins	404	02-21-2025 05:42 AM
[GUI Plugin] Marvin XD	Philantrop	Plugins	126	01-29-2017 12:48 PM
[GUI Plugin] KiNotes	-axel-	Plugins	0	07-14-2013 06:39 PM
[GUI Plugin] Plugin Updater Deprecated	kiwidude	Plugins	159	06-19-2011 12:27 PM