[GUI Plugin] FanFicFare

[JimmXinu]

Originally Posted by SilentShadow123

Hi, sorry to bother but I need some help finding the personal.ini tab in the google chrome browser cache location for fixing the cloudflare issues with fanficfare on ff.net.

I'm on a Macbook Air and after looking online, I found the cache location by going to finder and searching w/ Cmd+Shift+G "/Users/[USERNAME]/Library/Caches/Google/Chrome/." This lets me find the cache, but I've looked through the folders and there's nothing labelled personal.ini and there's no tabbing. What should I do?

Open FanFicFare's config from inside Calibre. One of the tabs is personal.ini and there's a button you can press to edit it. It's named that because FFF was originally a CLI tool with a config file.

[JimmXinu]

Originally Posted by Edifier

I've run into a bug on royal road. Where spaces get eaten by the program when the space is italicized, the space alone. <em> </em>


It turns from that.

To this.

Tho I'm not sure if there would be an easy fix from my end. I don't know what I'm doing.
https://www.royalroad.com/fiction/16...-possibilities - link to the chapter of the story where I noticed it.
However looking at other stories, they don't have this fucked up formatting.

The author's HTML in that chapter is... sub-optimal. Apparently, their editor put <em> tags around individual words or phrases instead of blocks. Including just space sometimes.

By default, FFF automatically removes most empty (or whitespace only containing) tags. It keeps <p> <td> and <th> tags by default, by you can add to that list in personal.ini:

add_to_keep_empty_tags:,em

Whether you add it for just that story, that site, or for everything is up to you.

[JimmXinu]

Originally Posted by Adin Terim

I've found an issue with sb/xenoforo adapter. It looks like the Publish Date is pulling from the threadmark creation date rather than the first post/thread creation date.

See this thread for an example: https://forums.spacebattles.com/thre...d-d-si.264789/

Image URL:
https://user-images.githubuserconten...8c87bb7088.png

Moderator Notice

Please don't in-line large images. Changed to a link by JimmXinu

That is a valid concern.

For most sites, taking the datePublished and dateUpdated from the chapter list works fine. However, it looks like SB at least is reporting the date the bookmark was created now instead?

And looking into this reveals that FFF's code for reading published/updated times from individual posts broke at some point due to site changes.

I need to look at all the sites that use this code before I can change it; hopefully they're the same...

[riothamus]

I'm having trouble using the browser cache method for a single story. This week I had several stories to update or download new. Some of them kept having chapter errors but I managed to try again and get them to work after 2-3 tries. However, this one story started out with chapter errors and now won't work at all.

I've tried it every day or two by clicking through every chapter and trying the "Overwrite always" option. If I have the "use_browser_cache_always:true" then I get this:

Status
Title
Author
Comment
URL
Error
The Potioneer's Assistant Rebrewed
kgfinkel
HTTP Error in FFF 'Page not found or expired in Browser Cache (see FFF setting browser_cache_age_limit)'(428) URL:'https://www.fanfiction.net/s/13820683/1/'
https://www.fanfiction.net/s/13820683/1/

If I have "use_browser_cache_always:false" then I get the cloudflare captcha error. I can download or update other ff.net stories following the browser cache guide but this one is stumping me. I suppose I could just delete it and try again but wanted to ask for help first.

Thanks,
Riothamus

[JimmXinu]

New Test Version Posted

2021-06-10
- Fix date reading for XenForo forums sites
- Change defaults.ini to correctly show default values for remove_spoilers, legend_spoilers

[JimmXinu]

Originally Posted by riothamus

I'm having trouble using the browser cache method for a single story.
...

It worked fine for me.

Things you might try:
- Clearing your browser cache before downloading the story again (in browser) or force-reloading each page (usually --it's possible your browser is showing you cached copies more than FFF's default 4 hour age limit.
- Increase the browser_cache_age_limit setting. -1 will use all cache entries regardless of age, but it will take longer to scan the cache.

Doing updates instead of overwrites will reduce traffic and should work better, unless you have reason to believe older chapters have changed.

[riothamus]

Originally Posted by JimmXinu

Doing updates instead of overwrites will reduce traffic and should work better, unless you have reason to believe older chapters have changed.

This is generally what I do. This time when I tried to update, several stories showed a chapter error in the log so I thought I had to overwrite to fix the errors. I'll try erasing the cache in the browser. I THINK I tried that once early on but I can't remember for sure.

Thanks,
Riothamus

Update, clearing the cache worked. Thanks. And boy, clearing the entire cache sure sped up the download process!

[Chris R.]

Hi I am trying to download with this plugin and I keep getting an Error saying cloudscraper reports:"Detected a Cloudflare version2 Captcha challenge this feature is not available..."

I am using a Dell laptop with a 64 bit windows and 4GB of ram.

I have a question Why can't you just make the Fanficfaredownloader From www.FanfictionDownloader.net that is currently available work with Calibre? I use this all the time with little to no problem.

[Philosophize]

Others seem to be getting the Browser Cache method to work just fine, but I haven't had any luck. I figure I'm doing something wrong, probably something simple, but for the life of me I can't figure out what - especially since JimmXinu's Browser Cache solution isn't all that complicated or difficult.

Here are the relative settings as they currently are, after trying a number of different configurations that have been suggested thus far:

use_basic_cache:true (I've tried setting this to false)
use_cloudscraper:true (Also tried this as false)
use_browser_cache:true
use_browser_cache_only:true

browser_cache_path:/Users/XXX.ssd/Library/Caches/Google/Chrome/Default/Cache
browser_cache_age_limit:-1

I've cleared the browser cache. I've tried manually clicking through each chapter of a story and I've used WebtoEpub.

Every time, the FFF dialog box barely flashes up before I get the message that none of the stories can be updated.

I'm on a Mac, OS 10.15.7

Thanks in advance for any suggestions or ideas that anyone might have. And thanks, also, to JimmXinu for not only making this plugin, but for working so hard to keep it working.

[SilentShadow123]

Hi, I finally got the browser cache feature to work. However, now I'm wondering about how many fanfictions per day or at a time should I be downloading from fanfiction.net so I don't trigger an IP ban or get locked out?

Also, is there a way I can keep track of the number of chapters or pages in the metadata of the fanfics? I want to be able to see the number of chapters in a column on the main screen where there's a list of all the fanfics in the library.

Thanks in advance.

[ownedbycats]

Originally Posted by SilentShadow123

Hi, I finally got the browser cache feature to work. However, now I'm wondering about how many fanfictions per day or at a time should I be downloading from fanfiction.net so I don't trigger an IP ban or get locked out?

If it's fetching from cache properly, it won't hit the site at all. So you don't need to worry about that.

Originally Posted by SilentShadow123

Also, is there a way I can keep track of the number of chapters or pages in the metadata of the fanfics? I want to be able to see the number of chapters in a column on the main screen where there's a list of all the fanfics in the library.

FanFicFare > Configure FanFicFare > Custom Columns. You'll need integer columns for this.

You'll also want to get the Count Pages plugin and set it up in Configure FanFicFare > Count Pages.

[SilentShadow123]

[QUOTE=ownedbycats;4129581]If it's fetching from cache properly, it won't hit the site at all. So you don't need to worry about that.

Yes, it's fetching from cache properly. I tried downloading 3 fanfics from ff.net, and I'm not getting the Cloudflare error anymore. Thank you.

[SilentShadow123]

Actually, I just tried to download from URLs 6 fanfics and now anytime I'm retrying the browser cache feature on ff.net, I'm getting this error:

HTTP Error in FFF 'Page not found or expired in Browser Cache (see FFF setting browser_cache_age_limit)'(428)

Can I please get some help with this and how to fix it?

[ownedbycats]

Try clearing the browser cache, opening the pages again in browser, and retrying. Always works for me. Force-reloading (usually ctrl+F5) may work but I found it less reliable.

If that doesn't work, you can also tweak browser_cache_age_limit in personal.ini. Setting it to -1 will make it use all files, but is extremely slow because it has to check them all.

[kim67255]

I'm trying to get the browser cache feature to work. I can't even find my cache file. I cleared the browser cache. That didn't do anything.

I'm so lost. I've read the directions to do this but it's all above my head. In step 1, it says to find my cache directory but I can't even find that. I have an LG laptop. The directions where for a Mac.

I know enough about Calibre to load my stories/books, add columns ect. I've changed things in the personal ini. But now I'm getting this message when I try to update a story. The message is
Directory does not contain a known browser cache type: 'C:\WINDOWS\system32'

I took out what I put in and I'm still getting the same error.

I know I sound like a moron, but I need help. Several of you have helped in the past and have been very patient with me. Any help would help. Thanks in advance.