[GUI Plugin] FanFicFare

[Atherton25]

Originally Posted by ownedbycats

Brain-fog question: I can't seem to locate the option to enable/disable automatically grabbing URLs from the clipboard. Where is it?

Fanficfare > Configure FanFicFare > Basic (Main tab)

Gui Options (right side) first check box is 'Take URL's from Clipboard'
This what you're looking for?

[ownedbycats]

I see it now. Thank you.

[ownedbycats]

Question: Sometimes FFF can't find a cache in page until I clear the browser cache and re-load the page. Why would this occur?

[Atherton25]

Originally Posted by ownedbycats

Question: Sometimes FFF can't find a cache in page until I clear the browser cache and re-load the page. Why would this occur?

I have a problem where (only if a fic has been updated more than once recently) I sometimes have to force a refresh on the first page or it throws a cache error. I load the page and then do Reload (CTRL+R) in chrome before it'll work (sometimes I've had to do it twice). So, while it is finding the cached page, because it's outdated/old cached page, it's not reading the first chapter properly.

...Is this the problem you're having? If not, ignore me, I just saw you're post and there's little info in it and thought that might be the issue.

[JimmXinu]

Recently code was added to warn, but not error when a cache file can't be read. It may be that, you'd have to run debug and watch the logs.

It's possible, even likely, that the code we're using to read the cache files doesn't work in all valid cases.

Without the unreadable files to test with myself, I'm not even going to try and figure it out in anymore detail.

[lia_]

I'm having a bit of a specific problem with the FFF plug-in and I'm hoping I can get some insight.

In short, the plugin is running about twice as slowly after I installed, then uninstalled the newest version of calibre and went back to the version I had been using (4.3.0).

I'm currently trying to download a thousand pages of a fanfic website as it's going offline-- 24 stories per page. I had been running FFF on 4.3.0 and was getting very fast times-- about 45 seconds to get metadata for 24 stories, 1-2 minutes for the job to run in the background, and 10-30 seconds to update my library with 24 books.

For fun, I tried downloading stories from fanfiction.net and the plugin didn't work-- so I thought it was because I was running an old version of calibre, and updated to 5.22.1. However, once I did that, my FFF became MUCH slower. I then uninstalled and reinstalled a number of versions of calibre to try and find the fastest version. After trying probably 7 or 8 different versions of calibre, I ended up uninstalling all of them and going back to 4.3.0

However, now my speeds are about 1.5-2.5 minutes to grab metadata for 24 books, 3-5 minutes for the job to run, and 10-30 seconds to upload to my library. Since I'm trying to download a thousand pages, going from 45 seconds to 2.5 minutes to grab metadata is a huge hassle.

My current theory is that through all my uninstalling and reinstalling I updated the plugin, and for whatever reason the newest version of the plugin is slower at what I'm doing. Is there a way to go back to the previous version of the plugin?

It's also possible that installing and uninstalling so many versions is causing calibre to run slower, but I've defragmented my hard drive, cleaned my disk, checked my calibre library (all suggestions for speeding up calibre in other threads) and none of it has made a difference.

Any insight is appreciated.

[ownedbycats]

Originally Posted by lia_

My current theory is that through all my uninstalling and reinstalling I updated the plugin, and for whatever reason the newest version of the plugin is slower at what I'm doing.

That's intended. There was a bug in earlier versions that essentially doubled the number of worker processes, resulting in parallel downloads that made Cloudflare unhappy. This was changed.

[John Maverick]

Maybe something changed in the page www.novelall.com because it throw the following error when updating or creating a new book for all novels:

'NoneType' object has no attribute 'string'

The error happens with every novel that I have tried. Here are some examples:

https://www.novelall.com/novel/The-King-39-s-Avatar.html
https://www.novelall.com/novel/Nine-Star-Hegemon-Body-Art.html
https://www.novelall.com/novel/Beastmaster-of-the-Ages.html
https://www.novelall.com/novel/Lord-of-the-Oasis.html
https://www.novelall.com/novel/Monster-Factory.html

My setup is the following:
OS: Linux Mint 20.1 x86_64
Calibre version: 5.22
FanFicFare version: v4.3.5

Like always thanks in advance.

[icecold]

Is there a way to ensure that some tags are always added to certain fandoms for ao3 and FFN? For instance I basically want all PMMM Fics to have the tags: Magic, Magical Girl, Female Protagonist, Fantasy.

[ackomb]

Hey guys, so in order to reduce traffic on FF-net I've been running updated only loading first and last chapter using the cache. Figuring that the error "failed chapters, xx total chapters" message would show up in the error column for me to fix later for stories that had multiple chapter updates. But it doesn't show so now I have no clue which stories have failed chapters anymore.

So my first question is, is there a way to figure this out?
My second question is, is there a way to get this error to show up in my error column?

[JimmXinu]

New Test Version Posted

2021-06-27
- adapter_wwwnovelallcom - Updates for site changes. 'translator' no longer available?
- New Site: worldofx.de (German language X-files eFiction)

Zauberlehrling! asked for worldofx.de in PM. Normally I would refer them to this FAQ, but it was a proper fanfiction site and an eFiction site to boot, so I added it.

adapter_wwwnovelallcom - I couldn't find a 'translator' metadata in the dozen or so stories I looked at. If someone can provide an example, I'll add.

worldofx.de - Metadata collection is less than perfect--category and genre are a bit muddled together.

[JimmXinu]

Multi-reply

Originally Posted by lia_

... In short, the plugin is running about twice as slowly after I installed, then uninstalled the newest version of calibre and went back to the version I had been using (4.3.0). ...

Changing versions shouldn't mess anything up, but I can't promise that.

Originally Posted by ownedbycats

That's intended. There was a bug in earlier versions that essentially doubled the number of worker processes, resulting in parallel downloads that made Cloudflare unhappy. This was changed.

Basically this. FFF now runs single-threaded for each site to avoid multiple simultaneous downloads on the same site.

You(lia_) haven't mentioned which site you're slamming, but if it hasn't changed lately, you may be able to use a pre-v4 FFF: https://github.com/JimmXinu/FanFicFare/releases

Originally Posted by icecold

Is there a way to ensure that some tags are always added to certain fandoms for ao3 and FFN? For instance I basically want all PMMM Fics to have the tags: Magic, Magical Girl, Female Protagonist, Fantasy.

Towards the bottom of the ReplaceMetadata wiki page there's a section that explains that, but it was mildly broken and didn't have a title. Now it's better. https://github.com/JimmXinu/FanFicFa...tems-to-a-list

Originally Posted by ackomb

Hey guys, so in order to reduce traffic on FF-net I've been running updated only loading first and last chapter using the cache. Figuring that the error "failed chapters, xx total chapters" message would show up in the error column for me to fix later for stories that had multiple chapter updates. But it doesn't show so now I have no clue which stories have failed chapters anymore.

I'll look into it.

In the meantime, in FFF config under Basic tab, you can choose to have FFF mark books with failed chapters.

EDIT:

When creating a new book, the error message field is not populated on chapter error because FFF doesn't have the calibre book id yet in that part of the code. I might be able to fix that, but I might not want to.

When updating existing books, I do see the error field being populated with the message about missing chapters (when correctly configured).

There's also the 'mark' option mentioned.

Plus (assuming you didn't unclick 'Show this warning again') there's a popup to warn you that some stories had failed chapters on both new and update by URLs and emails.

[chrnno]

Looked for it so perhaps I am missing the obvious(wouldn't be the first time), but is there an option to do image convert to jpg and compress, except for animated gif in which case don't convert?

[JimmXinu]

Originally Posted by chrnno

Looked for it so perhaps I am missing the obvious(wouldn't be the first time), but is there an option to do image convert to jpg and compress, except for animated gif in which case don't convert?

To conditionally convert image but leave animate gifs untouched? No, there isn't.

[chrnno]

Originally Posted by JimmXinu

To conditionally convert image but leave animate gifs untouched? No, there isn't.

Ah so I wasn't being oblivious. Being reducing my library size(png is way too big) and was wondering if there was a convenient way to keep things how I wanted. I guess gif is rare enough I can set conversion to be default and just note when a story does it to temporarily turn it off and manually convert the other images.

Thanks for the answer Jimm.