[GUI Plugin] FanFicFare

[Philosophize]

Originally Posted by bigwoof

hope this helps!

Thanks for responding!

It's definitely the right folder. To double-check, I used the command "go to folder," which allows me to type/paste in a folder location. I pasted in exactly what I have in the personal.ini file, and the window I expected opened right up.

And what I'm using is:

/Users/XXX/Library/Caches/Google/Chrome/Default/Cache/

Then I cleared the cache, and the folder emptied except for the index. So, it's gotta be right.

Then I visited a few pages, and several hundred files appeared. All named something like: 0a9dc2241a0a4556_0

Nothing has "data" in the name, if that matters.

So the disc isn't full (which I knew) and Chrome can definitely write there.

Then I clicked through a FFN story. Once again, I got the error:

Browser Cache Failed to Load with error 'Supposed cache entry file did not end with EOF header with correct magic number: '/Users/XXX/Library/Caches/Google/Chrome/Default/Cache/bb7e6cae8e957066_0''

Is it possible that chrome is writing the files incorrectly?? I mean, it sounds like files are being found, but are not formatted in the expected manner?

I opened that file, and it wasn't a FFN cache file. It was something entirely different. I cleared cache again, clicked through the chapters on a story, then tried for a few minutes to find a FFN story cache file, but no luck. Too many files and the largest seemed to reference google ads (likely those served on FFN pages).

I suppose I'll need to try Firefox - if Chrome is doing something wrong or just unexpected, I doubt there is anything I can do to make this work. But I wanted to get this out there in case someone else hits the same problem - I've not see anyone mention this particular error thus far.

Even if I do get Firefox working, I would like to know what's going on here with Chrome. It seems like all of my settings may actually be correct, but perhaps there's something else interfering. But what?

[JimmXinu]

New Test Version Posted

2021-06-15
- Skip Failures to read cache entries for Chrome Simple Cache and Firefox Cache2 instead of error.

There's a couple things going on.

1) FFF has to read all of the cache entries (with age limit) and look at their URL for these cache types. So it's trying to read all of them, even the non-ffnet ones. (As I recall, the 'chromagnon' cache has an index instead.)

2) It's entirely possible that our cobbled together Python code for reading browser caches is buggy in corner cases.

So the low-hanging-fruit answer is to just skip entries that don't load correctly and hope they aren't the ffnet pages.

An extremely similar error, except for Firefox has been reported, too.

[bigwoof]

Originally Posted by Philosophize

Thanks for responding!

It's definitely the right folder. To double-check, I used the command "go to folder," which allows me to type/paste in a folder location. I pasted in exactly what I have in the personal.ini file, and the window I expected opened right up.

Hi! It looks like you are using the right directory. not sure what is going on but Jim just released a test version to only consider FFF cache entries.

You could try the test version or Firefox and see if the issue is solved..

[Philosophize]

Originally Posted by bigwoof

You could try the test version or Firefox and see if the issue is solved..

Well, I get a different error this time:

Browser Cache Failed to Load with error 'name 'traceback' is not defined'

So something has definitely changed, but unfortunately not in a way that makes this work.

I'll tackle Firefox later, but I wanted to get this result posted in case it proves helpful to anyone.

[JimmXinu]

New Test Version Posted

2021-06-16
- Forgot to import traceback in browser cache changes.

Originally Posted by Philosophize

Browser Cache Failed to Load with error 'name 'traceback' is not defined'

My bad. Forgot to import traceback. Since I'm not seeing these errors, I can't test them properly.

This mistake shouldn't have effected anyone who wasn't already having problems.

[Philosophize]

Originally Posted by bigwoof

You could try the test version or Firefox and see if the issue is solved..

Success! I got it to work in Firefox.

Critical is going into Firefox, opening a new tab, and typing "about:cache" in the URL bar. This tells you exactly where the cache files are. I was still having trouble, but once I did that I got the right place and then every worked smoothly.

It's slow, since it's a much more manual process, and I guess I'll have to update fics weekly rather than monthly, but at least it's working.

Next time, I'll try Chrome again with the most recent update.

Thank you!

[ackomb]

It is slow and manual, but at least it allows us to keep up with our libraries.
For which we have to thank Jimm and the people who assisted him in his efforts to make this possible at all. He could have easily thrown the towel into the ring and nixed the possibility for FF-Net all together.

But there are a few helpful add-ons (if you get chrome to work or maybe there are similar add-ons to firefox) that will help.

I personally use "Get Story URL from E-Mail" then copy the URL's to the first add-on "Open Multiple URLs" (don't open too many at once though) then use "Web to EPUB" to thumb through the larger stories (be patient if it stall for a bit, it will continue), and then once finished move forward by pressing OK in Calibre to update your stories.

It's still some manual work, but at least you don't cramp up trying to thumb through a 115 chapter story or during switching back and forth between your mailbox and chrome opening all the hyperlinks in your e-mail manually.

ps. you don't have to actually save the story after using "Web to EPUB".

[ownedbycats]

Note that if you're only updating a story you've had previously downloaded, you don't need to run the entire thing through with the plugin either. I found that most of the time just the first and last chapter will work.

[HowWouldIKnow]

Originally Posted by JimmXinu

Re: titlepage, I cannot duplicate your problem. Maybe you have more than copy of the site section?

Nope, there is only one literotica section
And titlepage_entries is otherwise only available in the default section, which should be overwriten.

[Ascello]

So, can someone shortly explain to me how do I use FFF to get fics from FF.net nowadays? I didn't download any fics recently, so I have no idea how to do it with the new updates.

[ownedbycats]

https://github.com/JimmXinu/FanFicFa...erCacheFeature

[Subtext]

Can anyone here maybe help me please?
No matter the fic, every time I try to update it I get the same error, it just says:

An error has occurred while FanFicFare was updating calibre's metadata for "the fic". The ebook has been updated, but the metadata has not.

Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 1779, in update_books_loop
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 2318, in update_metadata
IndexError: string index out of range

Any idea what I can do to fix this?
Thank you.

[Atherton25]

Alright, I've searched the thread and can't find the answer to my question.

The problem: I've been running into (with much more frequency in the last few months) fanfics that are increasingly large in size due to pictures and almost always PNGs. I've actually had to manually edit some.

An extreme example of one (was on royalroad, now on scribblehub) is Sleeping Princess by Yairy (http://www.scribblehub.com/series/12...ping-princess/) it has hundreds of images some in JPG and many in PNG format... and in fact at last download was over 1200MB... I manually edited the file and changed all the images to JPG and suddenly I'm at 70ish MB.

I had to do this (manually convert the images and edit the HTML) to a few dozen fanfics when I put them on my new Kobo (went from 32gb (kindle) to 8gb on my Kobo) I dont remember all of the fics I modified, so I can't name them all off, but it was semi-frequent and most of them where newer fanfics.

So the question: Is there some sort of mechanism in FFF to auto-convert images to jpg (and possibly reduce large images)? If not, is there a way to do it without converting to mobi and then BACK to epub (which destroys the usability of it with FFF)?

[ownedbycats]

There is, but if I understand the comments right it doesn't work in plugin.

## jpg or png
## -- jpg produces smaller images, and may be supported by more
## readers, but it's older and doesn't allow transparency.
## Transparency removed as if remove_transparency: true
## -- png is newer but does allow transparency, but only in CLI.
## It doesn't work in calibre PI due to limitations of the API.
convert_images_to: jpg

[JimmXinu]

Originally Posted by Subtext

Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 1779, in update_books_loop
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 2318, in update_metadata
IndexError: string index out of range

Any idea what I can do to fix this?

Looking at the code, I suspect you have a custom_columns_settings line that has a comma(,) to indicate a flag but don't actually have a flag value (r, n or a).

Originally Posted by Atherton25

...
So the question: Is there some sort of mechanism in FFF to auto-convert images to jpg (and possibly reduce large images)? If not, is there a way to do it without converting to mobi and then BACK to epub (which destroys the usability of it with FFF)?

Yes, as ownedbycats mentioned:

Originally Posted by ownedbycats

There is, but if I understand the comments right it doesn't work in plugin.

## jpg or png
## -- jpg produces smaller images, and may be supported by more
## readers, but it's older and doesn't allow transparency.
## Transparency removed as if remove_transparency: true
## -- png is newer but does allow transparency, but only in CLI.
## It doesn't work in calibre PI due to limitations of the API.
convert_images_to: jpg

That comment about PI limitations refers to not being able to convert to png. jpg should work.

There's also a image_max_size setting (default: 580, 725) and even grayscale_images for eInk readers.

Search in defaults.ini (there's a button on the personal.ini config tab) for images to see the possible settings and their default values.