[GUI Plugin] FanFicFare

[JimmXinu]

Originally Posted by jessbbaby34

...
I tried adding new stories today and none of the site-used tags are showing up. And this is from two different sources I checked (Literotica and BDSM Library). I have since tried:
...

Given the sites involved, I assume you're primarily talking about the site-specific metadata entry eroticatags and that you want them Calibre's Tags field.

Try adding add_to_include_subject_tags:,eroticatags in your personal.ini settings under [defaults] like so:

[defaults]
...
add_to_include_subject_tags:,eroticatags

...and update the stories in FFF.

If that doesn't work, send me a PM (site frowns on links to explicit material) with a few story URLs and what metadata exactly from them you want and where you want it.

EDIT: I forgot the ',' in front of eroticatags that is necessary for it to work.

[danmeian]

Quick question:

Is there any way I can set a default answer to the pop-up "This story already exists in the library with a different URL"?

Thanks!

[JimmXinu]

Originally Posted by danmeian

Is there any way I can set a default answer to the pop-up "This story already exists in the library with a different URL"?

You can disable the 'Check for changed Story URL?' option on the FFF config 'Basic' tab, in the Updating Calibre Options section to always change the story URL.

There isn't currently an option to automatically skip or add new in that dialog.

However, if you also disable the 'Search by Title/Author(s) for If Story Already Exists?' option on the FFF config 'Basic' tab, in the Misc Options section, then FFF will only match existing stories by URL, so story URL changing should be reduced if not eliminated.

[Mandabar]

Heya Jimm, again thank you for this amazing software!

So I have a few questions and was hoping for some assists.

Recently I noticed my personal.ini wasn't really updating/removing old sites as they were removed from fff so I did a full personal.ini delete (copy and paste to separate notepad) and copied over the defaults.ini into it. That cleared up some problems. Do wish there was a way to open it up out of settings but it seems to be a settings only openable file, no actual file in explorer?

Pictures in xenforo stories. More and more they won't be scrapped I've noticed. i have one particular work where they are scrapped near the start but not the end. I'm assuming it's a different embed method but it's right annoying. In this story (QQ) they used [IMG] early on, more recently it is still [IMG] which honestly is confusing why it doesn't scrape. It's not an imgur embed which I understand issues coming from that. Then again that's from looking at the bbcode side of things.
I didn't see anything in the xenforo wiki entry so I can't recall if you've stated something on this or had a better scrape method for the differing embed methods. The story in my mind at the moment is unfortunately quite nsfw and on QQ and I'll be avoiding linking it

Another thing, I've been truly thankful for individual story settings. Has saved my ass so much by setting very restritive threadmark scrapping settings and then loosening them on a per story basis. Gosh some stories the sidestory/apochrya are double or more of the actual story. I like it when I hit 100% (or near enough) in my epub, for me to be at the actual end.
The question here though is there a way to set some chapters to be always refreshed, much like `always_reload_first_chapter:true' can do. Been reading a lot of celestial forge stories and they have an updating threadmark in informative usually somewhere where they edit and update the perks gained on an ongoing basis. Would be nice if I could add it as a post that is refresh on updates.
Something like 'reload_on_update:forums.xenforo.com/post/1093284'

Have we figured out why covers keep getting reset from the manually fixed/changed one back to some default? I remember seeing a few posts a while back on here. Default update cover on update is disabled and generate cover only on new books. Not sure what my original settings are here, been testing things so I have no idea haha.

Last (that I can remember at the moment) thing, is there anyway to FORCE a FFF default cover generation even when images are found? The generic text cover works quite well, sometimes better than ugly images/forum art gets scrapped. But I don't want to only use this cover when often there is a worthwhile image scrapped as a nice cover to standout in my library. Perhaps something added to the fanficfare menu?

[JimmXinu]

Originally Posted by Mandabar

Recently I noticed my personal.ini wasn't really updating/removing old sites as they were removed from fff ...

personal.ini is not truly a file in the plugin version, it's a blob in the library DB.

The only time FFF will change your personal.ini is if you clear it completely. Then it will give you a copy of plugin-example.ini. Or, if you create a new library, it will copy all your FFF settings from your previous library.

I do not recommend copying the entirety of defaults.ini. If you copy everything, then if/when I change something in defaults.ini your personal.ini may continue to override it with the old settings. See https://github.com/JimmXinu/FanFicFare/wiki/INI-File for the order of precedence.

Originally Posted by Mandabar

Pictures in xenforo stories.
...
The story in my mind at the moment is unfortunately quite nsfw and on QQ and I'll be avoiding linking it

Without seeing the issue myself, I'm not even going to speculate. There are ways of embedding images that FFF can't handle.

Originally Posted by Mandabar

The question here though is there a way to set some chapters to be always refreshed, much like `always_reload_first_chapter:true' can do.

There is not currently. Something like ignore_chapter_url_list may be possible. Is that something anyone else would like?

Originally Posted by Mandabar

Have we figured out why covers keep getting reset from the manually fixed/changed one back to some default?

Last I recall, I answered it to my satisfaction--or at least, the discussion ended. I don't remember any of the details now, you'll have to read the past posts.

Originally Posted by Mandabar

Last (that I can remember at the moment) thing, is there anyway to FORCE a FFF default cover generation even when images are found?

As I recall, never_make_cover: false and plugin Calibre Cover settings can do that.

## If set, the epub will never have a cover downloaded, even if
## include_images is on and the site has specific cover images.
## However, any existing cover will be kept during EPUB update.  So if
## don't like a story's cover and want to set your own, setting
## never_make_cover:true for that story URL will preserve your custom
## cover.
#never_make_cover: false

I don't care nearly as much about covers as some people, so I don't keep all the details in my head. I'm pretty sure it's been discussed before.

[Mandabar]

Originally Posted by JimmXinu

personal.ini is not truly a file in the plugin version, it's a blob in the library DB.

The only time FFF will change your personal.ini is if you clear it completely. Then it will give you a copy of plugin-example.ini. Or, if you create a new library, it will copy all your FFF settings from your previous library.

I do not recommend copying the entirety of defaults.ini. If you copy everything, then if/when I change something in defaults.ini your personal.ini may continue to override it with the old settings. See https://github.com/JimmXinu/FanFicFare/wiki/INI-File for the order of precedence.

Huh. I think I copied it all over since clearing personal.ini didn't give me a new default copy (ie plugin-example). I might have to give it an another try later

Without seeing the issue myself, I'm not even going to speculate. There are ways of embedding images that FFF can't handle.

I'll have to get back to you on this then.

There is not currently. Something like ignore_chapter_url_list may be possible. Is that something anyone else would like?

Ignore chapter url list? Would that allow you to set a particular post/chapter to be refreshed when new updates occur?

Last I recall, I answered it to my satisfaction--or at least, the discussion ended. I don't remember any of the details now, you'll have to read the past posts.

I'll give it a search and see what I find. I remember at the time I decided to just let it slide, wait and hope it got fixed naturally.

As I recall, never_make_cover: false and plugin Calibre Cover settings can do that.

## If set, the epub will never have a cover downloaded, even if
## include_images is on and the site has specific cover images.
## However, any existing cover will be kept during EPUB update.  So if
## don't like a story's cover and want to set your own, setting
## never_make_cover:true for that story URL will preserve your custom
## cover.
#never_make_cover: false

I don't care nearly as much about covers as some people, so I don't keep all the details in my head. I'm pretty sure it's been discussed before.

Probably, but the size of this thread. It's seen a lot of discussion I'll just say hah! Thanks, I'll just keep kludging along like I've done by deleting all images and forcing an update to generate one before allowing it to scrape the images again.

[culytera]

Originally Posted by Mandabar

Last (that I can remember at the moment) thing, is there anyway to FORCE a FFF default cover generation even when images are found? The generic text cover works quite well, sometimes better than ugly images/forum art gets scrapped. But I don't want to only use this cover when often there is a worthwhile image scrapped as a nice cover to standout in my library. Perhaps something added to the fanficfare menu?

With these settings, they always made the first page as the cover with these when I update or add fics. With the way I've configured the title page using add_to_output_css, titlepage_start, titlepage_end and such, they work quite well as the cover. Readable when viewing on my phone and I can read the summary right from the cover. Then I just change the title page's CSS using Kybook's own stylesheet injection.

[epub]
## include images from img tags in the body and summary of stories.
## Images will be converted to jpg for size if possible.  Images work
## in epub format only.  To get mobi or other format with images,
## download as epub and use Calibre to convert.
include_images:true

## If set, the first image found will be made the cover image.  If
## keep_summary_html is true, any images in summary will be before any
## in chapters.
make_firstimage_cover:false

jpg_quality: 100
## jpg or png
## -- jpg produces smaller images, and may be supported by more
## readers, but it's older and doesn't allow transparency.
## Transparency removed as if remove_transparency: true
## -- png is newer but does allow transparency, but only in CLI.
## It doesn't work in calibre PI due to limitations of the API.
convert_images_to: png

## Remove transparency and fill with background_color if true.
remove_transparency: false

## This switch prevents FanFicFare from doing any processing on the images.
## Usually they would be converted to jpg, resized and optionally made
## grayscale.
no_image_processing: true

And under the Calibre Cover tab in FFF's settings I have Update Calibre Cover (from EPUB) set to Yes, Always. Though I only download fics from AO3 so I'm not sure how other sites handle images.

[Kirtai]

Originally Posted by JimmXinu

Without seeing the issue myself, I'm not even going to speculate. There are ways of embedding images that FFF can't handle.

I've also seen a couple of missed images in a story thread on SpaceBattles here

[kamille3]

FFF does not download Chapters 2 and 3 of this story(mod--link removed). Only Chapter 1 is downloaded. Even adding rest of the chapters (2 and 3) separately as a new book does not work. Can someone take a look as to what's causing this?

Moderator Notice

Do not post links to NSFW content on MobileRead.

[JimmXinu]

kamille3 - I removed your link. You can PM me NSFW links. I use partial links below.

The author has (probably) made a mistake naming/organizing that particular story's chapters. Notice in the author list there is the one-chapter separate story with URL:

• /s/julie-my-fiancee-ch-01

Then there is the 3 chapter story with URLs:

• /s/julie-my-fiancee
• /s/julie-my-fiancee-ch-02
• /s/julie-my-fiancee-ch-03

This probably happened because of Fiancée vs Fiancee.

When you enter story URL /s/julie-my-fiancee, it finds /s/julie-my-fiancee-ch-01 first and creates that as a one chapter story.

When you enter /s/julie-my-fiancee-ch-02, it does initially find the correct story, but then the story URL is normalized to be the first chapter URL(/s/julie-my-fiancee) and when passed to the plugin background job, you're right back where you started.

I hesitate to change FFF's processing for this issue for fear of breaking something else. Given that it appears to be caused by author error, I doubt it's all that common.

And the most recent of these chapters is from 2014, so it's not an on-going problem like it would be for a story with updates everyday.

In the CLI, you can enter /s/julie-my-fiancee-ch-02 (with the full URL, of course) and get the three chapter version due to it being a one-pass process without a separate BG job. The first post in this thread has info on how to run FFF from Calibre as CLI without needing to install Python or anything.

[kamille3]

Thanks got it working

[davidfor]

Originally Posted by JimmXinu

kamille3 - I removed your link. You can PM me NSFW links. I use partial links below.

The author has (probably) made a mistake naming/organizing that particular story's chapters. Notice in the author list there is the one-chapter separate story with URL:

• /s/julie-my-fiancee-ch-01

Then there is the 3 chapter story with URLs:

• /s/julie-my-fiancee
• /s/julie-my-fiancee-ch-02
• /s/julie-my-fiancee-ch-03

This probably happened because of Fiancée vs Fiancee.

When you enter story URL /s/julie-my-fiancee, it finds /s/julie-my-fiancee-ch-01 first and creates that as a one chapter story.

When you enter /s/julie-my-fiancee-ch-02, it does initially find the correct story, but then the story URL is normalized to be the first chapter URL(/s/julie-my-fiancee) and when passed to the plugin background job, you're right back where you started.

I hesitate to change FFF's processing for this issue for fear of breaking something else. Given that it appears to be caused by author error, I doubt it's all that common.

And the most recent of these chapters is from 2014, so it's not an on-going problem like it would be for a story with updates everyday.

In the CLI, you can enter /s/julie-my-fiancee-ch-02 (with the full URL, of course) and get the three chapter version due to it being a one-pass process without a separate BG job. The first post in this thread has info on how to run FFF from Calibre as CLI without needing to install Python or anything.

I did have a quick look at it. The problem is that there is a regex doing the search for the URL in the author page. That doesn't do an exact match and takes the first match. Finding if the story has other chapters is done by looking at one of the parent elements and seeing if it has a particular class. If it does, it gets all the links under that parent. In this case, the current regex finds the solo story first and downloads that.

The fix would be to add a "$" to the end of the regex so that it does an exact match. But, it might break something. There are enough other problems with how the site handles multi-chapter stories, that it probably isn't worth it. But, this might explain one of the problems I have seen. I'll have a play and see.

[HowWouldIKnow]

HI,
how do I update stories where the author deleted the first chapters?

If I am using New Chapters it just says that the epub has more chapters than the story and if I overwrite then the first chapters will be deleted.

RRL

[JimmXinu]

That's basically the way it works.

You can either move the old copy off by removing the story URL (and likely changing the title) to preserve the removed chapters, or split them off into a new book with EpubSplit.

FanFicFare doesn't have any built-in ability to keep additional chapters that aren't in the book as it exists in the source web site.

[HowWouldIKnow]

Wouldn´t it be possible to just check what chapter numbers there are in the epub and which on the site?