[GUI Plugin] FanFicFare

[jazzhands]

Well, new pagination would explain why I'm seeing this now.

I appreciate your consideration. Thanks for your reply.

Originally Posted by JimmXinu

I don't recall seeing paginated series on AO3 before.

As a general rule, FFF does not fetch multiple pages with 'Get Story URLs from Web Page' or 'Make Anthology Epub from Web Page'. It's 'Page' singular.

Partly to limit complexity and partly to limit users from deciding to download 100s or 1000s of stories at a time.

However, FFF already has specialized code for series on AO3 (aka OTW), so I will at least consider spinning pages for it.

[JimmXinu]

New Test Version Posted

2024-04-02
- OTW(AO3) Support Paginated Series

Can be given /series/999 URL or one of the ?page=1 URLs, to the same effect. It looks for the highest page number(X) and fetches pages 1-X because OTW pagination doesn't show all pages for larger lists.

[jazzhands]

Thank you! I just tried with the example series from my initial post about this and it worked for me.

Originally Posted by JimmXinu

New Test Version Posted

2024-04-02
- OTW(AO3) Support Paginated Series

Can be given /series/999 URL or one of the ?page=1 URLs, to the same effect. It looks for the highest page number(X) and fetches pages 1-X because OTW pagination doesn't show all pages for larger lists.

[nan1923]

Thanks!

I tried it with one of my example series and one of the 100+ stories series. Both were downloaded correctly
Only thing I noticed is that fetching links and downloading metadata for those paginated series takes longer then before it was paginated.
But the pagination itself should be the reason for that

[JimmXinu]

Yes, having to fetch another page for every... page adds time.

[Ser4nb2LUY6e]

Is there any way to make FFF more resiliant to temporary download errors?

With that I mean, if I'm downloading a 3000 chapter novel which takes half a day, I really don't care if there were 3 chapters that had a timeout or some other error and got skipped on this initial download and just left out.

It should just try again to download the missing chapters when I do an update.

But having the initial download fail after running for half a day and be left with nothing is really annoying.

[ownedbycats]

## Because some adapters can pull chapter URLs from human posts, the
## odds of errors in the chapter URLs can be higher for some
## sites/stories.  You can set continue_on_chapter_error:true to
## continue on after failing to download a chapter and instead record
## an error message in the ebook for that chapter.
continue_on_chapter_error:false

[w4tchdoge]

Originally Posted by JimmXinu

Cover settings are complex and have a wiki page to help explain them.

If you haven't read it yet, please see if that answers any of your questions.

I've re-read that wiki page once you mentioned it and I believe that I should be able to get what I want by adding in generate_cover_settings but since I'm not getting the outcome I'm expecting I can only conclude that I'm doing something wrong here.

My current FanFicFare Calibre Cover settings are as follows, and I have the "Allow generate_cover_settings from personal.ini to override" checked. I'm currently using this SV work for testing as

• it has a cover
• I have a Generate Covers preset for SV works

and I have the following in my personal.ini:

Spoiler:

[https://forums.sufficientvelocity.com/threads/125749/]
#default_cover_image:https://forums.sufficientvelocity.com/data/threadmark-index-icons/h/73/73669.jpg?1702949553
generate_cover_settings:
 ${cover_image} => (specific|first|default) => SufficientVelocity

Unless I'm misinterpreting something in the wiki section about generate_cover_settings, I'd expect Generate Covers to run on this work using the preset I have defined in my personal.ini but it doesn't? Am I doing something wrong/missing something here? Any assistance/clarification is appreciated.

[JimmXinu]

Originally Posted by w4tchdoge

I've re-read that wiki page once you mentioned it and I believe that I should be able to get what I want by adding in generate_cover_settings but since I'm not getting the outcome I'm expecting I can only conclude that I'm doing something wrong here.

Desired Actions

So just to double check, you want:

1. GC run on SV, ignoring story cover images
2. Use story cover images for other sites (RR/etc)
3. Allow for specific individual stories to use cover images on SV

Yes, Always vs Yes, Unless

I think the setting you're misinterpreting is Generate Calibre Cover.

When you have Generate Calibre Cover: Yes, unless FanFicFare found a cover image set, and a cover image is found, all Generate Cover settings, including generate_cover_settings, are ignored.

So if you want generate_cover_settings to be able to override story covers, you have to use Generate Calibre Cover: Yes, Always. Then you arrange things so that no GC setting is set for sites/stories where you do want the cover image.

The wiki section Generate Cover Plugin WITH Story Cover Image and WITHOUT is closest to what you want. Or at least, that's what I referred to.

Solution

The best way to do this depends on what else you have in your personal.ini, but here's one way:

1. Set Generate Calibre Cover: Yes, Always
2. Set generate_cover_settings to use your GC setting for SV
3. Unset generate_cover_settings for specific stories

[forums.sufficientvelocity.com]
# or in [defaults], might be nicer if you want similar for other sites
generate_cover_settings:
 ${publisher}=>sufficientvelocity.com=>SufficientVelocity

[https://forums.sufficientvelocity.com/threads/daughter-of-the-white-moon.96253/]
# clear GC settings for this specific story, use story cover from site
generate_cover_settings:

There are myriad different ways to do the SV part. I chose one that could also be used in [defaults].

This assumes that you do not have GC settings chosen in the GUI either for Default or the specific site in question.

I also assume you have the radio button for Plugin Generate Cover checked (vs Calibre Generate Cover).

I found a different short SV story with a cover image to use as the exception case so that your example will get the GC.

Hope this helps.

[w4tchdoge]

Ah, I see where I messed up now.

I had previously tried Generate Calibre Cover: Yes, Always which did everything I wanted when it came to the XenForo works I had, but it also replaced the author-provided covers for Scribble Hub as I had GC set to generate Scribble Hub covers in the GUI. I had forgotten that I can unset it from the GUI and add it in the ini file as ${cover_image} => ((first)|(default)|(^$)) => ScribbleHub which would keep the author-provided covers but use GC for the default ones.

Thank you for being so helpful and I'm sorry for wasting your time with something this trivial.

[JimmXinu]

No problem. Covers are excessively complicated.

Looking back, you described your problem well the first time, but I didn't have the cycles to parse it then, sorry.

[ChaoticAdventure]

Hey, I have a small troubleshooting issue. Hopefully this is the right place to put this. If not, please redirect me, and I apologize!

I am trying to add a category tag, "TestCat", to every fic I download. So I put it under defaults in my personal.ini like this, alongside the character and ship tags:

[defaults]
extracategories:TestCat
extracharacters:TestChar
extraships:Test/Ship

The (test) characters and ships get added to every fic as they should, and so do the tags I have listed under extratags later on, but for some reason extracategories does not work, no matter what I put in there (I tried lots of test words to see if my replace_metadata or exclude was blocking it, but no dice). Is there a reason anyone might know of that this would be the case?
I thought it might be the custom column I use for categories, but both ships and characters use the same type of custom column (values like tags), and both of them were able to add things no problem.
Thanks in advance.

[JimmXinu]

Originally Posted by ChaoticAdventure

Hey, I have a small troubleshooting issue. Hopefully this is the right place to put this. If not, please redirect me, and I apologize!

You're in the right place, welcome.

The 'extra' settings are used in defaults.ini with many sites to avoid hard-coding category/ship/etc for sites dedicated to a particular fandom/ship/etc. See INI wiki page section on extrametadata.

Without knowing what site you are using, I can only speculate that you are using one of the sites that has an extracategories setting in defaults.ini.

A setting under a specific site section in defaults.ini takes precedence over the same setting under [defaults] in personal.ini. See INI wiki page section on defaults.ini vs personal.ini.

When I try those settings in personal.ini with a site I know doesn't have any extraX settings in defaults.ini, I see them all show up.

I would try using add_to_X:

[defaults]
add_to_extracategories:,TestCat
add_to_extracharacters:,TestChar
add_to_extraships:,Test/Ship

Note the leading comma(,) that is needed for adding to existing lists. See INI wiki page section on add_to_keyword and especially the part about the 'gotcha'.

[ChaoticAdventure]

Originally Posted by JimmXinu

I would try using add_to_X:

[defaults]
add_to_extracategories:,TestCat
add_to_extracharacters:,TestChar
add_to_extraships:,Test/Ship

Note the leading comma(,) that is needed for adding to existing lists. See INI wiki page section on add_to_keyword and especially the part about the 'gotcha'.

Thank you for letting me know about the commas, somehow I missed that when going through the wiki...
Unfortunately using the leading commas and add_to_X didn't change the results. Character and ship added properly, but the category didn't. I went through the defaults.ini and made sure there wasn't anything conflicting in there, too, and there wasn't. (I'm downloading from Ao3 if that makes a difference.)

I'm not really sure why this is...
It's fine, I don't need to be able to do it. It's just a bit odd.

[ChaoticAdventure]

I'd just like to add that I've now found a workaround for the thing I wanted to use add_to_extracategories for.
So I don't need it to work
In case this is a larger problem though: for some reason add_to_extracategories still doesn't work, even if I put it in overrides. That might be to do with custom columns, or something in my replace_metadata, I don't know.
But I've done what I set out to do, so I'm happy. Thanks again for the prompt response and have a great day