View Single Post
Old 09-26-2025, 11:09 AM   #11299
JimmXinu
Plugin Developer
JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.JimmXinu ought to be getting tired of karma fortunes by now.
 
JimmXinu's Avatar
 
Posts: 7,058
Karma: 4604637
Join Date: Dec 2011
Location: Midwest USA
Device: Kobo Clara Colour running KOReader
Quote:
Originally Posted by DevilsReject97 View Post
I wanted to see if you were still thinking about this? Or even an option to check box to keep them? Can't speak for others but I think it would be a huge help.
Already added to test version last month. (There hasn't been a new release since then.)

Quote:
Originally Posted by JimmXinu View Post
When continue_on_chapter_error was added, the use case was for old SB/SV story threads with manually crafted ToC posts that sometimes contained errors.

Today, we're seeing more and more sites that appear to start blocking after some unknown access limit is exceeded.

continue_on_chapter_error is helpful in those cases because you don't discard however many chapters did download before getting blocked. But I suspect that continuing to try each subsequent chapter after blocking starts will increase your blocked time--that's how I implemented it back in the day.

I propose to add a second setting: continue_on_chapter_error_try_limit.

FFF, (with continue_on_chapter_error:true), would record each chapter error and continue to the next chapter, but after continue_on_chapter_error_try_limit failures, would give up and mark all subsequent chapters 'ERROR' without trying to download them.

I'm thinking an appropriate default would be continue_on_chapter_error_try_limit:5

Some details:
  • Why not just leave out the failed / not-tried chapters?
    Because users won't immediately notice missing chapters--I did exactly that while testing that very thing.
  • What happens with updates?
    That's the real power of continue_on_chapter_error in this case; FFF will discard the ERROR message chapters and attempt to download them as if they were newly added. (Including be marked (new) if mark_new_chapters:true.)
    You could, for example, update a story with 1000 chapters once a day and if you get 100 or 200 chapters each time, have the whole thing in a week or so. Previously, we've instructed users to basically do that manually with chapter ranges.
  • What about the original use case? What if there are actually that many bad URLs? How can you ever get the chapters after those?
    You'd need to increase continue_on_chapter_error_try_limit for that story, or use ignore_chapter_url_list.
  • The ERROR chapter title would be the same, but ERROR chapter text for chapters after continue_on_chapter_error_try_limit would have different explanatory text.
  • 'Skipping subsequent chapters without trying' does not apply to later chapters that were already in the epub. Those will still be used.

Opinions?
Quote:
Originally Posted by JimmXinu View Post
New Test Version Posted

2025-08-28
- Add continue_on_chapter_error_try_limit setting (default:5) See this post.
JimmXinu is offline   Reply With Quote