Selective binarization and re-encoding program for use with KoReader

[LegeApps]

I am fine with a move but it has a lot to do with KoReader, because standard Kobo software doesn't support DjVu and has issues with JBIG2. So the program is explicitly designed to work with KoReader which supports those formats, and more, well.

And the commit you showed does not do the same thing as my program. it's in the name; it isolates the SMask. Many raster scans aren't masked at all so there is nothing to isolate, that's why they need to be rendered, or the images otherwise extracted. Rendering is faster. It also does not and cannot support layout detection to prevent images from being thresholded.

It is a good feature and I support it but it is not the same thing.

edit - i am implementing this in Lege now. it wasn't possible before i had control of the renderer. internet archive MRC type scans will retain their original text layers. removed some stuff i said about thresholding; this method doesn't threshold at all. it just uses the jbig2 smask layer, clean and easy for a subset of scanned book types (not all).

[LegeApps]

https://drive.google.com/file/d/1-Jy...ew?usp=sharing

That is a book I have been using for testing for the past year..it's an MRC encoded book from Internet Archive. 35 MB but it is JP2/JBIG2 mask. JP2 is an extremely heavy format. it takes 200ms for an optimized decoder on a core i7 to decode. On an e-ink reader, no chance of decoding in under a second. It takes 45 seconds to load the first page on my Kobo Clara BW using the latest version of KoReader.

https://drive.google.com/file/d/1gD7...ew?usp=sharing
This is a DjVu of the same book processed by my program. it's 17mb and only because i used high quality and high resolution output; it could be half as large with the right settings. it opens in under 200ms. page turns in under the same. it is optimized for the device. the device doesn't have to choke on a per page temporary adjustment, taking 30+ seconds each time.

Now do you all see the utility of the program? It is doing something on the desktop that an e-ink reader simply is not designed to do. E-ink readers are designed for text reading, and have to be hacked to handle complex image formats, and they still don't do them well. my program fills all those gaps, especially with the dithering option.

[shuvashish76]

Originally Posted by LegeApps

my renderer that I made with LLMs (I heavily researched and planned everything though).

Would have been better to archive the repo and continue on proprietary releases for future versions.
If anyone interested the last known AGPL code is available at https://github.com/cowvet195/Lege For cases like this requested at https://archive.softwareheritage.org/save/ at-least for this source archive.

ThankYou for your opensource contributions.

Originally Posted by LegeApps

Everything works fast and automatic, unlike ScanTailor et al. Opensource.

If possible edit the original post.

[LegeApps]

Originally Posted by shuvashish76

Would have been better to archive the repo and continue on proprietary releases for future versions.
If anyone interested the last known AGPL code is available at https://github.com/cowvet195/Lege For cases like this requested at https://archive.softwareheritage.org/save/ at-least for this source archive.

ThankYou for your opensource contributions.



If possible edit the original post.

2 people already did this, as you can see you are fork 3. they will likely not work on the project themselves, just saving it for ?? reasons. the sum of the code is the program that does the worthwhile task. there is no utility to the code at all. you're being petty, wanting something for nothing. to feel like you were part of the development?

i don't want to do the work of maintaining opensource code, when there is no reason to do so or benefit. especially since when it was opensource, it still needed the onnx models and other files in order to work correctly, which I still had to provide.

just delete this thread mods. still no new feedback about features or performance, just complaining.

[LegeApps]

Is it recorded anywhere that the layout detection model was a pp-doclayout-L, before i changed it recently to PP-doclayout-M, converted to onnx from pdiparams format with paddle2onnx, then quantized to fp16, then special graph surgery to prune convs that aren't compatible with wgpu? as in the model is COMPLETELY custom. there was no way to just grab the code and compile and you were good to go. you all complain about opensource but don't want to help or understand the amount of work that went into this. kinda foolish and laughable. people telling me about KoReader features that don't even apply.

[LegeApps]

You are all entirely free to fork and preserve the older shittier version of my code!!! and still use the newest release that is actually good and based on feedback from here! There is no reason at all to do the first thing besides being petty!

[shuvashish76]

Originally Posted by LegeApps

2 people already did this, as you can see you are fork 3. they will likely not work on the project themselves, just saving it for ?? reasons....you're being petty, wanting something for nothing. to feel like you were part of the development?

Maybe they want to build something IDK. softwareheritage is bit busy archiving other projects once ready I'll re-submit and delete my fork, that's my only reason.
I'm not a dev and I'm not pretending to be one with AI assisted code.

Originally Posted by LegeApps

i don't want to do the work of maintaining opensource code, when there is no reason to do so or benefit...you all complain about opensource but don't want to help or understand the amount of work that went into this.

Totally up-to your choice and I'm not complaining for being proprietary, it's just bit odd to switch from FOSS model especially as you said:

Originally Posted by LegeApps

"the program still isn't saleable since the kind of people who want to process book scans are generally not the people who want to pay for software. i'm one of them."

Originally Posted by LegeApps

You are all entirely free to fork and preserve the older shittier version of my code!!!

As per the license yes, ThankYou.

[LegeApps]

I don't want to discuss it anymore. i will keep releasing new release versions on github.

the opensource world basically doesn't deserve my renderer. if anyone thinks it's so easy, make it yourself.