Scrambling copyright ebooks to help troubleshoot problems ???

[eschwartz]

Tested on linux, seems to work fine.

Preliminary tests suggest that hyperlinks/footnotes work fine.



I notice that the temp folder (you use one single folder for successive EbookScramble actions) is not being cleaned up. One of the books I tested was a giant comic with lots of sizeable pictures! And the original file appeared in three places...
(And it does get cleaned up when calibre quit. Maybe that's why it took so long to quit.... Maybe it is a limit of calibre's tempfiles handling.)

But cleanup aside, it seems to be working.

...

Haven't tried any SVG images, I'll let you know if I find any.

[BetterRed]

jackie - I have footnoted texts, and I think some of the maps and charts are svg'd. I also have some French and Russian Cyrillic texts. I'll test on Win 10 version 1115 and calibre latest - but at weekend, too hot today, 100 degrees plus in the old money

PS : If I were to use it myself, I would probably use the standalone version rather than the plugin - so I'll give that a workout too.

BR

[jackie_w]

Originally Posted by eschwartz

Tested on linux, seems to work fine.

Preliminary tests suggest that hyperlinks/footnotes work fine.

That's a relief Thanks for finding the time.

Originally Posted by eschwartz

I notice that the temp folder (you use one single folder for successive EbookScramble actions) is not being cleaned up. One of the books I tested was a giant comic with lots of sizeable pictures! And the original file appeared in three places...
(And it does get cleaned up when calibre quit. Maybe that's why it took so long to quit.... Maybe it is a limit of calibre's tempfiles handling.)

But cleanup aside, it seems to be working.

Yes. Calibre appears to create a new Temp directory each time it's opened which gets deleted on closure. I didn't find a clean-up-as-you-go function but that doesn't mean there isn't one. I'll take another look.

Originally Posted by eschwartz

Haven't tried any SVG images, I'll let you know if I find any.

I think RbnJrg is an SVG guru, so hopefully he can help out. I'll shortly have v0.0.3 ready to roll with better SVG processing.

[jackie_w]

Originally Posted by BetterRed

jackie - I have footnoted texts, and I think some of the maps and charts are svg'd. I also have some French and Russian Cyrillic texts. I'll test on Win 10 version 1115 and calibre latest - but at weekend, too hot today, 100 degrees plus in the old money

PS : If I were to use it myself, I would probably use the standalone version rather than the plugin - so I'll give that a workout too.

BR

Thanks, BetterRed - no rush. I'll update to v0.0.3 in post #2 by tomorrow (Friday) latest.

[eschwartz]

Originally Posted by jackie_w

That's a relief Thanks for finding the time.


Yes. Calibre appears to create a new Temp directory each time it's opened which gets deleted on closure. I didn't find a clean-up-as-you-go function but that doesn't mean there isn't one. I'll take another look.

There must be something, because I am pretty sure conversions do just that.

But I think you may be creating one or two extra copies of some data as well, which should probably be optimized.

I had two identical copies of the original book in the main Temp directory, a third copy in format_abspath, and the unpacked version.

Given I have once or twice nearly crashed my computer by accidentally starting to convert dozens (60+) books at a time... because on linux, $TMP is a ramdisk...
I am understandably wary of anything that dumps multiple hundreds of MB into $TMP without actually needing to.

[RbnJrg]

Originally Posted by jackie_w

I think RbnJrg is an SVG guru, so hopefully he can help out. I'll shortly have v0.0.3 ready to roll with better SVG processing.

Of course Jackie, I will test your utility with some of my epubs with svg images. I'll let you know my results.

Rubén

[jackie_w]

Originally Posted by RbnJrg

Of course Jackie, I will test your utility with some of my epubs with svg images. I'll let you know my results.

Rubén

Thanks, Rubén. Please wait until I post v0.0.3.

[RbnJrg]

Originally Posted by jackie_w

Thanks, Rubén. Please wait until I post v0.0.3.

Ok, but I detect some issues with v0.0.2. The new version shouldn't erase anything inside <text> and <tspan> tags inside svg images. I attach two epub; the first one, is the original scrambled; the second one, the scrambled modified by hand (my hand ). The second one IMHO is how the ebook should be finished. Please, watch them.

Regards
Rubén

[jackie_w]

Originally Posted by RbnJrg

Ok, but I detect some issues with v0.0.2. The new version shouldn't erase anything inside <text> and <tspan> tags inside svg images. I attach two epub; the first one, is the original scrambled; the second one, the scrambled modified by hand (my hand ). The second one IMHO is how the ebook should be finished. Please, watch them.

v0.0.3 won't remove any text from svg <text> and <tspan> tags from the html files, it will just scramble it.

I don't want to replace a .svg image with a .png/.jpg/.gif image as that results in more ebook internal code changes than necessary.

At present, each .svg image is physically removed as the safest option, because there's no way of knowing what it contains.

A compromise may be to replace it with a small dummy .svg file. So if you'd like to create one for us ... . I don't think it's necessary to create 3 different ones for epub/azw3/kepub, but perhaps it would be helpful if it contained the words (or graphic representation) 'SVG image' somewhere inside it.

[jackie_w]

I've updated post #2. Comments welcome.

v0.0.3 - beta release Nov 20, 2015

1. Less destructive SVG image handling.
   All xxx.svg image files will be replaced with a dummy .svg.
   SVG image text found in the html files will be scrambled rather than deleted.
2. Cleanup-as-you-go for calibre Temp files when using calibre plugin

@eschwartz, Perhaps you could do the honours with the cleanup changes.

[RbnJrg]

Originally Posted by jackie_w

I've updated post #2. Comments welcome.

v0.0.3 - beta release Nov 20, 2015

1. Less destructive SVG image handling.
   All xxx.svg image files will be replaced with a dummy .svg.
   SVG image text found in the html files will be scrambled rather than deleted.
2. Cleanup-as-you-go for calibre Temp files when using calibre plugin

@eschwartz, Perhaps you could do the honours with the cleanup changes.

Great job!! The svg image managment is perfect; just I would made the following change in your dummy.svg file:

1. Instead of:

<svg id="dummysvg" xmlns="http://www.w3.org/2000/svg" height="60" viewBox="0 0 200 60" width="100" version="1.1">

I would use:

<svg id="dummysvg" xmlns="http://www.w3.org/2000/svg" height="60" viewBox="0 0 200 60" width="200" preserveAspectRatio="none" version="1.1">

Of that way, the svg image will occup the space of the original svg image. (of course, the text "SVG image" will be a bit distorted ) What do you thing?

Again, great job Jackie; congratulations!

Rubén

[jackie_w]

Originally Posted by RbnJrg

Great job!! The svg image managment is perfect; just I would made the following change in your dummy.svg file:

1. Instead of:

<svg id="dummysvg" xmlns="http://www.w3.org/2000/svg" height="60" viewBox="0 0 200 60" width="100" version="1.1">

I would use:

<svg id="dummysvg" xmlns="http://www.w3.org/2000/svg" height="60" viewBox="0 0 200 60" width="200" preserveAspectRatio="none" version="1.1">

Of that way, the svg image will occup the space of the original svg image. (of course, the text "SVG image" will be a bit distorted ) What do you thing?

Thank you

Yes, yours is much better, all the other dummy images may also be distorted according to css values, so no reason for the dummy svg to be different.

I'll change the dummy.svg file and repost now. (The width="100" was a typo error in mine, anyway . It should have been "200"). The preserveAspectRatio="none" is a good idea. Thanks.

[jackie_w]

OK, done. v0.0.3b posted

[RbnJrg]

Originally Posted by jackie_w

OK, done. v0.0.3b posted

Please Jackie, try the following dummy.svg file:

https://rbnjrg.bitrix24.com/~vb2IT

Tell me what you think about to use that image. If you like it, I can build svg images for azw3 and kepub.

Regards
Rubén

[jackie_w]

Originally Posted by RbnJrg

Please Jackie, try the following dummy.svg file:

https://rbnjrg.bitrix24.com/~vb2IT

Tell me what you think about to use that image. If you like it, I can build svg images for azw3 and kepub.

I've tried it. I think I'd like it better if the word 'SVG' was visible somewhere in there. Because SVGs are so different from jpg/gif/png, there may be some value in making it obvious, at-a-glance, which images are SVG and which aren't.

Can you do that?