Is there Epub cleaning software (so much unneeded code inside) - Page 3

Toxaris · 08-18-2015, 01:42 PM

Quote:

Originally Posted by Nick_1964

Thats the selling company... well, I could mail them and tell them.. but I guess you and I know the answer

Apose is a company that makes a lot of libraries and although I do not have experience with that specific library, I do know how it works. This is not the fault of the library, but the source that was fed into it...

mattmc · 08-19-2015, 10:24 PM

Quote:

Originally Posted by Nick_1964

Dear friends.
When I opened a commercial ebook that I bought (social DRM) I noticed the book is really slow.
So I looked to the code and that was terrible.. no way I can clean this by hand... is there software (I hope free because it is for only one book,until now) or an online tool that can clean it for me ??
Look at the spoiler for a example.
In real..this are only a couple of lines from the book...

Ew.

That's funny, because that markup looks similar to what InDesign produces, in terms of style tags covering everything. I actually already wrote a script that handles this. Specifically, it does this:

Code:

// Start:
<p><span class="123">Hello</span> <span class="123">World</span><span class="123">!</span></p>

// End:
<p><span class="123">Hello World!</span></p>

For example, I took your input and produced this:

Spoiler:

'Ik weet het,' zei Ro zacht. 'Ik heb alles gezien. Ik zat onder de tafel verstopt.

Elena keek hem verbijsterd aan.

'Mijn moeder zei dat ze mij een afkoelperiode wilde geven en dat ik dan wel weer redelijk zou worden. Ze stopte mij in een kamer, maar ik kon ontsnappen. Joxy, mijn privé- bediende heb ik kunnen overhalen en zij verstopte mij onder de trolley die ze naar de grote zaal bracht. Toen ik zag dat daar van alles stond te gebeuren besloot ik mij onder tafel te verbergen. Ik heb alles gezien en nu kom ik je halen. We moeten weg hier. We moeten William en Charlotte bevrijden. Dat… wezen is mijn moeder niet meer!'

Elena knikte en ze schreef opnieuw iets op het papier. 'Wat wil je doen? Samis heeft nu de twee boeken. Alles en iedereen is hier aangepast, gekruist of gemaakt. Greysdale is bewoond door zombies, Utopalta is half vergaan en Willowjinx is weg. Waar moeten we naartoe? Ik kan niets zo!' Elena wees naar haar keel.

'Shit- ja!' zei Ro net iets te hard. Meteen sloeg Elena een hand voor zijn mond.

Ro haalde haar hand weg. 'Sorry,' fluisterde hij. 'Ik weet het niet, maar we moeten iets doen.'

Met tegenzin schudde Elena haar hoofd. Ze pakte het papiertje en schreef verder. 'We hebben alleen het huis in het bos over. Misschien dat de professor ons kan helpen. Aan de Codex Trias hebben we niets. Die is veilig bij Bia en Luxis. Hier kunnen we niet blijven. We moeten William en Charlotte bevrijden en gaan dan naar het bos.'

'Goed plan,' fluisterde Ro.&nbsp;

Elena pakte het papier en gooide het in de open haard. Ro nam haar bij de hand en trok haar door de deur waar hij vandaan was gekomen. Ze kwam in een gelijksoortige kamer als die van haar alleen was het hier een stuk rommeliger.&nbsp;

Because I'm using an XML parsing engine, it does encode the apostrophes, ampersands and such. Is this acceptable?

Nick_1964 · 08-20-2015, 07:36 AM

Quote:

Originally Posted by mattmc

Ew.

That's funny, because that markup looks similar to what InDesign produces, in terms of style tags covering everything. I actually already wrote a script that handles this. Specifically, it does this:

Code:

// Start:
<p><span class="123">Hello</span> <span class="123">World</span><span class="123">!</span></p>

// End:
<p><span class="123">Hello World!</span></p>

For example, I took your input and produced this:

Spoiler:

'Ik weet het,' zei Ro zacht. 'Ik heb alles gezien. Ik zat onder de tafel verstopt.

Elena keek hem verbijsterd aan.

'Mijn moeder zei dat ze mij een afkoelperiode wilde geven en dat ik dan wel weer redelijk zou worden. Ze stopte mij in een kamer, maar ik kon ontsnappen. Joxy, mijn privé- bediende heb ik kunnen overhalen en zij verstopte mij onder de trolley die ze naar de grote zaal bracht. Toen ik zag dat daar van alles stond te gebeuren besloot ik mij onder tafel te verbergen. Ik heb alles gezien en nu kom ik je halen. We moeten weg hier. We moeten William en Charlotte bevrijden. Dat… wezen is mijn moeder niet meer!'

Elena knikte en ze schreef opnieuw iets op het papier. 'Wat wil je doen? Samis heeft nu de twee boeken. Alles en iedereen is hier aangepast, gekruist of gemaakt. Greysdale is bewoond door zombies, Utopalta is half vergaan en Willowjinx is weg. Waar moeten we naartoe? Ik kan niets zo!' Elena wees naar haar keel.

'Shit- ja!' zei Ro net iets te hard. Meteen sloeg Elena een hand voor zijn mond.

Ro haalde haar hand weg. 'Sorry,' fluisterde hij. 'Ik weet het niet, maar we moeten iets doen.'

Met tegenzin schudde Elena haar hoofd. Ze pakte het papiertje en schreef verder. 'We hebben alleen het huis in het bos over. Misschien dat de professor ons kan helpen. Aan de Codex Trias hebben we niets. Die is veilig bij Bia en Luxis. Hier kunnen we niet blijven. We moeten William en Charlotte bevrijden en gaan dan naar het bos.'

'Goed plan,' fluisterde Ro.&nbsp;

Elena pakte het papier en gooide het in de open haard. Ro nam haar bij de hand en trok haar door de deur waar hij vandaan was gekomen. Ze kwam in een gelijksoortige kamer als die van haar alleen was het hier een stuk rommeliger.&nbsp;

Because I'm using an XML parsing engine, it does encode the apostrophes, ampersands and such. Is this acceptable?

It looks 20 times better, but I am on the right way now,and almost cleaned the books, the only problem I have is that it is hard to find where blanc lines (paragraps) have to be inserted.. I was hoping that at least a new paragraph would start with the same "dict code" to detect where one must be before removing everything,but no logics in there..

I am also busy with the regex search, to learn it, the problem is not much sites uses examples from practice.. there are explanations enough but in order to work for me,I must have examples like, insert this, than that happens.. not the dry explanation like enter a # for every single this or that because then I can't see the usage of it,when I can, I also know that I could use that or not.

Sorry for late responding, there is a DDoS attack on my provider for 2 days and internet is a bit difficult to access, I now use Googles DNS servers to bypass the attacked dns servers of my provider..

Turtle91 · 08-20-2015, 08:29 AM

Here are a few regex examples that might help:

Mobileread

There are also some links on the Sigil-Regex help page.

There are also several sources online that may help, such as Regex Buddy.

You just need to make sure you are using the same "flavor" of regex as that used by Sigil... some of the expressions that other types of regex use aren't supported by Sigil.

I hope that helps!
Cheers,

Nick_1964 · 08-20-2015, 08:48 AM

Quote:

Originally Posted by Turtle91

Here are a few regex examples that might help:

Mobileread

There are also some links on the Sigil-Regex help page.

There are also several sources online that may help, such as Regex Buddy.

You just need to make sure you are using the same "flavor" of regex as that used by Sigil... some of the expressions that other types of regex use aren't supported by Sigil.

I hope that helps!
Cheers,

Spock would have said: "Everything that explains something, add it to experience.." or something like that.. I like the Buddy !!

Toxaris · 08-21-2015, 04:57 AM

So, you have Ziggo...

Anyway, if you still have the original, look through the stylesheet if there is a style that has a top-margin. If so, check where that style is used. Big change there is a scene change (white line) there.

Nick_1964 · 08-21-2015, 05:55 AM

Quote:

Originally Posted by Toxaris

So, you have Ziggo...

Anyway, if you still have the original, look through the stylesheet if there is a style that has a top-margin. If so, check where that style is used. Big change there is a scene change (white line) there.

Yes.. 35 times.. and named different in the next html file.. all css rules are in the html, but in the next html they are different, so in one html file it has another name then in the second.
But I am almost finished.. I think the only way to do it properly is read it,at the moment the story changes or change to another persons view, I add a blanc line myself.. so I have to read a chicklit.. for young adults.. wow..

Toxaris · 08-21-2015, 07:27 AM

Quote:

Originally Posted by Nick_1964

I think the only way to do it properly is read it,at the moment the story changes or change to another persons view, I add a blanc line myself.. so I have to read a chicklit.. for young adults.. wow..

Ouch, my condolences...

Nick_1964 · 08-21-2015, 07:28 AM

Quote:

Originally Posted by Toxaris

Ouch, my condolences...

theducks · 08-22-2015, 02:24 PM

To see if a stylsheet class is really unneeded, I simply comment it out, then see if the book(view) got ugly .

Ugly code, is mostly just a waste of space and processing power

Nick_1964 · 08-23-2015, 05:01 AM

Quote:

Originally Posted by theducks

To see if a stylsheet class is really unneeded, I simply comment it out, then see if the book(view) got ugly .

Ugly code, is mostly just a waste of space and processing power

The problem is not the stylesheet, I use the style sheet to see if some of the old layout can be restored,the problem is that there is a between every 3,5 or 5 letters, see the spoiler on the first post..

Tex2002ans · 08-24-2015, 11:16 AM

For cleaning up this type of hideous code, I have personally began using the Calibre Editor with DiapDealer's "Editing Toolbag":

https://www.mobileread.com/forums/sho...d.php?t=251365

This Plugin is more intelligent (can handle hideously nested spans) compared to just a Regex cleanup.

These are the settings I would use:

Click image for larger version

Name: DiapToolbag.png
Views: 19470
Size: 9.9 KB
ID: 141370

Just a single run with the above settings would have cleaned up your initial example to this:

Spoiler:

Then it becomes much easier to focus on reading the code and clean up the rest.

Nick_1964 · 08-24-2015, 11:24 AM

Quote:

Originally Posted by Tex2002ans

For cleaning up this type of hideous code, I have personally began using the Calibre Editor with DiapDealer's "Editing Toolbag":

https://www.mobileread.com/forums/sho...d.php?t=251365

This Plugin is more intelligent (can handle hideously nested spans) compared to just a Regex cleanup.

These are the settings I would use:

Attachment 141370

Just a single run with the above settings would have cleaned up your initial example to this:

Then it becomes much easier to focus on reading the code and clean up the rest.

Very,very usefull, thank you, I like the examples because even when it is not in my language they are easy to recognise.
The second and third book both had the same class where a new alinea must begin so I could easyly save those to keep the layout, the first book just has blanc lines everywhere,also in the middle of paragraps and have hyphens in it so the only solution there was to take out all the code and start all over.
Mailed the publisher but no answer yet.

I bookmarked this topic and will save all answers for future use.
Used "your" tool and example to clean out the rest and the books are now manageble so thanks everyone for helping me out.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Create / Optimize Cbz files for Kobo (software inside)	satsuki_yatoshi	Kobo Reader	20	06-22-2022 04:23 PM
conversion problem? - cleaning up epub	potestus	Calibre	1	05-31-2011 01:28 PM
Stop Automatic Code cleaning in Sigil	ericp20	Sigil	11	05-27-2011 08:52 AM
questions on epub and lrf and cleaning up book	Janette55	Sony Reader	1	03-11-2011 09:25 AM
Unutterably Silly A pug cleaning the inside of your monitor!	Dusty Bottoms	Lounge	4	05-03-2010 10:06 AM

08-20-2015, 08:29 AM	#34
Turtle91 A Hairy Wizard Posts: 3,094 Karma: 18727053 Join Date: Dec 2012 Location: Charleston, SC today Device: iPhone 11/X/6/iPad 1,2,Air & Air Pro/Surface Pro/Kindle PW & Fire	Here are a few regex examples that might help: Mobileread There are also some links on the Sigil-Regex help page. There are also several sources online that may help, such as Regex Buddy. You just need to make sure you are using the same "flavor" of regex as that used by Sigil... some of the expressions that other types of regex use aren't supported by Sigil. I hope that helps! Cheers,

08-21-2015, 04:57 AM	#36
Toxaris Wizard Posts: 4,520 Karma: 121692313 Join Date: Oct 2009 Location: Heemskerk, NL Device: PRS-T1, Kobo Touch, Kobo Aura	So, you have Ziggo... Anyway, if you still have the original, look through the stylesheet if there is a style that has a top-margin. If so, check where that style is used. Big change there is a scene change (white line) there.

08-22-2015, 02:24 PM	#40
theducks Well trained by Cats Posts: 29,795 Karma: 54830978 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	To see if a stylsheet class is really unneeded, I simply comment it out, then see if the book(view) got ugly . Ugly code, is mostly just a waste of space and processing power

Advert

Advert