Is there Epub cleaning software (so much unneeded code inside) - Page 2

eschwartz · 08-17-2015, 02:42 PM

I would go through the CSS and delete each useless line there. Anything that is only adding a font, or repetitively setting the line-height, margins, default font-size, etc. can probably be deleted.

Once you have cleaned up the CSS, calibre's CSS cleanup tool (but not Sigil's, IIRC) will delete both unused CSS style rules, and do-nothing CSS styles in the text. Use this, and you will end up with just a bunch of:

Code:

<p><span>lorem ipsum</span> <span>lorem ipsum</span> <span>lorem ipsum</span> <span>lorem ipsum</span></p>

or something close, depending on how many styles you thought might actually be useful.

The final stage will be to use Diapealer's "Diaps Editing Toolbag" plugin for calibre, which has a tool to delete empty span tags (ones which have no style).

Nick_1964 · 08-17-2015, 04:45 PM

Quote:

Originally Posted by eschwartz

I would go through the CSS and delete each useless line there. Anything that is only adding a font, or repetitively setting the line-height, margins, default font-size, etc. can probably be deleted.

Once you have cleaned up the CSS, calibre's CSS cleanup tool (but not Sigil's, IIRC) will delete both unused CSS style rules, and do-nothing CSS styles in the text. Use this, and you will end up with just a bunch of:

Code:

<p><span>lorem ipsum</span> <span>lorem ipsum</span> <span>lorem ipsum</span> <span>lorem ipsum</span></p>

or something close, depending on how many styles you thought might actually be useful.

The final stage will be to use Diapealer's "Diaps Editing Toolbag" plugin for calibre, which has a tool to delete empty span tags (ones which have no style).

Nothing is in the css it is all in the html files itself.. each html has the class rules in it,and they are not the same in every html.
So a class or paragraph have not the same value in the next html, so it isn't that you can delete all of a certain class in all html files because in the next one it has other values..

eschwartz · 08-17-2015, 05:07 PM

Inline CSS is still CSS.

I am pretty sure calibre is smart enough to find those rules as well.

Thus my suggestion remains valid.

Terisa de morgan · 08-17-2015, 05:23 PM

I don't use sigil but calibre editor, and you can clean something like that easily with diapdealer's plugin, removing all span/class/dict-007 (no regex needed, and it cares of beginning and end of span tag.

eschwartz · 08-17-2015, 05:47 PM

Terisa -- I know Diap's plugin can handle removing styled spans too, but I would personally prefer double-checking all styles before bulldozing over them.

PeterT · 08-17-2015, 06:02 PM

I'd almost suggest returning the original epub to whence it came and buying a better version. It sounds like it's been through a lot PDF to epub conversion.

eschwartz · 08-17-2015, 06:17 PM

Who says there is a better version somewhere else?

JSWolf · 08-17-2015, 07:06 PM

Quote:

Originally Posted by Nick_1964

Dear friends.
When I opened a commercial ebook that I bought (social DRM) I noticed the book is really slow.
So I looked to the code and that was terrible.. no way I can clean this by hand... is there software (I hope free because it is for only one book,until now) or an online tool that can clean it for me ??
Look at the spoiler for a example.
In real..this are only a couple of lines from the book...

Spoiler:

'Ik weet het,' zei Ro zacht. 'Ik heb alles gezien. Ik zat onder de tafel verstopt.

Elena keek hem verbijsterd aan.

'Mijn moeder zei dat ze mij een afkoelperiode wilde geven en dat ik dan wel weer redelijk zou worden. Ze stopte mij in een kamer, maar ik kon ontsnappen. Joxy, mijn privé- bediende heb ik kunnen overhalen en zij verstopte mij onder de trolley die ze naar de grote zaal bracht. Toen ik zag dat daar van alles stond te gebeuren besloot ik mij onder tafel te verbergen. Ik heb alles gezien en nu kom ik je halen. We moeten weg hier. We moeten William en Charlotte bevrijden. Dat… wezen is mijn moeder niet meer!'

Elena knikte en ze schreef opnieuw iets op het papier. 'Wat wil je doen? Samis heeft nu de twee boeken. Alles en iedereen is hier aangepast, gekruist of gemaakt. Greysdale is bewoond door zombies, Utopalta is half vergaan en Willowjinx is weg. Waar moeten we naartoe? Ik kan niets zo!' Elena wees naar haar keel.

'Shit- ja!' zei Ro net iets te hard. Meteen sloeg Elena een hand voor zijn mond.

Ro haalde haar hand weg. 'Sorry,' fluisterde hij. 'Ik weet het niet, maar we moeten iets doen.'

Met tegenzin schudde Elena haar hoofd. Ze pakte het papiertje en schreef verder. 'We hebben alleen het huis in het bos over. Misschien dat de professor ons kan helpen. Aan de Codex Trias hebben we niets. Die is veilig bij Bia en Luxis. Hier kunnen we niet blijven. We moeten William en Charlotte bevrijden en gaan dan naar het bos.'

'Goed plan,' fluisterde Ro. 

Elena pakte het papier en gooide het in de open haard. Ro nam haar bij de hand en trok haar door de deur waar hij vandaan was gekomen. Ze kwam in een gelijksoortige kamer als die van haar alleen was het hier een stuk rommeliger.

If you want to get rid of all those then what you do is replace with and use the Modify ePub plugin (Calibre) to remove all of those empty spans.

Toxaris · 08-18-2015, 02:50 AM

Quote:

Originally Posted by dickloraine

Is it a novel? If so, maybe use calibre to conver it to for example txt with markdown and then back to epub. Or convert it to docx and use toxaris word add-in. Good luck, it really looks terrible.

The add-in can actually import an ePUB directly. No need to convert it first.

Nick_1964 · 08-18-2015, 05:29 AM

Quote:

Originally Posted by PeterT

I'd almost suggest returning the original epub to whence it came and buying a better version. It sounds like it's been through a lot PDF to epub conversion.

Found this inside:
/* Styles for document saved to a stream */
/* Generated by Aspose.Words for Java 11.11.0.0 */

So I know it is made by that Aspose.

*All other, I will try the suggestions for sure but until now the new version of Sigil (0.8.7.) does do a lot.
It is almost clean,but now left with a lot of blanc lines.
A lot of the (from 000 till 972) contains margins like margin:12pt 0pt 3pt 5.5pt; but they are renumbered in every html so removing the values of margin:12pt 0pt 3pt 5.5pt; does help but also destroy whitespaces where they do belong.
So I am now trying to find html for html if there is one "dclt" that stands for a true paragraph so I can at least replace them for a to maintain the real paragraphs,before removing them all.
If I remove all code for .css, rather in the html of as separate file, there is no way I can find and keep some of the original page lay-out.

For now the first part of the suggestion made by rubeus to use the search and replace with worked the most, then the auto repair of Sigil did the rest. Only there are now more then 100 different values for 

As far as I know there is no "warranty" for an epub,it is coming from a small publisher, I can't ask a webshop "i want to buy this book,but can I see the code first" so if I buy it somewhere else it is no guarantee that I don't get exactly the same one.
For sure I want to try the plugin suggestions and cleanup but the internal editor works more different then the Sigil and I am used to that.
I do gonna use it but I try with Sigil first rather then to learn to use another editor.
Once I cleaned with Sigil I gonna import the "damaged" books into Calibre and start again there to see if it produces beter and work faster, so I do gonna use all the given options,because then I can learn it for future use.

*But I want to ask you kindly, for someone with my type of dislection, using 2 editors next to each other or learn to work with a new one is not so easy, that is why I use only one filemanager (Total commander) one mail program, one usenet program because if I am not i am overwhelmed by the new look and my brain will reset

and I have only one year english lessons so sometimes I need a bit more then a oneliner,have some patient with me.
At the end, I could do 2 things,delete the books and say sorry to the girl,or give it to someone that will do it for me,but then..I will not learn.

MikeB1972 · 08-18-2015, 05:34 AM

Quote:

Originally Posted by Nick_1964

Found this inside:
/* Styles for document saved to a stream */
/* Generated by Aspose.Words for Java 11.11.0.0 */

So I know it is made by that Aspose.

That's what Phoenix Pick used to use.
Do an epub to epub conversion in calibre on the original epub, then clean up in sigil if you want (After the calibre conversion the book can be read at a reasonable speed in an ereader IIRC).

rubeus · 08-18-2015, 09:27 AM

The latest Sigil Version 087 still has the tidy option available.

Nick_1964 · 08-18-2015, 09:40 AM

Quote:

Originally Posted by rubeus

The latest Sigil Version 087 still has the tidy option available.

Not in tools... then they have hide it somewhere else,renamed it or it is lost with the translation.. It was always in the tools section..
The old way to use it, control-d, now results in a delete..

Toxaris · 08-18-2015, 10:16 AM

Quote:

Originally Posted by MikeB1972

That's what Phoenix Pick used to use.
Do an epub to epub conversion in calibre on the original epub, then clean up in sigil if you want (After the calibre conversion the book can be read at a reasonable speed in an ereader IIRC).

Euw... An ePUB to ePUB conversion? Lets make the mess bigger...

Quote:

Originally Posted by Nick_1964

Not in tools... then they have hide it somewhere else,renamed it or it is lost with the translation.. It was always in the tools section..
The old way to use it, control-d, now results in a delete..

Anyway, the source of this book is a Word document that is converted to an ePUB via a Java program someone created and they used the Apose library to read/convert the Word document. The mess you see is not because of the conversion itself. This is a classic GIGO example and people who do not know how to use Word as it should....

Now, for Tidy in Sigil. Although I do not recommend it and advise to use extreme caution, it is still there, but not as 'standalone'.

Edit --> Preferences --> Clean Source --> HTML Tidy.

Again, use it at your own peril...

Nick_1964 · 08-18-2015, 12:59 PM

Quote:

Originally Posted by Toxaris

Euw... An ePUB to ePUB conversion? Lets make the mess bigger...

Anyway, the source of this book is a Word document that is converted to an ePUB via a Java program someone created and they used the Apose library to read/convert the Word document. The mess you see is not because of the conversion itself. This is a classic GIGO example and people who do not know how to use Word as it should....

Thats the selling company... well, I could mail them and tell them.. but I guess you and I know the answer

Quote:

Now, for Tidy in Sigil. Although I do not recommend it and advise to use extreme caution, it is still there, but not as 'standalone'.

Edit --> Preferences --> Clean Source --> HTML Tidy.

Again, use it at your own peril...

As I thought.. it dissapeared in the translation.. I think it must be the "html op orde brengen" option..
See Attachments. No wonder I could not find it... (if it is the right option..)
Thank you for pointing it out,or we would end in oneliners again

08-17-2015, 02:42 PM	#16
eschwartz Ex-Helpdesk Junkie Posts: 19,421 Karma: 85397180 Join Date: Nov 2012 Location: The Beaten Path, USA, Roundworld, This Side of Infinity Device: Kindle Touch fw5.3.7 (Wifi only)	I would go through the CSS and delete each useless line there. Anything that is only adding a font, or repetitively setting the line-height, margins, default font-size, etc. can probably be deleted. Once you have cleaned up the CSS, calibre's CSS cleanup tool (but not Sigil's, IIRC) will delete both unused CSS style rules, and do-nothing CSS styles in the text. Use this, and you will end up with just a bunch of: Code: <p><span>lorem ipsum</span> <span>lorem ipsum</span> <span>lorem ipsum</span> <span>lorem ipsum</span></p> or something close, depending on how many styles you thought might actually be useful. The final stage will be to use Diapealer's "Diaps Editing Toolbag" plugin for calibre, which has a tool to delete empty span tags (ones which have no style). Last edited by eschwartz; 08-17-2015 at 02:45 PM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Create / Optimize Cbz files for Kobo (software inside)	satsuki_yatoshi	Kobo Reader	20	06-22-2022 04:23 PM
conversion problem? - cleaning up epub	potestus	Calibre	1	05-31-2011 01:28 PM
Stop Automatic Code cleaning in Sigil	ericp20	Sigil	11	05-27-2011 08:52 AM
questions on epub and lrf and cleaning up book	Janette55	Sony Reader	1	03-11-2011 09:25 AM
Unutterably Silly A pug cleaning the inside of your monitor!	Dusty Bottoms	Lounge	4	05-03-2010 10:06 AM

08-17-2015, 05:07 PM	#18
eschwartz Ex-Helpdesk Junkie Posts: 19,421 Karma: 85397180 Join Date: Nov 2012 Location: The Beaten Path, USA, Roundworld, This Side of Infinity Device: Kindle Touch fw5.3.7 (Wifi only)	Inline CSS is still CSS. I am pretty sure calibre is smart enough to find those rules as well. Thus my suggestion remains valid.

08-17-2015, 05:23 PM	#19
Terisa de morgan Grand Sorcerer Posts: 6,248 Karma: 11768331 Join Date: Jun 2009 Location: Madrid, Spain Device: Kobo Clara/Aura One/Forma,XiaoMI 5, iPad, Huawei MediaPad, YotaPhone 2	I don't use sigil but calibre editor, and you can clean something like that easily with diapdealer's plugin, removing all span/class/dict-007 (no regex needed, and it cares of beginning and end of span tag.

08-17-2015, 05:47 PM	#20
eschwartz Ex-Helpdesk Junkie Posts: 19,421 Karma: 85397180 Join Date: Nov 2012 Location: The Beaten Path, USA, Roundworld, This Side of Infinity Device: Kindle Touch fw5.3.7 (Wifi only)	Terisa -- I know Diap's plugin can handle removing styled spans too, but I would personally prefer double-checking all styles before bulldozing over them.

08-17-2015, 06:02 PM	#21
PeterT Grand Sorcerer Posts: 12,203 Karma: 73448616 Join Date: Nov 2007 Location: Toronto Device: Nexus 7, Clara, Touch, Tolino EPOS	I'd almost suggest returning the original epub to whence it came and buying a better version. It sounds like it's been through a lot PDF to epub conversion.

08-17-2015, 06:17 PM	#22
eschwartz Ex-Helpdesk Junkie Posts: 19,421 Karma: 85397180 Join Date: Nov 2012 Location: The Beaten Path, USA, Roundworld, This Side of Infinity Device: Kindle Touch fw5.3.7 (Wifi only)	Who says there is a better version somewhere else?

08-18-2015, 09:27 AM	#27
rubeus Banned Posts: 272 Karma: 1224588 Join Date: Sep 2014 Device: Sony PRS 650	The latest Sigil Version 087 still has the tidy option available.

Advert

Advert