Plugin for tidying ePub files

[Steadyhands]

Originally Posted by CalibUser

Thanks, Steadyhands.

I will incorporate the code in the next version of the plugin.

Great
[ ]?‘(?i)(\d\d|ad|at|appen[a-z]*|ard|ave|bout|bye|cause|cept|cos|cuz|couse|ere|ea rd|em|er|e|ee|ell|f|fraid|fore|id|ighness|im|is|is self|gainst|kay|less|mongst|n|nd|neath|nough|nothe r|nuff|ood|ome|ow|ope|oney|orse[a-z]*|puter[a-z]*|round|scuse|spect[a-z]*|scaped|sides|tween|specially|t|taint|til|tis|twa s|twere|twould|twill|ud|un|urt)([\p{P}|\s])[/CODE]

Been playing a little more, I've added a couple of others and added [a-z]* to some to catch things like ‘orse ‘orses ‘orseflesh, ‘appen ‘appened, ‘57 ‘88.

[gipsy]

Hi,
can someone help me refine the FixP, FixE, FixW, FixO, FixF for greek letters?
As there are now they made some unnecessary changes. I want the to search and make changes in a whole word (start, middle, end), now sometimes they make changes and if the word is in the dictionary and sometimes and in hyphen words.
I notice the unnecessary changes after i add a (\w*|\s) at the start and end if the

CorrectText("ώ fixes",r"(\w*|\s)(οί\)|νο'\)|α\)|οδ|οό|ιυ|άί|ο5|ο'\)|ιίι|\(ό|ο\)|ίό|ο&gt;|ο'ι|ιό|οί|ιο|οι|&lt;ο|οϊ)(\w*\s)(?![^<>]*>)(?!.*<body[^>]*>)", IsFixO)

in order to get changes in the start-middle-end of the word.

There is any other solution to get the CorrectText to search in the start-middle-end of the word?

Thanks

[CalibUser]

The plugin has been updated in the first post in this thread as follows:

• Plugin now checks for updates on the web and informs you if an update is available.
• Plugin checks more words that are preceded by an apostrophe in the wrong direction eg ‘oney and the case of the word is ignored - with thanks to Steadyhands.
• Some internal code has been simplified.

@Steadyhands:

Originally Posted by Steadyhands

[ ]?‘(?i)(\d\d|ad|at|appen[a-z]*|ard|ave|bout|bye|cause|cept|cos|cuz|couse|ere|ea rd|em|er|e|ee|ell|f|fraid|fore|id|ighness|im|is|is self|gainst|kay|less|mongst|n|nd|neath|nough|nothe r|nuff|ood|ome|ow|ope|oney|orse[a-z]*|puter[a-z]*|round|scuse|spect[a-z]*|scaped|sides|tween|specially|t|taint|til|tis|twa s|twere|twould|twill|ud|un|urt)([\p{P}|\s])

I have modified the end of your code slightly so that it can amend apostrophes that appear in front of words that are followed by punctuation marks, eg, commas and quote marks. For example, the code will now handle:

"We’ll be seeing ‘em, I said to ‘er"

I have replaced ([\p{P}|\s]) in your code with (\W?).

[Steadyhands]

I've been working on the word list and the regex associated with them. The range [a-z]* gives too broad a match and will result in too many false positive returns. I've converted these to repetition matches in greedy mode. i.e. app[yines]{0,5} will match appy and appiness, and e[emr]{0,1} will match e, ee, em, er. Still not 100% perfect but much better then before. There are still issues with false positives for text like ‘At the sound of’ and ‘Is it real’ where you need to lookaround the text and that is the next improvement.

Probably should be stated that this regex works for double curly quote formatted books but not single - and I prefer to step through the file rather than a replace all.

[ ]?‘(?i)(\d\d|ad[n]{0,1}|app[yines]{0,5}|appen[eds]{0,2}|ard[er]{0,2}|arf|alf|ang|as|at|av[ein]{0,3}|bout|bye|cause|cept[ing]{0,3}|copter[s]{0,1}|cos|cross|cuz|couse|e[emr]{0,1}|ell|elp[edling]{0,5}|ere[abouts]{0,5}|eard|f|fraid|fore|id|igh[er]{0,2}|ighness|im|is|isself|gainst|kay|less|mongst| n|nd|neath|nough|nother|nuff|o[o]{0,1}|ood|ome|ow|op[eding]{0,3}|oney|orse[flesh]{0,5}|ouse[ds]{0,1}|pon|puter[edrs]{0,2}|round|scuse[ds]{0,1}|spect[sed]{0,2}|scaped|sides|tween|special[ly]{0,2}|stead|t|taint|til|tis|twas|twere|twould|twil l|ud|un|urt|vise)([\p{P}|\s])

[CalibUser]

Updates to the plugin include:

• the plugin will only run if the version of Sigil used is 9.1 or greater; there is a risk that a bug in Sigil version 0.9.0 will corrupt your eBook so the plugin will only work if the version of Sigil is 9.1 or greater.
  
• an improvement by Steadyhands to the code for words that are preceded by an apostrophe in the wrong direction.

Originally Posted by Steadyhands

Still not 100% perfect but much better then before.

The plugin will never be 100% perfect - unfortunately sometimes judgement is needed to correct the final text; the intention of the plugin was to automatically tidy up common errors in ePub files that had been OCR'd to speed up the process of correcting text and then use manual tweaks to correct any remaining errors.

Originally Posted by Steadyhands

Probably should be stated that this regex works for double curly quote formatted books but not single. There are still issues with false positives for text like ‘At the sound of’ and ‘Is it real’ where you need to lookaround the text and that is the next improvement.

I have ensured that the updated code will run only run if quotes used for speech are not single curly quotes to reduce these types of errors.

Originally Posted by Steadyhands

I prefer to step through the file rather than a replace all.

Some users may wish to copy and paste the code by Steadyhands into the "Find" box in Sigil and do a manual search and replace where the quotes used for speech are single curly quotes. The plugin will do a 'replace all' for ePub books in which quotes used for speech are not single curly quotes.

[Kiruhdu]

Hi folks

Sorry for the maybe silly questions!

Where can I find the manual which the plugin does reference?

Is there a way to process all html|xhtml files in an epub at once?

Thanks in advance!

[Doitsu]

Originally Posted by Kiruhdu

Where can I find the manual which the plugin does reference?

It's attached to the first post as an epub

[Kiruhdu]

Originally Posted by Doitsu

It's attached to the first post as an epub

Thanks a lot man - I've seen it, but didn't realize...

Sorry!

[Kiruhdu]

Hi

I'd have to install a new Win 10 according to a crash of one of my Hds.

Since this I get always I run the tidy-tool the message

Status: success

Cannot import PIL library

Python Laucher Version: 20170227
Published version 2.0.0.5A
Installed version 2.0.0.5A
You have the latest version of this plugin
===========================================
Cannot find the dictionary for your language.
Dictionaries for English (UK), English (USA), French, German and Spanish are installed with Sigil.
If you need a dictionary for a different language please install an appropriate Hunspell dictionary
in the folder hunspell_dictionaries in the Sigil program folder.
===========================================


My Language is German and the dictionaries are installed...

Has anyone an idea what to do?

Much thanks in advance.

[DiapDealer]

As far as the PIL import error; make sure the "Use Bundled Python" checkbox is checked in Preferences->Manage Plugins.

[Doitsu]

Apparently the plugin doesn't check the supported spell-check languages. For example, it offers Greek as a language option, even though no Greek dictionary is installed on my machine.
I.e., even though you can select German from the drop-down list, the plugin might not have found the German dictionaries. (It looks for de_DE.aff and de_DE.dic in the hunspell_dictionaries folder, which exists in both the main Sigil program folder and the Sigil preferences folder.)

a) To display the main Sigil folder right-click the Sigil desktop icon and select Dateipfad öffnen (Open file location).

b) To display the Sigil preferences folder open Sigil, press F5 and and click Ordner Einstellungen öffnen (Open Preferences Location).

Double-check that de_DE.aff and de_DE.dic exist in at least one of the hunspell_dictionaries folders.

[Thasaidon]

Hi

I use ePubtidy a lot but sometimes I get the problem illustrated by the attached image. If you gave time available could you have a look at it please.

[CalibUser]

@Thasaidon

I am not sure what the problem is - please describe the issue. Is it that the names of the included tags go off the scroll box?

[Thasaidon]

Sorry. I should have given more of an explanation.

Basically it is not possible to access all the tags on the right because they go off the screen and I cannot access the 'OK' button

This would not matter if I could access the "OK" button at the bottom of the screen as I could access those tags that are visible and click on "OK". I could then run the plugin again and hopefully the number of tags would have been reduced enough so I can access the rest.

[CalibUser]

@Thasaidon:

I will try to find some time this coming weekend to look at this issue.