[Conversion Plugin] Language Cleaner (profanity filter)

[jdanders]

Lengthy list of regexes to "clean up" language in books. Works as a profanity filter for Kindle and other ebooks.

Check out the README on Github for full details.
Github: https://github.com/jdanders/calibre-...nguage-cleaner
Latest release: https://github.com/jdanders/calibre-...eleases/latest

I wrote this plugin because I don't like reading vulgar language, but I like reading books with vulgar language in it . Personally I find books much more enjoyable after being processed with this script. Obviously it is a personal set of filters, but I've done my best to make the changes sound as natural as possible, and after using it for years, I think it's pretty good.

The configuration dialog allows you to toggle specific word families (like the f-bomb or religious exclamations) and add your own custom replacements using a built-in table. There is even a live tester so you can check your rules before saving.

LIMITATIONS
Language filtering is never perfect. Words are used in boundless combinations, and sometimes formatting tags inside words can hide them from the filters. It handles AZW3 and EPUB natively. For old-style MOBI files, you'll still want to convert to a newer format (like AZW3) first.

To install:

• Download the latest language_clean_plugin.zip from the GitHub releases page.
• In calibre choose Preferences -> Plugins -> Load plugin from file and select the zip.
• Add the Clean button to your toolbar via Preferences -> Toolbars & Menus.

To use:

• Select one or more books and click the Clean toolbar button.
• Check the button's dropdown for Preview Language Changes to see a color-coded diff of what will be replaced before you commit.
• By default, a backup (ORIG) of your book will be saved, and it can easily be restored.

Secret debug tip: In the config dialog, you can enable "Write change logs to directory". This writes before and after versions of the book as plain text files, which is great for auditing exactly what changed using a tool like WinMerge.

By the way, there is a strong layer of irony here -- if vulgar language offends you, you'll probably want to avoid actually looking in the cleaner.py file, as it is chock full of it

Here's a zip attachment, but it's really better to just go to the github page.

[Bookstooge]

If you are going to create, and maintain, a plugin, an up to date zip file is essential here.

Best of luck.

[theducks]

Originally Posted by jdanders

Here's a zip attachment, but it's really better to just go to the github page.

Calibre scrapes the plugin Index HERE AT MR and serves the plugin from HERE AT MR for automatic Update notifications.

You are not prohibited from hosting elsewhere, just be aware that many folk won't grab remote sources due to security concerns (If there IS a problem with one posted here at MR, We will hear it loudly and take it down fast and post warnings)

[JSWolf]

And the ZIP file needs to be attached to the first post in this thread, not the second.

[theducks]

Originally Posted by JSWolf

And the ZIP file needs to be attached to the first post in this thread, not the second.

Moderator Notice
Fixed that for you

[jdanders]

Thanks for the help!

[jdanders]

I update this a while ago, but it looks like the attachment is out of date still. I don't have enough right to edit the original post, so I'm adding the lastest zip here. Mods, could you fix it again? Maybe one day I'll be able to edit my own thread...

[BetterRed]

Originally Posted by jdanders

I update this a while ago, but it looks like the attachment is out of date still. I don't have enough right to edit the original post, so I'm adding the lastest zip here. Mods, could you fix it again? Maybe one day I'll be able to edit my own thread...

Fixed.

Post some replies in the Lounge until you get edit permission.

It's an anti-spam measure.

BR

[IreneFa]

It's a nice plugin, but what's the issue with God being mentioned at all?

[jdanders]

I'm not sure what you mean. All automated content editing is difficult to do well, and religious words are the hardest because they have "good" and "bad" meanings.

The filter has two modes for the word "God", and the modes are guessed at by the general vulgarity of the entire book. When a vulgar book is detected, all instances of "God" are replaced assuming no one is going to use the word well. Otherwise a more subtle scheme is used.

It's all very easy to change if you don't like the behavior. Instructions are included on the github page.

[jdanders]

See github for instructions on changing filtering behavior if you don't like the default. That's the nice thing about open source!

[jdanders]

Hi, I still don't have permission to edit my post. Here's an updated version of the plugin with one bug fix. Maybe a moderator will be nice enough to update for me

[JimmXinu]

Moderator Notice
Zip updated as requested.