Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Conversion

Notices

Reply
 
Thread Tools Search this Thread
Old 05-23-2014, 06:55 PM   #1
clintiepoo
Member
clintiepoo began at the beginning.
 
Posts: 19
Karma: 10
Join Date: Feb 2011
Device: kindle
Censorship - How to Censor ebooks

I don't really want to start a discussion about if you should do this - this is up to you. For me, I don't want to read cursing in an ebook. Everybody has their own tolerance level for content, but I've had to get rid of more than one physical book and ebooks alike because of bad language. So, I came up with a solution that works fairly well. This won't take a bad situation out of a book, but it will remove bad language.

Again, this isn't to debate censorship. If I want to scratch words out of my own physical book with a sharpie, that's my choice. I'm doing the same thing here digitally. Use this if you want - I'm sharing it because it might help somebody.

To use this, you have to extract the attached file into a directory where you can find it. Convert your ebook into whatever format you want. Before you hit convert, hit "Search and replace" on the left. Hit "load," and load this file.

This only finds exact matches of the words on the list. Sometimes authors will do things like "woooooow" with curse words. Other times, there are compound curse words and weird stuff that it can't catch either. For me, all the books I'm reading are at least pretty good - this just cleans some scattered language out of them. It won't make a horrible book good, but it will take out the language...

Another note: if you want to add your own word to the list (because this doesn't catch everything), put it in this format at the end of the list (the word you're filtering out is "word":
|\b(W|w)ord\b

-----------------------------

How I did it, if you're interested: I downloaded the mammoth word list, both censored and uncensored, from http://www.litscape.com/word_tools_m..._searches.html. I dumped the lists of 200,000+ words into excel and compared the lists. Uncensored word list - censored word list = "bad words". I had to scrub the list more because some of the terms didn't make sense to me (for example, the word "cracker" could be a racist term for a white person, but I don't want to pull every instance of the word "cracker" out of a book. This wasn't on the list, but that's the idea). After this, I had to do some regex work (again in excel) to catch upper and lower case words. This tool replaces the words with blanks. Calibre is funny with the search and replace, so I had to break the list into 5 different regular expressions to get it to work.
Attached Files
File Type: zip Don't Open Censorship List - Blanks.zip (1.7 KB, 279 views)
clintiepoo is offline   Reply With Quote
Old 05-23-2014, 09:29 PM   #2
meeera
Grand Sorcerer
meeera ought to be getting tired of karma fortunes by now.meeera ought to be getting tired of karma fortunes by now.meeera ought to be getting tired of karma fortunes by now.meeera ought to be getting tired of karma fortunes by now.meeera ought to be getting tired of karma fortunes by now.meeera ought to be getting tired of karma fortunes by now.meeera ought to be getting tired of karma fortunes by now.meeera ought to be getting tired of karma fortunes by now.meeera ought to be getting tired of karma fortunes by now.meeera ought to be getting tired of karma fortunes by now.meeera ought to be getting tired of karma fortunes by now.
 
meeera's Avatar
 
Posts: 5,808
Karma: 68407974
Join Date: Dec 2011
Location: Australia
Device: Kobo Libra 2, iPadMini4, iPad4, MBP; support other Kobo/Kindles
This list, which the "About" describes as "This list is truly the cesspool of the English language", is hilarious. Some of my favourite "cesspool" words:

Bootee
Bloody
Bastardize
Assize
Bohunk
Busty
Commie
Cumquat
Dick
Glans
Hadji
Hell
Hooch
Hussy
Hustler
Kaffir
Lesbos
Moke
Mung
Piker
Pule
Puss
Rigger
Rump
Snowballing
Snigger
Spunk
Tawdry
Tinkle
Wazoo
Damned
Jesus Christ
Asses

So so far we have eviscerated.... cookbooks, gardening books, travel books, books about animals, books about cars, children's fairy tales, books about Islam, Shakespeare, the Bible, horror books & thrillers, medical textbooks, and books by or about anyone who shortens the name "Richard".
meeera is offline   Reply With Quote
Advert
Old 05-24-2014, 08:01 PM   #3
jgaiser
Omnivorous
jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.
 
jgaiser's Avatar
 
Posts: 3,283
Karma: 27978909
Join Date: Feb 2008
Location: Rural NW Oregon
Device: Kindle Voyage, Kindle Fire HD, Kindle 3, KPW1
I think that *anyone* worried about these words needs to quit reading, quit watching television, quit going to movies and probably quit going out in public.

See: Thomas Bowdler
jgaiser is offline   Reply With Quote
Old 05-24-2014, 08:11 PM   #4
DiapDealer
Grand Sorcerer
DiapDealer ought to be getting tired of karma fortunes by now.DiapDealer ought to be getting tired of karma fortunes by now.DiapDealer ought to be getting tired of karma fortunes by now.DiapDealer ought to be getting tired of karma fortunes by now.DiapDealer ought to be getting tired of karma fortunes by now.DiapDealer ought to be getting tired of karma fortunes by now.DiapDealer ought to be getting tired of karma fortunes by now.DiapDealer ought to be getting tired of karma fortunes by now.DiapDealer ought to be getting tired of karma fortunes by now.DiapDealer ought to be getting tired of karma fortunes by now.DiapDealer ought to be getting tired of karma fortunes by now.
 
DiapDealer's Avatar
 
Posts: 28,529
Karma: 204127028
Join Date: Jan 2010
Device: Nexus 7, Kindle Fire HD
Quote:
Originally Posted by clintiepoo View Post
This tool replaces the words with blanks.
Ridiculousness of the venture aside; when you say replace with blanks, do you mean one blank for each word found? If I lost my mind and attempted to do something like this myself, I would certainly use something other than a blank to indicate a word went away. That would make some awkward reading otherwise. Some special combination of characters (XXXX) would make more sense (relatively speaking of course) to me. That way I could more easily anticipate mentally inserting my own shucky-darns on the fly.

And seriously ... assize???

Last edited by DiapDealer; 05-24-2014 at 08:22 PM.
DiapDealer is online now   Reply With Quote
Old 05-24-2014, 08:35 PM   #5
jgaiser
Omnivorous
jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.
 
jgaiser's Avatar
 
Posts: 3,283
Karma: 27978909
Join Date: Feb 2008
Location: Rural NW Oregon
Device: Kindle Voyage, Kindle Fire HD, Kindle 3, KPW1
Quote:
Originally Posted by DiapDealer View Post
And seriously ... assize???
Well it *does* have the ass word as part of it. Can't be too careful.

The whole list is really ridiculous. If you really need to remove the seven dirty words, I guess I can understand. But this list is a bunch of *icky* words and once again you would be better off just not reading modern books.
jgaiser is offline   Reply With Quote
Advert
Old 05-25-2014, 12:43 AM   #6
meeera
Grand Sorcerer
meeera ought to be getting tired of karma fortunes by now.meeera ought to be getting tired of karma fortunes by now.meeera ought to be getting tired of karma fortunes by now.meeera ought to be getting tired of karma fortunes by now.meeera ought to be getting tired of karma fortunes by now.meeera ought to be getting tired of karma fortunes by now.meeera ought to be getting tired of karma fortunes by now.meeera ought to be getting tired of karma fortunes by now.meeera ought to be getting tired of karma fortunes by now.meeera ought to be getting tired of karma fortunes by now.meeera ought to be getting tired of karma fortunes by now.
 
meeera's Avatar
 
Posts: 5,808
Karma: 68407974
Join Date: Dec 2011
Location: Australia
Device: Kobo Libra 2, iPadMini4, iPad4, MBP; support other Kobo/Kindles
*is tempted to share her recipe for cumquat & kaffir lime marmalade...*
meeera is offline   Reply With Quote
Old 05-25-2014, 09:11 AM   #7
Maggie-Me
Zealot
Maggie-Me plays well with othersMaggie-Me plays well with othersMaggie-Me plays well with othersMaggie-Me plays well with othersMaggie-Me plays well with othersMaggie-Me plays well with othersMaggie-Me plays well with othersMaggie-Me plays well with othersMaggie-Me plays well with othersMaggie-Me plays well with othersMaggie-Me plays well with others
 
Maggie-Me's Avatar
 
Posts: 146
Karma: 2594
Join Date: May 2009
Device: Kindle PW,Sony 700, Sony 950 (Daily Edition),Nook Color,iPad
Why not just read religious books or children books? Or does the Bible have curse words?

Serious question, most "great books" published are realistic and will contain words or situations that may offend some people.. but isn't that life?
Maggie-Me is offline   Reply With Quote
Old 05-25-2014, 10:13 AM   #8
kristalana
Groupie
kristalana ought to be getting tired of karma fortunes by now.kristalana ought to be getting tired of karma fortunes by now.kristalana ought to be getting tired of karma fortunes by now.kristalana ought to be getting tired of karma fortunes by now.kristalana ought to be getting tired of karma fortunes by now.kristalana ought to be getting tired of karma fortunes by now.kristalana ought to be getting tired of karma fortunes by now.kristalana ought to be getting tired of karma fortunes by now.kristalana ought to be getting tired of karma fortunes by now.kristalana ought to be getting tired of karma fortunes by now.kristalana ought to be getting tired of karma fortunes by now.
 
kristalana's Avatar
 
Posts: 152
Karma: 1170000
Join Date: Mar 2013
Location: USA
Device: Kindle PW2, Galaxy Tab Pro
Quote:
Originally Posted by Maggie-Me View Post
Why not just read religious books or children books? Or does the Bible have curse words?
The Bible has lots of the words from this list, so I guess that's out too.

Really though, that this even exists is such a bummer to me (whoops I said bum). What a way to approach the world.
kristalana is offline   Reply With Quote
Old 05-25-2014, 10:44 AM   #9
PeterT
Grand Sorcerer
PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.
 
Posts: 13,446
Karma: 78880114
Join Date: Nov 2007
Location: Toronto
Device: Libra H2O, Libra Colour
This is just another version of bowdlerizing, no more, no less, albeit one done with no attempt to preserve meaning.
PeterT is offline   Reply With Quote
Old 05-25-2014, 12:18 PM   #10
alanHd
Addict
alanHd ought to be getting tired of karma fortunes by now.alanHd ought to be getting tired of karma fortunes by now.alanHd ought to be getting tired of karma fortunes by now.alanHd ought to be getting tired of karma fortunes by now.alanHd ought to be getting tired of karma fortunes by now.alanHd ought to be getting tired of karma fortunes by now.alanHd ought to be getting tired of karma fortunes by now.alanHd ought to be getting tired of karma fortunes by now.alanHd ought to be getting tired of karma fortunes by now.alanHd ought to be getting tired of karma fortunes by now.alanHd ought to be getting tired of karma fortunes by now.
 
alanHd's Avatar
 
Posts: 374
Karma: 1408579
Join Date: Jul 2012
Location: UK
Device: Kindle Touch, Ipod Touch, Ipad Air
I hope you don't Mind me censoring your name has you cant have poo.

Each to there own I suppose, for me those words are an integral part of the story and besides whos to tell me what words are good or bad, Words can have different meanings across different cultures, I understand the word Fanny in the USA has a different meaning than here in the UK.
alanHd is offline   Reply With Quote
Old 05-25-2014, 02:09 PM   #11
arjaybe
Wizard
arjaybe ought to be getting tired of karma fortunes by now.arjaybe ought to be getting tired of karma fortunes by now.arjaybe ought to be getting tired of karma fortunes by now.arjaybe ought to be getting tired of karma fortunes by now.arjaybe ought to be getting tired of karma fortunes by now.arjaybe ought to be getting tired of karma fortunes by now.arjaybe ought to be getting tired of karma fortunes by now.arjaybe ought to be getting tired of karma fortunes by now.arjaybe ought to be getting tired of karma fortunes by now.arjaybe ought to be getting tired of karma fortunes by now.arjaybe ought to be getting tired of karma fortunes by now.
 
arjaybe's Avatar
 
Posts: 1,066
Karma: 12500000
Join Date: Aug 2013
Location: Okanagan
Device: Sony PRS-650, Kobo Clara
Let's be fair to clintiepoo. They don't want to censor everyone's books, just offer a way for like-minded people to censor their own books. 'kay? You wouldn't criticize someone for posting a pattern for furniture leg skirts, would you?
arjaybe is offline   Reply With Quote
Old 05-29-2014, 02:19 PM   #12
Achilles
Enthusiast
Achilles began at the beginning.
 
Posts: 27
Karma: 32
Join Date: Aug 2009
Device: Kindle 2
I'd just like to point out that "pollock" is a type of fish and "mung" is a type of bean. That is all.
Achilles is offline   Reply With Quote
Old 06-01-2014, 12:57 AM   #13
user743
Addict
user743 has never been to obedience school.user743 has never been to obedience school.user743 has never been to obedience school.user743 has never been to obedience school.user743 has never been to obedience school.user743 has never been to obedience school.user743 has never been to obedience school.user743 has never been to obedience school.user743 has never been to obedience school.user743 has never been to obedience school.user743 has never been to obedience school.
 
Posts: 243
Karma: 44444
Join Date: Mar 2014
Device: Kindle PW2 special offers removed by Amazon for FREE
Quote:
Originally Posted by kristalana View Post
The Bible has lots of the words from this list, so I guess that's out too.

Really though, that this even exists is such a bummer to me (whoops I said bum). What a way to approach the world.
I dont knew what you're talking about but the only Torah (bible) that exists which was given by go-d isn't even english rather the origanal Hebrew
user743 is offline   Reply With Quote
Old 06-01-2014, 02:11 AM   #14
eschwartz
Ex-Helpdesk Junkie
eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.
 
eschwartz's Avatar
 
Posts: 19,421
Karma: 85400180
Join Date: Nov 2012
Location: The Beaten Path, USA, Roundworld, This Side of Infinity
Device: Kindle Touch fw5.3.7 (Wifi only)
Quote:
Originally Posted by user743 View Post
I dont knew what you're talking about but the only Torah (bible) that exists which was given by go-d isn't even english rather the origanal Hebrew
So now we are censoring the Christian Bible altogether just because it was made up?

It still exists, and is still the Bible (albeit of a different religion) and I am fine with that despite being a very much Traditional Orthodox Jew...

Last edited by eschwartz; 06-01-2014 at 02:16 AM.
eschwartz is offline   Reply With Quote
Old 06-01-2014, 09:18 AM   #15
theducks
Well trained by Cats
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 31,001
Karma: 60358908
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
Hey guys!
You appear to be on the edge of the rules.

Maybe you should take this to the Hardened Debaters (only shows if you opt in)
theducks is offline   Reply With Quote
Reply


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Censorship Mac Carthy Writers' Corner 11 01-26-2012 07:47 AM
Censorship. Lady Fitzgerald Feedback 25 12-01-2010 03:25 PM
Apple pressured Comedy Central to censor Futurama joblack Apple Devices 20 07-06-2010 07:02 PM
Should big firms be allowed to censor news content? Alexander Turcic Lounge 0 01-27-2005 07:40 AM


All times are GMT -4. The time now is 03:29 PM.


MobileRead.com is a privately owned, operated and funded community.