MobileRead Forums - View Single Post - Unwrapping hard line breaks across all input formats

kacir · 04-28-2009, 05:24 AM

When I am trying to reformat a plain text book with lots of weird hard breaks I can usually make 99% of work using quick and dirty trick (usually implemented in Vim editor using Regular Expressions.

find <dot><end of paragraph>
find <exclamation point><end of paragraph>
find <question mark><end of paragraph>
find <dot><quote><end of paragraph>
find <exclamation point><quote><end of paragraph>
find <question mark><quote><end of paragraph>
Replace all those things with <what you found>HereIsEndOfParagraph<end of paragraph>

now fiond every line that does not end with HereIsEndOfParagraph<end of paragraph> and join it with the next

" Vim script. Can be easily adapted for sed
" This script can be written in a much more condensed and clever
" way, but this way it is much more understandable
:%substitute/[.]$/\0HereIsEndOfParagraph/
:%substitute/[?]/\0HereIsEndOfParagraph/
:%substitute/[!]/\0HereIsEndOfParagraph/
:%substitute/[.]["]$/\0HereIsEndOfParagraph/
:%substitute/[?]["]/\0HereIsEndOfParagraph/
:%substitute/[!]["]/\0HereIsEndOfParagraph/

:global!/HereIsEndOfParagraph$/join

:%substitute/HereIsEndOfParagraph$//

"end of quick-and-dirty Vim script

04-28-2009, 05:24 AM	#4
kacir Wizard Posts: 3,463 Karma: 10684861 Join Date: May 2006 Device: PocketBook 360, before it was Sony Reader, cassiopeia A-20	When I am trying to reformat a plain text book with lots of weird hard breaks I can usually make 99% of work using quick and dirty trick (usually implemented in Vim editor using Regular Expressions. find <dot><end of paragraph> find <exclamation point><end of paragraph> find <question mark><end of paragraph> find <dot><quote><end of paragraph> find <exclamation point><quote><end of paragraph> find <question mark><quote><end of paragraph> Replace all those things with <what you found>HereIsEndOfParagraph<end of paragraph> now fiond every line that does not end with HereIsEndOfParagraph<end of paragraph> and join it with the next " Vim script. Can be easily adapted for sed " This script can be written in a much more condensed and clever " way, but this way it is much more understandable :%substitute/[.]$/\0HereIsEndOfParagraph/ :%substitute/[?]/\0HereIsEndOfParagraph/ :%substitute/[!]/\0HereIsEndOfParagraph/ :%substitute/[.]["]$/\0HereIsEndOfParagraph/ :%substitute/[?]["]/\0HereIsEndOfParagraph/ :%substitute/[!]["]/\0HereIsEndOfParagraph/ :global!/HereIsEndOfParagraph$/join :%substitute/HereIsEndOfParagraph$// "end of quick-and-dirty Vim script