Heuristic processing

saxondawg · 04-04-2011, 01:39 AM

With heuristic processing, Calibre moves from excellent to scary excellent in document conversion. I realize it's a rather experimental feature, and won't be effective in every situation. But my initial observation is that's it's doing a much better job of detecting things like hard returned blank lines between paragraphs--my pet peeve with e-book files. Calibre has done a pretty good job of catching these for some time, but it seems to be more thorough with heuristic processing. (Note: I had noticed that Calibre was good about eliminating the extra ^p code between paragraphs, but when the ^l (line break, I think) was used, Calibre didn't pick that up--think that may have been fixed).

It's amazing how far Calibre has come in becoming a program that pretty well marks up an e-book document to be anything you want it to be. I can now manage my Kindle collections in Calibre. And I have (accurate enough) page numbers for all my books. These are things Amazon should have provided, and Calibre is filling the gap. I intend to make a donation to the writers of this program, and echo those who have reminded us to do so in another thread. This is one of my favorite programs, and someone deserves to make some money from it.

ldolse · 04-04-2011, 01:58 AM

You're welcome, a lot of the ground work there is mine, but I could never have turned it into a full fledged feature without user_none's help and Kovid's input and patience dealing with a complete neophyte Python programmer.

saxondawg · 04-04-2011, 02:48 PM

Well, you and user_none and Kovid have done a great job. Much appreciated.

theducks · 04-04-2011, 03:02 PM

Moderator Notice
Moved to proper sub-forum

cmcanulty · 01-21-2018, 04:07 PM

Wow what a difference! I mostly read converted pdf books and they were about unusable before. Is there a way to make the heuristic option the default. Thank you

theducks · 01-21-2018, 06:59 PM

What!
The last post was 2011. Necro posting is not encouraged .
Calibre has changed 2 major releases since then.

BetterRed · 01-21-2018, 07:43 PM

Quote:

Originally Posted by cmcanulty

Wow what a difference! I mostly read converted pdf books and they were about unusable before. Is there a way to make the heuristic option the default. Thank you

Yes, by checking the Enable... box in Preferences->Conversion->Common Options->Heuristics

BR

04-04-2011, 01:39 AM	#1
saxondawg Connoisseur Posts: 65 Karma: 50952 Join Date: Mar 2010 Device: kindle paperwhite	Heuristic processing With heuristic processing, Calibre moves from excellent to scary excellent in document conversion. I realize it's a rather experimental feature, and won't be effective in every situation. But my initial observation is that's it's doing a much better job of detecting things like hard returned blank lines between paragraphs--my pet peeve with e-book files. Calibre has done a pretty good job of catching these for some time, but it seems to be more thorough with heuristic processing. (Note: I had noticed that Calibre was good about eliminating the extra ^p code between paragraphs, but when the ^l (line break, I think) was used, Calibre didn't pick that up--think that may have been fixed). It's amazing how far Calibre has come in becoming a program that pretty well marks up an e-book document to be anything you want it to be. I can now manage my Kindle collections in Calibre. And I have (accurate enough) page numbers for all my books. These are things Amazon should have provided, and Calibre is filling the gap. I intend to make a donation to the writers of this program, and echo those who have reminded us to do so in another thread. This is one of my favorite programs, and someone deserves to make some money from it.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Word Processing on the Kindle 3	cow_trix	Amazon Kindle	41	05-17-2011 03:22 AM
Trying to use Textile processing	getajob	Conversion	18	03-09-2011 07:34 AM
Comic File Processing	wonderboy	Other formats	1	08-08-2009 04:17 AM
Image processing using html2epub?	Portnull	Calibre	2	06-03-2009 12:31 PM
Perl processing	alexxxm	Sony Reader	3	11-26-2007 06:13 AM

04-04-2011, 01:58 AM	#2
ldolse Wizard Posts: 1,337 Karma: 123455 Join Date: Apr 2009 Location: Malaysia Device: PRS-650, iPhone	You're welcome, a lot of the ground work there is mine, but I could never have turned it into a full fledged feature without user_none's help and Kovid's input and patience dealing with a complete neophyte Python programmer.

04-04-2011, 02:48 PM	#3
saxondawg Connoisseur Posts: 65 Karma: 50952 Join Date: Mar 2010 Device: kindle paperwhite	Well, you and user_none and Kovid have done a great job. Much appreciated.

04-04-2011, 03:02 PM	#4
theducks Well trained by Cats Posts: 29,792 Karma: 54830978 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	Moderator Notice Moved to proper sub-forum

01-21-2018, 04:07 PM	#5
cmcanulty Junior Member Posts: 9 Karma: 10 Join Date: Mar 2010 Device: none	Wow what a difference! I mostly read converted pdf books and they were about unusable before. Is there a way to make the heuristic option the default. Thank you

01-21-2018, 06:59 PM	#6
theducks Well trained by Cats Posts: 29,792 Karma: 54830978 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	What! The last post was 2011. Necro posting is not encouraged . Calibre has changed 2 major releases since then.