Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Formats > Workshop

Notices

Reply
 
Thread Tools Search this Thread
Old 05-28-2008, 06:47 PM   #1
brewt
Boo-Frickety-Hoo-Erizer
brewt will become famous soon enoughbrewt will become famous soon enoughbrewt will become famous soon enoughbrewt will become famous soon enoughbrewt will become famous soon enoughbrewt will become famous soon enough
 
brewt's Avatar
 
Posts: 254
Karma: 686
Join Date: Oct 2007
Device: SONY PRS 350!
So, How Big Can They Be?



I'm doing a large-ish Mobi Book conversion using MobiPocket Creator, high compression, no encryption, with 238 html files adding up to, oh I dunno, 109 megs or so (some with photos), a hyper-linked table of contents, MSword-embedded tables of contents on at least some of the 238 html files, only 1 cascading style sheet on 1 of the html files, and (after 4 hours) on the 11th pass of compression, I get this:

Error(prcgen/compress) : dictionary with too many recursions (input too redundant with "ab...yz" patterns with sliding cut probably)

about 93 times before it says:

Info(prcgen): MOBI File could not be generated because of errors!

and a

Build Failed!


Now, I don't think I've got too many bad hyperlinks - 31 of those which are really a result of a bad call from sitemap_creator calling the directory names I've got my html files in as links, that has never really proved to be an issue before on smaller projects...

It did in fact make a .prc file, but the links from the TOC are bad - they go to somewhere close to where I wanted them to, but not quite.


Did I hit the wall?

-bjc
brewt is offline   Reply With Quote
Old 05-29-2008, 03:17 PM   #2
brewt
Boo-Frickety-Hoo-Erizer
brewt will become famous soon enoughbrewt will become famous soon enoughbrewt will become famous soon enoughbrewt will become famous soon enoughbrewt will become famous soon enoughbrewt will become famous soon enough
 
brewt's Avatar
 
Posts: 254
Karma: 686
Join Date: Oct 2007
Device: SONY PRS 350!
I really hate finding answers to my own problems.....

If I use Standard Compression, it all just works.

But the resultant file is also twice as big: 47 megs, as opposed to 23 megs.

Bleah.


-bjc
brewt is offline   Reply With Quote
Old 05-31-2008, 10:34 AM   #3
Ervserver
Wizard
Ervserver ought to be getting tired of karma fortunes by now.Ervserver ought to be getting tired of karma fortunes by now.Ervserver ought to be getting tired of karma fortunes by now.Ervserver ought to be getting tired of karma fortunes by now.Ervserver ought to be getting tired of karma fortunes by now.Ervserver ought to be getting tired of karma fortunes by now.Ervserver ought to be getting tired of karma fortunes by now.Ervserver ought to be getting tired of karma fortunes by now.Ervserver ought to be getting tired of karma fortunes by now.Ervserver ought to be getting tired of karma fortunes by now.Ervserver ought to be getting tired of karma fortunes by now.
 
Ervserver's Avatar
 
Posts: 2,625
Karma: 1008294
Join Date: Dec 2007
Location: Iowa, USA
Device: Nook Simple Touch
them big files eat up memory fast
Ervserver is offline   Reply With Quote
Old 06-01-2008, 07:02 AM   #4
Spellbot 5000
Connoisseur
Spellbot 5000 will become famous soon enoughSpellbot 5000 will become famous soon enoughSpellbot 5000 will become famous soon enoughSpellbot 5000 will become famous soon enoughSpellbot 5000 will become famous soon enoughSpellbot 5000 will become famous soon enoughSpellbot 5000 will become famous soon enough
 
Spellbot 5000's Avatar
 
Posts: 58
Karma: 732
Join Date: May 2008
Device: Cybook Gen3
What exactly are you creating that needs 200+ html files?
Spellbot 5000 is offline   Reply With Quote
Old 06-01-2008, 08:53 AM   #5
JSWolf
Suspended
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
Posts: 35,392
Karma: 16147088
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Sony Reader PRS-650, iPad, nook STR
Are you really sure that high compression will give a 50% savings in the size of the resulting file?
JSWolf is offline   Reply With Quote
Old 06-01-2008, 10:30 AM   #6
pilotbob
Grand Sorcerer
pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.
 
pilotbob's Avatar
 
Posts: 19,424
Karma: 9605542
Join Date: Jan 2007
Location: Tampa, FL USA
Device: Kindle Touch
Quote:
Originally Posted by JSWolf View Post
Are you really sure that high compression will give a 50% savings in the size of the resulting file?
Pure text which is what HTML is compresses very well. In some cases more than 50%.

BOb
pilotbob is offline   Reply With Quote
Old 06-02-2008, 10:20 PM   #7
brewt
Boo-Frickety-Hoo-Erizer
brewt will become famous soon enoughbrewt will become famous soon enoughbrewt will become famous soon enoughbrewt will become famous soon enoughbrewt will become famous soon enoughbrewt will become famous soon enough
 
brewt's Avatar
 
Posts: 254
Karma: 686
Join Date: Oct 2007
Device: SONY PRS 350!
Complete Works of (insert prolific author here) could easily take up 200+ files. And rather than wade through 200 entries in mobi's library, I'm partial to navigating through a table of contents to a book (that has it's own table of contents). When I lose my place, it's easier to get back to where I was.

So there.

The bad prc that the build failed on was down to 23 megs (from the original 109 megs of html files). the good one a middle-compression was at 43 megs. I've seen similar ratios on other projects - this one was the largest I've tried so far.

The real question is: on my Father's Kindle (which I have no direct access to), will something this big work?

-bjc
brewt is offline   Reply With Quote
Old 06-03-2008, 11:39 AM   #8
HarryT
eBook Enthusiast
HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.
 
HarryT's Avatar
 
Posts: 61,021
Karma: 38262005
Join Date: Nov 2006
Location: UK
Device: Kindle PW2, iPad Retina Mini, iPhone 4, MS Surface Pro
No reason why it shouldn't - Mobi files are in 64k "blocks" and only the current block is in memory at any time.
HarryT is offline   Reply With Quote
Old 06-03-2008, 02:08 PM   #9
brewt
Boo-Frickety-Hoo-Erizer
brewt will become famous soon enoughbrewt will become famous soon enoughbrewt will become famous soon enoughbrewt will become famous soon enoughbrewt will become famous soon enoughbrewt will become famous soon enough
 
brewt's Avatar
 
Posts: 254
Karma: 686
Join Date: Oct 2007
Device: SONY PRS 350!
Thanks, Harry, that's encouraging.

Maybe the breakage here didn't happen at the number of pages or megabytes but the number of words - as Mobi allows you to look up any word in any book, it seems that some kind of reference has to be collated into the dictionaries for any given file, and maybe that was the wall I hit.

Speculative Project I won't have time for:

Make a mobi file with several hundred html files, each with only 1 unique word in it, at High Compression. I'm betting that will just work just fine.

Making the Complete Works of all these guys, I'll bet, just won't:

20 Most Prolific Authors and Writers in Literary History

1. MARY FAULKNER (1903-1973) 904 books
2. LAURAN PAINE (b. 1916) 850 + books
3. PRENTISS INGRAHAM (1843-1904) 600 + books
4. JOZEF IGNACY KRASZEWSKI (1812-1887) 600 + books
5. ENID MARY BLYTON (1900?-1968) 600 books
6. JOHN CREASEY (1908-1973) 564 books
7. SUYUTI (1445-1505) 561 books
8. URSULA BLOOM (b. 1898?) 520 + books
9. GEORGES SIMENON (b. 1903) 500 + books
10. HOWARD ROGER GARIS (1873-1962) 500 + books
11. ARTHUR WILLIAM GROOM (1898-1964) 400 + books
11. EDWARD ZANE CARROLL JUDSON (1823-1886) 400 + books
12. EDWARD L. STRATEMEYER (1862-1930) 400 + books
13. BAKIN (1767-1848) 300 + books
14. EVELYN EVERETT GREEN (1856-1932) 300 + books
15. NIGEL MORLAND (b. 1905) 300 + books
17. D. S. ROWLAND (b. 1928) 286 + books
18. BARBARA CARTLAND (b. 1902) 280 ± books
19. ALEXANDRE DUMAS pere (1802-1870) 277 books
20. L. T. MEADE (1854-1914) 258 books


(from http://www.trivia-library.com/c/20-m...ry-history.htm )


Odd, isn't it, that before the ease-of-book-creation era (i.e., now), there were people who seriously writing lots and lots of books, whereas now, well, not so much......


-bjc
brewt is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Hi from Big D bthurman Introduce Yourself 5 01-08-2010 08:13 AM
big hello and big hug dongdongliushui Introduce Yourself 5 07-16-2009 02:44 PM
A BIG thank you Nate0072 Lounge 6 05-15-2009 05:17 AM
What now? and a big Thank You! Lumiens Sony Reader 12 01-12-2009 06:14 PM
HOW BIG IS YOURS ??? mpd123 Reading Recommendations 14 12-22-2008 08:48 PM


All times are GMT -4. The time now is 05:57 PM.


MobileRead.com is a privately owned, operated and funded community.