Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre

Notices

Reply
 
Thread Tools Search this Thread
Old 11-23-2012, 11:56 PM   #1
freddyzdead
Junior Member
freddyzdead began at the beginning.
 
Posts: 3
Karma: 10
Join Date: Nov 2012
Device: Ainol Novo 7 Elf
Calibre Too CPU Intensive

The trouble is that Calibre is written in Python, possibly the least-efficient "programming "language there is. On my Windows 7 Toshiba laptop, Calibre is using almost 500 MB of RAM. There are 4 Calibre-parallels running and 4 Conhosts as well. This is the biggest piece of bloatware I've ever seen. And all it is doing is loading a few thousand books. It has been going for over an hour now and is just halfway through. So how many days is it going to take it to convert these PDFs into ePubs? Python is for script-kiddies, not serious programming.

Moderator Notice
You posted to a thread over 2 years old. Moved new posts to new thread. Do not resurrect ancient threads.

Last edited by DoctorOhh; 11-24-2012 at 11:14 AM. Reason: Moved posts to own thread
freddyzdead is offline   Reply With Quote
Old 11-24-2012, 12:03 AM   #2
PeterT
Grand Sorcerer
PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.
 
PeterT's Avatar
 
Posts: 12,119
Karma: 73448614
Join Date: Nov 2007
Location: Toronto
Device: Nexus 7, Clara, Touch, Tolino EPOS
Feel free to rewrite it
PeterT is offline   Reply With Quote
Advert
Old 11-24-2012, 12:04 AM   #3
GoSharks
SQUIRREL!!
GoSharks ought to be getting tired of karma fortunes by now.GoSharks ought to be getting tired of karma fortunes by now.GoSharks ought to be getting tired of karma fortunes by now.GoSharks ought to be getting tired of karma fortunes by now.GoSharks ought to be getting tired of karma fortunes by now.GoSharks ought to be getting tired of karma fortunes by now.GoSharks ought to be getting tired of karma fortunes by now.GoSharks ought to be getting tired of karma fortunes by now.GoSharks ought to be getting tired of karma fortunes by now.GoSharks ought to be getting tired of karma fortunes by now.GoSharks ought to be getting tired of karma fortunes by now.
 
GoSharks's Avatar
 
Posts: 1,636
Karma: 8400000
Join Date: Nov 2010
Location: California
Device: K-Fire, PW2, PW3
Quote:
Originally Posted by freddyzdead View Post
The trouble is that Calibre is written in Python, possibly the least-efficient "programming "language there is. On my Windows 7 Toshiba laptop, Calibre is using almost 500 MB of RAM. There are 4 Calibre-parallels running and 4 Conhosts as well. This is the biggest piece of bloatware I've ever seen. And all it is doing is loading a few thousand books. It has been going for over an hour now and is just halfway through. So how many days is it going to take it to convert these PDFs into ePubs? Python is for script-kiddies, not serious programming.
Ummm....so don't use it. By the way, reviving a 2 1/2 year old thread just to troll doesn't exactly raise your credibility. Welcome to the ignore list.
GoSharks is offline   Reply With Quote
Old 11-24-2012, 02:37 AM   #4
cybmole
Wizard
cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.
 
Posts: 3,720
Karma: 1759970
Join Date: Sep 2010
Device: none
Quote:
Originally Posted by PeterT View Post
Feel free to rewrite it
or buy the epub versions
cybmole is offline   Reply With Quote
Old 11-24-2012, 05:02 AM   #5
theducks
Well trained by Cats
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 29,689
Karma: 54369090
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
Quote:
Originally Posted by freddyzdead View Post
The trouble is that Calibre is written in Python, possibly the least-efficient "programming "language there is. On my Windows 7 Toshiba laptop, Calibre is using almost 500 MB of RAM. There are 4 Calibre-parallels running and 4 Conhosts as well. This is the biggest piece of bloatware I've ever seen. And all it is doing is loading a few thousand books. It has been going for over an hour now and is just halfway through. So how many days is it going to take it to convert these PDFs into ePubs? Python is for script-kiddies, not serious programming.
So! 500M? that is 1/6 of the installed RAM that my W7 Toshiba came with.
W7 itself, uses more than 500M

You can READ all those book in A DAY? (IMHO the only reason you would need to convert them all at once. in which case it would have been better to by a device that supported viewing PDF's.)
theducks is offline   Reply With Quote
Advert
Old 11-24-2012, 05:16 AM   #6
HarryT
eBook Enthusiast
HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.
 
HarryT's Avatar
 
Posts: 85,544
Karma: 93383043
Join Date: Nov 2006
Location: UK
Device: Kindle Oasis 2, iPad Pro 10.5", iPhone 6
Why are you using such an ancient version of Calibre?
HarryT is offline   Reply With Quote
Old 11-24-2012, 06:27 AM   #7
cybmole
Wizard
cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.cybmole ought to be getting tired of karma fortunes by now.
 
Posts: 3,720
Karma: 1759970
Join Date: Sep 2010
Device: none
why do folks bother to complain, when the time needed to type in a complaint is greater than the time need to just wait for the conversion to finish.

the conversion will run just as quick, or slow, if you go away & do something useful - as in get-a-life. you don't HAVE to sit & watch it

PS ripping / converting a DVD takes FAR longer than converting a book but I don't see folks moaning about the time needed in their software forums

Last edited by cybmole; 11-24-2012 at 06:31 AM.
cybmole is offline   Reply With Quote
Old 11-24-2012, 11:44 AM   #8
DoctorOhh
US Navy, Retired
DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.
 
DoctorOhh's Avatar
 
Posts: 9,864
Karma: 13806776
Join Date: Feb 2009
Location: North Carolina
Device: Icarus Illumina XL HD, Nexus 7
Quote:
Originally Posted by freddyzdead View Post
It has been going for over an hour now and is just halfway through. So how many days is it going to take it to convert these PDFs into ePubs?
Do the math, an hour... half way through.... hmm... it could take anywhere from two hours to ?? days. Wait until you see the quality of the PDF conversions, they will range from OK to horrible because PDF is a page oriented format and even Adobe has a heck of a time converting PDFs to a reflowable ebook format.

Quote:
Originally Posted by freddyzdead View Post
Python is for script-kiddies, not serious programming.
This statement just shows how your skills and/or imagination are truly limited. The script-kiddie behind this program has managed to make a living off of this program for a number of years and there are currently over 12 million users of calibre. Any way you slice it that is serious programming.

If you ever manage to get calibre working for you...

Good Reading!

Last edited by DoctorOhh; 11-26-2012 at 07:19 PM.
DoctorOhh is offline   Reply With Quote
Old 11-26-2012, 06:16 PM   #9
freddyzdead
Junior Member
freddyzdead began at the beginning.
 
Posts: 3
Karma: 10
Join Date: Nov 2012
Device: Ainol Novo 7 Elf
It's obvious to me that the trouble is that Calibre is written in Python, which is hard to believe, but there it is. Calibre has been converting a bunch of books for a week now. CPU has been stuck on 100% the whole time, it is currently using about 1.2 gigabytes of RAM and the machine is barely able to do web browsing never mind anything serious. Some idiot accused me of trolling, nothing of the sort, I just cannot understand how anybody could have used Python for this, it was never intended for this sort of thing. Apart from the resource-hogging and speed issues, Calibre has destroyed the original directory structure and the books are now sorted by title not author/title.

I would like to know if there is another converter for PDF to ePub that doesn't have these issues?

Last edited by DoctorOhh; 11-26-2012 at 06:47 PM.
freddyzdead is offline   Reply With Quote
Old 11-26-2012, 06:47 PM   #10
DoctorOhh
US Navy, Retired
DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.
 
DoctorOhh's Avatar
 
Posts: 9,864
Karma: 13806776
Join Date: Feb 2009
Location: North Carolina
Device: Icarus Illumina XL HD, Nexus 7
Quote:
Originally Posted by freddyzdead View Post
It's obvious to me that the trouble is that Calibre is written in Python
Moderator Notice
Moved post to existing thread. Stop necro-posting to threads that are 2 years old.

Last edited by DoctorOhh; 11-26-2012 at 07:19 PM.
DoctorOhh is offline   Reply With Quote
Old 11-26-2012, 07:00 PM   #11
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 73,661
Karma: 127838198
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
Quote:
Originally Posted by freddyzdead View Post
I would like to know if there is another converter for PDF to ePub that doesn't have these issues?
Yes, there are other programs that will convert PDF to ePub. But NONE WILL DO IT WITHOUT ERRORS. So why are you bothering? Do do it right, you will then need to A/B compare the PDF to the ePub and it's not worth it. Are these legally obtained PDF?
JSWolf is offline   Reply With Quote
Old 11-26-2012, 07:11 PM   #12
geormes
Groupie
geormes ought to be getting tired of karma fortunes by now.geormes ought to be getting tired of karma fortunes by now.geormes ought to be getting tired of karma fortunes by now.geormes ought to be getting tired of karma fortunes by now.geormes ought to be getting tired of karma fortunes by now.geormes ought to be getting tired of karma fortunes by now.geormes ought to be getting tired of karma fortunes by now.geormes ought to be getting tired of karma fortunes by now.geormes ought to be getting tired of karma fortunes by now.geormes ought to be getting tired of karma fortunes by now.geormes ought to be getting tired of karma fortunes by now.
 
geormes's Avatar
 
Posts: 152
Karma: 216188
Join Date: Jul 2010
Device: Nook Classic, Kobo Touch, Nook Simple Touch, Kobo Aura
Guess you should ask for a refund!
geormes is offline   Reply With Quote
Old 11-26-2012, 07:15 PM   #13
DoctorOhh
US Navy, Retired
DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.
 
DoctorOhh's Avatar
 
Posts: 9,864
Karma: 13806776
Join Date: Feb 2009
Location: North Carolina
Device: Icarus Illumina XL HD, Nexus 7
Quote:
Originally Posted by freddyzdead View Post
It's obvious to me that the trouble is that Calibre is written in Python, which is hard to believe, but there it is.
There are limits to everything, but Python works fine for this application.

Quote:
Originally Posted by freddyzdead View Post
Calibre has been converting a bunch of books for a week now.
Mass converting PDF files is a foolish waste of time. To have a chance at decent PDF conversions you need to review the converted file and adjust conversions settings as needed and do as JSWolf stated an A/B compare between the original and the conversion to make sure it survived as a readable document.

Bottom line PDF conversions are hit and miss because for so many years PDF was strictly a page layout format limited/confined by the size of the page. It was never previously meant to be able to be reflowable to fit different page sizes.

Quote:
Originally Posted by freddyzdead View Post
CPU has been stuck on 100% the whole time, it is currently using about 1.2 gigabytes of RAM and the machine is barely able to do web browsing never mind anything serious.
If you allow calibre full use of your machine it will use it. If you had decided to limit cores (Preferences - Miscellaneous) or job priority (Preferences - Behavior - Job priority -> Low) you could have been using your machine with ease this entire time.

Quote:
Originally Posted by freddyzdead View Post
Some idiot accused me of trolling, nothing of the sort
When you twice resurrect 2 year old threads for the purpose of whining before you even investigate the features built into the program, by definition you are trolling.

Quote:
Originally Posted by freddyzdead View Post
I just cannot understand how anybody could have used Python for this, it was never intended for this sort of thing.
Nothings perfect, but given calibre's success I would say that Python is well suited for this sort of application. The plugin architecture has allowed other developers to expand calibre's capability beyond its core function and the template programming language allows users to do all sort of customization of their library.

Quote:
Originally Posted by freddyzdead View Post
Apart from the resource-hogging and speed issues, Calibre has destroyed the original directory structure and the books are now sorted by title not author/title.
Trolling much? The original directory structure has NOT been altered in the slightest. When books are added to calibre the books are copied to calibre's database so your original files and folders are not touched.

Quote:
Originally Posted by freddyzdead View Post
I would like to know if there is another converter for PDF to ePub that doesn't have these issues?
No program converts PDF well. But you can use Adobe Acrobat to save books as html (even this is far from perfect) then use other programs to convert the html to ePub. Calibre is great at quickly converting html to ePub.

Good Reading.

Last edited by DoctorOhh; 11-26-2012 at 07:27 PM.
DoctorOhh is offline   Reply With Quote
Old 11-26-2012, 09:27 PM   #14
freddyzdead
Junior Member
freddyzdead began at the beginning.
 
Posts: 3
Karma: 10
Join Date: Nov 2012
Device: Ainol Novo 7 Elf
Well, thank you for your patient response and I apologize for bumbling into your forum. I'm using Calibre 0.9.5 btw. Not old. I can't help noticing that I'm not the only one having clogging issues. My Toshiba is not top-of-the-line or anything, but it is dual-core and has 2 GB RAM and I've never had any speed problems. Until Calibre. What I didn't realize before is that when I first noticed the trouble, all it was doing was LOADING the books, not even converting or anything. That's what took 3+ hours. The converting is what's taken days on end.

Up until now, I've regarded Microsoft Office as the pinnacle of inefficient programming. But the only thing that comes close to Calibre is Opera when I've got about 50 tabs open. I try not to do that as it uses huge amounts of memory.

But it's obvious that Python is the problem here; it has an enormous run-time library, that no one ever mentions. It has to execute masses of code just to do even the simplest of tasks. I am old enough to remember when real programs were written in Assembler and a program that actually did useful stuff was less than 64 kilobytes. And that was when programs had to provide their own drivers for video, audio, etc. The trouble started with Basic, which allowed almost anybody to write "programs" just by learning a scripting language. Things only got worse from then on. Now the landscape is littered with compilers and top-heavy runtime modules. Maybe it's Dennis Ritchie's fault, because most of them look a lot like "C". So now we need multi-core processors and gigabytes of RAM to get the same performance we used to get from an 8086 with 640KB. Well, almost.

What I mean is, we've just about lost contact with our roots; even Microsoft has stopped worrying overmuch about backwards compatibility. 64-bit Windows can no longer run 16-bit programs. So what? you might say, but it's important.

Maybe the shift toward mobile computing will slow down the rot.

Actually, Calibre just now finished the conversion and is now idling, for which it is using a mere 90 MB. Good grief.
freddyzdead is offline   Reply With Quote
Old 11-26-2012, 09:37 PM   #15
DoctorOhh
US Navy, Retired
DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.
 
DoctorOhh's Avatar
 
Posts: 9,864
Karma: 13806776
Join Date: Feb 2009
Location: North Carolina
Device: Icarus Illumina XL HD, Nexus 7
Quote:
Originally Posted by freddyzdead View Post
Well, thank you for your patient response and I apologize for bumbling into your forum. I'm using Calibre 0.9.5 btw. Not old.
The comment by HarryT about using an old version was because you resurrected a thread that stated the OP was using calibre version 0.6.24. When this pops up new, folks ask why such an old version. Yet another reason for not resurrecting 2 year old threads. When in doubt start a new thread.
DoctorOhh is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
calibre-0.8.14 Linux ebook-convert cpu run/endless loop? rogerx Conversion 7 09-02-2011 10:56 PM
Calibre overtaxing my CPU mufc Calibre 14 06-25-2011 02:47 PM
Calibre 0.6.50 using 100% cpu sol_barbez Calibre 10 06-14-2010 10:33 PM
is it possible to make calibre just use one CPU? booksonthemove Calibre 1 02-20-2010 04:55 PM
Calibre CPU Usage & German Recipes mutrata Calibre 5 04-13-2009 03:20 PM


All times are GMT -4. The time now is 09:15 AM.


MobileRead.com is a privately owned, operated and funded community.