Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Library Management

Notices

Reply
 
Thread Tools Search this Thread
Old 02-11-2013, 11:12 AM   #1
enitro
Enthusiast
enitro began at the beginning.
 
Posts: 26
Karma: 10
Join Date: Mar 2012
Device: PRS-T1
Adding MASSIVE amount of books

How to add massive amount of books (100 000) in Calibre the fastest way, which doesn't crash or is it better via command line(how to do that), all books are in one folder.

Have 4 SSD in RAID 0 max out sata 3 (550/550 read and write),and 16gb of RAM.
Thanks.
enitro is offline   Reply With Quote
Old 02-11-2013, 02:00 PM   #2
Zetmolm
Evangelist
Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.
 
Posts: 476
Karma: 950180
Join Date: Jan 2010
Device: Onyx Boox 60, PocketBook Touch
Just select the appropriate Add Books option and patiently wait for the import to finish. I did that once on much poorer hardware than yours, and it worked. No crashes.
Zetmolm is offline   Reply With Quote
 
Enthusiast
Old 02-11-2013, 02:13 PM   #3
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 36,464
Karma: 17660776
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Sony Reader PRS-650, iPad, nook STR
So where do these 100,000 eBooks come from?

I ask because some come here asking for help with eBooks that did not legally obtain.
JSWolf is offline   Reply With Quote
Old 02-11-2013, 02:17 PM   #4
theducks
Grand Sorcerer
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 14,428
Karma: 5560777
Join Date: Aug 2009
Location: The (original) Silicon Valley, USA
Device: Galaxy Tab 2, Astak Pocket Pro, K4NT
And I thought I read a LOT.

100K books. I don't think I have read even close to Half that in my lifetime.

ALL of my Libraries may total 6K: books, records, tapes,video
theducks is offline   Reply With Quote
Old 02-11-2013, 02:23 PM   #5
enitro
Enthusiast
enitro began at the beginning.
 
Posts: 26
Karma: 10
Join Date: Mar 2012
Device: PRS-T1
Quote:
Originally Posted by Zetmolm View Post
Just select the appropriate Add Books option and patiently wait for the import to finish. I did that once on much poorer hardware than yours, and it worked. No crashes.
What is faster via GUI or command line.

Thanks for the reply.
enitro is offline   Reply With Quote
Old 02-11-2013, 04:30 PM   #6
fidvo
Zealot
fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.
 
Posts: 113
Karma: 775434
Join Date: Jun 2012
Device: none
Quote:
Originally Posted by JSWolf View Post
So where do these 100,000 eBooks come from?

I ask because some come here asking for help with eBooks that did not legally obtain.
True, but don't we generally adopt a "don't ask don't tell" policy? The OP is asking for technical advice that applies just as well to legally obtained books as pirated books. As long as he's not admitting anything, I don't want the responsibility of deciding whether to withhold advice if it might help a pirate.
fidvo is offline   Reply With Quote
Old 02-12-2013, 08:36 AM   #7
enitro
Enthusiast
enitro began at the beginning.
 
Posts: 26
Karma: 10
Join Date: Mar 2012
Device: PRS-T1
Thanks for the reply any other suggestions.
enitro is offline   Reply With Quote
Old 02-12-2013, 10:24 AM   #8
calvin-c
Guru
calvin-c ought to be getting tired of karma fortunes by now.calvin-c ought to be getting tired of karma fortunes by now.calvin-c ought to be getting tired of karma fortunes by now.calvin-c ought to be getting tired of karma fortunes by now.calvin-c ought to be getting tired of karma fortunes by now.calvin-c ought to be getting tired of karma fortunes by now.calvin-c ought to be getting tired of karma fortunes by now.calvin-c ought to be getting tired of karma fortunes by now.calvin-c ought to be getting tired of karma fortunes by now.calvin-c ought to be getting tired of karma fortunes by now.calvin-c ought to be getting tired of karma fortunes by now.
 
Posts: 756
Karma: 1575310
Join Date: Jul 2009
Device: Moon+ Pro
FWIW I've seen a 'Project Gutenberg' CD. I don't remember how many books were on it but it was more than 10K. I don't think I'd load all of them, but that's because I wouldn't be interested in all of them.
calvin-c is offline   Reply With Quote
Old 02-12-2013, 10:52 AM   #9
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 36,464
Karma: 17660776
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Sony Reader PRS-650, iPad, nook STR
Quote:
Originally Posted by fidvo View Post
True, but don't we generally adopt a "don't ask don't tell" policy? The OP is asking for technical advice that applies just as well to legally obtained books as pirated books. As long as he's not admitting anything, I don't want the responsibility of deciding whether to withhold advice if it might help a pirate.
If it feels shady, I ask. There is no policy against that. If the person then answers and they are legal, I'll be happy to help. My asking has stopped us from continuing to try to help others with eBooks download from illegal sources.

If the OP isn't going to answer, then (IMHO) we should stop helping until the OP can say where these 100,000 eBooks came from.
JSWolf is offline   Reply With Quote
Old 02-12-2013, 11:33 AM   #10
Zetmolm
Evangelist
Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.Zetmolm ought to be getting tired of karma fortunes by now.
 
Posts: 476
Karma: 950180
Join Date: Jan 2010
Device: Onyx Boox 60, PocketBook Touch
Quote:
Originally Posted by JSWolf View Post
If the OP isn't going to answer, then (IMHO) we should stop helping until the OP can say where these 100,000 eBooks came from.
You mean: guilty until proven innocent?
Zetmolm is offline   Reply With Quote
Old 02-12-2013, 11:49 AM   #11
fidvo
Zealot
fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.
 
Posts: 113
Karma: 775434
Join Date: Jun 2012
Device: none
Quote:
Originally Posted by JSWolf View Post
If it feels shady, I ask. There is no policy against that. If the person then answers and they are legal, I'll be happy to help. My asking has stopped us from continuing to try to help others with eBooks download from illegal sources.

If the OP isn't going to answer, then (IMHO) we should stop helping until the OP can say where these 100,000 eBooks came from.
Fair enough. I disagree, but I respect your opinion. I have no problem with you giving or withholding your help based upon whatever criteria you choose.
fidvo is offline   Reply With Quote
Old 02-12-2013, 05:47 PM   #12
Gunnerp245
Gadget Freak
Gunnerp245 ought to be getting tired of karma fortunes by now.Gunnerp245 ought to be getting tired of karma fortunes by now.Gunnerp245 ought to be getting tired of karma fortunes by now.Gunnerp245 ought to be getting tired of karma fortunes by now.Gunnerp245 ought to be getting tired of karma fortunes by now.Gunnerp245 ought to be getting tired of karma fortunes by now.Gunnerp245 ought to be getting tired of karma fortunes by now.Gunnerp245 ought to be getting tired of karma fortunes by now.Gunnerp245 ought to be getting tired of karma fortunes by now.Gunnerp245 ought to be getting tired of karma fortunes by now.Gunnerp245 ought to be getting tired of karma fortunes by now.
 
Gunnerp245's Avatar
 
Posts: 1,116
Karma: 1043832
Join Date: Nov 2007
Location: US
Device: EE, PE, Note 8
Quote:
Originally Posted by enitro View Post
How to add massive amount of books (100 000) in Calibre the fastest way, which doesn't crash or is it better via command line(how to do that), all books are in one folder.

Have 4 SSD in RAID 0 max out sata 3 (550/550 read and write),and 16gb of RAM.
Thanks.
Do as zetmolm wrote should work fine. Ensure nothing unneccesary is running and let it go.
Gunnerp245 is offline   Reply With Quote
Old 02-12-2013, 10:24 PM   #13
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 36,464
Karma: 17660776
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Sony Reader PRS-650, iPad, nook STR
Quote:
Originally Posted by fidvo View Post
Fair enough. I disagree, but I respect your opinion. I have no problem with you giving or withholding your help based upon whatever criteria you choose.
The way I look at it is if the OP is not doing anything illegal, then the OP can tell us so and then nobody will have an issue helping. But the OP chose to ignore my question. That again raises red flags. I've never heard of anyone with 100,000 eBooks that were obtained legally. I could be wrong, but that's for the OP to tell us.
JSWolf is offline   Reply With Quote
Old 02-13-2013, 11:32 AM   #14
jgaiser
Omnivorous
jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.jgaiser ought to be getting tired of karma fortunes by now.
 
jgaiser's Avatar
 
Posts: 2,966
Karma: 20846667
Join Date: Feb 2008
Location: Rural NW Oregon
Device: Kindle Fire HD, Kindle GDX, Kindle 3, KPW, Nook HD+
We've had this discussion a number of times.

Folks who collect fanfic, people who collect public domain works. There are numerous ways and there's certainly no reason that one should *assume* illegality without proof.

If a mod thinks there's a problem, they will certainly step in and make that clear.
jgaiser is offline   Reply With Quote
Old 02-13-2013, 12:01 PM   #15
fidvo
Zealot
fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.fidvo ought to be getting tired of karma fortunes by now.
 
Posts: 113
Karma: 775434
Join Date: Jun 2012
Device: none
Quote:
Originally Posted by JSWolf View Post
The way I look at it is if the OP is not doing anything illegal, then the OP can tell us so and then nobody will have an issue helping. But the OP chose to ignore my question. That again raises red flags. I've never heard of anyone with 100,000 eBooks that were obtained legally. I could be wrong, but that's for the OP to tell us.
That's why I don't ask. I'm not here to judge, I'm here to give and receive advice. Honestly, I don't want to know if he's doing something illegal, because then I have to decide whether I can in good conscience offer my advice. Even if he obtained his library illegally, the advice itself applies just as well to legitimate cases, so why withhold it? I don't want that responsibility, so I'm not going to go out of my way to find out whether the person who asked for it will use it for nefarious purposes. What he chooses to do with it is his responsibility, not mine.

But like I said, I would never presume to tell you what to do. If your conscience tells you not to give advice because the situation seems shady, then I applaud you for taking a stand.

It's all academic anyway, since I've never tried adding that many books to my library so I have no advice to give.
fidvo is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
massive CBR to CBZ conversion of books in calibre database whitespirit Conversion 11 11-23-2012 09:30 AM
Amazon preview amount now 50% ? mr ploppy Writers' Corner 9 02-17-2012 06:18 AM
Unlimited amount of errors ACrum555 Calibre 5 04-02-2010 06:37 PM
Best way to convert large amount of books? ficbot Calibre 3 01-11-2010 04:36 PM
What would you do if you get a great amount of money Sweetpea Lounge 74 06-21-2009 07:14 PM


All times are GMT -4. The time now is 05:01 AM.


MobileRead.com is a privately owned, operated and funded community.