Adding MASSIVE amount of books

[enitro]

How to add massive amount of books (100 000) in Calibre the fastest way, which doesn't crash or is it better via command line(how to do that), all books are in one folder.

Have 4 SSD in RAID 0 max out sata 3 (550/550 read and write),and 16gb of RAM.
Thanks.

[Zetmolm]

Just select the appropriate Add Books option and patiently wait for the import to finish. I did that once on much poorer hardware than yours, and it worked. No crashes.

[JSWolf]

So where do these 100,000 eBooks come from?

I ask because some come here asking for help with eBooks that did not legally obtain.

[theducks]

And I thought I read a LOT.

100K books. I don't think I have read even close to Half that in my lifetime.

ALL of my Libraries may total 6K: books, records, tapes,video

[enitro]

Originally Posted by Zetmolm

Just select the appropriate Add Books option and patiently wait for the import to finish. I did that once on much poorer hardware than yours, and it worked. No crashes.

What is faster via GUI or command line.

Thanks for the reply.

[fidvo]

Originally Posted by JSWolf

So where do these 100,000 eBooks come from?

I ask because some come here asking for help with eBooks that did not legally obtain.

True, but don't we generally adopt a "don't ask don't tell" policy? The OP is asking for technical advice that applies just as well to legally obtained books as pirated books. As long as he's not admitting anything, I don't want the responsibility of deciding whether to withhold advice if it might help a pirate.

[enitro]

Thanks for the reply any other suggestions.

[calvin-c]

FWIW I've seen a 'Project Gutenberg' CD. I don't remember how many books were on it but it was more than 10K. I don't think I'd load all of them, but that's because I wouldn't be interested in all of them.

[JSWolf]

Originally Posted by fidvo

True, but don't we generally adopt a "don't ask don't tell" policy? The OP is asking for technical advice that applies just as well to legally obtained books as pirated books. As long as he's not admitting anything, I don't want the responsibility of deciding whether to withhold advice if it might help a pirate.

If it feels shady, I ask. There is no policy against that. If the person then answers and they are legal, I'll be happy to help. My asking has stopped us from continuing to try to help others with eBooks download from illegal sources.

If the OP isn't going to answer, then (IMHO) we should stop helping until the OP can say where these 100,000 eBooks came from.

[Zetmolm]

Originally Posted by JSWolf

If the OP isn't going to answer, then (IMHO) we should stop helping until the OP can say where these 100,000 eBooks came from.

You mean: guilty until proven innocent?

[fidvo]

Originally Posted by JSWolf

If it feels shady, I ask. There is no policy against that. If the person then answers and they are legal, I'll be happy to help. My asking has stopped us from continuing to try to help others with eBooks download from illegal sources.

If the OP isn't going to answer, then (IMHO) we should stop helping until the OP can say where these 100,000 eBooks came from.

Fair enough. I disagree, but I respect your opinion. I have no problem with you giving or withholding your help based upon whatever criteria you choose.

[Gunnerp245]

Originally Posted by enitro

How to add massive amount of books (100 000) in Calibre the fastest way, which doesn't crash or is it better via command line(how to do that), all books are in one folder.

Have 4 SSD in RAID 0 max out sata 3 (550/550 read and write),and 16gb of RAM.
Thanks.

Do as zetmolm wrote should work fine. Ensure nothing unneccesary is running and let it go.

[JSWolf]

Originally Posted by fidvo

Fair enough. I disagree, but I respect your opinion. I have no problem with you giving or withholding your help based upon whatever criteria you choose.

The way I look at it is if the OP is not doing anything illegal, then the OP can tell us so and then nobody will have an issue helping. But the OP chose to ignore my question. That again raises red flags. I've never heard of anyone with 100,000 eBooks that were obtained legally. I could be wrong, but that's for the OP to tell us.

[jgaiser]

We've had this discussion a number of times.

Folks who collect fanfic, people who collect public domain works. There are numerous ways and there's certainly no reason that one should *assume* illegality without proof.

If a mod thinks there's a problem, they will certainly step in and make that clear.

[fidvo]

Originally Posted by JSWolf

The way I look at it is if the OP is not doing anything illegal, then the OP can tell us so and then nobody will have an issue helping. But the OP chose to ignore my question. That again raises red flags. I've never heard of anyone with 100,000 eBooks that were obtained legally. I could be wrong, but that's for the OP to tell us.

That's why I don't ask. I'm not here to judge, I'm here to give and receive advice. Honestly, I don't want to know if he's doing something illegal, because then I have to decide whether I can in good conscience offer my advice. Even if he obtained his library illegally, the advice itself applies just as well to legitimate cases, so why withhold it? I don't want that responsibility, so I'm not going to go out of my way to find out whether the person who asked for it will use it for nefarious purposes. What he chooses to do with it is his responsibility, not mine.

But like I said, I would never presume to tell you what to do. If your conscience tells you not to give advice because the situation seems shady, then I applaud you for taking a stand.

It's all academic anyway, since I've never tried adding that many books to my library so I have no advice to give.