|
@StillReading - Your previous post came across to me as a 'whinge', you made unsubstantiated claims about performance, complained that having to enter data was a Pain in the Ass, and finished with a snide remark about how 'in a perfect world all would be the way you want it to be...". You also told us that whilst your an IT professional you're not prepared to acquire the skills to write your own plugin.
calibre does not use the SQLite data as you probably think it does.
I have a one library of ~50,000 books, there are 9 custom columns, 2 of which are long text that in some cases contain long screeds of HTML. I can switch to that library in 1-2 seconds, queries are almost instantaneous.
I have another library consisting of almost 10,000 video and audio interviews, again there are a number of custom columns, in fact that library makes use of more custom columns than it does builtin columns! The library itself is 600GB, I can switch to to that library in 1-2 seconds. If I want all the Charlie Rose interviews and the current 'book' happens to be one of his, then I can press Alt/A and all 300+ are displayed instantly.
My computer is modest a i5 with 6G of Ram with WD spinning disks, no tricks like RAM disks. The drive housing the libraries is compressed, it is watched by my AV, all files are fully indexed and wherever possible using Ifilter dlls. I cannot discern any impact on Calibres performance by having those services running.
Again you say "I'm pretty sure the more (custom) fields you have in a database, the slower queries get". But how much slower - a few microseconds, a few seconds, a few minutes. I'm pretty sure your statement is speculation, based on what are probably false assumptions.
If you wrote a script using calibres command line facilities you could build a library of say 50,000 books quite quickly. Then you could perform some empirical tests to examine your hypothesis as to calibres performance.
Failing that you could have asked how big can a library be, what impact on performance do different custom column types have, is performance impacted by the number of tags etc, etc.
Anyway I'm sorry we have gotten off on the wrong foot, its actually quite unusual for me, as others could attest - maybe I'm having a bad hair day.
Try a few things, if they don't work satisfactorily try a different idea. I had one issue when I started using calibre that bugged me. How to deal with extra material for authors and books, it took me months to come up with the solution I'm using now.
BTW I'm 40+ years in IT and calibre is probably the most flexible and extendible products of its genre (record keeping) I've come across and that's only a fraction of what it does.
BR
|