Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Library Management

Notices

Reply
 
Thread Tools Search this Thread
Old 02-09-2019, 05:04 AM   #1
pleiadesc
Enthusiast
pleiadesc began at the beginning.
 
Posts: 46
Karma: 10
Join Date: Nov 2016
Device: none
Help customize Calibre Portable for SSD

Hi,

I use Calibre Portable in windows, I would like to use my SSD to speed up calibre but I have a small SSD, I would like to move application and metadata into the SSD and leave the books on the HDD

I found a bat file inside a folder in L:\Calibre Portable\Calibre\app\resources\ made by itimpi. Is this still recommended to use? It has a different folder structure than the Calibre Portable

I would like to retain the folder structure so I can just overwrite it with a new version of Calibre.

The easiest way I can think of is to copy everything into the SSD and symlink the Calibre Library which contains the book

The problem is the metadata.db and a json file is inside the Calibre Library folder.

Can i change the metadata.db location by adding a command to the launcher similar to the batch file?

Thank you!
pleiadesc is offline   Reply With Quote
Old 02-09-2019, 06:06 AM   #2
BetterRed
null operator
BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.
 
Posts: 12,178
Karma: 10633638
Join Date: Mar 2012
Location: Sydney Australia
Device: none
Quote:
Originally Posted by pleiadesc View Post
Hi,

I use Calibre Portable in windows, I would like to use my SSD to speed up calibre but I have a small SSD, I would like to move application and metadata into the SSD and leave the books on the HDD

I found a bat file inside a folder in L:\Calibre Portable\Calibre\app\resources\ made by itimpi. Is this still recommended to use? It has a different folder structure than the Calibre Portable

I would like to retain the folder structure so I can just overwrite it with a new version of Calibre.

The easiest way I can think of is to copy everything into the SSD and symlink the Calibre Library which contains the book

The problem is the metadata.db and a json file is inside the Calibre Library folder.

Can i change the metadata.db location by adding a command to the launcher similar to the batch file?

Thank you!
Putting symlink to an hdd resident library into the ssd resident Calibre Portable folder should be OK, but I am not sure if you can use the CALIBRE_OVERRIDE_DATABASE_PATH environment variable in Portable to 'redirect' the database location - I have a feeling you cannot.

If your SSD is an internal drive what's the point of installing Portable on it?

FWIW: I moved a 120K book library with a 300MB metadata.db from a WD Caviar Black HDD to my Samsung 500GB nVMe M2 SSD. The performance difference was negligible - start up times went from 8s to 5s, switching VM Views, VLs, bulk metadata edits were all much the same - after a couple of days i put it back on the HDD. Why would this be so - because for most operations calibre uses in in-memory copy of the database.

BR
BetterRed is offline   Reply With Quote
Advert
Old 02-10-2019, 11:29 PM   #3
pleiadesc
Enthusiast
pleiadesc began at the beginning.
 
Posts: 46
Karma: 10
Join Date: Nov 2016
Device: none
Thank you BetterRed for the real-world usage test, I like the portable version because I like to keep all the configuration files in a single folder. I won't think about this too much.
pleiadesc is offline   Reply With Quote
Old 02-10-2019, 11:51 PM   #4
BetterRed
null operator
BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.
 
Posts: 12,178
Karma: 10633638
Join Date: Mar 2012
Location: Sydney Australia
Device: none
Quote:
Originally Posted by pleiadesc View Post
Thank you BetterRed for the real-world usage test, I like the portable version because I like to keep all the configuration files in a single folder. I won't think about this too much.
By default calibre keeps its global configuration data (preference settings, plugins, configuration overrides etc) in the %APPDATA%/calibre folder. The CALIBRE_CONFIG_DIRECTORY Environment variable is available if you want to relocate it elsewhere. Library specific configuration data is kept in the library databases.

AFAIK the only calibre related entries in the Windows registry are those put there by the so-called Trusted Installer.

BR
BetterRed is offline   Reply With Quote
Old 02-11-2019, 09:25 PM   #5
pleiadesc
Enthusiast
pleiadesc began at the beginning.
 
Posts: 46
Karma: 10
Join Date: Nov 2016
Device: none
Thank you again for the Environment variable, I don't mind the windows registry entries, I will customize itimpi's batch file and change the folder structure similar to the calibre portable.
pleiadesc is offline   Reply With Quote
Advert
Old 02-11-2019, 10:21 PM   #6
BetterRed
null operator
BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.
 
Posts: 12,178
Karma: 10633638
Join Date: Mar 2012
Location: Sydney Australia
Device: none
I have to say this - in my opinion you may be wasting your time. In times foregone, getting the metadata.db onto a faster device may have had some mileage, but I'm not sure that's true today.

When I got a Samsung 500GB Nvme M.2 system drive in In Q3 2017, I moved my Books library (120,000+ books) onto it just see what difference it made. The start up times dropped from 7-10 secs to 3-5 secs - nothing else changed, sorting and searching were just as fast as they when the library was on a 2 TB WD Caviar Black drive, adding books, conversions etc were about the same (Temp is on the SSD).

So I moved the library back to the HDD. i don't like having data on the same drive as the OS - and at the time I wasn't inclined to partition the SSD for an extra 5 secs once or twice a day

BR
BetterRed is offline   Reply With Quote
Old 02-12-2019, 10:31 AM   #7
mbovenka
Wizard
mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.
 
Posts: 1,727
Karma: 6411769
Join Date: Oct 2007
Location: Almere, The Netherlands
Device: Kobo Forma
Quote:
Originally Posted by BetterRed View Post
I have to say this - in my opinion you may be wasting your time. In times foregone, getting the metadata.db onto a faster device may have had some mileage, but I'm not sure that's true today.
I pretty much agree.

I recently moved from a dedicated 5400RPM HD to a SATAIII SSD (running at SATAII speeds, though; the second SATA port in my laptop turns out to be SATAII only) and my startup time is a few seconds faster (pretty much the difference in throughput of the two drives in loading the metadata DB).

Adding books is a bit faster, though, as are things like embedding metadata. Bulk saving of OPF files (calibredb backup_metadata) is a *lot* faster. That's the SSD handling small files a lot better than spinning metal. Conversions are a wash, probably because my system disk (and thus my temp dir) already was an SSD.

In all, the gains aren't as great as I'd hoped.
mbovenka is offline   Reply With Quote
Old 02-12-2019, 01:39 PM   #8
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 34,049
Karma: 10261488
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
all read only operations owrk on a pure in-memory representation of the db, so are unaffected by the speed of the disk on which the db rsides.
kovidgoyal is offline   Reply With Quote
Old 02-13-2019, 12:20 AM   #9
pleiadesc
Enthusiast
pleiadesc began at the beginning.
 
Posts: 46
Karma: 10
Join Date: Nov 2016
Device: none
@BetterRed

Thank you for the advice, I like to test it out myself, so far the startup times are a little faster but overall speed is the same. what I learned from testing this is that I can separate the library from the applications which is very cool.

@mbovenka

Did you separate the library and the applications?

@kovidgoyal

Thank you for your insight, How about the write operations? does the SSD have any effects?
pleiadesc is offline   Reply With Quote
Old 02-13-2019, 02:19 AM   #10
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 34,049
Karma: 10261488
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
yes, ssd will help with initial load and write operations, but write operations are typically a very small fraction of total workload.
kovidgoyal is offline   Reply With Quote
Old 02-13-2019, 05:35 AM   #11
mbovenka
Wizard
mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.
 
Posts: 1,727
Karma: 6411769
Join Date: Oct 2007
Location: Almere, The Netherlands
Device: Kobo Forma
Quote:
Originally Posted by pleiadesc View Post
@mbovenka

Did you separate the library and the applications?
Yes, the library is on a separate SSD from the application.
mbovenka is offline   Reply With Quote
Old 02-13-2019, 12:07 PM   #12
theducks
Well trained by Cats
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 22,625
Karma: 22515566
Join Date: Aug 2009
Location: (The original) Silicon Valley, USA
Device: K4NT, Galaxy Tab A, Kobo Aura2
Many of my Libraries are on different LOCAL drives.
My 'Main' is on a 'Caviar Black'. It doesn't help, when the activity light appears solid. The systems data bus is saturated (I rarely use swap. 8G of RAM)
theducks is offline   Reply With Quote
Old 02-13-2019, 12:50 PM   #13
ilovejedd
hopeless n00b
ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.
 
ilovejedd's Avatar
 
Posts: 3,405
Karma: 8891032
Join Date: Jan 2009
Location: in the middle of nowhere
Device: PW4, PW3, iPad 9.7, iPad 12.9
Quote:
Originally Posted by theducks View Post
Many of my Libraries are on different LOCAL drives.
My 'Main' is on a 'Caviar Black'. It doesn't help, when the activity light appears solid. The systems data bus is saturated (I rarely use swap. 8G of RAM)
It really depends on what you're doing. I actually have run some batch import tests and there was a huge speed up keeping the Calibre library on a separate drive from the OS when using mechanical disks.

https://www.mobileread.com/forums/sh...8&postcount=17

I'm happy to keep my full Calibre libraries on SSD. I also use one of my older SSDs for quick copies/backups. I do backup to HDD, but that's more like a scheduled overnight task or when I'm not pressed for time. Not a need to make a copy and get out in 5 minutes kinda thing.
ilovejedd is offline   Reply With Quote
Old 02-14-2019, 08:52 PM   #14
pleiadesc
Enthusiast
pleiadesc began at the beginning.
 
Posts: 46
Karma: 10
Join Date: Nov 2016
Device: none
Quote:
Originally Posted by kovidgoyal View Post
yes, ssd will help with initial load and write operations, but write operations are typically a very small fraction of total workload.
for sharing
pleiadesc is offline   Reply With Quote
Old 02-14-2019, 08:56 PM   #15
pleiadesc
Enthusiast
pleiadesc began at the beginning.
 
Posts: 46
Karma: 10
Join Date: Nov 2016
Device: none
Quote:
Originally Posted by mbovenka View Post
Yes, the library is on a separate SSD from the application.
, I like the idea of separating the library and application.
pleiadesc is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Calibre Portable and Assigned Letter to Portable Drive issue nkle1128 Library Management 1 03-11-2017 05:11 PM
How can you Customize Calibre's Look? chilady1 Calibre 8 12-26-2012 11:50 PM
Running Calibre on an SSD barium Calibre 16 07-17-2012 12:00 PM
how to customize viewer for calibre tanyeun Calibre 9 05-28-2010 04:06 AM
Customize Calibre Navbars marcot Calibre 1 05-15-2010 12:49 AM


All times are GMT -4. The time now is 05:28 AM.


MobileRead.com is a privately owned, operated and funded community.