Cloud Library, Local Database on Windows/Portable

Methanoid · 10-01-2020, 09:14 AM

Using Calibre Portable, I want my eBooks stored in cloud but my database needs to be local (Can't store that in GDrive).

Is there a command line option for calibre-portable.exe I need to use?

Something LIKE C:\Portable_Apps\Calibre\calibre-portable.exe --CALIBRE_OVERRIDE_DATABASE_PATH=C:\Calibre_Portable \metadata.db ??

theducks · 10-01-2020, 10:52 AM

I'm almost positive you can't use Google Drive for the Library as it tampers with the file names and would break the {ID} linkages.

Your idea might work with other clouds.

Methanoid · 10-01-2020, 11:18 AM

Quote:

Originally Posted by theducks

I'm almost positive you can't use Google Drive for the Library as it tampers with the file names and would break the {ID} linkages.

Your idea might work with other clouds.

Thanks... So thats Google TeamDrive/GDrive out... Do you know if any of the free services work? I could use one just for Calibre library

theducks · 10-01-2020, 01:54 PM

Depends on how many GB you need. Some folk use Dropbox (the free one)

You do realize the Free ones do not include data backup at their end. Be sure to keep a local copy as backup if you use the cloud version.

BetterRed · 10-01-2020, 06:09 PM

Quote:

Originally Posted by Methanoid

Thanks... So thats Google TeamDrive/GDrive out... Do you know if any of the free services work? I could use one just for Calibre library

If you're running Windows and you have an MS account, you should have a free 5GB at Onedrive, 100GB costs $3 a month.

BR

Sirtel · 10-01-2020, 06:39 PM

OneDrive tends to randomly delete Calibre library files.

Dropbox is the most problem-free, but their free tier is the smallest of all. Personally I've used their paid plan for several years and have no complaints. Still, one must always be on one's guard when keeping an active library in a cloud.

stumped · 10-02-2020, 02:24 AM

box works , 10gb free tier - but only if no single file is >250MB. nothing larger is allowed in free tier. should be fine if you don't have comics/ large pdfs
box.com
i still use dropbox, I built up the free tier to 15gb with referrals over several years. but beware also, dropbox free now has a 3 device limit

and even on free tier. deleted files in dropbox are saved for 30 days so there is enough time to roll back form a catastrophe, if spotted soon enough

BetterRed · 10-02-2020, 08:06 AM

Quote:

Originally Posted by Sirtel

OneDrive tends to randomly delete Calibre library files.

I wonder why Onedrive would randomly and specifically delete calibre library files ?

I've used Onedrive since before it was called Skydrive, Live something - Drive/Files/Sync? I have files in Onedrive from 2004, not aware of ever losing anything. But I mainly use a commercial FTP service, and there's stuff there from 1984

I really should get rid of most of it.

BR

Sirtel · 10-02-2020, 08:41 AM

Quote:

Originally Posted by BetterRed

I wonder why Onedrive would randomly and specifically delete calibre library files ?

I've used Onedrive since before it was called Skydrive, Live something - Drive/Files/Sync? I have files in Onedrive from 2004, not aware of ever losing anything. But I mainly use a commercial FTP service, and there's stuff there from 1984

I really should get rid of most of it.

BR

No idea why it does so, but I've gotten burned myself and have read here about other people who have had it happen to them.

Dropbox has never deleted anything on its own. It can create conflicted copies though, so one has to monitor one's library. But it's still better than just deleting random files and not notifying the user about it.

DNSB · 10-02-2020, 02:34 PM

Quote:

Originally Posted by BetterRed

I've used Onedrive since before it was called Skydrive, Live something - Drive/Files/Sync? I have files in Onedrive from 2004, not aware of ever losing anything. But I mainly use a commercial FTP service, and there's stuff there from 1984

I really should get rid of most of it.

BR

My oldest memory of OneDrive/SkyDrive/Windows Live Skydrive was when it was being tested as Windows Live Folders with a codename of SkyDrive. At that time, it's reliability was not the greatest but then neither were most of my Internet connections. Though I'm surprised you have files in there from 2004—I seem to remember the go live date being in 2007.

BetterRed · 10-02-2020, 07:39 PM

I would have started with a version from MS Research; I used to keep tabs on MS-R stuff because a couple of guys who worked for me in Singapore ended up working there. One still does, and I think I still have the collage maker from their Cambridge (UK) lab

BR

nixsee · 10-03-2020, 07:09 PM

I've never had trouble with either OneDrive or Google Drive/Backup and Sync.

On a related note, I used to get a sync "error" for metadata.db when Calibre was open (file in use) whereas with v5 it is continually re-uploading with each edit to the catalog - highlights/annotations, etc... It is only a problem with the database, because the epub book "re-uploads" but does so instantly (presumably recognizing that the only actual change is only with the book's small metadata.opf file).

Any ideas on how to stop this? I was using my mobile data plan today and it just blew through a lot of data, purely from annotations causing continual uploading of the database. But even when I'm on a dedicated connection, I'd prefer for it to just sync when I close Calibre, as it did before.

Sirtel · 10-03-2020, 08:15 PM

Pause syncing while Calibre is open.

nixsee · 10-03-2020, 08:18 PM

Of course that is an option, but I'm certain that I won't always remember to do so. Moreover, it is quite likely that I will have reason to sync other files while Calibre is open.

Since something seems to have changed with v5, I'm hoping that there could be a toggle somewhere for this.

stumped · 10-04-2020, 12:47 AM

I have always been able to mirror cloud library to cloud ok with free file sync , with calibre open but idle.
Maybe I tweaked a setting in ffs so that it worked without applying a temp file lock to metadata.db 2hen copying, can't remember for sure.
But am staying well clear of by until the dust settles, so can't help with that. .except to state the obvious- try completely exiting calibre ft i.e. shut it down. Then do whatever copies, syncs are needed.
That has to be best practice. It can be sort of automated with bat files and scripts. Close, sync, restart.

10-01-2020, 09:14 AM	#1
Methanoid Member Posts: 12 Karma: 10 Join Date: Nov 2015 Device: Kindle	Cloud Library, Local Database on Windows/Portable Using Calibre Portable, I want my eBooks stored in cloud but my database needs to be local (Can't store that in GDrive). Is there a command line option for calibre-portable.exe I need to use? Something LIKE C:\Portable_Apps\Calibre\calibre-portable.exe --CALIBRE_OVERRIDE_DATABASE_PATH=C:\Calibre_Portable \metadata.db ??

10-03-2020, 07:09 PM	#12
nixsee Connoisseur Posts: 79 Karma: 24858 Join Date: Feb 2020 Device: none	I've never had trouble with either OneDrive or Google Drive/Backup and Sync. On a related note, I used to get a sync "error" for metadata.db when Calibre was open (file in use) whereas with v5 it is continually re-uploading with each edit to the catalog - highlights/annotations, etc... It is only a problem with the database, because the epub book "re-uploads" but does so instantly (presumably recognizing that the only actual change is only with the book's small metadata.opf file). Any ideas on how to stop this? I was using my mobile data plan today and it just blew through a lot of data, purely from annotations causing continual uploading of the database. But even when I'm on a dedicated connection, I'd prefer for it to just sync when I close Calibre, as it did before. Last edited by nixsee; 10-03-2020 at 07:15 PM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Local library file, pointing to cloud-based ebooks?	Timmeh	Calibre	5	01-07-2020 06:21 PM
local cloud ebooks do not load the book into cc	RsH	Calibre Companion	0	10-14-2019 10:25 PM
Local database and eBooks on NAS?	DerDominik	Library Management	3	06-02-2018 02:57 PM
Local Cloud Access	HippieWiccan	Calibre Companion	6	08-04-2015 02:36 AM
portable database?	sn123py	Calibre	28	05-18-2011 05:43 AM

10-01-2020, 10:52 AM	#2
theducks Well trained by Cats Posts: 31,267 Karma: 61916422 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	I'm almost positive you can't use Google Drive for the Library as it tampers with the file names and would break the {ID} linkages. Your idea might work with other clouds.

10-01-2020, 01:54 PM	#4
theducks Well trained by Cats Posts: 31,267 Karma: 61916422 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	Depends on how many GB you need. Some folk use Dropbox (the free one) You do realize the Free ones do not include data backup at their end. Be sure to keep a local copy as backup if you use the cloud version.

10-01-2020, 06:39 PM	#6
Sirtel Grand Sorcerer Posts: 13,994 Karma: 243829945 Join Date: Jan 2014 Location: Estonia Device: Kobo Sage & Libra 2	OneDrive tends to randomly delete Calibre library files. Dropbox is the most problem-free, but their free tier is the smallest of all. Personally I've used their paid plan for several years and have no complaints. Still, one must always be on one's guard when keeping an active library in a cloud.

10-02-2020, 02:24 AM	#7
stumped Wizard Posts: 3,305 Karma: 10259306 Join Date: May 2016 Device: kobo forma, Kobo Libra, Huawei media Tab, fire HD10, PW3 HDX8.9,	box works , 10gb free tier - but only if no single file is >250MB. nothing larger is allowed in free tier. should be fine if you don't have comics/ large pdfs box.com i still use dropbox, I built up the free tier to 15gb with referrals over several years. but beware also, dropbox free now has a 3 device limit and even on free tier. deleted files in dropbox are saved for 30 days so there is enough time to roll back form a catastrophe, if spotted soon enough

10-02-2020, 07:39 PM	#11
BetterRed null operator (he/him) Posts: 22,018 Karma: 30277294 Join Date: Mar 2012 Location: Sydney Australia Device: none	I would have started with a version from MS Research; I used to keep tabs on MS-R stuff because a couple of guys who worked for me in Singapore ended up working there. One still does, and I think I still have the collage maker from their Cambridge (UK) lab BR

10-03-2020, 08:15 PM	#13
Sirtel Grand Sorcerer Posts: 13,994 Karma: 243829945 Join Date: Jan 2014 Location: Estonia Device: Kobo Sage & Libra 2	Pause syncing while Calibre is open.

10-03-2020, 08:18 PM	#14
nixsee Connoisseur Posts: 79 Karma: 24858 Join Date: Feb 2020 Device: none	Of course that is an option, but I'm certain that I won't always remember to do so. Moreover, it is quite likely that I will have reason to sync other files while Calibre is open. Since something seems to have changed with v5, I'm hoping that there could be a toggle somewhere for this.

10-04-2020, 12:47 AM	#15
stumped Wizard Posts: 3,305 Karma: 10259306 Join Date: May 2016 Device: kobo forma, Kobo Libra, Huawei media Tab, fire HD10, PW3 HDX8.9,	I have always been able to mirror cloud library to cloud ok with free file sync , with calibre open but idle. Maybe I tweaked a setting in ffs so that it worked without applying a temp file lock to metadata.db 2hen copying, can't remember for sure. But am staying well clear of by until the dust settles, so can't help with that. .except to state the obvious- try completely exiting calibre ft i.e. shut it down. Then do whatever copies, syncs are needed. That has to be best practice. It can be sort of automated with bat files and scripts. Close, sync, restart.