Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre

Notices

Reply
 
Thread Tools Search this Thread
Old 10-03-2008, 10:56 AM   #1
astrodad
Guru
astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.
 
astrodad's Avatar
 
Posts: 945
Karma: 568242
Join Date: Dec 2007
Device: Kindle Paperwhite 1, iPad, iPhone 5
Abandoned attempt to use calibre with SSH mounted drive

Some of you may know about my quest to maintain my calibre database in the cloud. I've tried everything. I had been trying to use an SSH-mounted drive to place my entire calibre database remotely. This sort of worked, but was always very slow. On Windows, using Sftpdrive, it was sort of okay, on a Mac with Expandrive (using MacFuse) it was terrible.

With the introduction of the latest version of calibre, wherein Kovid has changed the application to use a file system for the ebooks and a metadata database, things improved on Windows, but not on the Mac. Plus I would continue to get I/O errors, dropouts, and general instability.

After much frustration, I've given up that effort. Now I just use DropBox. I put the library in a 'library' folder on my Dropbox share and let it do its thing as I add/delete/update books. It's much easier, the application is now as responsive as it's supposed to be, and I don't have to worry about maintaining a constant network connection.

I would still like to see a version of calibre that implemented a more network-capable database driver, but for now I am happy!

The only problem I have with Dropbox is the 2GB barrier. I already have my own Amazon S3 and could use that, but Dropbox doesn't support custom buckets. Does anyone know of a background synch program that works with your own Amazon S3 account? Or a background synch program that works with SFTP?
astrodad is offline   Reply With Quote
Old 10-03-2008, 11:51 AM   #2
pilotbob
Grand Sorcerer
pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.
 
pilotbob's Avatar
 
Posts: 19,634
Karma: 11390499
Join Date: Jan 2007
Location: Tampa, FL USA
Device: Kindle Touch
Quote:
Originally Posted by jplumey View Post
The only problem I have with Dropbox is the 2GB barrier. I already have my own Amazon S3 and could use that, but Dropbox doesn't support custom buckets. Does anyone know of a background synch program that works with your own Amazon S3 account? Or a background synch program that works with SFTP?
Have you looked a JungleDisk? It allows for mounting an S3 account as a drive on Windows and Mac.

BOb
pilotbob is offline   Reply With Quote
Old 10-03-2008, 12:13 PM   #3
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 26,436
Karma: 5383257
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
I use unisync over sftp to keep share my library across my two primary computers.
kovidgoyal is offline   Reply With Quote
Old 10-03-2008, 12:19 PM   #4
astrodad
Guru
astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.
 
astrodad's Avatar
 
Posts: 945
Karma: 568242
Join Date: Dec 2007
Device: Kindle Paperwhite 1, iPad, iPhone 5
Quote:
Originally Posted by pilotbob View Post
Have you looked a JungleDisk? It allows for mounting an S3 account as a drive on Windows and Mac.

BOb
I use JungleDisk as my primay net backup but it doesn't have a real-time sync. And using JungleDisk, mapped as a drive or mount point, is bad for calibre because the changes don't occur in real-time. They are cached and then uploaded in the background.

I tried it earlier and it was a colossal failure. It's a great backup solution though.
astrodad is offline   Reply With Quote
Old 10-03-2008, 12:23 PM   #5
pilotbob
Grand Sorcerer
pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.
 
pilotbob's Avatar
 
Posts: 19,634
Karma: 11390499
Join Date: Jan 2007
Location: Tampa, FL USA
Device: Kindle Touch
Quote:
Originally Posted by jplumey View Post
I tried it earlier and it was a colossal failure. It's a great backup solution though.
Right. I thought you had said you tried it, but couldn't remember.

Here is something that I was looking at before I decided to go with TimeMachine on OSx. I may trial it just to keep my documents in sync between my PC and Mac, $24 a year for 10gb isn't to bad. They have a free trial for 30 days.

http://www.sugarsync.com/

Maybe you might want to give it a wack.

BOb
pilotbob is offline   Reply With Quote
Old 10-03-2008, 12:43 PM   #6
astrodad
Guru
astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.
 
astrodad's Avatar
 
Posts: 945
Karma: 568242
Join Date: Dec 2007
Device: Kindle Paperwhite 1, iPad, iPhone 5
Thanks for the suggestion. That looks about the same as Dropbox. What I would like is a way to sync to my own Amazon S3 or SSH-mounted remote drive. SugarSync and Dropbox are nearly the same in that they go to their own data repositories.
astrodad is offline   Reply With Quote
Old 10-03-2008, 12:52 PM   #7
JeffElkins
PRSCustomizer
JeffElkins is no ebook tyro.JeffElkins is no ebook tyro.JeffElkins is no ebook tyro.JeffElkins is no ebook tyro.JeffElkins is no ebook tyro.JeffElkins is no ebook tyro.JeffElkins is no ebook tyro.JeffElkins is no ebook tyro.JeffElkins is no ebook tyro.JeffElkins is no ebook tyro.
 
JeffElkins's Avatar
 
Posts: 773
Karma: 1416
Join Date: Jan 2008
Device: PRS 505 Blue/iPod Touch/Epic 4G/Nook Classic
I've been using an NFS drive for my database. No problems thus far.
JeffElkins is offline   Reply With Quote
Old 10-03-2008, 06:00 PM   #8
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 26,436
Karma: 5383257
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
The simplest non-real time solution (provided you can be sure that only one person is going to be using the central database location is to create a simple wrapper script for launching calibre with rsync)

Code:
#!/bin/sh
rsync myserver.net:/path/lo/library/folder /path/to/local/copy
calibre
rsync /path/to/local/copy myserver.net:/path/lo/library/folder
rsync will only copy changed files and it can use ssh as well as various other transport protocols.
kovidgoyal is offline   Reply With Quote
Old 10-03-2008, 09:19 PM   #9
pilotbob
Grand Sorcerer
pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.
 
pilotbob's Avatar
 
Posts: 19,634
Karma: 11390499
Join Date: Jan 2007
Location: Tampa, FL USA
Device: Kindle Touch
Quote:
Originally Posted by kovidgoyal View Post
Code:
#!/bin/sh
rsync myserver.net:/path/lo/library/folder /path/to/local/copy
calibre
rsync /path/to/local/copy myserver.net:/path/lo/library/folder
rsync will only copy changed files and it can use ssh as well as various other transport protocols.
That's a darned good idea. I'm going to do that. I assume rsync is platform agnostic? Now, to figure out how to do that on a mac rather than dragging the application to my doc or running from spotlight... hmmm. (still learning mac OS innards. I could do this on Windows with my eyes closed.)

BOb


BOb
pilotbob is offline   Reply With Quote
Old 10-06-2008, 10:46 AM   #10
astrodad
Guru
astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.astrodad ought to be getting tired of karma fortunes by now.
 
astrodad's Avatar
 
Posts: 945
Karma: 568242
Join Date: Dec 2007
Device: Kindle Paperwhite 1, iPad, iPhone 5
So far DropBox is working fantastic for me. I've used rsync in the past and I've never had problems with it, so I may look at that again. The problem is that I would have to set up a different process on each OS that I work with (Two Mac boxes, Windows, and Linux). Dropbox just work right now without having to do a bunch of configuration. But thanks for the suggestion!
astrodad is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
backing up Calibre folder on USB drive dcarlozzi Related Tools 4 06-01-2010 09:59 AM
Calibre unable to detect drive on Mac patchymama Calibre 5 11-29-2009 12:40 PM
Conflict between Calibre and mounted TrueCrypt device volume acidzebra Calibre 4 08-13-2009 04:11 PM
Calibre on a flash drive rcuadro Calibre 5 02-13-2009 10:44 AM
Can the EBW1150 be mounted as a usb drive? nrapallo Fictionwise eBookwise 7 12-12-2008 05:53 AM


All times are GMT -4. The time now is 02:03 PM.


MobileRead.com is a privately owned, operated and funded community.