corrupted dbase

[ccayer]

The next release of calibre contains code that will try pretty hard to recover from a corrupted database.

The ability to recover from a corrupted database sounds like a great feature. Even though it's something you hope you never need, it's nice to know that feature is there.

I copy metadata.db to metadata.db.1, etc.. I keep 6 copies for the last 6 backups, all the way to metadata.db.6 It's a very simple rename, of metadata.db.1->metadata.db.2, etc. before copying the current metadata.db to metadata.db.1.

I have yet to see a corrupted metadata.db, but if I ever do, I've got all 6 copies backed up every day for months.

The backup of the metadata.db is even more 'insurance' against corruption. Is there a way to have Calibre run a batch file on exit? I can whip up a batch file, similar to the one described, and it would be convenient to have it run automatically when I close Calibre.

[Starson17]

Originally Posted by ccayer

The backup of the metadata.db is even more 'insurance' against corruption. Is there a way to have Calibre run a batch file on exit? I can whip up a batch file, similar to the one described, and it would be convenient to have it run automatically when I close Calibre.

I use Windows Task Scheduler, and it runs at night. Most backup programs will run a pre-backup batch file, and you can put it there,a nd your backup program will run it. However, I don't know of a way to get Calibre to run a batch file on exit. It might be a useful feature for some if you want to request it in the bug tracker.

[chaley]

Originally Posted by Starson17

However, I don't know of a way to get Calibre to run a batch file on exit.

Why not start calibre in a batch file? When it exits, you can do whatever you want.

Note that if you are on windows, there are some issues with using calibre in batch files. You need to use the START command. There was a thread around a month ago that went into detail. I always start calibre with the calibre-debug command and don't have problems, but your mileage might vary.

[Starson17]

Originally Posted by chaley

Why not start calibre in a batch file? When it exits, you can do whatever you want.

Note that if you are on windows, there are some issues with using calibre in batch files. You need to use the START command. There was a thread around a month ago that went into detail. I always start calibre with the calibre-debug command and don't have problems, but your mileage might vary.

If you start calibre with a simple command line in the batch file (like you, I do that with "calibre-debug - g" when working on the source) it won't run the next line in the batch, for the reason you mentioned - Calibre has trouble with batch files.

If you put "start" in front, it runs calibre and the next line in the batch, but it runs the next line immediately, not after Calibre exits.

I believe this will work if you install powershell:

powershell -command - < batchfile.bat

but it's probably easier to use one of the other methods.

[hnoto]

Originally Posted by dwanthny

I'm a big fan of using the save to disk feature to back up your books, I even wrote procedures here to do just that. The truth is that the simple way to back up your library according to the creator of Calibre is to copy your library folder to another location. By default the metadata.db file is in the root of the library folder.

I'm a pretty simple girl. So I'm glad to hear that my simple idea will work.

[Debby]

Starson17, would you mind sharing how you do this in Task Scheduler?

Thanks...

[chaley]

Originally Posted by Starson17

If you put "start" in front, it runs calibre and the next line in the batch, but it runs the next line immediately, not after Calibre exits.

Try it with 'start /wait'. That causes the original bat file to wait until the subprocess dies. This thread has a fair discussion of the technique along with experiment results.

[chaley]

Originally Posted by Debby

Starson17, would you mind sharing how you do this in Task Scheduler?

I am not starson17 , but you might get some help in this thread.

[Starson17]

Originally Posted by chaley

Try it with 'start /wait'

Excellent point, I'd forgotten the /wait option.

[Debby]

Originally Posted by chaley

I am not starson17 , but you might get some help in this thread.

Thank you! If someone has something a little more detailed that would help. I can generally follow along if I have examples. For example, with no experience I was able to use the plugin for removing the "unspeakable".

I actually understand how to make the batch file (major step for a non-techie ).
But I am not certain of the syntax for copying the library. I will google using task manager and see if I find examples.

I am looking for way to ensure the library stays backed up since I have had to restore it twice. I am beginning to suspect the issue is the interaction with the reader - since both times this happened I plugged in the Sony 505 to upload books. At least now I understand how to save all the metabooks (with covers)!

[Starson17]

Originally Posted by Debby

But I am not certain of the syntax for copying the library.
...
I am looking for way to ensure the library stays backed up since I have had to restore it twice.

There are many here who will be happy to help you structure what you want. The problem is figuring out what that is - i.e., what you want and what will work for you given the size of your library, when you want the library backed up, etc.

A basic copied Library type of backup has two parts - the books and the metadata.db file. Copying all of the books, each time I exited Calibre, would be impossible for me. It would take far too long, and I seldom exit it.

I think your first question to answer is: "When do you want your library backed up?" If your computer runs 24/7, it's easy - do it at night. If not, perhaps you just want to manually run the batch file, not automatically. Or maybe you prefer when you turn on/off the computer?

You could use a system that copies the ebooks manually (you manually choose to run a backup by starting a batch file), but always backs up metadata.db when you exit. You could choose to run the backup automatically at night, and only leave the computer on at night when you want a backup -telling the Scheduled Task to not run when the computer is off.

What do you think would work for you?

[itimpi]

If you are running Windows then a very simple form of backup is to run a DOS command of the form:
XCOPY /D /S /Y SourceFolder TargetFolder
This will do a copy (including sub-folders), and the /D option tells it to only copy files whose date has changed.

More sophisticated backup solutions will do differential backups and give you the option to return to a nominated point in time. The backup utility that comes as part of Windows will do for most people.

[Debby]

Thank you! I typically leave my computer on 24/7 so at night would be the best. I really liked your idea of having 6 files on hand and then deleting the old. What saved me during this last disaster was the ability to use restore in windows. I actually have a backup system in place but it failed. My network back up was full and the system administrator did not catch it (located off site). So, I am going to add my own backup to be safe.

I don't think I need the entire library copied every night - I agree that would be too much. I currently have about 1,000 books. But, the file is not really that big - around 850 MB

1. A complete back up (metadata, covers) once a week. I think the saved disk technique (similar to dwanthny) would be ideal but I don't believe that can automated. So, I will do that manually.

1. In a perfect world (sigh) a back up would occur of the NEW books I added that day (with covers) along with a daily metadata.

Would this work if I needed to restore the library? My goal would be to be able to restore everything completely (including covers and metadata).

Or if I just copy the metadata nightly, what happens if I copy over the metadata and one of the books is not in the library file?

[DoctorOhh]

Originally Posted by Debby

1. In a perfect world (sigh) a back up would occur of the NEW books I added that day (with covers) along with a daily metadata.

itimpi's basic batch file backup can easily be setup to run each night. This would back up the NEW books you added that day (with covers) along with a daily metadata.

[Starson17]

Originally Posted by Debby

1. In a perfect world (sigh) a back up would occur of the NEW books I added that day (with covers) along with a daily metadata.

This is basically what I do. I can suggest some options.

My preference is to run PureSync, a folder synchronization program via a batch file. It operates in one-way mirror mode, compares my backup copy of the Library to my master copy (located on another drive in a networked computer), copies over any new books, deletes any old books that were deleted from the master, and copies over and replaces the metadata.db file (provided it has changed). There are lots of folder synchronization programs around.

Another alternative is to run XCOPY. It can be set to copy only files that have not been backed up and then it sets the archive bit, but that method doesn't delete old books deleted from the master, nor does it work if another backup program is being used.

You can always just copy the entire Library folder every now and then.

As to the multiple metadata.db files, I use something simple like this:

c:
cd \path\to\Calibre\Library
if exist metadata.db.6 del metadata.db.6
if exist metadata.db.5 ren metadata.db.5 metadata.db.6
if exist metadata.db.4 ren metadata.db.4 metadata.db.5
if exist metadata.db.3 ren metadata.db.3 metadata.db.4
if exist metadata.db.2 ren metadata.db.2 metadata.db.3
if exist metadata.db.1 ren metadata.db.1 metadata.db.2
if exist metadata.db copy metadata.db metadata.db.1

You can put it in a batch file, run it nightly with a Windows scheduled task, or before your backup.