How to backup and restore libraries, settings, and plugins

[AnnieQuinn]

Hi, I have seen a thread about archiving to restore library management settings so that they can be restored when reinstalling the computer or changing computers. Including plugins and custom columns.
But I can't find that thread now.
Or can you guys show me how to archive and restore?
I already know how to restore library content (books and libraries).
Now I am confused about plugins and sub-columns. I am not sure what to save so that I can restore later.
Thank you very much. I have learned a lot from you guys, thanks for being patient with me.

[chaley]

To backup everything:

• In the steps below, ensure calibre is not running.
• Use a program like FreeFileSync to mirror your library to where you want it saved. Do not use two-way syncing.
  
  If you have enough space in a cloud drive, mirror the library to there so you have an off-site backup. NG: There have been incidents where backups mirrored to Google Drive aren't usable because of Drive's versioning scheme. YMMV. DO NOT use a cloud drive for your library.
• Plugins and many calibre settings are stored in the calibre configuration folder. Again, use a program like FreeFileSync to backup this folder to where you want it saved. You can find where the configuration folder is stored using calibre: go to Preferences / Miscellaneous / Open calibre configuration folder. Note the path. It is usually in a home folder. For example, on Windows it is usually in \Users\*you*\AppData\Roaming\calibre.
  
  Again, mirror the configuration folder to a cloud drive if you have cloud space.
• You can keep a history of the configuration folder contents using the Backup configuration folder(s) calibre plugin. Mirror the folder where you save the backups to a cloud drive if you have space and wish offsite backup for the history.

Restoring from these backups is straight forward; copy the mirrored backups back to their source.

Again, DO NOT use a cloud drive to store an active library or configuration folder.

[JSWolf]

And DO NOT use Google Drive as it WILL CORRUPT your library.

[AnnieQuinn]

Thank you so much for your help.

[DNSB]

If you want to backup your libraries and configuration to Google Drive (or any other cloud storage service), I would recommend using a zip utility (I personally use 7Zip) to zip your libraries and the calibre configuration directory and then send that file to your backup destination. For myself, I use 7Zip and a batch file to automate the process.

This does require enough local storage back to create the .zip file which can be an issue for those who don't have much in the line of local storage.

[theducks]

Sending a ZIP to GD prevents GD from modifying the File names INSIDE the zip.

GD adjusting the file names is what breaks Calibre linkages.

[BetterRed]

Originally Posted by DNSB

If you want to backup your libraries and configuration to Google Drive (or any other cloud storage service), I would recommend using a zip utility (I personally use 7Zip) to zip your libraries and the calibre configuration directory and then send that file to your backup destination. For myself, I use 7Zip and a batch file to automate the process.

This does require enough local storage back to create the .zip file which can be an issue for those who don't have much in the line of local storage.

I have never needed to use my backup (managed by Goodsynch which is very similar to FFS), to recover an entire library, it's almost invariably a book folder, or a format file I regret removing six months ago (GS retains an archive of deleted folders and files).

I include several calibre libraries and configs, and my locally saved mail, soc med posts, tax receipts, shopping lists etc, etc in one GS job… I am 90% sure FFS can do the same.

I can reinstate a format or book directly from GS's current mirror or its archive of deleted folders and files into the relevant calibre library using the relevant Add Books action.

I keep a weekly backup in the cloud, but I've never made any use of it except to look at and maybe copy from when away from home. I do daily backups lo local HQ HDD drives - from which I've recovered books and formats as described above. Haven't lost an HDD in decades.

I also make use of Windows Previous Versions in "Bugger where did Chapter Eleven go" situations. Always me selecting Chapter Eleven, hitting Delete and saying Yes of course I'm sure, then doing a Ctrl+S, Alt+space,c

BR

[enuddleyarbl]

Why has no one mentioned simply using Export under the Library button on the menu bar? I've used its Import pair several times now to restore everything about Calibre. Am I not seeing something that the export/import function doesn't save/restore?

https://manual.calibre-ebook.com/gui.html#library

[chaley]

Originally Posted by enuddleyarbl

Why has no one mentioned simply using Export under the Library button on the menu bar? I've used it's Import pair several times now to restore everything about Calibre. Am I not seeing something that the export/import function doesn't save/restore?

You're right, it should be mentioned, but in the context of moving libraries between machines. It has a few problems if used as a basic backup/restore mechanism:

• It isn't incremental. One backs up the entire library. This takes time and space.
• It isn't easily automated. I do an incremental backup every time calibre quits.
• Several people have reported problems with corrupted zip files. Because this is an all-or-nothing backup, one corruption invalidates the entire backup.

If what you want is to move a calibre library from one machine to another then the built-in import/export is the best solution because it deals with differences between operating systems. However, be sure to test restoring the backup before the source library is deleted.

[JSWolf]

Originally Posted by DNSB

If you want to backup your libraries and configuration to Google Drive (or any other cloud storage service), I would recommend using a zip utility (I personally use 7Zip) to zip your libraries and the calibre configuration directory and then send that file to your backup destination. For myself, I use 7Zip and a batch file to automate the process.

This does require enough local storage back to create the .zip file which can be an issue for those who don't have much in the line of local storage.

You do not need to ZIP anything if you use Onedrive. Google Drive you do 100%.

However, it's easiest to use rclone and winfsp to map your cloud service as a drive and use FreeFileSync to sync to your cloud service.

[DNSB]

Originally Posted by JSWolf

You do not need to ZIP anything if you use Onedrive. Google Drive you do 100%.

Actually for me, I do need to zip the backups since I keep 3 generations of backup and using the date as part of the filename makes this easy to do.