Question Re: Windows 10 Filehistory & Calibre

[pjmpjm]

I've run Calibre for years on Windows, and up until recently thought that the newish builit-in 'Filehistory' utility in Windows was backing up my Calibre database. (I send my Filehistory data to an external hard drive.)

However, in checking Filehistory lately, I notice that it doesn't always include the book itself in each book's 'backup' file. Instead, in the book's individual folder, Filehistory will often include only the OPF and JPG (cover) files and not the EPUB or MOBI or other book file.

Can anyone with more detailed Filehistory and Calibre knowledge give me some advice?

In any case, I always keep a completely separate backup of my Calibre Library directory on a separate external hard drive.

Thanks in advance!

[DNSB]

Originally Posted by pjmpjm

I've run Calibre for years on Windows, and up until recently thought that the newish builit-in 'Filehistory' utility in Windows was backing up my Calibre database. (I send my Filehistory data to an external hard drive.)

However, in checking Filehistory lately, I notice that it doesn't always include the book itself in each book's 'backup' file. Instead, in the book's individual folder, Filehistory will often include only the OPF and JPG (cover) files and not the EPUB or MOBI or other book file.

Can anyone with more detailed Filehistory and Calibre knowledge give me some advice?

I was under the impression that File History only backed up changed files so it would make sense that if you were editing metadata, cover images, etc. you would not get the ebook itself unless you used ModifyEpub or Polish to embed the metadata into the ebook file.

Check incremental backup vs. full backup for the different backup strategies.

As for newish? I seem to remember seeing File History in Windows 8.

[pjmpjm]

David, thanks so much for the quick reply. It could be that I'm misinformed about exactly what Filehistory does in Windows 10. Perhaps someone else can confirm its interaction with Calibre. In the meantime, I'll do some more research. As regards my 'newish' comment . . . I recall my reluctant switch from DOS over to the 'new' Windows sometime around 1985, so I guess I'm dating myself!

[pjmpjm]

"File History automatically backs up your files every hour by default, but you can select a different time ... By default, File History will be set to back up back up important folders in your user account's home folder. This includes the Desktop, Documents, Downloads, Music, Pictures, Videos folders."

The above is what I found just now, which seems to confirm my original idea as to how File History works. I keep my Calibre Library folder on my Desktop, so expected that it would be backed up regularly.

[DNSB]

Originally Posted by pjmpjm

"File History automatically backs up your files every hour by default, but you can select a different time ... By default, File History will be set to back up back up important folders in your user account's home folder. This includes the Desktop, Documents, Downloads, Music, Pictures, Videos folders."

The above is what I found just now, which seems to confirm my original idea as to how File History works. I keep my Calibre Library folder on my Desktop, so expected that it would be backed up regularly.

File History does the same job of backing up files, but it follows a technique called Continous Data Backup which means the system can backup files in real-time. Similar to its older counterpart, File History supports incremental backups where successive copies of data only contain what has been changed since the last backup.

As I said, check the differences between an incremental backup strategy, a full backup strategy and a differential backup strategy. Deciding which to use is close to a black art. Our corporate policy is a full backup weekly with incrementals the other 6 days. Backing up 120TB over the WAN to the remote SAN takes close to 20 hours.

Full Backup captures your entire system and all the data you want to protect. Frequent full backups result in easier recovery operations.

• Pros: Fast, reliable recovery
• Cons: Slower backup, lots of storage required

Incremental Backup captures only the changes made since the last incremental backup. Saves both time and storage space, and ensures that your backup is up to date.

• Pros: Fast backups, low storage space
• Cons: Slower recovery, risk of data loss

Differential Backup captures only the changes made since the last full backup, not since the last differential backup. This requires more storage space, but ensures an easier, more reliable restore. Many organizations struggle with incremental vs. differential backup solutions.

• Pros: Fast backups, low storage space
• Cons: Slower recovery

[pjmpjm]

Thanks again, David. Much appreciated. I hadn't wanted this question to be about Windows 10 and the details as to the workings of File History, but whether or not using File History was a good option for backing up Calibre. I was pretty sure that many long-term Calibre users, like myself, would want to know whether this 'backup' approach was really workable.

Since I started using Calibre, I've manually backed up my Calibre Library folder by simply copying the whole directory to an external hard drive. And I continue to do this, every week or two.

But it would good to hear from others who may be depending on File History for their main Calibre backup. Does it really work?

For the record, File History appears to take the incremental backup approach, checking for any changes in all monitored files every hour (or more often, if requested).

[DNSB]

Originally Posted by pjmpjm

Since I started using Calibre, I've manually backed up my Calibre Library folder by simply copying the whole directory to an external hard drive. And I continue to do this, every week or two.

I backup my calibre libraries and configuration folder to external storage once per week. If you don't mind leaving your computer on, scheduled tasks can make life much easier.

Originally Posted by pjmpjm

But it would good to hear from others who may be depending on File History for their main Calibre backup. Does it really work?

For the record, File History appears to take the incremental backup approach, checking for any changes in all monitored files every hour (or more often, if requested).

The issue with incremental backups is that they can be a pain to restore since you need to start with the first full backup and then add the incremental backups one after the other. If one gets damaged, you have problems. That's why a weekly full backup and then 6 incremental backups is what I prefer for work.

[PeterT]

Remember no need for the computer to be left on; as long as it's either suspended or hibernate then a scheduled task can wake it tiring the task.

My backups are done daily by Macrium and are a monthly full backup, weekly differential and daily incremental (and yes I have tested bare metal restores).

[DNSB]

Originally Posted by PeterT

Remember no need for the computer to be left on; as long as it's either suspended or hibernate then a scheduled task can wake it tiring the task.

To me, that is leaving the computer on.

Originally Posted by PeterT

My backups are done daily by Macrium and are a monthly full backup, weekly differential and daily incremental (and yes I have tested bare metal restores).

The bolded section is what too many people forget to test.

[PeterT]

Originally Posted by DNSB

The bolded section is what too many people forget to test.

Which is why I mentioned it

I will admit that this approach (Macrium / QNAP) is a whole lot quicker for recovery than my old Windows Homes Server was, all though from a pure techie mind set up much preferred the idea of a client / server based approach. (Oh the good old days of managing an ADSM / TSM solution with a large automated back end robotic tape Library).

[JSWolf]

Originally Posted by pjmpjm

Thanks again, David. Much appreciated. I hadn't wanted this question to be about Windows 10 and the details as to the workings of File History, but whether or not using File History was a good option for backing up Calibre. I was pretty sure that many long-term Calibre users, like myself, would want to know whether this 'backup' approach was really workable.

Since I started using Calibre, I've manually backed up my Calibre Library folder by simply copying the whole directory to an external hard drive. And I continue to do this, every week or two.

But it would good to hear from others who may be depending on File History for their main Calibre backup. Does it really work?

For the record, File History appears to take the incremental backup approach, checking for any changes in all monitored files every hour (or more often, if requested).

The best way to backup your Calibre libraries is to use FreeFileSync. That will backup everything the first time and then will only backup anything that's been changed since. It is an excellent program and it's been highly recommended on MR a number of times.

[pjmpjm]

Originally Posted by JSWolf

The best way to backup your Calibre libraries is to use FreeFileSync. That will backup everything the first time and then will only backup anything that's been changed since. It is an excellent program and it's been highly recommended on MR a number of times.

Thanks very much, JSWolf. I've just downloaded FreeFileSync and will try it out this afternoon. Sounds just like the extra backup I need.

[pjmpjm]

Originally Posted by PeterT

Remember no need for the computer to be left on; as long as it's either suspended or hibernate then a scheduled task can wake it tiring the task.

My backups are done daily by Macrium and are a monthly full backup, weekly differential and daily incremental (and yes I have tested bare metal restores).

Thanks very much, PeterT.

[billhafiz]

Hi pjmpjm. I refer back to your original question, which had also perplexed me (which is how I came to your thread). I had also been perplexed by the $OF folder which is in File Histories directory system and contains masses of material with incomprehensible file names. Apparently the $OF folder is the systems way of dealing with very long file names, as is often the case with ebook file names generated by Calibre. If you haven’t now given up on Windows File History, I’m guessing you will find a $OF folder in there. If you do a search for e.g. *.epub or *.mobi I would predict you will find files of that format with unrecognisable names; and if you open one of these you’ll find it’s an item from your library. My understanding and experience of File History is that on first backup it does make a copy of every file in the specified folders (and subsequently adds newer copies of files that have been edited).
In order to see the full content of your Calibre library in File History do the following:
1. In Windows Explorer click on the folder which contains your Calibre library
2. In the Home tab of the ribbon find and click on History (in the Open group)
3. This will take you into a friendly view of your File History, which hopefully will include everything expected, which you can explore and form which you can potentially restore to the original or a different location.
I hope this helps.

[pjmpjm]

Bill, thanks so much for taking the time to write to me about Calibre and Windows File History. You are one of the relatively few who understood what I meant in my original post . . . that File History, if it really works as advertised, should be an excellent automatic backup of the Calibre folder. In the meantime, I've followed the advice given to me by others here at MobileRead, who suggested the excellent freeware, FreeFileSync, and I've backed up my Calibre twice every night, once to an external hard drive and once to a large mini SD card in my laptop. That's kept me feeling much more secure about all my books. I'll try your suggestion this evening. Am just now away from my File History backup drive, so can't investigate immediately. Once again, thanks very much!