Disappearing files

Argel · 02-14-2010, 04:58 PM

Just when I was coming to rely on Calibre I discover that large chunks of my library have simply gone missing.

The books show up in the library display with title/author metadata present and an apparent size but there are no formats available - not surprising since the directories pointed to are empty.

These are books which have been successfully imported, converted and uploaded again - they were there and they were fine.

Further inspection suggests that basically all books in mobi format which were present in the library before the beginning of December 2009 have gone. Books added since that date appear untouched. There are books in lit format from before that date but I cannot say whether any lit books have gone. Many prc books are still there, too, so no idea whether any have gone. My guess is that it is only mobi.

As far as I am aware I have never touched the Calibre directory structure - I have only ever downloaded and installed new versions and everything has seemed fine.

OS is Vista 32.

kovidgoyal · 02-14-2010, 05:38 PM

calibre doesn't delete files unless you ask it to. And is certainly doesn't preferentially delete one format and not another. In fact it is designed ina manner such that once a book file is added to the library, it is never touched unless you change metadata, in which case it is copied to the new folder indicated by that metadata.

Argel · 02-14-2010, 05:49 PM

Hmmm. Nevertheless the files have gone and I've never even looked at the Calibre directories before today. As to working out a way of deleting only mobi files, I wouldn't have a clue, much less a reason to try.

When you say change the metadata, would that include my habit of reversing first/second names in the author name slot as well as sort order after import?

Don't get me wrong, I love Calibre but the fact is that I've only ever used as a simple consumer so I don't think I've done anything clever or even unusual.

jackie_w · 02-14-2010, 06:48 PM

Sorry to hear of your problems. Have you tried searching the whole of your disk (not just calibre directories) for *.mobi to see if any of your lost items are somewhere strange?

Argel · 02-14-2010, 07:14 PM

Quote:

Originally Posted by jackie_w

Sorry to hear of your problems. Have you tried searching the whole of your disk (not just calibre directories) for *.mobi to see if any of your lost items are somewhere strange?

Thanks for the suggestion but I've searched for the specific files and no joy. Nothing is actually lost since I've always kept the original libraries of each format and have already re-imported them. I'm putting it down to a problem in upgrading or a glitch in a previous version.

The only practical consequence is that I've put back the day [year] when I start relying on Calibre alone to keep the library, just in case.

theducks · 02-14-2010, 07:25 PM

Check your Virus Vault and Log .
I suggest that you exclude the Calibre Librry folder (and All Subs), Further, I heartily recommend you make your Anti Virus ASK what to do when it discovers file x is a bad guy. I have not seen a lot of False Positives, but some would have destroyed any database usability .

Another Database sync killer is disk cache. Some pieces get written (Metadata in this case) and other pieces were in cache, waiting to be written to disk, when something went sour

Again, disable write behind caching. It exists to make you think you are done sooner than you are and give back control of your program (while it plays,'catch-up') .

kovidgoyal · 02-14-2010, 08:38 PM

When you click the arrow next to the delete button, there's an option to delete only files of a specific format. That's really the only way I can think that this could have happened.

Argel · 02-14-2010, 09:17 PM

Quote:

Originally Posted by kovidgoyal

When you click the arrow next to the delete button, there's an option to delete only files of a specific format. That's really the only way I can think that this could have happened.

Well all the stuff is now reinstalled and I'm going to assume that it happened when I upgraded after a long gap in December. Thanks for listening.

DoctorOhh · 02-14-2010, 10:42 PM

Quote:

Originally Posted by Argel

Well all the stuff is now reinstalled and I'm going to assume that it happened when I upgraded after a long gap in December. Thanks for listening.

I wouldn't be so quick to chalk this up to an upgrade glitch. If you do that you may make the same mistake again. In the past I have accidentally moved or deleted things I didn't mean to when I started cleaning items up via the search window.

I'll keep my fingers crossed for you in the hopes that whatever it was that caused this doesn't happen again.

02-14-2010, 04:58 PM	#1
Argel Opinionated [but right] Posts: 281 Karma: 1412 Join Date: Apr 2008 Location: UK Device: Cybook Gen3, PRS 505, Kindle Int, Oasis, Paperwhite, Scribe	Disappearing files Just when I was coming to rely on Calibre I discover that large chunks of my library have simply gone missing. The books show up in the library display with title/author metadata present and an apparent size but there are no formats available - not surprising since the directories pointed to are empty. These are books which have been successfully imported, converted and uploaded again - they were there and they were fine. Further inspection suggests that basically all books in mobi format which were present in the library before the beginning of December 2009 have gone. Books added since that date appear untouched. There are books in lit format from before that date but I cannot say whether any lit books have gone. Many prc books are still there, too, so no idea whether any have gone. My guess is that it is only mobi. As far as I am aware I have never touched the Calibre directory structure - I have only ever downloaded and installed new versions and everything has seemed fine. OS is Vista 32. Last edited by Argel; 02-14-2010 at 05:31 PM. Reason: Further information

02-14-2010, 05:38 PM	#2
kovidgoyal creator of calibre Posts: 45,198 Karma: 27110894 Join Date: Oct 2006 Location: Mumbai, India Device: Various	calibre doesn't delete files unless you ask it to. And is certainly doesn't preferentially delete one format and not another. In fact it is designed ina manner such that once a book file is added to the library, it is never touched unless you change metadata, in which case it is copied to the new folder indicated by that metadata. Last edited by kovidgoyal; 02-14-2010 at 05:42 PM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Characters are disappearing	JiYu	Amazon Kindle	2	10-02-2010 03:02 PM
PRS-600 Log files disappearing after SD card unmount (buggy sync?), anyone seen this before?	Xaphiosis	Sony Reader Dev Corner	2	07-12-2010 07:49 PM
Disappearing txt files?!?	JaneFancher	Sigil	2	06-26-2010 02:55 PM
Files disappearing!	The CB	Calibre	2	08-11-2009 06:23 PM
Library Disappearing	Knocka	Calibre	29	03-13-2009 09:37 PM

02-14-2010, 05:49 PM	#3
Argel Opinionated [but right] Posts: 281 Karma: 1412 Join Date: Apr 2008 Location: UK Device: Cybook Gen3, PRS 505, Kindle Int, Oasis, Paperwhite, Scribe	Hmmm. Nevertheless the files have gone and I've never even looked at the Calibre directories before today. As to working out a way of deleting only mobi files, I wouldn't have a clue, much less a reason to try. When you say change the metadata, would that include my habit of reversing first/second names in the author name slot as well as sort order after import? Don't get me wrong, I love Calibre but the fact is that I've only ever used as a simple consumer so I don't think I've done anything clever or even unusual.

02-14-2010, 06:48 PM	#4
jackie_w Grand Sorcerer Posts: 6,249 Karma: 16539642 Join Date: Sep 2009 Location: UK Device: ClaraHD, Forma, Libra2, Clara2E, LibraCol, PBTouchHD3	Sorry to hear of your problems. Have you tried searching the whole of your disk (not just calibre directories) for *.mobi to see if any of your lost items are somewhere strange?

02-14-2010, 07:25 PM	#6
theducks Well trained by Cats Posts: 30,909 Karma: 60358908 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	Check your Virus Vault and Log . I suggest that you exclude the Calibre Librry folder (and All Subs), Further, I heartily recommend you make your Anti Virus ASK what to do when it discovers file x is a bad guy. I have not seen a lot of False Positives, but some would have destroyed any database usability . Another Database sync killer is disk cache. Some pieces get written (Metadata in this case) and other pieces were in cache, waiting to be written to disk, when something went sour Again, disable write behind caching. It exists to make you think you are done sooner than you are and give back control of your program (while it plays,'catch-up') .

02-14-2010, 08:38 PM	#7
kovidgoyal creator of calibre Posts: 45,198 Karma: 27110894 Join Date: Oct 2006 Location: Mumbai, India Device: Various	When you click the arrow next to the delete button, there's an option to delete only files of a specific format. That's really the only way I can think that this could have happened.

Advert

Advert