Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre

Notices

Reply
 
Thread Tools Search this Thread
Old 02-05-2009, 10:56 PM   #1
GavinZac
Junior Member
GavinZac began at the beginning.
 
Posts: 5
Karma: 10
Join Date: Feb 2009
Device: Sony Reader
Did Calibre really just delete my entire collection?!

Its 4am and I've been working on organising my book collection via Calibre for the last 6 hours. I've just had an SQLite error, and now Calibre shows no files - and neither does my file manager.

Please tell me Calibre would not delete every single file on the basis of an error?
GavinZac is offline   Reply With Quote
Old 02-06-2009, 12:31 AM   #2
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 25,447
Karma: 4961459
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
calibre never deletes files on receiving an error.
kovidgoyal is offline   Reply With Quote
Old 02-06-2009, 07:13 AM   #3
GavinZac
Junior Member
GavinZac began at the beginning.
 
Posts: 5
Karma: 10
Join Date: Feb 2009
Device: Sony Reader
I don't think its wise to make such assumptions!

If Calibre found itself with an empty database suddenly, would it clear out the chosen Calibre eBook directory? Because after the error my library was gone, and unfortunately so were 400 eBooks.

Is there a log file where I can find out the exact error?

Calibre seemed like such fantastic software that I'm actually probably going to try again - the alternative is going through a ton of LIT files by hand. But I'd like to isolate what this problem was, so as to avoid it in the future (and obviously, im going to back up the books which had yet to be imported to Calibre, this time )

Last edited by GavinZac; 02-06-2009 at 07:16 AM.
GavinZac is offline   Reply With Quote
Old 02-06-2009, 09:16 AM   #4
itimpi
Wizard
itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.
 
Posts: 4,031
Karma: 777817
Join Date: Nov 2008
Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)
I can tell you from experience that Calibre does NOT clear out the library folder if there are files in there it does not have in its metadata database.

When Calibre is about to delete any files it has a confirmation dialog before it proceeds, so again it seems unlikely it can go mad deleting files.

I guess a lot depends on what caused the orignal error. If it was at the file-system level it could have been Windows that deleted all the files!

Having said that, I do back up the Calibre database and associated files at regular intervals as a lot of effort has gone into organising my collection and getting all the metadata and cover art as I want them, let alone the conversions into formats suitable for my e-book readers.

Last edited by itimpi; 02-06-2009 at 09:19 AM.
itimpi is online now   Reply With Quote
Old 02-06-2009, 09:41 AM   #5
wallcraft
reader
wallcraft ought to be getting tired of karma fortunes by now.wallcraft ought to be getting tired of karma fortunes by now.wallcraft ought to be getting tired of karma fortunes by now.wallcraft ought to be getting tired of karma fortunes by now.wallcraft ought to be getting tired of karma fortunes by now.wallcraft ought to be getting tired of karma fortunes by now.wallcraft ought to be getting tired of karma fortunes by now.wallcraft ought to be getting tired of karma fortunes by now.wallcraft ought to be getting tired of karma fortunes by now.wallcraft ought to be getting tired of karma fortunes by now.wallcraft ought to be getting tired of karma fortunes by now.
 
wallcraft's Avatar
 
Posts: 6,979
Karma: 5183568
Join Date: Mar 2006
Location: Mississippi, USA
Device: Kindle 3 and Fire
I suggest searching your entire system for the ebook files. Perhaps they got moved somehow. What operating system are you running under?
wallcraft is offline   Reply With Quote
Old 02-06-2009, 12:42 PM   #6
pilotbob
Grand Sorcerer
pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.
 
pilotbob's Avatar
 
Posts: 19,494
Karma: 11248282
Join Date: Jan 2007
Location: Tampa, FL USA
Device: Kindle Touch
Quote:
Originally Posted by GavinZac View Post
I don't think its wise to make such assumptions!
I'm pretty sure Kovid, they guy that wrote calbire, isn't assuming here.

Did you look in your Recycle Bin. It's easy to make a slip of the mouse sometimes.

BOb
pilotbob is offline   Reply With Quote
Old 02-06-2009, 02:25 PM   #7
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 25,447
Karma: 4961459
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Quote:
Originally Posted by GavinZac View Post
I don't think its wise to make such assumptions!

If Calibre found itself with an empty database suddenly, would it clear out the chosen Calibre eBook directory? Because after the error my library was gone, and unfortunately so were 400 eBooks.

Is there a log file where I can find out the exact error?

Calibre seemed like such fantastic software that I'm actually probably going to try again - the alternative is going through a ton of LIT files by hand. But I'd like to isolate what this problem was, so as to avoid it in the future (and obviously, im going to back up the books which had yet to be imported to Calibre, this time )
The only times that calibre deletes anything is when you ask it to delete a book and when you change the metadata on a book. On the latter ocassion, the book is first copied to a new folder and then the original folder is deleted.

What exactly is deleted? The library folder, the metadata.db file, all the individual book folder? Only the book files?
kovidgoyal is offline   Reply With Quote
Old 02-06-2009, 03:31 PM   #8
GavinZac
Junior Member
GavinZac began at the beginning.
 
Posts: 5
Karma: 10
Join Date: Feb 2009
Device: Sony Reader
Quote:
Originally Posted by wallcraft View Post
I suggest searching your entire system for the ebook files. Perhaps they got moved somehow. What operating system are you running under?
I'm using Ubuntu Intrepid, everything up to date. They definitely aren't in any trash or temp folder, in fact I don't have any LBR files on the computer - I had been using Calibre to convert my LIT collection to LBR
Quote:
Originally Posted by pilotbob View Post
I'm pretty sure Kovid, they guy that wrote calbire, isn't assuming here.
It's not an accusation on my part toward Kovid, but as a software developer myself I know that assuming your software doesn't do something is a quick way to find out what it can do! Like one Windows Mobile program which sync'd with not just the host PC but each on the network...

Quote:
Originally Posted by kovidgoyal View Post
The only times that calibre deletes anything is when you ask it to delete a book and when you change the metadata on a book. On the latter ocassion, the book is first copied to a new folder and then the original folder is deleted.
The only thing I can think of so, is that perhaps it tried to update metadata, thought it had succeeded but it hadn't. Again, is there a log file I could go through?

Quote:
What exactly is deleted? The library folder, the metadata.db file, all the individual book folder? Only the book files?
The folder is there, the metadata.db file is there, and one other folder, a folder called "Nora Roberts" (don't laugh, it's my girlfriend's honest ) with absolutely nothing in it

Is there a way to check if there's anything in the metadata.db file? I've assumed its empty because Calibre doesn't show anything, but I could be wrong.

Anyway, I've reassembled my collection and will give Calibre another go, retaining a backup. I'll report any further errors I get here.

Please don't think I'm trolling. I'd love to be the guy trolling as I'd still have my books. I'd just like to not have this happen again to me, or others I guess. But mostly to me

Last edited by GavinZac; 02-06-2009 at 03:37 PM.
GavinZac is offline   Reply With Quote
Old 02-06-2009, 03:42 PM   #9
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 25,447
Karma: 4961459
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Quote:
Originally Posted by GavinZac View Post
The only thing I can think of so, is that perhaps it tried to update metadata, thought it had succeeded but it hadn't. Again, is there a log file I could go through?
That would at worst have removed a single folder, not all of them.

Quote:
The folder is there, the metadata.db file is there, and one other folder, a folder called "Nora Roberts" (don't laugh, it's my girlfriend's honest ) with absolutely nothing in it
I really can't think of a situation that would lead to this, and I've never heard of it happening before. What linux filesystem is your database stored on?

Quote:
Is there a way to check if there's anything in the metadata.db file? I've assumed its empty because Calibre doesn't show anything, but I could be wrong.
The database is a sqlite database. You should be able to use any of a dozen different tools to browse the database.

Best way to get a log is to simply start calibre in a terminal. It will print any unhandled errros to stdout (it also shows them in the GUI).
kovidgoyal is offline   Reply With Quote
Old 02-06-2009, 03:48 PM   #10
GavinZac
Junior Member
GavinZac began at the beginning.
 
Posts: 5
Karma: 10
Join Date: Feb 2009
Device: Sony Reader
Quote:
Originally Posted by kovidgoyal View Post
That would at worst have removed a single folder, not all of them.
I really can't think of a situation that would lead to this, and I've never heard of it happening before. What linux filesystem is your database stored on?
Ok. I'm using EXT3, no fancy EXT4 for me yet.

Quote:
The database is a sqlite database. You should be able to use any of a dozen different tools to browse the database.
I'll take a look, but I've actually restarted importing them so it's probably pointless.

Quote:
Best way to get a log is to simply start calibre in a terminal. It will print any unhandled errros to stdout (it also shows them in the GUI).
Ok cool. Maybe as a feature for next release it could output a crash dump or something on errors? I'll try to run it from terminal from now on and if I encounter this again I'll pop the output into this thread.

As I said,I'm going to give it another go. It's a great program, and I've just introduced my girlfriend to it. She told me to say it's fantastic, and was surprised when the guy writing it was also the guy answer questions on a forum
GavinZac is offline   Reply With Quote
Old 02-06-2009, 10:06 PM   #11
pilotbob
Grand Sorcerer
pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.pilotbob ought to be getting tired of karma fortunes by now.
 
pilotbob's Avatar
 
Posts: 19,494
Karma: 11248282
Join Date: Jan 2007
Location: Tampa, FL USA
Device: Kindle Touch
Quote:
Originally Posted by GavinZac View Post
Anyway, I've reassembled my collection and will give Calibre another go, retaining a backup. I'll report any further errors I get here.
Sign up for dropbox (getdropbox.com) and then move your calibre library to your dropbox. This will give you automatic offline backup. Also, dropbox revs stuff so if it is deleted from your pc you can recover it.

BOb
pilotbob is offline   Reply With Quote
Old 02-06-2009, 10:13 PM   #12
Andybaby
Wizard
Andybaby plays well with othersAndybaby plays well with othersAndybaby plays well with othersAndybaby plays well with othersAndybaby plays well with othersAndybaby plays well with othersAndybaby plays well with othersAndybaby plays well with othersAndybaby plays well with othersAndybaby plays well with othersAndybaby plays well with others
 
Andybaby's Avatar
 
Posts: 1,279
Karma: 2683
Join Date: Nov 2008
Location: New York
Device: PRS-700
and I know that an error like this is possible. it has happened to me before. in windows. with another program.

I was moving Data using a well known file manager from one drive to another, neither of them the C drive, I hit cancel, and it took that to mean to delete my c:/windows folder.

Im entirely sure that it was a freak accident and will probably never happen again. with that program, or calibre
Andybaby is offline   Reply With Quote
Old 02-06-2009, 10:23 PM   #13
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 25,447
Karma: 4961459
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Quote:
Originally Posted by GavinZac View Post
Ok cool. Maybe as a feature for next release it could output a crash dump or something on errors? I'll try to run it from terminal from now on and if I encounter this again I'll pop the output into this thread.
Like I said, unhandled errors are displayed in the GUI and printed to stdout. Since calibre is written in python, it doesn't usually crash, and even when it does, a dump wouldn't provide much useful information.

Quote:
As I said,I'm going to give it another go. It's a great program, and I've just introduced my girlfriend to it. She told me to say it's fantastic, and was surprised when the guy writing it was also the guy answer questions on a forum
Actually, answering questions on the forum is a big part of what keeps me motivated to continue developing calibre.
kovidgoyal is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
pulling an entire website into Calibre and generate an epub file using news function? N13L5 Calibre 2 10-06-2010 09:00 PM
Calibre not converting entire PDF book, HELP! chilady1 Calibre 4 09-21-2010 05:11 AM
Please Help - My Entire Calibre Library Disappeared Marcy Calibre 17 08-14-2010 09:56 AM
TWILIGHT FANS!!! Entire collection on Kindle for $5.27 [Pricing error/now higher!] chilady1 Deals, Freebies, and Resources (No Self-Promotion) 27 10-29-2009 10:53 AM
Jacobs, W. W.: Deep Waters, The Entire Collection. 19 Oct. 2007 Roy White BBeB/LRF Books 0 10-19-2007 09:59 PM


All times are GMT -4. The time now is 06:01 PM.


MobileRead.com is a privately owned, operated and funded community.