08-19-2015, 06:18 AM | #1 |
Enthusiast
Posts: 30
Karma: 10
Join Date: Jan 2010
Device: none
|
Sudden Big Problems with Library
Dear all,
I've used Calibre for years, since 2010 in fact, and I never had a problem with it. I now have a very large library of over 7300 books. A few days back, all of a sudden, Calibre started giving me a strange error when opening books (double clicking on the title) something like "I/O error". It eventually told me the metadata database was corrupted and that it needed to re-check everything. So it did, taking a pretty long time. Now, I got a report with LONG list of "Invalid Titles", "Extra titles", "Extra Authors", "Extra Book Formats" and "Unknown Files in Books" (hundreds of entries). In practical terms, I have 3 different kind of problems: 1) there are many titles which appear in the database but that tells me it cannot find the file, while in fact the PDF file is where it should be (I click "open path" and there it is) OR there are even TWO copies of the same PDF; 2) there are many titles which appear in the database but that tells me it cannot find the file, and in fact the relevant folder has only the "cover" and the "metadata": where the hell did my books go?? (this is what really worries me). 2) there are many books for which I have the PDF in the correct folder, or again sometimes even two files, or two metadata files, (but sometimes the folder has no number in brackets) which do not appear on the database. [NB these problems do not match exactly with the categories of error above: if it search for titles in the list of "Extra Titles" sometimes they will not appear in the database but will be in the folder, sometimes it will show in the database and also work fine...] I don't know what to do. I tried to uninstall and reinstall the lastest version, using the old library, but didn't help. I tried to tell calibre to restore database twice, but I always get error messages. Can anyone hand-hold me through this? I am mostly concerned about the many seemingly missing books. As a LAST resort I could explode the calibre library, delete everything but the PDFs and re-add everything in a new fresh installed program, but that would mean having to re-correct everything for over 7000 books. It took me years to populate and keep this library database tidy. Help please! Last edited by BranMakMorn; 08-19-2015 at 06:32 AM. |
08-19-2015, 08:11 AM | #2 |
Wizard
Posts: 4,552
Karma: 950151
Join Date: Nov 2008
Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)
|
When there is a very large mismatch between what files are in a Calibre library and what Calibre thinks should be there then the easiest way to recover is typically something along the lines of:
|
Advert | |
|
08-19-2015, 08:18 AM | #3 | |
Enthusiast
Posts: 30
Karma: 10
Join Date: Jan 2010
Device: none
|
Quote:
Damn, point n3 applies. I keep my Calibre Library inside the Google Drive folder, because 1) I want a constant backup and 2) I read my PDFs on an iPad, and I sync the book I need from Google Drive, do my annotations so that they then are automatically added to the file on my computer. It's strange tho, because I've used this system for years (for about 3 years I was on Sugarsync, then they decided to charge, so I moved to Google Drive about a year ago). Could it be just that? But again, what mostly concerns me is: were are the 200+ books which now are just missing? if I order my Calibre library for file size I can easily see that I've got over 200 entries without a size. If i click view path some of them will be there (so why doesn't it see them?), but some are missing... |
|
08-19-2015, 08:32 AM | #4 | |
Wizard
Posts: 4,552
Karma: 950151
Join Date: Nov 2008
Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)
|
Quote:
The process I mentioned should allow you to find and rectify such problems. I think someone also put together a program which could scan a Calibre library stored on Google Drive and correct cases where the number in brackets had been removed, but I do not have any link to it. If you want to use a Cloud service for your Calibre library then something like Copy.com or OneDrive might be better choices. Note, however, that when using Cloud Services you must always make certain that you never have two instances of Calibre at different locations running against the same Calibre library or corruption will occur as Calibre is not multi-user aware in its current incarnation). |
|
08-19-2015, 08:45 AM | #5 | |
Enthusiast
Posts: 30
Karma: 10
Join Date: Jan 2010
Device: none
|
Quote:
Thanks, I'll try to follow the process you described. And no, I never run Calibre on any other computer but mine. One last question though: why do I find in so many cases that a given book has been duplicated in the folder, so that I see, for ex, "How to Fix your Calibre - John Doe" AND "How to Fix your Calibre - John Doe (1)" ? |
|
Advert | |
|
08-19-2015, 09:07 AM | #6 | |
Wizard
Posts: 4,552
Karma: 950151
Join Date: Nov 2008
Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)
|
Quote:
Points to note
|
|
08-19-2015, 09:58 AM | #7 | |
Well trained by Cats
Posts: 29,659
Karma: 54369090
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
|
Quote:
Backup your Library (and settings) IO error on the main library is almost always a drive (or hardware) failure any attempt to repair the Drives file system is like putting a person having a Heart Attach, on a treadmill. Find and fix the IO problem: (2010 hardware is Old age hardware. Consumer grade does not always last as long as business grade) If your library is on a Flash drive, replace the drive. They have finite cycles. If your drive is a external USB HD: 1) make sure the power supply is firmly connected (IMHO self (USB) powered drives are marginal designs). 2) Replace the USB cable. 3) Verify the port connector is still firm. Better yet. change ports |
|
08-19-2015, 10:03 AM | #8 |
Ex-Helpdesk Junkie
Posts: 19,422
Karma: 85397180
Join Date: Nov 2012
Location: The Beaten Path, USA, Roundworld, This Side of Infinity
Device: Kindle Touch fw5.3.7 (Wifi only)
|
See this sticky in the Related Tools subforum: WARNING - Google Drive Incompatible with Calibre!
It has links to the two tools developed at various times by MR members to fix such a library. |
08-19-2015, 10:28 AM | #9 |
Enthusiast
Posts: 30
Karma: 10
Join Date: Jan 2010
Device: none
|
Umm, ok so just to be clear: is it Google Drive or is my HDD failing? It's on no external of flash drive, it's my laptop HDD. I also always backup the whole thing on an external one, like every 2 months, and I've done it yesterday.
EDIT: and my laptop is not even 2 years old. Last edited by BranMakMorn; 08-19-2015 at 10:31 AM. |
08-19-2015, 10:55 AM | #10 |
Grand Sorcerer
Posts: 12,103
Karma: 73447988
Join Date: Nov 2007
Location: Toronto
Device: Nexus 7, Clara, Touch, Tolino EPOS
|
Take a look in the Windows Event Viewer and see if there are any events related to disk failure.
|
08-19-2015, 11:12 AM | #11 | |
Ex-Helpdesk Junkie
Posts: 19,422
Karma: 85397180
Join Date: Nov 2012
Location: The Beaten Path, USA, Roundworld, This Side of Infinity
Device: Kindle Touch fw5.3.7 (Wifi only)
|
Quote:
All your signs point to a Google Drive attack, I personally see no reason to suspect HDD failure. (But it never hurts to check a drive for hardware failures.) |
|
08-19-2015, 12:56 PM | #12 |
Well trained by Cats
Posts: 29,659
Karma: 54369090
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
|
All of a sudden, 'Google Drive' entered this discussion.
To be clear: Do you use Google drive for ANYTHING? If the answer is NO, then the 'Google drive' is a red herring (In you case) GD is a known Library issue The event viewer (system section) is a good tip (look at red items) |
08-19-2015, 01:09 PM | #13 |
Enthusiast
Posts: 30
Karma: 10
Join Date: Jan 2010
Device: none
|
So to be clear:
YES, I keep my entire Calibre Library folder inside my Google Drive folder. NO, to the best of my understanding, Event Viewer has no Disk-related errors. So, I suppose it's just Google Drive's fault. Which sucks, but I guess I can look into OneDrive. Tomorrow morning I'll try to apply the fix offered above. |
08-19-2015, 01:25 PM | #14 |
Grand Sorcerer
Posts: 12,103
Karma: 73447988
Join Date: Nov 2007
Location: Toronto
Device: Nexus 7, Clara, Touch, Tolino EPOS
|
What many people (ok; some people (ok; I know I do)) is keep their library OUTSIDE of any of the Google Drive / Dropbox / ... folders on their PC, but then use a tool to do a ONE WAY sync from the location on their PC to the Google Drive / Dropbox / ... folder on their PC.
In my case I use Allway Sync http://allwaysync.com/ |
08-19-2015, 01:33 PM | #15 | |
Well trained by Cats
Posts: 29,659
Karma: 54369090
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
|
Quote:
GD is just not a good fit with the Calibre Library structure Whatever you use. Pause synch when using Calibre. Things happen in rapid sequences. 1 way (as a backup only) is better for the same reason |
|
Thread Tools | Search this Thread |
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Big Library Read | Fbone | General Discussions | 7 | 06-09-2015 06:02 PM |
Big Library (accelerate starting?) | epubfan | Library Management | 1 | 12-28-2013 02:58 PM |
Sudden increase in problems | Darnielle | Kobo Tablets | 29 | 12-10-2011 08:02 AM |
Sudden big slowdown in page turn time | KlondikeGeoff | Sony Reader | 16 | 06-25-2011 10:15 PM |
New Owner - Big Problems | Crumbz | iRex | 9 | 11-04-2008 12:40 AM |