[MacOS] I need a new Calibre library

ChipAHoy · 11-16-2018, 11:34 AM

I hope I don't get banned from the forums for posting this, because my issue has been posted elsewhere, as a response to previous users' posts. But I don't know what to do to get my Calibre library back.

I have tried restoring my Calibre library from backups, and either get a message that no valid library is present when I try to switch libraries in the Calibre app, or, it seems to import my backup library, then shows zero books.

I have attempted this restoring while Calibre is closed, per earlier instructions. I end up with multiple Calibre directories that I didn't create.

I don't know what exactly I did to create this mess, but the more I try to fix it, the worse it seems to get. I have the ebook files on my computer, it's just trying to get them into a Calibre library that I am having problems with. Have spent more time than I want to admit trying to fix this.

I just want to restore or create a working library in Calibre. Is there not any way just to start from scratch?

ChipAHoy · 11-16-2018, 12:04 PM

how do I do this on a Mac?

Quote:

Originally Posted by kovidgoyal

I dont really understand what your issue is, since the number of things you could have done to arrive in this state is nearly infinite, but, here's how to reset everything.

1) Remove any calibre environment variables

2) Remove the calibre configuration directory. Reboot your computer.

3) Copy your old library folder off the NAS and on to a local hard disk

4) Delete the metadata.db file from that folder, if it exists

5) Start calibre from the command prompt as

calibre.exe --with-library "C:/path/to/your/library folder/from/step/3"

6) You will get am empty library

7) Right click the calibre logo icon on the claibre toolbar and choose library maintenance->Rebuild database

theducks · 11-16-2018, 12:24 PM

A valid Calibre Library has a Metadata.db file in its top level folder (the folder is the library name).

AFAIK that is all that is required to keep that message at bay. (all the books could still be MIA)
This is what SHOWS (lists) your books in the GUI as well as points to the file to perform any actions you call for
This Must Match the Library (version in time) with the Author / title folders
(the reason we advise folk to NOT mess beneath the skirts. one tiny change, breaks the linkages)

BetterRed · 11-16-2018, 03:13 PM

Quote:

Originally Posted by ChipAHoy

I hope I don't get banned from the forums for posting this, because my issue has been posted elsewhere, as a response to previous users' posts.

Moderator Notice
Fixed that for you - I'll also change the title to highlight you're using MacOS.

BR

BetterRed · 11-22-2018, 01:44 AM

Moderator Notice
bump

If there are any MacOS gurus around, perhaps they could respond to post #2 in this thread.

I think this thread from same OP is related ==>> [MacOS] read-only database

BR

Pizza_Cant_Read · 11-25-2018, 10:55 PM

Dang Chipahoy, did you get your problem resolved? I am not enough of a power user to comprehend your problem. I know that calibre doesn't backup the books themselves, so by backup would that pretty much amount to the Metadata.db file? The database file storing your metadata is corrupt?

There is debug mode tucked in the "Preferences" menu. It will restart the application and create a comprehensive log file documenting each event. Retrace the procedure you have described in your troubleshooting and when you quit, a txt file will popup. You can copy that here or on pastebin etc. For extra points make a video.

I have lost my metadata before and if you are so upset it is likely because your library is big and you invested a tremendous amount of time in compiling that metadata. I get it the pain you feel and can't promise to help you but at the very least we will update the ticket here with the log file (and video if you can manage). Still no luck we will post on the calibre Reddit page and I have an underground forum we can try too.

I am a mac user. My laptop has been thrown a few times and I appreciate the build quality but I know it can be difficult to find help :-)

Pizza_Cant_Read · 11-25-2018, 11:12 PM

Oh oh oh! Another idea is to use a Windows machine, follow the prescribed steps you pasted from Kovid in the second post and if it works move the library back to the Mac. If you don't have access you can get a VPS or something that gives you the short term access.

When you are feeling low, remember that you at least haven't lost the books themselves haha

MarjaE · 11-25-2018, 11:35 PM

Each of your calibre libraries should include metadata.db and metadata_db_prefs_backup.json

Unless you put them in ~/Library, Time Machine *should* back them up, but if not, I don't know what can help with that.

Pizza_Cant_Read · 11-26-2018, 03:41 AM

Quote:

Originally Posted by MarjaE

Each of your calibre libraries should include metadata.db and metadata_db_prefs_backup.json

Unless you put them in ~/Library, Time Machine *should* back them up, but if not, I don't know what can help with that.

MarjaE, it seems like you might have a better grasp of the issue he is describing. Can you explain it to me? All I *think* I understand is he has corrupt metadata and can't seem to restore... why would this occur?

Hoping he had his ebook files saved elsewhere *fingers crossed*

theducks · 11-26-2018, 10:31 AM

Quote:

Originally Posted by Pizza_Cant_Read

MarjaE, it seems like you might have a better grasp of the issue he is describing. Can you explain it to me? All I *think* I understand is he has corrupt metadata and can't seem to restore... why would this occur?

Hoping he had his ebook files saved elsewhere *fingers crossed*

2 things that typically mess things bad:
1) The user did a 'bulk' operation (MDE in bullk mode, Delete All x)

2) Sync software not paused or restoring the wrong files from backups. metadata.db is lock-stepped to the folders in a particular Libraries contents for a Date and time.

A structurally damaged DB usually announces itself. Those are usually caused by the machine losing power or locking up while Calibre was working

MarjaE · 11-30-2018, 03:34 PM

I wish I knew what to do about this. I've had bad restores for other applications, so I'm not sure.

1. I think you *should* be able to move your existing library somewhere else, e.g. to the desktop, so it's untouched if restoration goes wrong.

2. And then if you have Time Machine backups, you should be able to go into Time Machine and restore the last good library. Exceptions are if it is in User/Libraries, because Time Machine does not back that up, or if it is excluded via System Preferences > Time Machine > Options.

If you can restore a good library via step 2, then you can probably ditch the bad library moved in step 1.

... Unless there's a problem with moving the library? It's a common technique when debugging Mac software.

theducks · 11-30-2018, 04:21 PM

You can put the Entire Library FOLDER any safe place.
The folders name IS the Library name. All you need to do if you move or rename that folder is
Right click the Library Icon: Switch Create: USE EXISTING : select the folder in its new location

11-16-2018, 11:34 AM	#1
ChipAHoy Thistle Sifter Posts: 187 Karma: 24088 Join Date: Sep 2016 Location: San Diego Device: Kindle Paperwhite	[MacOS] I need a new Calibre library I hope I don't get banned from the forums for posting this, because my issue has been posted elsewhere, as a response to previous users' posts. But I don't know what to do to get my Calibre library back. I have tried restoring my Calibre library from backups, and either get a message that no valid library is present when I try to switch libraries in the Calibre app, or, it seems to import my backup library, then shows zero books. I have attempted this restoring while Calibre is closed, per earlier instructions. I end up with multiple Calibre directories that I didn't create. I don't know what exactly I did to create this mess, but the more I try to fix it, the worse it seems to get. I have the ebook files on my computer, it's just trying to get them into a Calibre library that I am having problems with. Have spent more time than I want to admit trying to fix this. I just want to restore or create a working library in Calibre. Is there not any way just to start from scratch?

11-16-2018, 12:24 PM	#3
theducks Well trained by Cats Posts: 29,799 Karma: 54830978 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	A valid Calibre Library has a Metadata.db file in its top level folder (the folder is the library name). AFAIK that is all that is required to keep that message at bay. (all the books could still be MIA) This is what SHOWS (lists) your books in the GUI as well as points to the file to perform any actions you call for This Must Match the Library (version in time) with the Author / title folders (the reason we advise folk to NOT mess beneath the skirts. one tiny change, breaks the linkages) Attached Thumbnails

11-25-2018, 11:12 PM	#7
Pizza_Cant_Read Sentient Sauce Posts: 460 Karma: 2519794 Join Date: Nov 2017 Location: China Device: 9th Gen Oasis	Oh oh oh! Another idea is to use a Windows machine, follow the prescribed steps you pasted from Kovid in the second post and if it works move the library back to the Mac. If you don't have access you can get a VPS or something that gives you the short term access. When you are feeling low, remember that you at least haven't lost the books themselves haha Last edited by Pizza_Cant_Read; 11-25-2018 at 11:23 PM. Reason: changed second step to 'second post', why do I feel like I need to provide a reason lol

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
MacOS Mojave Books App and Calibre	datostar	Apple Devices	2	10-26-2018 08:25 PM
Calibre constantly crashing in macOS Sierra	phunnylinguist	Calibre	10	01-14-2018 06:29 AM
Calibre and MacOS Sierra	susaz	Calibre	2	10-04-2016 08:51 PM
MacOS Errors with Calibre 0.76 - QImage::setPixel	peterloron	Calibre	19	07-03-2010 11:45 PM
Can't launch Calibre on MacOS	peterloron	Calibre	2	12-31-2009 02:35 AM

11-22-2018, 01:44 AM	#5
BetterRed null operator (he/him) Posts: 20,567 Karma: 26954694 Join Date: Mar 2012 Location: Sydney Australia Device: none	Moderator Notice bump If there are any MacOS gurus around, perhaps they could respond to post #2 in this thread. I think this thread from same OP is related ==>> [MacOS] read-only database BR

11-25-2018, 10:55 PM	#6
Pizza_Cant_Read Sentient Sauce Posts: 460 Karma: 2519794 Join Date: Nov 2017 Location: China Device: 9th Gen Oasis	Dang Chipahoy, did you get your problem resolved? I am not enough of a power user to comprehend your problem. I know that calibre doesn't backup the books themselves, so by backup would that pretty much amount to the Metadata.db file? The database file storing your metadata is corrupt? There is debug mode tucked in the "Preferences" menu. It will restart the application and create a comprehensive log file documenting each event. Retrace the procedure you have described in your troubleshooting and when you quit, a txt file will popup. You can copy that here or on pastebin etc. For extra points make a video. I have lost my metadata before and if you are so upset it is likely because your library is big and you invested a tremendous amount of time in compiling that metadata. I get it the pain you feel and can't promise to help you but at the very least we will update the ticket here with the log file (and video if you can manage). Still no luck we will post on the calibre Reddit page and I have an underground forum we can try too. I am a mac user. My laptop has been thrown a few times and I appreciate the build quality but I know it can be difficult to find help :-)

11-25-2018, 11:35 PM	#8
MarjaE Guru Posts: 924 Karma: 53902736 Join Date: Jun 2015 Device: multiple	Each of your calibre libraries should include metadata.db and metadata_db_prefs_backup.json Unless you put them in ~/Library, Time Machine should back them up, but if not, I don't know what can help with that.

11-30-2018, 03:34 PM	#11
MarjaE Guru Posts: 924 Karma: 53902736 Join Date: Jun 2015 Device: multiple	I wish I knew what to do about this. I've had bad restores for other applications, so I'm not sure. 1. I think you should be able to move your existing library somewhere else, e.g. to the desktop, so it's untouched if restoration goes wrong. 2. And then if you have Time Machine backups, you should be able to go into Time Machine and restore the last good library. Exceptions are if it is in User/Libraries, because Time Machine does not back that up, or if it is excluded via System Preferences > Time Machine > Options. If you can restore a good library via step 2, then you can probably ditch the bad library moved in step 1. ... Unless there's a problem with moving the library? It's a common technique when debugging Mac software.

11-30-2018, 04:21 PM	#12
theducks Well trained by Cats Posts: 29,799 Karma: 54830978 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	You can put the Entire Library FOLDER any safe place. The folders name IS the Library name. All you need to do if you move or rename that folder is Right click the Library Icon: Switch Create: USE EXISTING : select the folder in its new location

Advert

Advert