Books missing from library but showing metadata?

Kaetrin · 06-29-2023, 02:30 AM

Hi,

I recently upgraded computers and had to reinstall Calibre and put my library into it etc from the previous PC (unfortunately I didn't do the export thing - next time!) I was able to associate my previous Calibre library on the new PC to Calibre and it was all fine. However, recently while the books are showing as in the library and all the metadata is showing, when I go to actually add a book to my reader or look at it, I get a message saying that there is no available format in the library. I have thousands of books in my library and I'm reluctant to re-add them all one by one, especially as I don't want to have to add in all the metadata again. The books which are "missing" don't show covers but all the other metadata shows in my Calbre app. The ones which are working okay are recent adds but nothing historical is showing without me adding it again from scratch.

Any suggestions to get it all lined up again?

thx!
Kaetrin

theducks · 06-29-2023, 10:58 AM

The 'Export thing'

is just an easy way to get everything (It grabs EVERY Library Calibre knows about (on the Switch menu) and the settings folder (all plugins and their settings).
The old way was copy the Library folder AND copy the Configuration folder and replace the ones on a FRESH (no books) app install.

No available formats can be from different things.

The Simplest is CASE of the filename (Linux or Mac).
Test: Select a Problem book in Calibre: Tap "O" There should be at least 3 files (There will be more if other formats are there):cover, opf and a format. Icons may vary.
If you see the missing format or cover. Then this might be a 'case' issue.

Corruption caused by using Google Drive as an intermediary in the copy process (GD fiddles with the (##) part of the name. That is the {id}used in calibre.

The files are really lost because you accidentally put the new Library in a folder that is part of a cloud sync (I think MS defaults 'Documents' to their (OneDrive?) sync.

Kaetrin · 06-30-2023, 02:47 AM

I have checked the "O" file. The metadata is there but there is nothing in the "data" file.

The books are all still on my computer.

The Calibre library is not in Documents. It's on a partition on a hard drive. I didn't/don't use Google Drive or any cloud sync. The books were all there but now they're not and I'm not sure why.

I have a backup of my Calibre library from January 2023 I can use if necessary (if I can work out how to get it associated correctly...)

BetterRed · 06-30-2023, 03:42 AM

Quote:

Originally Posted by Kaetrin

I have checked the "O" file. The metadata is there but there is nothing in the "data" file.

The books are all still on my computer.

The Calibre library is not in Documents. It's on a partition on a hard drive. I didn't/don't use Google Drive or any cloud sync. The books were all there but now they're not and I'm not sure why.

<snip>

That doesn't make sense to me. If they are there, are they in a library folder structure e.g:

Code:

../Books/Charles Dickens/Great Expectations (825)/cover.jpg
../Books/Charles Dickens/Great Expectations (825)/Great Expectations - Charles Dickens.epub
../Books/Charles Dickens/Great Expectations (825)/metadata.opf

And is there a file named metadata.db in the library folder, e.g:

Code:

../Books/metadata.opf

BR

theducks · 06-30-2023, 05:18 AM

Quote:

Originally Posted by Kaetrin

I have checked the "O" file. The metadata is there but there is nothing in the "data" file.

The books are all still on my computer.

The Calibre library is not in Documents. It's on a partition on a hard drive. I didn't/don't use Google Drive or any cloud sync. The books were all there but now they're not and I'm not sure why.

I have a backup of my Calibre library from January 2023 I can use if necessary (if I can work out how to get it associated correctly...)

Remember: A Calibre Library DB is in Lock Step with its contained folders (and their contents). YOU CAN NOT JUST REPLACE ANY PART (from a backup copy) USING THE OS. All or none.

I would NOT try and merge a Broken (this bad), Library with a backup.
Move (rename the Top Library folder: ( From Calibre Library -> BrokenLibrary),
now restore the entire Backup (Calibre Library Folder)
Then use Add Books: Add from Folders and Sub Folders

Set Adding Books:Control...: Adding Actions (a tab): Auto Merge to what you prefer BEFORE adding from the damaged Library.

Kaetrin · 06-30-2023, 08:11 AM

Quote:

Originally Posted by theducks

Remember: A Calibre Library DB is in Lock Step with its contained folders (and their contents). YOU CAN NOT JUST REPLACE ANY PART (from a backup copy) USING THE OS. All or none.

I would NOT try and merge a Broken (this bad), Library with a backup.
Move (rename the Top Library folder: ( From Calibre Library -> BrokenLibrary),
now restore the entire Backup (Calibre Library Folder)
Then use Add Books: Add from Folders and Sub Folders

Set Adding Books:Control...: Adding Actions (a tab): Auto Merge to what you prefer BEFORE adding from the damaged Library.

Thank you. I did what you suggested and the older books are all showing now. I've added (carefully) from books I know were there in the broken library and just re-added from non-Calibre files where I needed to. I'm sure I'm missing some books yet but I can add them as I go.

I really appreciate your help with this! Thank you again.

ownedbycats · 06-30-2023, 10:24 AM

Were you using 6.20 on Windows at any point during this 'recently'? It was only out for a few days before 6.21 got pushed out (and for good reason too).

There was a bug with the file-locking that could result in data loss - I had a small mishap with it myself which sounds similar to what happened to you. Book record was still in db, but files and cover went missing.

Kaetrin · 06-30-2023, 09:34 PM

Yes. That would at least explain it. I thought I was losing the plot! I have upgraded to the latest version just today which also fixed a database issue with my new Kobo reader as it happens (as at yesterday I had been running on 6.21 but I think I only upgraded to that version last week?).

ownedbycats · 07-01-2023, 07:01 AM

6.20 was released June 9 - the next major release was four days later, June 13. Usually major releases are every second week, but since this bug resulted in data loss it was pushed up.

06-29-2023, 02:30 AM	#1
Kaetrin Connoisseur Posts: 82 Karma: 9402 Join Date: Jul 2009 Location: Adelaide, South Australia Device: Kobo Libra Colour	Books missing from library but showing metadata? Hi, I recently upgraded computers and had to reinstall Calibre and put my library into it etc from the previous PC (unfortunately I didn't do the export thing - next time!) I was able to associate my previous Calibre library on the new PC to Calibre and it was all fine. However, recently while the books are showing as in the library and all the metadata is showing, when I go to actually add a book to my reader or look at it, I get a message saying that there is no available format in the library. I have thousands of books in my library and I'm reluctant to re-add them all one by one, especially as I don't want to have to add in all the metadata again. The books which are "missing" don't show covers but all the other metadata shows in my Calbre app. The ones which are working okay are recent adds but nothing historical is showing without me adding it again from scratch. Any suggestions to get it all lined up again? thx! Kaetrin

06-29-2023, 10:58 AM	#2
theducks Well trained by Cats Posts: 31,047 Karma: 60358908 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	The 'Export thing' is just an easy way to get everything (It grabs EVERY Library Calibre knows about (on the Switch menu) and the settings folder (all plugins and their settings). The old way was copy the Library folder AND copy the Configuration folder and replace the ones on a FRESH (no books) app install. No available formats can be from different things. The Simplest is CASE of the filename (Linux or Mac). Test: Select a Problem book in Calibre: Tap "O" There should be at least 3 files (There will be more if other formats are there):cover, opf and a format. Icons may vary. If you see the missing format or cover. Then this might be a 'case' issue. Corruption caused by using Google Drive as an intermediary in the copy process (GD fiddles with the (##) part of the name. That is the {id}used in calibre. The files are really lost because you accidentally put the new Library in a folder that is part of a cloud sync (I think MS defaults 'Documents' to their (OneDrive?) sync. Attached Thumbnails

06-30-2023, 10:24 AM	#7
ownedbycats Custom User Title Posts: 10,961 Karma: 74999999 Join Date: Oct 2018 Location: Canada Device: Kobo Libra H2O, formerly Aura HD	Were you using 6.20 on Windows at any point during this 'recently'? It was only out for a few days before 6.21 got pushed out (and for good reason too). There was a bug with the file-locking that could result in data loss - I had a small mishap with it myself which sounds similar to what happened to you. Book record was still in db, but files and cover went missing. Last edited by ownedbycats; 06-30-2023 at 10:28 AM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Moved library to E drive, missing books in library	SlickRCBD	Library Management	3	02-09-2023 07:25 PM
New Custom Metadata item not showing value in Library mode	SteSouth	Calibre	3	09-05-2022 06:12 AM
Intact Library, metadata corrupted (half library not showing)	puxatudo	Library Management	1	08-02-2022 09:06 AM
Imported library but metadata not showing	marie39	Calibre	11	06-14-2020 07:41 AM
Metadata from Calibre not showing up on books in Nook ST	jasmith74	Devices	6	12-27-2011 04:49 PM

06-30-2023, 02:47 AM	#3
Kaetrin Connoisseur Posts: 82 Karma: 9402 Join Date: Jul 2009 Location: Adelaide, South Australia Device: Kobo Libra Colour	I have checked the "O" file. The metadata is there but there is nothing in the "data" file. The books are all still on my computer. The Calibre library is not in Documents. It's on a partition on a hard drive. I didn't/don't use Google Drive or any cloud sync. The books were all there but now they're not and I'm not sure why. I have a backup of my Calibre library from January 2023 I can use if necessary (if I can work out how to get it associated correctly...)

06-30-2023, 09:34 PM	#8
Kaetrin Connoisseur Posts: 82 Karma: 9402 Join Date: Jul 2009 Location: Adelaide, South Australia Device: Kobo Libra Colour	Yes. That would at least explain it. I thought I was losing the plot! I have upgraded to the latest version just today which also fixed a database issue with my new Kobo reader as it happens (as at yesterday I had been running on 6.21 but I think I only upgraded to that version last week?).

07-01-2023, 07:01 AM	#9
ownedbycats Custom User Title Posts: 10,961 Karma: 74999999 Join Date: Oct 2018 Location: Canada Device: Kobo Libra H2O, formerly Aura HD	6.20 was released June 9 - the next major release was four days later, June 13. Usually major releases are every second week, but since this bug resulted in data loss it was pushed up.

Advert

Advert