Instructions for proper use of Library Maintenance

[calail]

So, I've searched and am unable to find details on using Library Maintenance (specifically Check Library) and interpreting the errors and how to appropriately fix them.

My apologies if these directions are right in front of my nose, but hoping someone can point me.

TIA!

[theducks]

There are 2 phases of LM
IIRC phase 1 checks the structure of the data. (data type matches field type)
Phase 2 checks the entries against the book folders for mismatching stuff
The errors describes what is wrong. Each kind of error needs to be corrected (usually manually). some offer a simple delete

I suggest saving the Log and attacking those as needed (usually using the OS file manager).
Unknowns, you probably need to move OUT of the Library folder, then use ADD Books to put them into the Library PROPERLY.

This is one of the few places you use the OS file manager (and using the file manager otherwise was probably how you got the problem. Never use the File manager to change the contents of a Library. a disk/OS crash is another )

[BetterRed]

↑ ↑ ↑ ++

I have a copy of the text shown on the right side of the Library Check dialogue box in my "How to" notes so that I can refer to it when I'm processing the log.

BR

[calail]

First, I appreciate that you took the time to reply. I've been muddling through the errors, but the error descriptions didn't make a lot of sense to me when I read them. So, I'm working through them now.

Originally Posted by theducks

Each kind of error needs to be corrected (usually manually). some offer a simple delete. I suggest saving the Log and attacking those as needed (usually using the OS file manager).
Unknowns, you probably need to move OUT of the Library folder, then use ADD Books to put them into the Library PROPERLY.

Originally Posted by theducks

This is one of the few places you use the OS file manager (and using the file manager otherwise was probably how you got the problem.

As a side note, I have NEVER used file manager to make changes to my libraries, so that is not what created the 800+ errors that are appearing. But I still appreciate your reply

[BetterRed]

@calail - I run Library check once a week using the calibredb check_library command.

Normally there are no errors, but when there is one I can usually recall how it probably came about e.g. "Ah yes, that would have happened when I unpacked the CBZ to re-order some images. I obviously forgot to delete the resultant folder after creating a new CBZ."

[theducks]

Originally Posted by calail

First, I appreciate that you took the time to reply. I've been muddling through the errors, but the error descriptions didn't make a lot of sense to me when I read them. So, I'm working through them now.

As a side note, I have NEVER used file manager to make changes to my libraries, so that is not what created the 800+ errors that are appearing. But I still appreciate your reply

Are you syncing your lib to the cloud/NAS? Always pause, else changes can get into a race and be restored before the move (rename of Author or title) completes.

Oh! I assumed you were already on a local (internal or USB) drive

Another issue is running Calibre from both sides of a dual boot Win or Linux

[calail]

Originally Posted by BetterRed

↑ ↑ ↑ ++

I have a copy of the text shown on the right side of the Library Check dialogue box in my "How to" notes so that I can refer to it when I'm processing the log.

BR

Thanks. That's actually the FIRST thing I did - pasted it into a file. I was having a hard time understanding the info however, but after reading and playing with my files, it made a bit more sense.

[calail]

Originally Posted by theducks

Are you syncing your lib to the cloud/NAS? Always pause, else changes can get into a race and be restored before the move (rename of Author or title) completes.

Oh! I assumed you were already on a local (internal or USB) drive

Another issue is running Calibre from both sides of a dual boot Win or Linux

I'm not syncing it anywhere. I use Calibre Portable (should have mentioned that in my OP). Since I have four large libraries, I'm beginning to suspect the errors occurred when I moved books to different libraries. But, I can't replicate the problem, so maybe it was short lived?

My multiple libraries make it difficult to muddle through the errors since it doesn't tell me what library has the problem, so I have to hunt around for the title/author/etc...

[theducks]

Flash (pen) drives don't give warning when failing. One day they work and the next

I don't understand the confusion.
Library maintenance only runs against the CURRENTLY selected library.
The Library name is also the base folder name

[BetterRed]

@calail - the Check library feature works on the current library. I use the command line version in a script that checks my Main, Media and Journals libraries writing three CSVs.

When you move books between libraries you need to be careful that none of the files in the corresponding book folders is open in another program, such as the cover.jpg in an Photoshop, or a PDF in Nitro, or an RTF in Word.

Why do you need multiple libraries? I use them because the custom columns I want for each are very disparate, but I never move books between my three main libraries.

BR

[calail]

Originally Posted by theducks

Flash (pen) drives don't give warning when failing. One day they work and the next

Yeah, I do worry about that. But, I need to travel with my library, so the portable drive works best for me. It's a portable harddrive, so not a little flash drive, but I know they fail as well sometimes. I keep a backup every couple months; haven't needed it. yet.

Originally Posted by theducks

I don't understand the confusion.
Library maintenance only runs against the CURRENTLY selected library.
The Library name is also the base folder name

Well, that's what I assumed, but the error list actually showed errors from two different libraries. I thought. I'll have to double check that. Thx.

[calail]

Originally Posted by BetterRed

@calail - the Check library feature works on the current library. I use the command line version in a script that checks my Main, Media and Journals libraries writing three CSVs.

Hmm... not sure how to do that, but will check it out.

Originally Posted by BetterRed

When you move books between libraries you need to be careful that none of the files in the corresponding book folders is open in another program, such as the cover.jpg in an Photoshop, or a PDF in Nitro, or an RTF in Word.

I could see how this might happen once or twice... but not a lot of times. I don't typically mess with the files (outside of Calibre) so this shouldn't have been a problem.

Originally Posted by BetterRed

Why do you need multiple libraries? I use them because the custom columns I want for each are very disparate, but I never move books between my three main libraries.

I have multiple libraries because I have so many books. I had read that once libraries started getting big, Calibre didn't work efficiently, so I created several. My main library has almost 12,000 titles, then two of my other libraries have 5,200 and 6,400 titles. I move books sometimes because I put them in the wrong library or I decide to move a group of books for some reason.

[Fiat_Lux]

Originally Posted by calail

I had read that once libraries started getting big, Calibre didn't work efficiently, so I created several.

The efficiency aspect is when you don't have enough RAM in your system.

My rule of thumb is 1 GB RAM for every 50,000 titles. YMMV.

As a practical matter, splitting libraries at around the 100,000 item mark is a good idea. That is just under one TB, easy enough to copy to another drive, for backing up purposes.

Amber

[BetterRed]

@calail - I have a 130,000+ book library that runs ok on a six year old 4G ASUS Windows 7 notebook. So you should be fine with a ~25,000 book library, on what's probably a faster system.

BR

[calail]

Originally Posted by BetterRed

@calail - I have a 130,000+ book library that runs ok on a six year old 4G ASUS Windows 7 notebook. So you should be fine with a ~25,000 book library, on what's probably a faster system.

BR

Thanks for the tip. I'll have to give it some thought. I've gotten through the 800+ errors, and it wasn't as frightening as it at first seemed. Now checking my next library... wish me luck