Virtual libraries

[RobinLee]

Hi

Will virtual libraries showing only a few columns make Calibre run faster?

Just over 5000 books
61 columns
45 plugins
60 icon rules

My computer has a SSHD with 16MG RAM but even just copying a book from anther library takes a lot longer than it used to.

I really don't want to split up the library physically, but if I were to use virtual libraries only showing specific columns would it run faster?

[Tarana]

Wow, that's some library! I can't help you, alas. I only use the virtual library based on TAGS. So, one is for Scifi, one is for thriller/crime, that sort of thing. And yes, that runs better.

[theducks]

Originally Posted by RobinLee

Hi

Will virtual libraries showing only a few columns make Calibre run faster?

Just over 5000 books
61 columns
45 plugins
60 icon rules

My computer has a SSHD with 16MG RAM but even just copying a book from anther library takes a lot longer than it used to.

I really don't want to split up the library physically, but if I were to use virtual libraries only showing specific columns would it run faster?

AFAIK VL's are just logical views that just make interaction faster.
AND there is no difference in the columns.There is ONLY ONE DB (Use the VIEW MANAGER plugin to adjust yhe colums to show )

Have you run Library Maintenance (at least, the first phase)? That compacts the DB (tosses the now dead records). ( make note of the metadata DB size before cleaning)

Lots of RAM is best as the DB is in RAM (and you have that) . , exclude the Library folder from active A/V (all books have been checked when first downloaded. Assumes the download folder has not been foolishly excluded)

[Rellwood]

Originally Posted by theducks

Have you run Library Maintenance (at least, the first phase)? That compacts the DB (tosses the now dead records). ( make note of the metadata DB size before cleaning)

Lots of RAM is best as the DB is in RAM (and you have that) . , exclude the Library folder from active A/V (all books have been checked when first downloaded. Assumes the download folder has not been foolishly excluded)

I usually run the check library once a week, right now its 59MB and I just performed a check which made it go to 55.

What do you mean by excluding the folder from the active A/V?

[theducks]

All those rules and columns are taking a big hit.

The question is WHY did you do it the way you did and is there a better (more process efficient) way?

Will a saved search get the job done when you need THAT particular item?

Would putting multiple column values in a Tag like column get you there (every column bloats the DB structure)

and you really need that many Icon (or coloring) rules?
We have many users with 50K books. I am approaching 15K.
It takes 11 seconds to switch back to the Main Library after working in my Intake Library. I have 5 color rules, NO column rules, and 10 custom columns.

[theducks]

Originally Posted by Rellwood

I usually run the check library once a week, right now its 59MB and I just performed a check which made it go to 55.

What do you mean by excluding the folder from the active A/V?

Just that. Open you Anti virus preferences and exclude it from the real time scans (Leave the manual scans). That way, when you add, move, edit books or metadata, they are not scanned (and eating CPU cycles and time)

[Rellwood]

@theducks,

I suppose I could weed it down. Its my own fault with the plugins. Its funny that you talk about not needing all that data because sometimes I come across an old library with much less data and end up wishing I could stay in it because it is so clean and easy to manage.

[Rellwood]

Originally Posted by theducks

Just that. Open you Anti virus preferences and exclude it from the real time scans (Leave the manual scans). That way, when you add, move, edit books or metadata, they are not scanned (and eating CPU cycles and time)

Oh, Antivirus...no its an ignored folder.

[BetterRed]

Originally Posted by RobinLee

Hi

Will virtual libraries showing only a few columns make Calibre run faster?

Just over 5000 books
61 columns
45 plugins
60 icon rules

My computer has a SSHD with 16MG RAM but even just copying a book from anther library takes a lot longer than it used to.

I really don't want to split up the library physically, but if I were to use virtual libraries only showing specific columns would it run faster?

5,000 books is not many books, I have a library with 150,000

60+ columns seems excessive, especially if the library contains actual ebooks rather than 'foreign objects' such as music or movies. Composed columns (columns built from other columns) can have a -ve effect on performance

45 plugins seems excessive, although they should only effect start up times, but I would get rid of any I don't actually use.

60 icon rules also seems excessive, maybe you could reduce the number of rules by using Program Mode templates.

As has already been mentioned, use the View Manager (VM) plugin to limit what columns are shown in the Book List. VM will also define the sort order.

Regarding AntiVirus (AV): IMO if you need to exclude your calibre library from the AV you use, you need to get another AV. I run two, Defender and MalwareBytes, I exclude 1 DLL (a Word Addin) in MWB, and nothing in Defender. As far as I'm concerned tey have no discernible effect of calibre performance.

Added: Copying a typical book (1 cover, 1 PDF, 1 DOCX, 1 EPUB, 1 metadata.db) from my Intake library to my Books library takes a second or two, copying a 'book' which has audio/video content (FLAC, MP3/4) or hi-res comics (CBZ) take longer of course. The libraries are on a SATA 3.0 2TB HDD.

BR

[Sirtel]

Originally Posted by BetterRed

5,000 books is not many books, I have a library with 150,000

60+ columns seems excessive, especially if the library contains actual ebooks rather than 'foreign objects' such as music or movies. Composed columns (columns built from other columns) can have a -ve effect on performance

45 plugins seems excessive, although they should only effect start up times, but I would get rid of any I don't actually use.

60 icon rules also seems excessive, maybe you could reduce the number of rules by using Program Mode templates.

As has already been mentioned, use the View Manager (VM) plugin to limit what columns are shown in the Book List. VM will also define the sort order.

Regarding AntiVirus (AV): IMO if you need to exclude your calibre library from the AV you use, you need to get another AV. I run two, Defender and MalwareBytes, I exclude 1 DLL (a Word Addin) in MWB, and nothing in Defender. As far as I'm concerned tey have no discernible effect of calibre performance.

Added: Copying a typical book (1 cover, 1 PDF, 1 DOCX, 1 EPUB, 1 metadata.db) from my Intake library to my Books library takes a second or two, copying a 'book' which has audio/video content (FLAC, MP3/4) or hi-res comics (CBZ) take longer of course. The libraries are on a SATA 3.0 2TB HDD.

BR

Same here. Almost 20 000 books, 25 columns (with the built-in ones included), 10 plugins, 6 icon rules. 16 GB RAM, 500 GB SSD. Copying 20-50 books all at once takes 10-20 seconds (I only have standard epub/mobi/azw3 books).

I do use the View Manager plugin and several custom columns are not visible (I need them for calibre catalogs). Also I run Library Maintenance regularly.