Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Library Management

Notices

Reply
 
Thread Tools Search this Thread
Old 10-07-2022, 11:58 PM   #1
hlhp
Member
hlhp began at the beginning.
 
Posts: 17
Karma: 10
Join Date: Mar 2019
Device: none
switch to large library is slow

I have a library with about 7000 items.
it will take about 10 seconds switch to it.

sometimes I need switch between libraries frequently,
except from combining libraries, is there a way to make the switch faster?
hlhp is offline   Reply With Quote
Old 10-08-2022, 02:15 AM   #2
BetterRed
null operator (he/him)
BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.
 
Posts: 21,693
Karma: 29711016
Join Date: Mar 2012
Location: Sydney Australia
Device: none
IIRC Custom columns that are a) shown in the book list and b) use the formats_modtimes, formats_paths and formats_sizes template functions can slow things down.

BR

Last edited by BetterRed; 10-08-2022 at 02:37 AM.
BetterRed is offline   Reply With Quote
Old 10-08-2022, 02:35 AM   #3
BetterRed
null operator (he/him)
BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.
 
Posts: 21,693
Karma: 29711016
Join Date: Mar 2012
Location: Sydney Australia
Device: none
Quote:
Originally Posted by hlhp View Post
I have a library with about 7000 items.
it will take about 10 seconds switch to it.

sometimes I need switch between libraries frequently,
except from combining libraries, is there a way to make the switch faster?
If you refer to Library B without wanting to change its metadata whilst working on Library A, you could use the CalibreSpy plugin which provides read-only access to multiple libraries whilst 'regular' calibre is active ==>> Index of plugins

On Windows the switching between 'regular' calibre and CS windows is done via Desktop switching i.e = Alt+Tab, Win+Tab etc. So it's more or less instant.

BR

Last edited by BetterRed; 10-08-2022 at 02:52 AM.
BetterRed is offline   Reply With Quote
Old 10-08-2022, 05:40 AM   #4
hlhp
Member
hlhp began at the beginning.
 
Posts: 17
Karma: 10
Join Date: Mar 2019
Device: none
thank you for the respond

after some test, found out the slow performance is caused by have 8 custom columns in the large library.(although all the all the values are fixed values)

I need switch between libraries with cover view, thus CalibreSpy will not fit.

is there a way to keep the library in memory for fast switch?
hlhp is offline   Reply With Quote
Old 10-08-2022, 06:31 AM   #5
BetterRed
null operator (he/him)
BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.
 
Posts: 21,693
Karma: 29711016
Join Date: Mar 2012
Location: Sydney Australia
Device: none
The 'library' is the metadata.db SQLite database which is memory resident when calibre is active. The Author/Title folders are place holders for the actual book content (format) files.

How much RAM do you have?

Are any of the 8 custom columns built from other columns - i.e. do they have have a template.

FWIW - CalbreSpy shows cover if you press Ctrl+I

BR
BetterRed is offline   Reply With Quote
Old 10-08-2022, 09:23 AM   #6
hlhp
Member
hlhp began at the beginning.
 
Posts: 17
Karma: 10
Join Date: Mar 2019
Device: none
I have 16GB ram, it should be sufficient.

you are right, it have 2 columns build from other columns with formula(template?).
after removing this 2 columns, the performance is much better.

I will try out CalbreSpy tomorrow. thank you
hlhp is offline   Reply With Quote
Old 10-08-2022, 10:45 AM   #7
Comfy.n
want to learn what I want
Comfy.n ought to be getting tired of karma fortunes by now.Comfy.n ought to be getting tired of karma fortunes by now.Comfy.n ought to be getting tired of karma fortunes by now.Comfy.n ought to be getting tired of karma fortunes by now.Comfy.n ought to be getting tired of karma fortunes by now.Comfy.n ought to be getting tired of karma fortunes by now.Comfy.n ought to be getting tired of karma fortunes by now.Comfy.n ought to be getting tired of karma fortunes by now.Comfy.n ought to be getting tired of karma fortunes by now.Comfy.n ought to be getting tired of karma fortunes by now.Comfy.n ought to be getting tired of karma fortunes by now.
 
Posts: 1,609
Karma: 7891011
Join Date: Sep 2020
Device: none
I'd suggest generating a debug log with this batch script:
https://www.mobileread.com/forums/sh...63&postcount=2

run script > wait for calibre to load > close calibre > see log generated in the same folder as the .bat file.

this thread got me curious so i just did that... and after looking in the log I found that an emblem formula was calling a deleted custom column, causing some start delay.

deleted the rule > now Calibre loads faster

edit: now that I remembered the "restart in debug mode" option in preferences menu, this seems easier

Last edited by Comfy.n; 10-08-2022 at 10:51 AM.
Comfy.n is offline   Reply With Quote
Old 10-08-2022, 12:39 PM   #8
theducks
Well trained by Cats
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 31,001
Karma: 60358908
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
Quote:
Originally Posted by hlhp View Post
thank you for the respond

after some test, found out the slow performance is caused by have 8 custom columns in the large library.(although all the all the values are fixed values)

I need switch between libraries with cover view, thus CalibreSpy will not fit.

is there a way to keep the library in memory for fast switch?
I use the Content server with my browser to VIEW other libraries (even on other hosts on my LAN). This may work for you if the intent does not require moving stuff from one to the other
theducks is offline   Reply With Quote
Old 10-08-2022, 06:17 PM   #9
BetterRed
null operator (he/him)
BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.
 
Posts: 21,693
Karma: 29711016
Join Date: Mar 2012
Location: Sydney Australia
Device: none
Quote:
Originally Posted by hlhp View Post

you are right, it have 2 columns build from other columns with formula(template?).
after removing this 2 columns, the performance is much better.
If you post the template code the template coding gurus might be able to suggest something to make them faster.

BR
BetterRed is offline   Reply With Quote
Old 10-09-2022, 05:36 AM   #10
hlhp
Member
hlhp began at the beginning.
 
Posts: 17
Karma: 10
Join Date: Mar 2019
Device: none
thank you for all the suggestions.

Just ran the debug and some tests, found out that a template column cause the problem.

I used to the default GUI and need to use the tag browser, CalibreSpy and Content server seems not very good for me.

I will just leave as is, and fix the template column later.
hlhp is offline   Reply With Quote
Reply


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Slow performance on very large library MattMRead Library Management 9 01-18-2023 08:15 PM
Slow with large library luoto Calibre 17 02-06-2020 04:44 PM
Large Calibre Library Slow - Solved Mythlandia Library Management 0 09-09-2013 03:46 AM
Large Library working slow bigbird1227 Library Management 3 11-21-2011 05:14 PM
Large FB2s slow? edwlarkey Astak EZReader 2 10-09-2009 12:29 AM


All times are GMT -4. The time now is 02:48 PM.


MobileRead.com is a privately owned, operated and funded community.