06-28-2013, 09:14 PM | #1 |
Member
Posts: 13
Karma: 10
Join Date: Jun 2013
Device: kobo touch
|
Please implement faster index-search
I have a library with 21.000 books and the index-search (title, author and so one) is very very slow (3 minutes and longer).
Any chance to implement a faster index-search-algorithm to calibre? |
06-28-2013, 10:40 PM | #2 | |
Well trained by Cats
Posts: 29,803
Karma: 54830978
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
|
Quote:
OR You are doing an unqualified search (Not specifying the search field) or adjusted the tweak to limit fields searched when not qualified. |
|
06-29-2013, 01:03 AM | #3 | |
null operator (he/him)
Posts: 20,570
Karma: 26954694
Join Date: Mar 2012
Location: Sydney Australia
Device: none
|
Quote:
BR |
|
06-29-2013, 02:39 PM | #4 |
Member
Posts: 13
Karma: 10
Join Date: Jun 2013
Device: kobo touch
|
OK, thanks.
Qualified search in 1 column is faster. My default search before was "title, authors, tags, series, publisher". But i am nevertheless a little confused that searches in 5 colums need so long time. |
06-29-2013, 04:42 PM | #5 | |
Well trained by Cats
Posts: 29,803
Karma: 54830978
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
|
Quote:
Each tag is a record below the skirts. How many different tags do you have? |
|
06-30-2013, 11:06 AM | #6 |
Member
Posts: 13
Karma: 10
Join Date: Jun 2013
Device: kobo touch
|
|
06-30-2013, 07:18 PM | #7 |
null operator (he/him)
Posts: 20,570
Karma: 26954694
Join Date: Mar 2012
Location: Sydney Australia
Device: none
|
I suspect format may slow things down because I think it refers to the extensions of files in the book folders
I thought there was a corresponding database column with a different name that was faster - but I've forgotten the name and I can't see it anywhere so maybe I dreamt it BR |
06-30-2013, 07:33 PM | #8 | |
Grand Sorcerer
Posts: 12,167
Karma: 73448616
Join Date: Nov 2007
Location: Toronto
Device: Nexus 7, Clara, Touch, Tolino EPOS
|
Quote:
|
|
06-30-2013, 08:01 PM | #9 | |
null operator (he/him)
Posts: 20,570
Karma: 26954694
Join Date: Mar 2012
Location: Sydney Australia
Device: none
|
Quote:
epubfan - suggest you do a search on approximate_formats to see what its all about - its a function rather than a column - you'll need to create a custom column - see attachment BR Last edited by BetterRed; 06-30-2013 at 11:14 PM. Reason: add screen shot |
|
06-30-2013, 08:08 PM | #10 | |
Grand Sorcerer
Posts: 12,167
Karma: 73448616
Join Date: Nov 2007
Location: Toronto
Device: Nexus 7, Clara, Touch, Tolino EPOS
|
Quote:
|
|
07-01-2013, 09:35 AM | #11 |
Member
Posts: 13
Karma: 10
Join Date: Jun 2013
Device: kobo touch
|
|
07-01-2013, 10:23 AM | #12 |
Grand Sorcerer
Posts: 12,167
Karma: 73448616
Join Date: Nov 2007
Location: Toronto
Device: Nexus 7, Clara, Touch, Tolino EPOS
|
No idea... All I was trying to do was to aid with the possible format column issue. Try searching the calibre forums for other people with performance issues...
The column I refer can be added via Preferences | Interface | Add your own column Code:
Lookup name: approxformats Column Heading: Rough List of Formats Column Type: Column built from other columns Template: {:'approximate_formats()'} |
07-01-2013, 05:43 PM | #13 | |
null operator (he/him)
Posts: 20,570
Karma: 26954694
Join Date: Mar 2012
Location: Sydney Australia
Device: none
|
Quote:
With the exception of format, these are database columns, the database is 'heavily indexed' in order to make searching and sorting fast. However, 'formats' refers to the extensions of files in book folders, hence a search (or sort) must crawl through the library folder tree looking for files whose extensions match the search term, which is slow. But, 'approximate_formats()' refers to a derived list of formats that you need to put in a custom database column which will be fast for the same reasons other database column based searches are. See the link that Peter T posted for a discussion of why & how the function came to implemented. And see http://manual.calibre-ebook.com/temp...ximate-formats for definition and caveats BR |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Index: Making a linked index in epub | virtual_ink | ePub | 21 | 10-19-2011 11:23 PM |
search/api index of ebooks? | kbs | Upload Help | 0 | 08-25-2011 08:31 PM |
Setting series index in bulk metadata search&replace | bubak | Calibre | 4 | 12-19-2010 04:04 PM |
Please implement proper quoting | JSWolf | Feedback | 12 | 12-02-2010 04:39 AM |
The Public Index: Google book search settlement website | Elfwreck | News | 0 | 07-28-2009 11:23 AM |