[Enhancement] FTS indexing by template

ownedbycats · 03-30-2023, 01:56 PM

If Calibre's FTS indexing allows for selective indexing, an idea: Templates could be used to determine what gets indexed or not.

Anything set as 'true' is indexed, anything 'false' or null does not. Perhaps something like 'select' could be used to choose the specific formats to index.

Some simple examples:

This would only index books with epubs:

Code:

program: if 'epub' in approximate_formats() then 'true' fi

This would index everything unless 'noindex' is in #admintags:

Code:

program: if 'noindex' inlist $#admintags then 'false' else 'true' fi

Would anyone else use this? Is it even feasible?

kovidgoyal · 03-30-2023, 10:25 PM

Whats the use case? if you dont want certain books searched, you can exclude them from the actual FTS search already. What does it gain you to exclude them from indexing?

ownedbycats · 03-30-2023, 11:16 PM

My personal usecase would be preventing it from indexing very large PDF files that don't have text data to begin with (mostly just a waste of processing power and disk space by extracting all those images).

kovidgoyal · 03-31-2023, 01:40 AM

disk space usage is temporary, only while being indexed, which is a one time operation.

03-30-2023, 01:56 PM	#1
ownedbycats Custom User Title Posts: 11,360 Karma: 79528341 Join Date: Oct 2018 Location: Canada Device: Kobo Libra H2O, formerly Aura HD	[Enhancement] FTS indexing by template If Calibre's FTS indexing allows for selective indexing, an idea: Templates could be used to determine what gets indexed or not. Anything set as 'true' is indexed, anything 'false' or null does not. Perhaps something like 'select' could be used to choose the specific formats to index. Some simple examples: This would only index books with epubs: Code: program: if 'epub' in approximate_formats() then 'true' fi This would index everything unless 'noindex' is in #admintags: Code: program: if 'noindex' inlist $#admintags then 'false' else 'true' fi Would anyone else use this? Is it even feasible?

03-30-2023, 11:16 PM	#3
ownedbycats Custom User Title Posts: 11,360 Karma: 79528341 Join Date: Oct 2018 Location: Canada Device: Kobo Libra H2O, formerly Aura HD	My personal usecase would be preventing it from indexing very large PDF files that don't have text data to begin with (mostly just a waste of processing power and disk space by extracting all those images). Last edited by ownedbycats; 03-30-2023 at 11:19 PM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
FTS - Exporting the search	Comfy.n	Calibre	3	07-24-2023 10:01 PM
Question about FTS index	ownedbycats	Library Management	2	12-02-2022 04:37 PM
Are FTS results cached?	ownedbycats	Library Management	2	09-13-2022 02:21 AM
FTS database size?	slantybard	Calibre	6	08-17-2022 05:09 AM
FTS DB maintenance functions?	DrChiper	Calibre	12	07-29-2022 08:34 PM

03-30-2023, 10:25 PM	#2
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Whats the use case? if you dont want certain books searched, you can exclude them from the actual FTS search already. What does it gain you to exclude them from indexing?

03-31-2023, 01:40 AM	#4
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	disk space usage is temporary, only while being indexed, which is a one time operation.

Advert