Sorry for the double post, but I have further thoughts on the matter.
I'm strongly oppose to any LLM feature buildin to Calibre, no matter wich implementation, because the sustainability of them is not garanted.
Calibre is, in my opinion, an example of mature software that has been developed over a long period of time and has always implemented only stable features.
LLMs are nothing like that. They are just the latest technological hype from Silicon Valley, and although they are impressive, their future and longevity are by absolutly no means guaranteed.
Remember the Metaverse, NFTs, the cryptocurrencies, the Big Data, etc. The list of disruptive and revolutionary technologies that everyone forgot five years later is long, and right now, LLMs are all to be the next addition to that list.
The future of web development is AI. Get on or get left behind. by Alex.Party
There are chance, too significant to be ignored, that the feature discussed here will have to be completely removed from Calibre in the next years because there will no longer be any LLM service to support it.
So no, no LLMs whatsoever. If, in 10 years, LLM has proven to be a stable, sustainable technology with sufficient usage/demand, then yes, it will be feasible to implement a technology that has proven to be mature.