Talk to your Calibre Library

FacetiousKnave · 06-02-2026, 08:59 AM

Hey everyone,

Like a many of you, I have a massive Calibre library (7,000+ DeDRM EPUBs).

Although I read a lot, sometimes I struggle to know what to read next, or what books address specific topics, or how those topics are addressed, how I can connect a current read to another one to follow a topic-related path.

So, in other words, I wanted a way to actually interact with that hoard of knowledge using AI—asking questions across hundreds of books at once, finding specific philosophical arguments, or cross-referencing authors—but I absolutely refused to upload my personal library to OpenAI or pay for a cloud subscription.

So, I built Ollama Pi Chat. It’s an open-source, local-first desktop app that acts as a secure wrapper for Ollama, but with a heavily engineered offline RAG (Retrieval-Augmented Generation) engine built specifically for massive EPUB libraries.

I'm going to try to explain how it works:

Point it at your Calibre Folder: You don’t need to move or convert your books. Just point the app’s indexer at your Calibre Library directory, and it will safely parse the raw text from your EPUBs. The app does not edit or touch your ebooks in any way, it only reads them.
Ultra-Compact Database (No Bloat): Most vector databases explode in size if you feed them thousands of books. I engineered this to use Matryoshka semantic compression (256-dimension vectors) and SQLite external-content tables. The result? You can index the mathematical meaning and text of 7,000+ books into a single database that is less than 10 GB.
100% Local & Private: It runs entirely on your hardware using Ollama and local embedding models. No internet required, no API keys, and your data never leaves your machine.
Bulletproof Indexing for “Omnibus” Books: If you have massive “Complete Works” EPUBs that usually crash standard parsers, this handles them smoothly using in-memory ZIP streams. Plus, the indexing job is 100% resumable. If you close your laptop halfway through indexing your library, it picks up exactly where it left off.

If you want to give it a try, the repository is here: https://github.com/DuckTapeKiller/ollama-pi-chat

Please note that this app only works on both Intel / Arm64 MacBooks.

JSWolf · 06-02-2026, 09:43 AM

Why not use your AI to convert this to a cross-platform app?

rantanplan · 06-02-2026, 10:22 AM

Quote:

but I absolutely refused to upload my personal library to OpenAI or pay for a cloud subscription.

The current way that the price for tokens go it wouldn't make sense to use a cloud subscription for this anyway

.

Quote:

You can index the mathematical meaning and text of 7,000+ books into a single database that is less than 10 GB.

You know whats funny about that number? That means that the database is likely larger than your ebook library.

dandaman · 06-02-2026, 11:43 AM

Great! Will try on my MacBook Pro in a bit.

JSWolf · 06-03-2026, 06:11 AM

Hello? calibre library? Are you there?

06-02-2026, 08:59 AM	#1
FacetiousKnave Unconscionable Posts: 91 Karma: 25000 Join Date: Sep 2022 Location: Helsinki Device: Kindle	Talk to your Calibre Library Hey everyone, Like a many of you, I have a massive Calibre library (7,000+ DeDRM EPUBs). Although I read a lot, sometimes I struggle to know what to read next, or what books address specific topics, or how those topics are addressed, how I can connect a current read to another one to follow a topic-related path. So, in other words, I wanted a way to actually interact with that hoard of knowledge using AI—asking questions across hundreds of books at once, finding specific philosophical arguments, or cross-referencing authors—but I absolutely refused to upload my personal library to OpenAI or pay for a cloud subscription. So, I built Ollama Pi Chat. It’s an open-source, local-first desktop app that acts as a secure wrapper for Ollama, but with a heavily engineered offline RAG (Retrieval-Augmented Generation) engine built specifically for massive EPUB libraries. I'm going to try to explain how it works: Point it at your Calibre Folder: You don’t need to move or convert your books. Just point the app’s indexer at your Calibre Library directory, and it will safely parse the raw text from your EPUBs. The app does not edit or touch your ebooks in any way, it only reads them. Ultra-Compact Database (No Bloat): Most vector databases explode in size if you feed them thousands of books. I engineered this to use Matryoshka semantic compression (256-dimension vectors) and SQLite external-content tables. The result? You can index the mathematical meaning and text of 7,000+ books into a single database that is less than 10 GB. 100% Local & Private: It runs entirely on your hardware using Ollama and local embedding models. No internet required, no API keys, and your data never leaves your machine. Bulletproof Indexing for “Omnibus” Books: If you have massive “Complete Works” EPUBs that usually crash standard parsers, this handles them smoothly using in-memory ZIP streams. Plus, the indexing job is 100% resumable. If you close your laptop halfway through indexing your library, it picks up exactly where it left off. If you want to give it a try, the repository is here: https://github.com/DuckTapeKiller/ollama-pi-chat Please note that this app only works on both Intel / Arm64 MacBooks.

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Kobo Vox won't talk to Calibre	Adrianna	Devices	0	08-16-2013 10:17 PM
Kobo takes forever to talk to Calibre	Robotech_Master	Kobo Reader	7	05-28-2012 05:09 AM
Free - Freaks Talk Back: Tabloid Talk Shows and Sexual Nonconformity	nboshart	Deals and Resources (No Self-Promotion or Affiliate Links)	1	06-05-2010 10:27 AM
505 corrupted - can't talk to Library - help!	abbrown	Sony Reader	10	09-09-2008 06:43 PM

06-02-2026, 09:43 AM	#2
JSWolf Resident Curmudgeon Posts: 83,628 Karma: 153646251 Join Date: Nov 2006 Location: Roslindale, Massachusetts Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3	Why not use your AI to convert this to a cross-platform app?

06-02-2026, 11:43 AM	#4
dandaman Zealot Posts: 122 Karma: 220 Join Date: May 2026 Location: London, United Kingdom Device: Kindle PW3, Kobo Clara Colour	Great! Will try on my MacBook Pro in a bit.

06-03-2026, 06:11 AM	#5
JSWolf Resident Curmudgeon Posts: 83,628 Karma: 153646251 Join Date: Nov 2006 Location: Roslindale, Massachusetts Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3	Hello? calibre library? Are you there?

Advert

Advert