MobileRead Forums - View Single Post - Has anyone run a neural LLM on a jailbroken Kindle Paperwhite?

Hubris · 08-06-2025, 08:27 PM

Has anyone here tried running a quantized neural language model (like a really tiny GPT-2 or RWKV) directly on a jailbroken Kindle Paperwhite (512 MB RAM, ARM Linux)? Is it actually possible to get any real LLM working locally on the hardware, even just as a proof of concept?

In theory, it seems doable with the smallest models—something like TinyLlama, DistilGPT2, or a “world’s smallest” RWKV build. Obviously, it would be painfully slow and not very smart, but technically it would be a real AI running natively on a Kindle, which would be kind of amazing.

Would love to hear if anyone’s managed this, or even just tried!

08-06-2025, 08:27 PM	#1
Hubris Member Posts: 24 Karma: 79 Join Date: May 2025 Device: Jailbroken Kindle paperwhite 7th gen Firmware 5.16.2.1.1	Has anyone run a neural LLM on a jailbroken Kindle Paperwhite? Has anyone here tried running a quantized neural language model (like a really tiny GPT-2 or RWKV) directly on a jailbroken Kindle Paperwhite (512 MB RAM, ARM Linux)? Is it actually possible to get any real LLM working locally on the hardware, even just as a proof of concept? In theory, it seems doable with the smallest models—something like TinyLlama, DistilGPT2, or a “world’s smallest” RWKV build. Obviously, it would be painfully slow and not very smart, but technically it would be a real AI running natively on a Kindle, which would be kind of amazing. Would love to hear if anyone’s managed this, or even just tried!