I vaguely looked into it and IIRC some of it (PyGame, maybe?) depends on SDL-1, and I so very much don't want to build such an outdated thing

.
SDL-2, on the other hand, why not, but it possibly dropped the only video driver that handled the Kobo fb, so, meh.
If someone cares enough to check, it's probably trivial to build (SDL2, I mean. Python extensions are a bit of a nightmare to cross-compile).
Having basics understanding of how Linux stuff builds (i.e., being vaguely familiar with autotools should cover most of it) helps.
My toolchains should now also be fairly trivial to build,
someone asked something of the sort recently in the Kindle dev forum and was successful without too much trouble.
As for the Python thing, my build-script has extensive comments about that, so I won't repeat myself

.