Take a look at the code for the iRex iLiad and DR1000S; using a stylus, they write directly to the ePaper screen. Keep in mind that ePaper/eInk is not pixel based like CRT/LCD. The iRex forum is here
I can't help wondering what on Earth
it is that you are trying to do.
Have fun, and good luck!
I’m reaching back some 30 years (when I was getting my kids into computing), but the LOGO language might afford you some simple (considering the limits of the processor and that your input will be limited to 8 menu/button choices) but impressive graphics. Coupled with you might learn from the iRex stuff, this might be right for you. A Linux version can be found here: UCBLogo