I believe that you can run without X, but not without Qt4. The Qt libraries are used internally by Calibre to handle rendering in various places as I understand it - not just for GUI purposes.
Depending on what your exact requirement is, you might want to look at the Calibre command line options to see if you can achieve what you desire using those facilities?
|