Many parts of ebook-convert use Qt which requires X11. You won't get a window that opens but X11 is necessary for those parts to work. Rasterizing SVG images for example is handled by Qt. If you have a headless environment look into
xvfb as an alternative to installing a full x-server.