check out the jobs window (Gear icon in the lower right) after you try to convert a book. you should see a job listing for the conversion attempt and if you hit the details button, some diagnostic messages. If you have not installed the needed software, the messages will say so there.
GO TO
https://github.com/kfix/calibre_plugin_djvumaker to see an example of a completed job.