I spent some time tracking down the root cause of this issue and a fix, see
https://bugreports.qt.io/browse/QTBUG-41151
I'm guessing that the distribution version of Qt patches the code to work with their default cursor theme, which is why it works with the system Qt and not the calibre bundled Qt.
There's two hours of my life I will never get back.