I think whether the alt attribute displays or not is up to the reader software. According the
ePub spec, the alt tag
may be used by the reader (as opposed to
must), which means it's another thing in the spec that is optional so may or may not be supported. As an alternative, you could try the title attribute (although that's optional too).