There are not many options for Linux. One you did not mention is
Okular. This is actively supported, and includes an annotation system, but interesting formats like CHM and ePub are "optional" and are often not available in standard Linux distributions.