I've seen this twice, both after I happened to run down my battery. The power switch doesn't actually cut power to the Kindle. Instead, it behaves much the same as the power button on your PC. The downside is that some part of your Kindle is indeed on when the Kindle is supposedly off.
Since your problem is persistent, I think your Kindle is in some way defective.