You actually can, if you jailbreak the Kindle. Of course that presents its own problems, namely the inability to do so on recent firmware without hardware modding.
It is not generally an issue, as the lowest setting is virtually unnoticeable to the unaided eye.
Some people have stated like you that their eyes are more sensitive than perhaps Amazon expects.