I'd say most readers suffer from this problem but not everyone experiences it since it depends on the sunlight intensity. The fading effect is (I think) caused by the radiation emitted by the sun which causes some kind of interference on the e-ink display.
On the following picture we can see how e-ink displays are made so it seems plausible that a high level of electromagnetic radiation might interfere in some way with character rendering on the screen.
