Well, the battery itself probably would last close enough to forever left in a dump somewhere. (Or my desk drawer, which amounts to nearly the same thing.) At least enough for an archaeologist to find and wonder.
How long it can hold a charge and the number of times it can be recharged is a different finite measure.