You must have recently edited the metadata for all your books. Modified refers to the metadata.
And modifying a tag that applies to many books can update the modified date for all those books.
The modified date is not something you should be overly relying on.