That what we says by "Fair Use"
You own the right to read/use the book, and until you didn't distribute it, you could do what you want. This is only a stream of byte, you have the right to do anything with from this point of view, even better, if you are a mathematician, you could see this stream of byte as a number, and you can add, sub, multiply or divide any other number with this number...