That should work. When the SD card is put into the Touch, it scans for books and adds them to the library. When the cards is removed, the books are removed from the library. Transferring the SD card to the other Touch will just make them available there.
The only issue is that not all SD cards work with all Touches. I have two that work perfectly. Others here have had lots of problems with different SD cards.