You shouldn't lose any bookmarks. However, from my experience, using an SD card CAN be a bit chancy. Be sure to have your reader on when you pull the card out/put it in and give the reader plenty of time to process the fact that you've moved it.
The other option is to be sure before handing your reader over that it is open to a non-controversial text/collection. Or be careful who you show off to.