Yea, I figured it out. I can toggle it off and on, its just a two key combo I have to use. So Its two single keys side by side.
I found the key board short cut at
https://keycombiner.com/collections/calibre/. Found out what the esc key is in the settings, then changed it to something different. In my case, I use the number pad One and Two. Number one Starts the Voice Reader and Number Two shuts it off. Thanks for the reply.