I noticed that you cannot actually see in the configuration which voices you already have downloaded (well, you can see them via: )
Code:
C:\Users\DrChiper\AppData\Local\calibre-cache\piper-voices
A suggestion would be to highlight those already downloaded ones to determine which you have tried before.