Piper with --cuda acceleration?

[Geremia]

Is there a way to enable CUDA GPU acceleration with Calibre's packaged version of Piper?

Appending the "--cuda" flag had no effect; it still used only my CPU:

cat test.txt | /opt/calibre/bin/piper/piper --model /home/geremia/.cache/calibre/piper-voices/en_US-ryan-high.onnx --sentence-silence 0.0 --length_scale 0.1 --cuda

[kovidgoyal]

Build your own piper and replace the binary in the calibre package with it or with a script what adds --cuda to the argument list and then calls your own binary

[Geremia]

Originally Posted by kovidgoyal

Build your own piper and replace the binary in the calibre package with it or with a script what adds --cuda to the argument list and then calls your own binary

Ah, so your binary doesn't have CUDA support.

[Geremia]

Using a script

#!/bin/sh

# convert the bash alias="piper --cuda" into a bash function and run it:

/home/geremia/.local/bin/piper --cuda "$@"

in place of /opt/calibre/bin/piper that uses my GPU-enabled, PIP-installed piper, which works when I run

echo 'hello, this is a test.' | ./piper --model /home/geremia/.cache/calibre/piper-voices/en_US-ryan-high.onnx | aplay

, I get this in ebook-viewer:

calibre, version 8.3.0
ERROR: Read aloud failed: piper process failed with exit code: 2 and error messages:

[kovidgoyal]

No clue, calibre just calls the piper binary in json mode with each sentence, presumably it doesnt work with cuda in that mode. You'd have to ask the piper developers.