Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable GPU support #5

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Conversation

mreilaender
Copy link

@mreilaender mreilaender commented Nov 12, 2023

Enables GPU support by adding --cuda to the argument parser and passing it to piper

Closes #1

@edurenye
Copy link

Looks good to me, and this would be a great thing to have.
Can you please review it @synesthesiam ?

@synesthesiam
Copy link
Contributor

The piper executable does not support the --cuda flag

@edurenye
Copy link

Hi @synesthesiam, thank you for your quick answer.

According to the documentation from here: https://github.com/rhasspy/piper (line https://github.com/rhasspy/piper/blob/6c5e283439f8400aa7a2652aafbedfb77ca3fc22/README.md?plain=1#L176) piper has a --cuda flag.

Is it a bug there that cuda does not work (I see you just commited something in that repo related to cuda) or is it in this other issue rhasspy/rhasspy3#49?

Can we help you in some way?

@synesthesiam
Copy link
Contributor

The Python library for piper supports CUDA. I added the flag for the C++ version yesterday, but it needs the "gpu" version of the onnx runtime so I will need to adjust the build process too.

@ashald
Copy link

ashald commented Dec 18, 2023

@synesthesiam is there a way to leverage the latest C++ version that has the --cuda parameter? Thanks!

@ms1design
Copy link

ms1design commented Apr 19, 2024

+1, @synesthesiam I would be appreciated if you could guide us a bit how to utilise cuda in our Jetson project here (using cuda12.2 and onnxruntime-gpu): dusty-nv/jetson-containers#481

Edit: Solved here: dusty-nv/jetson-containers@4ba5dc4

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

cuda support
6 participants