Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kindly add OpenVINO backend support #32

Open
gericho opened this issue May 6, 2024 · 3 comments
Open

Kindly add OpenVINO backend support #32

gericho opened this issue May 6, 2024 · 3 comments

Comments

@gericho
Copy link

gericho commented May 6, 2024

Will it be possible to add OpenVINO support for Intel-based processors? The repo by @zhuzilin here shows a speed improvement of nearly 50%, so users will be able to use larger models without sacrificing current performance. Thank you!

Screenshot 2024-05-06 150935

@zachs-55
Copy link

You can use OpenVINO with whisper.cpp (I personally found using CLBlast instead was a little faster on my weak Celeron n5095, though):
https://github.com/ggerganov/whisper.cpp#openvino-support

Then you can use this for a Wyoming endpoint: https://github.com/ser/wyoming-whisper-api-client

@gericho
Copy link
Author

gericho commented May 14, 2024

Thank you very much, I'll give it a try soon!

@tannisroot
Copy link

faster-whisper uses CTranslate2 which doesn't have OpenVino support.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants