You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The Python consumer will load the whisper model for every single request that it receives.
Loading the whisper model is time consuming process and it delays the time the app takes to completion execution.
Expectation
Instead of loading the whisper model at every single request, the model should be loaded once when the worker spins up.
All subsequent requests should use the loaded instance directly instead of spawning a new one.
The text was updated successfully, but these errors were encountered:
Current
The Python consumer will load the whisper model for every single request that it receives.
Loading the whisper model is time consuming process and it delays the time the app takes to completion execution.
Expectation
Instead of loading the whisper model at every single request, the model should be loaded once when the worker spins up.
All subsequent requests should use the loaded instance directly instead of spawning a new one.
The text was updated successfully, but these errors were encountered: