Whisper transcription app big performance regression

[thundergolfer]

https://modal-com.slack.com/archives/C069RAH7X4M/p1713624663717089

[thundergolfer]

A one hour podcast used to take ~1 minute, so big drop in performance.

[thundergolfer]

I think first thing to do is to replace the use of NFS

[ahxxm]

would be great if the official example uses WhisperX, it can transcribe one hour podcast in 1 minute using only 1 container(or more specific, 1 graphi card with 16G vram, using large-v3), instead of spins up 100-300 containers for a single transcription

[ahxxm]

made a poc repo here https://github.com/ahxxm/serverless-audio-transcriber