Run whisper on external server

Run whisper on external server

 

You must have found a suitable Whisper Container on Docker hub.

Whisper works but it is slow (also around 15 seconds).

Would be great if it would support GPU, that would make it way faster.

 

Images option

rhasspy/wyoming-whisper

faster-whisper     - https://github.com/rhasspy/wyoming-faster-whisper/pull/9


Whisper Addon

 

~# docker search wyoming-whisper

otput

NAME                                   DESCRIPTION                                     STARS     OFFICIAL
rhasspy/wyoming-whisper                Wyoming protocol server for faster-whisper s…   10        
abtools/wyoming-whisper-cuda           wyoming-whisper compiled with CUDA support f…   0         
pando85/wyoming-whisper                Wyoming protocol server for faster whisper s…   0         
rhasspy/wyoming-whisper-cpp                                                            0         
dwyschka/wyoming-whisper-cuda                                                          0         
slackr31337/wyoming-whisper-gpu        https://github.com/slackr31337/wyoming-whisp…   0         
grubertech/wyoming-whisper             fast-whisper with large-v3 model built for G…   0         
confusedengineer/wyoming-whisper-gpu   Github:  https://github.com/Confused-Enginee…   0         
robomagus/wyoming-whisper-rk3588                                                       0         
clonyara/wyoming-whisper                                                               0         
xiaozhch5/wyoming-whisper    

 

Option

way 1. desktop machine

I was also curious to know if whisper add-on will run faster in a desktop machine. Since I did not have a linux server I had to install ubuntu on a VirtualBOX, exposed the virtual machine to my network, installed docker on ubuntu then downloaded whisper. I could easily integrate remote whisper to my HomeAssistant installed on a rpi4. All works as expected. So far all good.

 

I’m running this and a few other containers on

Debian 11 bullseye

AMD Ryzen 7 3800X

32 GB RAM

 

 

Wyoming-Whisper in Docker with Nvidia GPU support.

https://github.com/Fraddles/Home-Automation/tree/main/Voice-Assistant

 

useful links

https://community.home-assistant.io/t/run-whisper-on-external-server/567449

https://developer.ibm.com/tutorials/run-a-single-container-speech-to-text-service-on-docker/