RPi5 8GB:Docker HA + HA Custom Component (in-process server)+ + llama.cpp server + Gemma 4 E2B +Docker Open WebUI + Local access on same host.
Running a Local LLM debian vmware on an PC for Home Assistant
Claude Code for Home Assistant.Full MCP Server running inside Home Assistant. AI clients connect directly to it.
Using Claude Code to manage your Home Assistant Configuration step by step
Running locally llama.cpp with Gemma 4 as a Local Home Assistant Voice Assistant on Raspberry Pi 5 (8GB)
How to Run AI Models Locally with llama.cpp on rpi5
How to Run AI Models Locally with Ollama
Ollama vs llama.cpp vs vLLM — Which Should You Use?
ModelScope vs Hugging Face vs k2-fsa.github.io vs Kaldi vs Sherpa