I have been watching HomeAssistant’s progress with assist for some time. We previously used Google Home via Nest Minis, and have switched to using fully local assist backed by local first + llama.cpp (previously Ollama). In this post I will share the steps I took to get to where I am today, the decisions I made and why they were the best for my use case specifically. Links to Additional Improvements Here are links to additional improvements posted about in this thread. New Features Security C...
This is something I’m going for too. Currently just running Ollama integration with HA for voice control but I’d be moving STT/TTS locally too. The new Qwen 3.5 35B loads fairly quickly and responds quickly enough to be usable for conversation on my system. The 9B version is extremely fast and adequate for voice control.