This hasn’t been asked in a while, and I really loved reading the last discussion so I’m hoping to kick it off again and see what has changed!
What I’d like to know is:
- What specific products do you wish you could host on your own infrastructure, but the product does not offer such a deployment method
- Do you or would you use the product without being able to self-host? I.E. In its current state
- Do you think your employer, if any, holds the same opinions?
Want to selfhost AI assistent with that can work with my desktop OS.
I’ve heard good things about https://github.com/ggerganov/llama.cpp
Check Out r/LocalLLaMA for that.
Hwve you lokked at mycroft?
Would https://fabien.benetou.fr/Content/SelfHostingArtificialIntelligence help?