Self hosted hands free app
from HumanPerson@sh.itjust.works to selfhosted@lemmy.world on 10 Nov 16:45
https://sh.itjust.works/post/49559254

Basically title. I want an app that can integrate with a server to run whisper and small local llms to place phone calls and such. Already have ollama and such, so that side is done. I just need the integration.

Edit for clarity: I mean a local siri type thing.

#selfhosted

threaded - newest

okwhateverdude@lemmy.world on 10 Nov 16:47 next collapse

Vibecode something? Fair warning that vibecoding android apps is fraught with peril. Be very explicit in what versions of android and the SDK in your prompt.

HumanPerson@sh.itjust.works on 10 Nov 16:59 collapse

I have lots of java and a smidgen of kotlin experience so I’ll probably just regular code it if I have to. I would still prefer if something already exists.

BlameThePeacock@lemmy.ca on 10 Nov 17:25 collapse

Agent voice response

It’s even mostly open source.

HumanPerson@sh.itjust.works on 10 Nov 21:33 collapse

That looks like a call center type thing. I’m more looking for “hey google” without (most of) the spyware.

Edit: re-reading my post, I see how it looks like that’s what I meant.

BlameThePeacock@lemmy.ca on 10 Nov 22:20 collapse

So there’s an answer, and then there’s a problem.

The easy answer is that Home Assistant has Voice Assistants now, and you can use Ollama, Whisper, and Piper to do that all locally.

The problem is that it really only talks to Home Assistant, there’s no ability to have it search the web, or make a phone call, or really anything else outside of Home Assistant without significant addon stuffs.

It also requires a reasonably significant amount of RAM on your computer to run the VM for Home Assistant while supporting Whisper and Piper and Ollama.