NWCoffeenut t1_jdsgb83 wrote
Reply to comment by sumane12 in J.A.R.V.I.S like personal assistant is getting closer. Personal voice assistant run locally on M1 pro/ by Neither_Novel_603
I think a good part of the latency was with the TTS system. The actual text response for the most part came back reasonably quickly.
illathon t1_jdsoud8 wrote
No most implementations of whisper are slow.
itsnotlupus t1_jdt280v wrote
Whisper is the speech recognition component.
I don't think he said what he's using for TTS, might be MacOS' builtin thingy.
eggsnomellettes t1_jdt5dxl wrote
They're using elevenlabs, which isn't local and hence a slow API call
tortoise888 t1_jdtp8yj wrote
If we eventually get open source Elevenlabs quality models running locally it's gonna be insane.
Genesis_Fractiliza t1_jdu2f6x wrote
!remind me 1 month
RemindMeBot t1_jdu2nlm wrote
I will be messaging you in 1 month on 2023-04-27 04:55:12 UTC to remind you of this link
3 OTHERS CLICKED THIS LINK to send a PM to also be reminded and to reduce spam.
^(Parent commenter can ) ^(delete this message to hide from others.)
| ^(Info) | ^(Custom) | ^(Your Reminders) | ^(Feedback) |
|---|
ebolathrowawayy t1_jdvfmrk wrote
There's also Tortoise TTS which can be run locally but idk how fast it is.
Viewing a single comment thread. View all comments