This is really cool work! I'm curious like what do you see as the biggest lever for speeding up TTS models or from a technical perspective that this was a promising direction in the first place to push on. If I were to guess, some distillation but I'm certain there are probably TTS model aware architectural changes that just make inference wayyyy faster?
I saw a local-ai demo (something + gemma), where the person used ASR to get text and gemma to clean it up (like turning "question mark" into a literal "?", bullet points another one). The presenter also showed a gemma only option, that did both in one go, but had a higher WER on average, and even though the formatting statements were handled without a multi-stage pipeline, they preferred the multi-stage overall
https://github.com/loudreader/loudkit
I think real time natural tts should be possible everywhere soon
For OP the clip name is nari-nina-01a0a12f-980a-765e-8029-fa56bd23210d.wav
Voice models are not winner take all market unlike LLM APIs
Coming here as Developer Relations at AssemblyAI
Is the ASR inference engine open source as well?
https://huggingface.co/Qwen/spaces
I saw a local-ai demo (something + gemma), where the person used ASR to get text and gemma to clean it up (like turning "question mark" into a literal "?", bullet points another one). The presenter also showed a gemma only option, that did both in one go, but had a higher WER on average, and even though the formatting statements were handled without a multi-stage pipeline, they preferred the multi-stage overall