Inflect-Micro-v2: complete voice in 9.36M parameters

Posted by nateb2022 1 day ago

Counter209Comment27OpenOriginal

Comments

Comment by modinfo 1 day ago

This is amazing, the quality blow my mind for such small model! I just replaced my old onnx model with yours!

here my implementation with speech dispatcher and server: https://github.com/skorotkiewicz/inflect-speechd

thanks for shearing!

Comment by yjftsjthsd-h 1 day ago

Couple highlights:

> Complete local text-to-waveform speech synthesis under 10M parameters.

In case, like me, you hoped "complete" voice might mean both stt and tts. Not to speak poorly of it, just clarifying.

> English only, with one fixed male voice. This is not zero-shot voice cloning.

(And then a bunch of statements on limitations that I read as 'quality can be spotty but if you play with it it should be fine') But like. In <10M params I'm not judging:)

Comment by semiquaver 1 day ago

When would “text-to-waveform speech synthesis” ever imply speech to text?

Comment by yjftsjthsd-h 1 day ago

The HN title is "Inflect-Micro-v2: complete voice in 9.36M parameters".

Comment by NetOpWibby 1 day ago

The inflections are weird but this doesn't sound like a robot. Not bad!

Comment by tmaly 1 day ago

This is impressive. I wish there were a voice clone option.

Comment by fastball 1 day ago

With so few parameters, I imagine a voice fine-tune might be readily tractable.

Comment by 1 day ago

Comment by billdueber 1 day ago

I keep seeing tts stories here. Is it just an interesting subset of the llm world, or is there a huge use case I’m somehow missing?

Comment by SamPatt 19 hours ago

I just built my own voice assistant with my Pebble Time 2 watch and it uses a VPS hosted TTS (Piper) and Hermes agent.

I learned about all of these projects on HN at one point or another.

Comment by eightysixfour 1 day ago

I use STT/TTS to interface with a local LLM for Home Assistant in my house.

Comment by _davide_ 1 day ago

I'm do so as well, i tried qwen3 omni 3 but it was ridiculously stupid, and i ended up with stt thinker and tts. kokoro for now

Comment by K0balt 1 day ago

How heavy in inference on this? The model would easily fit on many microcontroller modules, I wonder if they could run it?

Comment by sudb 1 day ago

this is extremely encouraging for individuals/small companies being able to train pareto-frontier TTS models (specifically compute required to run vs quality of model output)

Comment by da-x 1 day ago

I think we need more neurons in the human brain than parameters in this model for speech. I wonder what it says about the human brain vs LLM efficiency.

Comment by StilesCrisis 1 day ago

I'd love to hear it but it seems your quota is exhausted.

Comment by g58892881 1 day ago

Comment by StilesCrisis 1 day ago

Nice! Strangely, "Nano" sounds a lot better than "Micro" to me.

On my iPhone 14 Pro the page crashes after 2-3 plays. I wonder if it uses too much memory?

Comment by g58892881 1 day ago

also, i double checked, nano is nano and micro is micro. didnt fuck that up

Comment by g58892881 1 day ago

right. happens on my 13 too. memory leak confirmed, not sure yet what's causing it

Comment by g58892881 1 day ago

unable to fix it. latest dev ort, dispoing tensors, restarting the session/worker. nothing, crashes every time.

defaulting to wasm on ios devices now

Comment by jsomedon 1 day ago

amazing quality for such small size!

Comment by itake 1 day ago

Amazing quality for small size, but definitely not that enjoyable to listen to.

IMHO, its at about the same quality level of historic TTS tools.

Comment by stavros 1 day ago

I'm not sure which historic tools you mean, but to me this sounds much better than anything older than ten years ago.

Comment by itake 1 day ago

I compared the macos Samantha just now and I guess the inflect-micro is marginally better...

Comment by leobg 1 day ago

Ivona „Joey“, „Amy“

Comment by phoenixranger 1 day ago

amazing! was looking for something similar

Comment by mcbetz 1 day ago

Alternative title: Text to speech in 9.36M, English only.

Comment by fintuner 1 day ago

[flagged]

Comment by amelius 1 day ago

[dead]

Comment by zenith605 1 day ago

[flagged]

Comment by afdsaifdoi 1 day ago

[dead]