Show HN: Hurston-1 open source TTS that speak Southern American and Afro-English
Posted by Gcarter08 2 days ago
Hey HN, I’m open sourcing my Hurston-1 narrowband TTS model (Apache-2.0). It is very good with American English and does especially well with Southern American and Regional African English accents. Destined AI is based in Atlanta, and I built this because I’m amazed by what AI can do, and I wanted to help introduce and welcome more people to feel comfortable using and interacting with AI.
Since 2021, I’ve been collecting fully consented voice data from over 20,000 people, 1M audio recordings, and over 1,800 hrs of audio captured to date. For this model, I used a small part of the data, 136 hrs, to finetune Maya1 and expand it’s capabilities.
Hurston-1 is a narrowband TTS model that focuses the output on telephone use because that is still where most of these voices will be heard. I’ve used it to support customers such as Amazon and Salesforce and generated over half-mill revenue with it. Now I’m open sourcing it to help unlock opportunities for others as well.
Limitations: this model doesn’t maintain the exact same voice across prompts and doesn’t support voice cloning. For many use cases, this is fine but maybe not so - if you’re creating podcasts.
This is the first release - I’m already working on the next version with improvements.
I would appreciate, if anyone is interested in this space, download the model from huggingface, check it out and let me know any feedback. Also, open to connecting with others in this space as well.
Comments
Comment by someperson 2 days ago
But tangentially related, for non-English languages of the African continent, the Gates Foundation are pledging some grants to improve AI access outside of English-speaking regions: https://news.bpdata.com/article/gates-foundation-pledges-1-b...
Despite being focused on English, your project could be of interest for their funding. It's probably worth reaching out to let them know about your work.
Comment by Gcarter08 1 day ago
Comment by weare138 2 days ago
Comment by DANmode 1 day ago
Food for thought.
Comment by emayljames 1 day ago
Comment by alephnerd 2 days ago
That said, my hunch is your Africa speicifc datasets might lossy, as entire regions of Africa are very linguistically diverse and someone who speaks Bambara and French will affect a different English accent than someone who speaks Maninka and English.
Comment by Gcarter08 1 day ago
For example, right now if you say you want a Southern American accent, you might get a voice that is a Black person from Atlanta or Rural Georgia in future versions you will be able to specify Atlanta or rural, etc.. same with the regional African accents.
Comment by themanmaran 1 day ago
Comment by zeroq 1 day ago
Comment by Gcarter08 1 day ago
I also have a demo phone line 678.940.8800 with a few of the voices
Comment by fractorial 2 days ago
Comment by Gcarter08 1 day ago
Comment by SamBam 1 day ago
Is it likely that they are using a model like this? Or are they actually trying to voice clone the original and then translate to English? I'm not even sure if the few Spanish-accented English auto-dubs I've heard are the same voice or not.
(Actually, that reminds me of growing up in Italy, where for a long time all English movies were shown dubbed, not subtitled, and they had the same lead male voice for all male leads, and the same lead female voice for all female leads, across every movie. I can still hear those voices in my head now thirty years later...)
Comment by pessimizer 1 day ago
Are you talking about the English of Africans in different parts of Africa? If so, are you including the voices of white and Mediterranean Africans?
I'm confused. As a black American with roots (going back a couple centuries) in the Ark-La-Tex, I would think our dialects would be covered under "Southern American," which makes me suspect that you were referring to me with all of those references to another continent.
Comment by Gcarter08 1 day ago
We are calling out Southern American, and the regional African English (e.g. a person with a regional Nigerian (igbo) accent speaking english, or someone with a regional Kenya (Swahili) accent that is still speaking english). Those are all different but all represented well in this model.
Those were not a catch all for black americans.
Comment by islewis 2 days ago
I cannot speak to the other accents, but my experience has been that American south accents are really poorly represented in mainstream Speach-To-Text models. If your STT model is pointed at end users, this can cause quite a quality drift when looking at eval vs prod performance depending on who your user base is.
I am not sure what terms you have collected the speach data on, but I am sure there are lots of people working with voice models that would be very interested in this as an eval set.
Comment by Gcarter08 1 day ago
Comment by trollbridge 2 days ago
Comment by Gcarter08 1 day ago
Comment by 1317 1 day ago
Comment by fatihserhattura 1 day ago
Comment by likoya 2 days ago
Comment by ubertaco 2 days ago
Comment by ranger_danger 2 days ago
Comment by gus_massa 2 days ago
(I imagine that it has the errors and bad pronunciation of a tipical Latam person, that is different for example from the errors and bad pronunciation of a tipical Spanish person)
Comment by Gcarter08 1 day ago