OUI-1: world's first model for Generative UI

The most interesting part about this for me is that they decided to create their own language or DSL for the task at hand. So it's not just a large language model; it's an LLM with its own language.

I have a feeling that the best AI systems to come will, in fact, be a complete package like this: a harness, a DSL, and an entire package designed to produce certain outcomes cheaper and faster.

And producing that complete package is why software engineering will not be obsolete.

Remember when everything was iSomething? The original iPod and iPhone created a real trend back then.

Seems like many AI products ride the same wave now. Open WebUI, OpenHands, OpenUI. I am a bit more dubious about this affiliation, though.

I think there is a big misunderstanding in the space around what Gen UI is and what its used for. Lots of folks refer to it as a framework for building web apps - its not. Gen UI is a DSL for LLM to build UIs on the fly in a multi turn converstation - those are - throw away, one off interfaces or visualization. The reason for the DSL is pragmatism - standardisation and token savings.

The html/css/js or a react app built by an LLM is not Gen UI.

OpenAI, OpenAPI and now OpenUI. Explain this to a non tech person...

I've been thinking for a while that something like this could be a solution for the suboptimal UX in the digital assets space.

Imagine a very small LLM embedded into a MetaMask equivalent where you just specify the task you want to do - ie, "I want to send USDT on mainnet", "I want to import the token at address 0x..." - and the wallet assembles the UX for this task for the human to execute.

Pre-LLMs Steve Krug wrote "Don't make me think" Now we come to a generation of random UIs that will confuse the life out of users and, being non deterministic, be a nightmare for support teams; though they'll probably have no real support, just more llms.

It should be possible to run on Mac via https://github.com/mmastrac/diffgemma, but I'm at rustconf right now and I can't download weights on hotel wifi easily.

Quite interesting to see no real comments here for 50+ minutes, so I will kick it off.

I'm a huge believer in this future of software. Having the UI layer completely abstracted from pre-written code and dynamically generated "on the fly" based on the context of the user is, I believe, the future.

Just think about the complexity of localization and how many IFs you had to write to solve different language versions, etc. in the old PHP code. A lot of that complexity can simply disappear.

Having dynamically built UI won't only be better for the user experience, it can actually allow us to create much more personalized experiences (I hate when UI teams constantly redesign perfectly fine software).

Interestingly, this will open up a completely new consumption interface, because I believe there will be a UI predefined by the creator of the application (your day 1 user experience) that will then evolve into a more personalized experience over time.

So much room to grow in this space.

> Interfaces must be generated in under a second

Why? Is two seconds too long? Would your other constraints be easier (usability and hardware spec) if this was longer? Does anyone actually need a UI generated in under a second?

Generative UI is unsolved because current models do not have taste and end up generating the same kind of slop.

I'm amazed that this blog doesn't even have a single screenshot/photo of the kind of UI they can generate.

Focusing on benchmarks in this domain feels very wrong.

Oui ma chérie

Someone steel man the case for users actually wanting to be a UI designer for the application they pay you for.

Please for the love of god have a human write something that you expect other humans to read

Oh no.

oh, you eye?

Do you hate the designer changed the UI of your favorite app so you have to relearn it every three months?

Congrats! Now you need to relearn it every time you open the app.