How OpenAI Used Its Own LLMs to Design Its Jalapeño Chip
33 points by maxall4 2 hours ago | 31 comments

pama 17 minutes ago
Having worked with people doing bringup of specialized chips, I am awed at how the world has changed.

> When the first chips came back from the foundry in May, the team pointed its internal AI models at designing software to run benchmarks such as SemiAnalysis’s InferenceX. On DeepSeek’s multi-head latent attention kernel benchmark, performance climbed from 0.31 percent of the theoretical ceiling (set by the chip’s compute and memory bandwidth) to 88.94 percent in roughly 40 hours. Ho says this result is repeatable, so the time between when foundries deliver the first chips and when production ramps up can be reduced. “All our schedule assumptions are going to be based on the fact we have this capability now,” he says.

reply
karim79 2 hours ago
I grow Jalapeños. This conflation of AI and actual chili peppers irks me.
reply
amelius 29 minutes ago
Guess how electrical engineers feel about the term "transformers".
reply
frangonf 11 minutes ago
As a former EE, attention was all I needed to not get zapped.
reply
karim79 27 minutes ago
This is an excellent comment. I'm still laughing.
reply
Lalabadie 2 hours ago
I do generative art (no relation to AI prompting). I feel your frustration.
reply
fragmede 11 minutes ago
Cryptographers also got the same raw deal
reply
TomGarden 27 minutes ago
Oh my!
reply
seanmcdirmid 9 minutes ago
Jalapeño also used to be a Java VM written in Java at IBM.
reply
asveikau 2 hours ago
Just think of how the people of Xalapa, Mexico feel. They should send them a royalty check.
reply
glitchc 32 minutes ago
Feeling the burn?
reply
honeycrispy 31 minutes ago
I'm annoyed that the meaning of the word "Agent" has been obliterated.

Like, why couldn't they invent a new word and not hijack an existing word?

reply
karim79 18 minutes ago
Call it GPTChippomatic or something. Please leave my peppers alone.
reply
Razengan 22 minutes ago
Did you not watch the Matrix documentary?
reply
MadrasTh0rn 16 minutes ago
I guess I'll have to
reply
Razengan 2 hours ago
> irks me

It's jalapeño grill would you say?

reply
karim79 55 minutes ago
Not sure what you're talking about. But I'll tell you, home grown Jalapeño peppers, fermented with 3% salt is the stuff of dreams.
reply
wiml 37 minutes ago
"It's all up in yo' grill, would you say?"
reply
Razengan 27 minutes ago
You know what really grinds my gears? Friction.
reply
amelius 2 hours ago
At some point people will use an LLM to design an Apple M series competitor.
reply
Lramseyer 27 minutes ago
Production grade CPU design is more than just the RTL (the source code.) To achieve the performance numbers that these companies get, you have to do a ton of optimization in your physical design to achieve the power/performance/area (PPA) metrics that make these products competitive. LLMs are not suitable for that kind of work.

There are people working on PPA optimization and trying to shake up how things are done, just not with LLMs.

reply
btown 10 minutes ago
Something that I think is fascinating, though, is that labs are no longer beholden to the limitations of commercial design software. Want to replace your simulator and optimizer with a fully custom verifiable stack of Lean proofs of optimality and correctness? Just throw your unlimited token budget at it.
reply
bhouston 54 minutes ago
It is probably doable right not to push a risc-v design into that performance space.
reply
bigyabai 2 hours ago
They won't, because they'd need an ARM architecture license.
reply
amelius 59 minutes ago
Why, the LLM can make up its own architecture.

The value lies in the design space exploration, which is what an LLM can easily do.

https://en.wikipedia.org/wiki/Design_space_exploration

reply
cmrdporcupine 9 minutes ago
Or they'll just build a competitor in RISC-V instead and that's fine.

Except the problem is not restricted to the actual ISA or its HDL implementation, etc.

It's even just getting space / time in a fab at that advanced of a process node.

reply
wmf 52 minutes ago
Arm sells architecture licenses to anybody these days.
reply
pixl97 2 hours ago
I mean you can design anything without a license. Selling it is where the problems come up. Even then there are likely places in China that would still make it for you.
reply
cute_boi 40 minutes ago
openai should figure out how to make lithography machine, so ASML don't have monopoly on it.
reply
TomGarden 19 minutes ago
The Chinese have been working on EUV for a while
reply
bigyabai 29 minutes ago
"Reverse engineer this DARPA project, make no mistakes"
reply