Inkling: Our Open-Weights Model
332 points by vimarsh6739 3 hours ago | 86 comments

segmondy 2 hours ago
Very nice, multi modal, largest open weight model that supports audio. Would be interesting to see how good the audio capability is.

If you want to run locally, checkout https://github.com/danielhanchen/llama.cpp/tree/add-inkling https://unsloth.ai/docs/models/inkling https://huggingface.co/unsloth/inkling-GGUF https://huggingface.co/unsloth/inkling-NVFP4

This supposedly is better than KimiK2.7, as much hype as GLM5.2 gets, I find myself using KimiK2.7 half of the time, so if the benchmark is true, then this can definitely go in the mix. My hope is that it might have strengths in some areas to beat all other open weight models.

reply
ls_stats 3 hours ago
America needs its own DeepSeek or Z.ai, a lot of people (myself included) root for open chinese models to win because they have no other choice.

Thinking Machines might be it.

reply
joshmarlow 2 hours ago
I don't hear about them a lot but it looks like arcee.ai is aiming to be just that.

Here are some of their current open weight offerings: https://www.arcee.ai/open-source-catalog

reply
gkapur 3 hours ago
It could be but there are a host of companies going after open weights models: Arcee, Reflection, Llama (TBD on Meta's focus on closed-source versus open-source), etc.

That said, the fine-tuning API + open weight model at least is a semblance of a viable business that could work so I will be curious about it. I'm not sure the synergy is fully there (why is someone with an open weights model privelaged to fine-tune it better if it's just QLora or Lora) but let's see!

reply
andriy_koval 2 hours ago
> It could be but there are a host of companies going after open weights models: Arcee, Reflection, Llama (TBD on Meta's focus on closed-source versus open-source), etc.

my bet is that Chinese government fund Chinese models way more compared to what those companies receive (except llama, which is outdated but was strong foundation at its time)

reply
gkapur 2 hours ago
The story of Reflection AI is supposedly that the company was faffing and failing at winning in the coding agent space, but was introduced to Jenson, who suggested they build an open-weight model and said he would fund it. That turned into a $2 billion financing with NVIDIA doing roughly $500 million and was a complete pivot.

I think the bet would have to be that a US Open Weight company either: 1. Gets a lot of money from Jenson who views them as a counterbalance to the big labs in his ecosystem and a way to generate leverage (the same way he is positioning neoclouds-- it also could be synergistic with neoclouds who could offer the model serving endpoints) 2. Can fast follow the same way Mistral does (which, honestly, seems like just distilling the Chinese model, which distills the US lab but is pretty innovative on a whole lot of architecture both in training and serving land.) 3. AND figure out some (maybe not super lucrative but lucrative enough) sort of business model, as well. There are lots of possible business models, so I will be curious how this whole space evolves.

reply
fmajid 2 hours ago
Jensen Huang is just trying to commoditize the complements to his GPUs.
reply
andriy_koval 2 hours ago
> That turned into a $2 billion financing with NVIDIA doing roughly $500 million and was a complete pivot.

I suspect 2B is not enough to boostrap frontier model from the scratch (for both talent and hardware)

reply
mannanj 2 hours ago
I have a similar bet. Looks like people don't like this idea. You got downvoted a lot.
reply
UncleOxidant 45 minutes ago
Hopefully they'll release some smaller models (<100B) that we can run on home hardware at faster than 10tok/s.
reply
bostonvaulter2 2 hours ago
What is the business model for an open weight model?
reply
matsur 52 minutes ago
Thinky has a potential answer in Tinker — give away the weights and charge for the SFT (and maybe RL down the line) to make the model more capable for specific tasks.
reply
raincole 45 minutes ago
To compete against America. If your country has something like DeepSeek you really can't afford to let it fall as it's your best leverage if the US government decides to ban companies in your country from accessing American LLMs. And this is why there will never be a "DeepSeek of the US."
reply
gtirloni 39 minutes ago
Considering how volatile things can get depending on who's president, I'd say even American companies need to "compete against America" if they don't want to get their rug pulled from under them (which, apparently, the legal system allows to easily happen in the US).
reply
ergocoder 48 minutes ago
The same business model that Deepseek is using.

Open-source models + services. This is more attractive because it doesn't lock in the vendors. If I grow larger, I can decide to deploy the open-source models.

reply
tyre 32 minutes ago
So they're constantly hemorrhaging their most valuable clients?

Tech history is littered with the corpses of "open source but we sell hosting" services. Models are so expensive to train, you can't be losing the big clients once they get super profitable.

reply
verdverm 3 hours ago
Its not as good as GLM 5.2 for agentic workflows while also being bigger. Competition is going to be ruthless because the super low cost to switching.

There is also AllenAi in the US, but they have yet to produce a model at this scale. Thankfully, new contenders can come out of nowhere and do well, as long as they can produce a competitive model.

reply
InsideOutSanta 2 hours ago
> Its not as good as GLM 5.2 for agentic workflows while also being bigger

GLM 5.2 underwent extensive post-training and iteration since its original release to reach its current state. This seems like an extremely strong model for a first release, with a lot of potential for improvement, just like DS4.

Sometimes I wish Meta had stuck with Llama 4 a bit longer to see how much further it could be pushed.

reply
verdverm 43 minutes ago
This is a great point
reply
tonic_note 58 minutes ago
isn't that what Reflection is trying to be?
reply
wxw 27 minutes ago
> Inkling is not the strongest overall model available today, open or closed. Instead, a combination of qualities makes it a good open-weights base for customization: multimodal capabilities, efficient thinking, and availability on Tinker for fine-tuning.

Open base models that can be fine tuned on Tinker is a great business model IMO. You (i.e. an enterprise) can own your own model & have it perform frontier-or-better at your task at potentially much lower cost and Thinking Machines gets to be your essential infra/service provider in this world.

Also,

> Inkling-Small matches or exceeds its larger sibling on many benchmarks — the result of improvements we made to the pre-training data and recipe for the smaller model.

Very cool! Excited to see the next generations of Thinky models.

reply
ianbutler 3 hours ago
It's nice to see a strong long context open weights model that is multi-modal.

There are many applications that will benefit from the strength in audio here and until z.ai and co work in visual this could be very strong for general agentic applications, though I see there's a bit of weakness in the benches for areas that might make that less true.

Like all models need to slap it in your harness and do proper evals on the tasks you care about.

reply
0xbadcafebee 2 hours ago
MiniMax M3 and DeepSeek v4-Pro are highly capable long context open weight multi-modal models. But long-context is a trap, because performance still falls dramatically after 150k-200k context.
reply
ianbutler 58 minutes ago
> But long-context is a trap, because performance still falls dramatically after 150k-200k context.

I often see this repeated, and it is not true task to task. I work on this daily and we have several tasks where long context is advantageous and our evals against a whole battery of models with different windows show it as being so.

This is why having good evals for the tasks you're working on is so important.

I do grant it's a good rule of thumb.

reply
InsideOutSanta 2 hours ago
> But long-context is a trap, because performance still falls dramatically after 150k-200k context.

I'm not sure exactly what causes the difference, but this heavily depends on the model. In my experience with Opus 4.8, I can go well over 500k and still get extremely good results. A drastically different example was GLM-5.1, which worked great until about 100k and then turned insane almost immediately. They did fix that with 5.2, though.

reply
minraws 2 hours ago
For a first model, and given it's open, I am gaining some faith in American Open research labs again...

I couldn't test it since it's not on openrouter or something, but even if it's only as good as GLM5.1 that's more than good enough first attempt, I think.

Perhaps a lot more labs will catch up to ballpark frontier esque level soon, I am all for more competition in any field.

reply
cpt100 40 minutes ago
NVIDIA is building Nemotron
reply
Reubend 3 hours ago
Seems like this is particularly good at instruction following, but not as strong at coding as others. It's always great to get more diversity of open weight models though! I'll need to test this out to see what its "personality" is like.
reply
janalsncm 3 hours ago
For the most part it’s better than Nemotron, worse than GLM. This makes it the best American open weights model from what I can tell?
reply
nickludlam 2 hours ago
It's nearly double the size of Nemotron 3 Ultra, so I'd expect it to be considerably better, although the active parameter count seems to be a touch lower at 41B vs 55B
reply
vcryan 6 minutes ago
I'm surprised that Nemotron gets mentioned at all. In my experiments with it for coding tasks it performed extremely poorly, essentially unusable.
reply
dr_dshiv 2 hours ago
What are the different business models for open-weight AI companies?
reply
subygan 2 hours ago
For thinking machines, they provide super simple finetuning APIs.

if it is their model, they can have more lower level integrations for that. Thinking machines might be the only large lab in the US to have business interest aligned with open sourcing strong models that are customizable.

reply
firasd 2 hours ago
Just serving the model over API seems like a natural fit and is what many of them are doing. So simply being the cloud provider for your own open weight model can be a source of revenue
reply
charcircuit 2 hours ago
What is the moat? The time it takes for AI to rewrite an efficient inference stack for a new model? Considering most LLMs follow a similar architecture, adapting to a new model shouldn't take that much time.
reply
InsideOutSanta 2 hours ago
There is no moat. At the moment, all of these companies are burning money to gain mindshare and market share. That's what Thinking Machines is doing; they're not looking for a business model.
reply
dgellow 43 minutes ago
Nobody in the LLM world has a moat, or even an actual business model
reply
dyauspitr 2 hours ago
But so can everyone else. What’s the moat for spending all those billions. I understand the Chinese angle, they need to undermine American models as a matter of statecraft, but what is the business model here? It just seems like VC charity.
reply
kingleopold 2 hours ago
use open models to gain marketing/users/attention and then go closed? maybe
reply
3848488459 2 hours ago
TM is a special company in that a lot of well commected people are willong to fund MM SOLELY because having a woman leader looks well on their family office portfolio.
reply
fragmede 42 minutes ago
Mira Murati's success isn't because she's a woman.
reply
JimsonYang 2 hours ago
Maybe the thesis is that

Open source low cost models will dominate most enterprise tasks as cost curves will dictate usage. TM is trying to replicate that especially as the US and China gets more defensive with their tech

reply
Topfi 2 hours ago
Similar to companies working on FOSS codebases, hosting (sometimes with the license restricting third-parties in some way), providing tailored models and services to customer's and getting bought for your team if your model happens to be competitive enough.
reply
vanuatu 2 hours ago
- inference

- RLaaS (Tinker, or the more involved FDE motion a la Reflection / Applied Compute)

reply
nickandbro 17 minutes ago
Lol slither.io is the new benchmark now? I guess my game slitherworld.com is now something that can be vibecoded too
reply
GodelNumbering 2 hours ago
Interestingly, when opening this page, the first thought I had was not that the benchmarks should be high, but 'I really hope they did not benchmaxx'. I think a model with modest benchmark scores can have much better real world utility as opposed to the current frontiers that are RL'd into being robotic and rigid.
reply
kancha 49 minutes ago
Not compared against Gemma 4? That is a big omission.
reply
alansaber 3 hours ago
I never thought i'd see the day they released a model, rather than a blog post. The Figure 3 demo being a screencap of chrome in localhost made me feel better about myself. Jokes aside, best western open weights model- very cool.
reply
pr337h4m 3 hours ago
They are one of the few labs (perhaps even the only one at this level) that are doing something both unique and useful, rather than simply imitating what the others are doing: https://thinkingmachines.ai/blog/interaction-models/
reply
potwinkle 22 minutes ago
Very impressive model, exciting to see an American open-source lab with such competitive results.
reply
luciana1u 14 minutes ago
the gap between 'open weights' and 'open source' is now wide enough to fit an entire corporate legal department
reply
logicprog 21 minutes ago
This seems like a really really great debut model for a new lab. I'm happy
reply
firasd 3 hours ago
Looks like it can be tried at https://tinker.thinkingmachines.ai/playground
reply
bbstats 3 hours ago
too bad we'll never know how good it is, since they used a radar plot to show its benchmark scores!
reply
InsideOutSanta 2 hours ago
How does the radar plot prevent you from looking at just one of its axes?
reply
ggcr 2 hours ago
My personal bet is that this model should really shine in Autoresearch NanoGPT-style speedruns because its first-class integration with Tinker
reply
mhluongo 2 hours ago
Interested in the implied strategy - that training a bespoke model for what you need will make economic sense over using a mass-trained model. I wonder if that's true?
reply
pants2 3 hours ago
The Artifical Analysis has a link on their homepage but it 404's :/

https://artificialanalysis.ai/models/inkling

reply
amarble 3 hours ago
They also indicate they have a 276B A12B version, but it doesn't seem the weights are available. This might actually be able to fit in 128GB when quantized to 2 bits or so which makes it interesting.
reply
Flux159 3 hours ago
They mention in the announcement link https://thinkingmachines.ai/news/introducing-inkling/ that they are still testing Inkling-Small and it will also still be multimodal. This makes it super interesting as a Deepseek V4 Flash replacement (and would be interesting with DwarfStar / ds4 if it gets supported).
reply
androiddrew 2 hours ago
Give me a good 180B param model that fits snuggly on an single DGX spark and I will sing your praises.
reply
luciana1u 29 minutes ago
the open-weight model release cadence is approaching npm package velocity. soon we'll have left-pad-7b and someone will unpublish it and break half of production
reply
solomatov 3 hours ago
It looks like HuggingFace shows Apache-2.0 but they have AUP. How does it work together?
reply
bobkb 3 hours ago
Happy to see an open weight model ! This has all the right ingredients for success.
reply
inkvi 2 hours ago
Do they have an api to try the model in real envs?
reply
jijji 32 minutes ago
competition in this space is great, especially with open models/weights. I think the answer is not closed source models. Similar to the Unix versus Linux situation in the 1990's, open source wins out. Yesterdays story about how OpenAI has now began encrypting traffic between model and agent [0], this story brings a breath of fresh air. There is nothing "Open" about hiding the communication between model and agent, especially with software that is running within a trusted environment/network. It needs to be more transparent, not less.

[0] https://www.theregister.com/ai-and-ml/2026/07/15/openai-hide...

reply
trilogic 56 minutes ago
You certainly cooking smth, Good Luck Mira.
reply
verdverm 3 hours ago
If it's ~30% bigger and not as good as GLM 5.2, why would I tinker with this model?

Maybe for the multi modal?

reply
Aurornis 3 hours ago
> If it's ~30% bigger and not as good as GLM 5.2, why would I tinker with this model?

The benchmarks never tell the full story. Some of the open weights models have been benchmaxxed for a while. Their utility on real work can be different than the benchmark number.

The multimodal input is also a big deal. Having vision input is really helpful for a lot of tasks.

reply
speedping 3 hours ago
I second that. Gemini 3.5 Flash rocks the benchmark charts but is terrible as an agent. Horrible instruction adherence and makes WAY too many tool calls
reply
luckydata 2 hours ago
which cheap models have you found work best as agents?
reply
buremba 3 hours ago
Then why are they publishing the benchmarks which makes them look worse than GLM 5.2?
reply
buremba 59 minutes ago
I'm not sure why I'm being downvoted but I didn't mean it in a negative way.

For such announcement, I would expect them to give me clues on when I should use this model and in which cases it's the best one.

The benchmarks that they share doesn't indicate that it's cheaper to run than other models, or can fit in my local machine, or excels in a specific vertical.

After reading the comments here and X, I can see it being the top-3 multi-modal open-source model though.

reply
godelski 2 hours ago
Because it's still informative
reply
verdverm 3 hours ago
being close is still impressive, especially for their first (released) model

gives me hope that the training moat is even smaller than we thought

reply
gkapur 3 hours ago
If they have a really seamless fine-tuning experience and maybe can help you extract the data you need to FT (which is one of the big challenges in actually getting fine-tuning democratized), maybe you would use it because "Tinker" defaults to it.

The model could also be more flexible for non-coding use-cases (they show the results for reasoning being strong) so maybe the argument is to use it for non-coding use-cases to drive relatively deterministic conclusions for non-coding agents (they have also done some determinism work on kernels, which could be useful in pulling on that thread of deterministic models that are fine-tuned for everything that is not writing code.)

That said, I'm not sure how much all the work they have done actually synergizes or if the market size (at least in the short to medium term) is big enough for a huge outcome from the company's current valuation with those bets as the enterprise agent estate is taking a while to evolve. Hence companies like Anthropic and OpenAI are throwing tons of consulting money at the problem.

reply
Flux159 3 hours ago
There's also an Inkling-Small that is 276B, 12B active that is much smaller than GLM 5.2 and still multimodal. Not released yet, but in the announcement link they mention that they're testing Inkling-Small & will release as open weight after testing. That one may be interesting as a Deepseek V4 Flash replacement.
reply
pizlonator 2 hours ago
> Maybe for the multi modal?

Yeah

reply
RohoSwagger 54 minutes ago
why is this website ai slop
reply
eisbaw 17 minutes ago
do you want them to focus on the website or their model? do you buy a device because of its unboxing experience?
reply
MaxPock 2 hours ago
Raised 2 billion dollars at a 12 billion valuation and debuts at 41 on the Artificial Analysis Intelligence Index, while KIMI and DeepSeek will release Fable-class models this week. What a joke.
reply
gordonhart 2 hours ago
Moonshot (Kimi) has raised $3.77B and been around for >3 years, Thinking Machines raising $2B and releasing a decent open weights model in 16 months is actually quite comparable.
reply
KronisLV 2 hours ago
> ...while KIMI and DeepSeek will release Fable-class models this week.

What new model is DeepSeek releasing? Their current V4 Pro at Max reasoning is consistently worse than GLM 5.2 at Max reasoning, though the latter is close to Opus 4.8 at Extra/Max reasoning, albeit a little bit worse in my experience (though if they gave comparable amounts of tokens to Anthropic 5x Max subscription I could see myself moving over, currently they give you less though even with their ZCode discount).

In practical agentic development, none of those seem to be that close to Fable to me. Spent 181 million tokens with GLM 5.2 with ZCode in the past month, 142 million with DeepSeek V4 Pro with ZCode and OpenCode and about 3.45 billion across all Anthropic models with Claude Code, though understandably with my workload between 95-99% of them are cached (very docs/plan/tooling/read heavy work to limit slop, albeit with sub-agents and workflows).

reply
segmondy 2 hours ago
DeepSeekV4 was a preview model, read the papers. It's not the final model. They released it to demonstrate architectural capabilities. They are still training and the model release is planned within the next month.
reply
KronisLV 44 minutes ago
If they somehow make it approach Fable in capability, I’ll be quite surprised!
reply
raverbashing 3 hours ago
Cool, now we just need the GPU that supports it
reply
MaxPock 3 hours ago
[flagged]
reply
CurbStomper 3 hours ago
[dead]
reply