K2 Horizon: A connected fleet of six open models
156 points by karimf 4 hours ago | 50 comments

cesarvarela 14 minutes ago
I find it funny that while these releases are a technological miracle, the charts in the doc use tiny fonts and are hard to read. Goes with the idea that coding might be solved, but taste isn't.
reply
jjordan 3 hours ago
Fully open models really need to be a big part of the AI future. That includes all source code, open training data, how it's organized, fed to the model, processed, etc. Until that becomes a thing you're always going to be left wondering what exactly lies underneath the closed model you are using, leaving open the possibility for societal manipulation.
reply
kibae 2 hours ago
The training data would need to have a permissive license for this to be possible.
reply
embedding-shape 13 minutes ago
Or, we just need to get this over with and declare any digital data findable via the internet to just be public property of everyone. Everything becomes public, besides stuff you keep locally, and there is no difference anymore, it's all just data anyone can use for whatever. A 1 year grace period for everyone to pull stuff off they don't want to be a part of this bright new open era, then we just scrap everything related to intellectual property, copyright and similar stupid stuff, and slap UBI on top of all of it for good measure.
reply
ux266478 2 hours ago
You could sidestep it by running non-permissibly licensed training data that you purchased through an LLM. Legal attitude so far seems to be that this is transformative as long as it's not 1:1. The question on whether or not the end result is copyrightable of course remains controversial and inconsistent, but that question is also fairly irrelevent. You don't get more libre than public domain.

That's a fair amount of computational and labor overhead mind you, as you'll need to verify and prune the quality of your mountain of synthetic data, but certainly possible.

Though this assumes the legal system is a rational actor playing by the set of rules it claims to. In fact, I highly suspect you could get very unlucky and get an unfavorable ruling against you, because you stepped on a big pile of money's toes in the process of doing this.

reply
alightsoul 10 minutes ago
It can also be used to sidestep copyright like this forum, books and most websites even if the data was not purchased but is a website or book.

Are LLMs what we need to make all data public domain? This way it could be used for that purpose

reply
jjordan 28 minutes ago
Hear me out.

Decentralized unstoppable storage, combined with decentralized unstoppable training, sorta like SETI for AI training. The seed of this tech already exists with IPFS and others like it.

We know (some? all?) of the big labs have skirted copyright laws at one point or another. Truly open models would just build on what is publicly available.

reply
alightsoul 11 minutes ago
Crypto bros took the idea with some blockchain shit and no one takes it seriously anymore so it died
reply
ignoramous 6 minutes ago
UAE's IFM / LLM360 MO is indeed "fully open source" LLMs: https://www.llm360.ai/reports/LLM360-Towards-Fully-Transpare...
reply
echelon 2 hours ago
Eventually we'll just construct 100% synthetic training data that can reliably reproduce pretrains and fine tunes.

The first broadly useful fully open source models will do this.

We already have open data / open code / open weights for some domain-specific cases, such as audio models trained on large open datasets, eg. Tacotron / LJSpeech from waaay back in the day, though that is certainly not SOTA anymore.

Distillation could possibly be considered an early case of this as raw AI outputs are themselves not copyrightable unless humans enrich, filter, or transform them. Granted, that does not handle the cases where the outputs are sufficiently similar to copyrighted original works.

reply
chaosharmonic 30 minutes ago
But how much of that synthetic data still ultimately derives from non-open sources? You'd still have to ask what a clean room implementation ultimately is, depending on how granular or aggressive a large publisher wanted to get about it.

That said, I don't necessarily disagree with you. Talkie[1] presents an interesting case for it being at least possible to do this entirely on public domain material.

But even that used Claude somewhere in the course of its training pipeline (it's listed as a contributor on their GitHub), so again, how granular you want to get with that is still a question.

[1] https://talkie-lm.com/chat

reply
waffleiron 39 minutes ago
Where does that synthetic data come from? Magically just started existing?
reply
trvz 2 hours ago
Why? Sure, I’d prefer it, too, but this is just another GNU/Linux vs. macOS situation: most of us would prefer the first, but actually get shit done on the latter.
reply
didibus 2 hours ago
And that's why companies shouldn't fear opening up, but having both is still a net benefit.
reply
zufallsheld 2 hours ago
Without open-source, there'd be no macOS.. So good thing, it exists.
reply
homarp 2 hours ago
which is why everyone runs docker on mac, to get shit done.
reply
verdverm 21 minutes ago
we get shit done on the cloud with the former rather than the later

I personally find the analogy unconvincing, the UX dimension is completely different as I can use the same harness with any model; and the year of the linux desktop is coming soon (tm)

reply
verdverm 25 minutes ago
I believe Olmo from AllenAi is this

https://allenai.org/olmo

Open models can be used/changed for social manipulation too, by anyone, which scares a bunch of people, as opposed to the dark pattern manipulation from Big Ai/Tech

reply
cute_boi 55 minutes ago
Money is the issue here, no one wants to fund it.
reply
__MatrixMan__ 31 minutes ago
I'm sure anthropic didn't want to fund the extra "safety" guardrails they put into fable, but they were forced to, else they couldn't release it.

Sure there are all kinds of problems with that situation. But it still demonstrates that they can be coerced: play nice or don't play at all.

reply
a11r 2 hours ago
It is great to see another player introduce a fully open stack. Nvidia's Nemotron is the only other prominent one I know of.

All that said, the headline claims do not match the self-reported performance. For example, the dense 32B model is significantly behind Qwen3.8 27B (chart towards the bottom of https://ifm.ai/blog/k2). Gemma4 31B is not in the comparison set. This is the most important sweet spot for self hosted open-weight models today and real competition here will be very welcome.

reply
baron3dl 50 minutes ago
https://allenai.org/ has the fully open olmo also
reply
xienze 2 hours ago
They have the 32B listed as "stage 1" with the note "final checkpoint to be released." So, not finished yet. Not sure why you'd release it if it's not finished, but that's the explanation.

The 7B does look very, very good however.

reply
bluejay2387 17 minutes ago
In this case, the fully open source pipeline is probably as valuable or more so than the weights, so releasing early has some justification.
reply
WithinReason 2 hours ago
32B performs worse than the 7B model so I'm sure they will improve it
reply
piinbinary 3 hours ago
A bit off topic, but I think I'm starting to get model fatigue. These come out 10x faster than new Javascript frameworks were coming out 10 years ago (at least new models are far easier to adopt).
reply
hungryhobbit 54 minutes ago
There was a time when every new PC CPU coming out was a giant deal: "Guys have you heard about this new Pentium processor, it's incredible?"

But over time, more and more people got into the chip-making business, and the big players started releasing more and more chips. Now only the die-hard CPU trackers worry about every new CPU and exactly how it's better ... while everyone else just worries about "which CPU will be good enough at this moment".

I think models are on that same arc.

reply
dgellow 12 minutes ago
Honestly, you don’t have to pay attention. What you do with models matters way more than the models themselves, and you don’t need frontier for the vast, vast majority of use cases
reply
wuhhh 3 hours ago
At least this one can claim being fully open to differentiate it
reply
kelseyfrog 3 hours ago
Just wait until RSI gains enough traction. We'll be compute-limited rather than labor-limited.
reply
uniclaude 2 hours ago
Seeing this the day all major closed LLMs went offline is quite the reminder of how valuable open source can be.
reply
jon9544hn 3 hours ago
Here’s the link (K2)[https://ifm.ai/k2/] as the originally linked link is a login url.
reply
mmastrac 2 hours ago
The comparisons with other models here are odd.. the other models change depending on the task. It would be far more useful to at least compare against the more recent open models (DS4Flash/GLM53Flash/Qwen38).
reply
cogman10 6 minutes ago
They are trying to keep the models within the same quant class, which is tough to do since a lot of models aren't distilled to lower quants.

There is, for example, no Qwen3.8 7B.

It is odd to me, though, that they didn't run the same benchmark suite for the various quants.

reply
kamranjon 3 hours ago
it's funny that the tagline is Radically Open, but you're immediately hit with http login - maybe this was the wrong link?
reply
sottol 3 hours ago
It's not the blog post, but there's some info here:

https://ifm.ai/k2/

375 A23B, 36 A4B, 32B, 7B, 3.7B, 0.9B variants.

> 32B: Ranking among the top models in its class, 32B is our most powerful dense model, balancing capability, adaptability, and local deployability.

> 7B: The industry’s best-performing model under 10B combines strong software engineering and expert knowledge in a package small enough to run on a phone.

reply
gs17 3 hours ago
https://ifm.ai/k2/ seems to work for me.
reply
esafak 3 hours ago
But it's missing the all-important charts that the blog had before it started asking for authentication.
reply
wmedrano 3 hours ago
You can find some of the charts on huggingface

https://huggingface.co/collections/IFM/k2-horizon

reply
sottol 3 hours ago
Thanks! Qwen-3.8 27B seems to benchmark better but I'd like to try this some time.
reply
verdverm 18 minutes ago
little qwen is my favorite for the homelab, vllm 0.28 now supports the dflash2 to go with it
reply
sottol 3 hours ago
reply
afzalive 2 hours ago
Not to be confused with Kimi K2. Out of all the names they could've used, they picked one that would be confusing.
reply
bee_rider 2 hours ago
I kind of assumed all the K2 names were puns. K2 is quite tall, so to get to the top of it you have to be really good at hill climbing. Anyway it’s a pretty well known mountain so I don’t think anyone can call dibs on it.
reply
villish 51 minutes ago
Frontier. Everything is frontier. K2 not to be confused with the other K2, or K3 that is also frontier.
reply
prometheus1992 2 hours ago
Nice! can't wait to add these in my local stack and try them out.
reply
luckydata 3 hours ago
both repositories for pre-training and post-training are actually empty... someone might have jumped the gun on the release.
reply
verdverm 15 minutes ago
[dead]
reply
luciana1u 32 minutes ago
i'll believe 'radically open' when the training data ships alongside the weights. until then it's a very fast demo.
reply
adrian_b 24 minutes ago
I just looked on Huggingface.co, and the training data is there.

For example, 3.3 Tbyte for code reasoning, 4.5 Tbyte for mathematical reasoning, 8.4 Tbyte of pre-train behaviors, and so on.

I did not compute the sum of the dataset sizes, but it appears to be some tens of Tbyte. Nonetheless, I assume that this amount of training data is more than an order of magnitude less than what OpenAI, Anthropic and the like have used, which must have been at least many hundreds of Tbyte, but more likely several thousands of Tbyte of data.

reply
dakolli 28 minutes ago
Hey its a lot mpre thsn Anthropic which you probably use everyday all day without complaints.
reply