> For game development, we partnered with professional developers at Tencent Interactive Entertainment Group (IEG) to curate high-quality training data and build evaluations. We focused on feature implementation, gameplay logic, state tracking, and asset pipelines. We also extensively adapted Hy4 for major engines such as Unreal Engine, Unity, and Godot, and expanded its capabilities to multiplayer game development. Compared with Hy4 preview, Hy4 improves by 19.1% on GameDev and 9.8% on GameLogic.
Here's more about that game development studio - https://en.wikipedia.org/wiki/Tencent_Games - they've been around since 2004.
They are the Berkshire Hathaway of everything, to be honest. They invest in and acquire minority stakes in hundreds of companies.
https://en.wikipedia.org/wiki/Berkshire_Hathaway https://en.wikipedia.org/wiki/Tencent
I like that they acknowledge that. For working with ai as a tool open models are already great. For millennium problems and doomermaxxing they are not there yet.
Verrrry thorough in its work and therefore verrrrry slow. It spent a long time with each question, running about 26 queries for each question, and in some questions it ran 64 queries. One of the queries that it wrote also took about an hour to run, which affected its overall exam time.
Last year the open weight models were the cheap & good alternatives. Then in September/October that cost story got rewritten by the GPT-6 series and Claude's 5 series.
Hy4 brings open models back on the cost/accuracy frontier, but its behavior is too thorough + slow.
Another thing we're seeing is that post training open models is starting to see results. Particle-1 from last week is also on our frontier, which is post-trained on DeepSeek V4.1 and Fireworks Ember-1 from a few weeks ago was post-trained on Kimi K3.
Take these numbers with a grain of salt: this exam is just for short horizon, low-context data analysis tasks, not full-fledged software projects.
If the gap closes, we do zero austerity, and interest rates are high, I cannot see a way out of a major economic crisis, even if we do start to see dramatic productivity wins.
More on-topic (and maybe more positive?), but this model feels a bit more expensive than I would have expected!
The only thing worse for the economy than failure would be success.
Ant/OAI/Google are way ahead when it comes to the smartest, largest-scale and most compute-intensive models. By Jevons' paradox, if you make inference for leaner models cheaper (as the Chinese models do, being broadly comparable to GPT Terra or Claude Sonnet; barely approaching Opus/Sol at their very best) that only increases demand for the complementary service of very smart inference.
From biggest to smallest, the top three:
AIG controlled $1.05T and market cap crashed from $180B to $3.8B
Wachovia controlled $782B and market cap crashed from $110B to $1.8B
Lehman Brothers controlled $639B and market cap crashed from $60B to $200M.
Massive companies accounting for lots of money in people's retirment accounts. The companies made mistakes leading to what would have resulted or did result in defaulting on their debts. Suddenly billions of dollars vanished from retirement accounts.
We could very easily see a similar cascade of corrections if we get a few more "Alphabet missed earnings" news calls.
Personally, the thing I'm most excited about is the FrontierCode 2.0 score, which is a benchmark I trust a bit more - 31 seems to be roughly on par with 6.1 Sol and Opus 5.5 medium
If you're going to be surveilled 24/7, at least you gotta make it work for you.
I don't get it.
There was CCTV at the station, your friend arrived in a taxi. And we're supposed to be amazed you can call up the taxi company and quote a numberplate off CCTV ?
Can be done anywhere in the world.
Would have been far more impressive story if she had arrived in a private car, dropped off by a work colleague or something.
Which country are you in where you cant take "call the driver" for granted?
Meanwhile, in the west, the standard of living has been eroding for the majority of the population. Technological progress is associated with layoffs, loss of agency at the workplace, and diminishing life prospects. So, it's no surprise that there is growing opposition to AI.
Model | Cached Input | Input (Miss) | Output
---------------|--------------|--------------|----------
Tencent Hy4 | $0.042 | $0.83 | $2.50
DeepSeek (peak)| $0.006 | $0.30 | $1.20
DeepSeek (off) | $0.003 | $0.15 | $0.60OAI / Ant are in for a reckoning.
So, yeah. Back to GLM 5.3.
Le cordonnier mal chaussé.
Tencent Hy4 ties DeepSeek V4.1 Flash at 82/100, in 23.2 min for $0.30 vs 20.1 min for $2.26. Same game quality for about a seventh of the price. Cheap models keep closing the gap.
Model: https://jonclegg.github.io/pacman-bakeoff/#tencent-hy4
Closest: https://jonclegg.github.io/pacman-bakeoff/#deepseek-v4.1-fla...
That's how you get a civilizational advantage. By allowing people to just do things. It's so bizarre to watch China embrace the wonders of science and technology, while certain American startups and communities repeat "WHAT ABOUT THE BIOWEAPONS?"
The American century has been fumbled hard.
Oh, wait…
It shouldn't be. China is the closest thing to a technocracy the world has.
I wonder how much Covid conspiracy theories play into this. If you've already been accused of making bioweapons, and the world had to shut down for three years because of them, then what's the worst that could happen to you? People accusing you of doing it again? The people that hate you already hate you, they can't really hate you and harder.
Meanwhile, in the fear based economy that America has, OpenAI is running scared of the possiblity of headlines that they helped terrorists or a high school shooter in some way. In the case of rape, we've maybe moved the conversation past "well she shouldn't have been wearing that" to "they shouldn't be raping" but in cases involving AI, we're still at the "well, what was the chatbot wearing?" stage of things.
You can feel like companies have no responsibility for how their products are used but it might be worth showing some grace to the people who are dead now by not trying to downplay what happened to them by implying it was just like everyone else's experience of "asking ai questions".
But also cases like the 2 girls suing Snapchat and settling for unknown amounts of money.
Eh, I'm reasonably certain it's not altruism. It's another form of competition with the US companies and I'm thankful for it while it lasts.