24” or even 27” feels like such a downgrade.
Also please make the iMacs usable as external monitors agains. Would buy one as a “livingroom computer” instantly if it was also possible to occasionally use it as a docking station for an air..
The generation doesn't mater as much to me as the memory bandwidth. When that day comes, I'd rather have a M1 Max 64GB over a M5 Pro 64GB.
And now if you stretch you can run DeepSeek Flash 4.1.
And if you were willing to roll up your sleeves you could build your own AI lab at home and run this model and models like GLM Flash 5.3 and DeepSeek Flash V4.1 at lower quants. The budget GPUs (like V100) are kind of not budget now, but still <5K to acquire 128GB of fast VRAM that can compete with a 5090 and actually has a lot more interesting options available IMO.
It will show you on the model selection IF a model fits and if you use a "Qwen 3.8-35B-A3B" type of model, it should just work out of the box. A3B stands for Active which means you need a lot less fast ram.
You will run into issues fast though: If you have big tasks for it to do, your pc/mac will get warm very fast and noisy and you will cosume relevant more energy.
And as you mention: yeah small context!
Its still not that practical in my opinion.
Dense models also don't like quantization as much and are less tolerant of it. There are some very interesting smaller models like https://huggingface.co/nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4... Dory that I would check out. You need system RAM or to stream a larger MoE model from disk and it won't be fast. You need to specialize the models some to get quality results if you have very limited system resources.
https://github.com/Niko1221/Strata/
My setup is a Ryzen 3600, 90GB DDR4 allocated to a VM (don’t even really need that much, just had it available, special thanks to the year 2024), and an RX 9060XT 16GB ($500 GPU).
I get around 40-60 tok/s depending on the quantization level I choose.
As you can see, the CPU is nothing special, don’t even need DDR5.
So it depends on what you're doing. Using it for a fun oracle without feeding it too much context per turn? Sure, an older Max chip is great.
As a coding agent doing meaningful work on a sizable project? Compared to a cheap as chips cloud option, it will take an order of magnitude more time to complete.
Isn't it also rumored that the M7 is reworked for AI?
And Xiaomi announced their AI Cube with 1.2t of bandwidth. Just because Nvidia is protecting its business by giving consumers either compute or bandwidth and Apple being something in between, doesn't mean we can't get both a lot better balanced.
I don't know man?
The generation kind of does matter. I'm not gonna lie, matrix multiplication units speed things up considerably. That hardware confers a material change in capability.
Maybe from M5 up, it doesn't matter? But you're definitely going to notice the difference between M1 and M5 for instance.
I am one of those: bought the M1 Max with 64gb thinking in running VMs, afterward bought a lighter Air with less memory and ended up using the M1 Max as a kind of luxury for LLMs and multicore computing.
The only hope we have is the AI bubble bursting, but that will undoubtedly come with its own set of macroeconomic surprises.
It feels just as fast as day 1 and I've never had any speed issues. Say what you want about Apple and their pricing and ecosystem but I've been using their hardware for over 20 years now and it's always been top notch.
If you buy their support/AppleCare, your support and warranty is excellent too. They don't skimp. I've seen them go so far past the extra mile it's unreal.
It only makes sense for niche use cases, like your grandpa who is happy to have a single spot in his home for the computer, or a reception desk at a business, etc.
This is basically 99% of the proposition of the iMac at this point. If you don't need the specific all-in-one, color, and other design aspects of the iMac or can afford a Studio display, there's no reason not to buy some other display + a Mac mini or a laptop + display
Though I have had good results buying 1-2 generation old refurbished Macs as my secondary machines or for family members who don’t need cutting edge everything.
It’s even more valuable now that Apple silicon of every generation is more than enough to run every non-power user use case short of newer video games.
It’s too bad. A high end iMac still holds a lot of appeal, especially for those seeking clean desk setups. I’m using an MBP hooked up to dual monitors through a dock right now and it’s fine, but I do miss how clean my desk was back when it was a VESA mounted iMac Pro and companion monitor.
the iMac returned to its roots as the “family computer” or “grandma email box” kind of machine.
I’ve kept that philosophy over the years, the MBA was replaced by the 2017 12” retina MacBook and then again with the 13” M2 MBA. The Mini gave way to the 2018 Mini, then a M1 Max Studio. I even attempted replacing the MacBook with an iPad though that didn’t really workout.
It’s the best of both worlds really, enough power to do everything when on the go and even more power back at the office.
0: https://elliotjaystocks.com/blog/a-note-about-my-new-mac-set...
What's the appeal there? Doing big-RAM-requirement stuff that just won't run on a laptop?
Nowadays, the M series chips are so powerful that I’ve not had a real need to use my Studio and work mainly using my M2 Air.
So if I’m going to have a machine always sitting on my desk at home anyway, it may as well be a desktop with fewer compromises and no battery to slowly degrade while never getting used.
A nice bonus is that it takes a lot more to make the fans on a desktop noisy relative to what it takes on an MBP, and if there’s one thing I dislike about computers it’s fan noise.
24" is a good size for casual users which is the main market. You can have two roomy-ish GUI apps (two web pages, etc) side by side.
This has been reported for many months. Sorry if you missed the news, but if you need a much higher memory variant the M5 Pro/Max are what’s available this cycle.
To be honest, I doubt we're going to see iMacs with very high RAM any time soon. RAM is expensive and most people buying high-RAM machines want to bring their own monitor, not get an all-in-one with a small-ish screen.
Peripherals not included.
I would love to have a pink one for my MBP!
£700/£800 buys you a 24" display (with an unspecified refresh rate, so presumably 60Hz), a keyboard, and a mouse. I loved my 27" iMac to pieces, but it's really hard to justify buying this thing today.
That's about $1000, and it buys you a 32" 4K OLED panel with a high refresh rate, better than anything the Mac has. That's the kind of monitor you would pair with a gaming rig though, and probably overkill for the kind of office use the Mac is intended for.
0: https://www.ifixit.com/Teardown/iMac+Intel+27-Inch+EMC+2309+...
1: https://www.ifixit.com/Teardown/iMac+M3+24-Inch+Teardown:+Ap...
https://www.apple.com/shop/product/mxk53am/a/magic-mouse-usb...
The ECC in DDR5 is on-die ECC and that's not "real" ECC, it's what DDR5 needs to not fail. Side-band ECC is the standard method, employing extra memory chips and 72bit memory. OEMs mix these in the marketing materials to fool the users into thinking they buy the better option.
Her eyes were much less tired at the end of the day.
It’s nice for games but I don’t really care for productivity use. In fact in that situation I’d take integer-scaled HiDPI density over refresh rate in that scenario.
Mechanically straightforward since it’s all in one. Pretty much just the power cable, keyboard and mouse. Pretty unbreakable ux wise, reliably sleeps with little power draw and wakes up quickly without them questioning if it’s broken. Reasonably unobtrusive updates so they don’t go turning them off. Etc.
We thought long and hard about a Mac Mini — and not happy about going from 27" to 24" — but a Studio Display doubles the price and he's not willing to take another chance on third-party stuff.
But they aren't Apple.