Apple has new Mac app coming to make running local AI models easy
72 points by linolevan 3 hours ago | 34 comments
jedbrooke 12 minutes ago
> Cluster for scale: “Connect two or more Thunderbolt 5-capable Mac computers and Harbor pools their unified memory into a single inference resource. Run models that exceed any single computer’s capacity, or serve more concurrent requests across your cluster.”
replyThis seems like the main way it would differentiate itself over existing solutions like LMStudio etc.
gizmodo59 5 minutes ago
I really want capable models local but it’s impossible for me to afford the hardware. If there is a magical way to run glm 5.3 without quantization at 80-100tps with a total spend of less than 10K I’d be happy but that’s impossible now.
replysimonw 31 minutes ago
"Harbor is currently in a private preview under Apple’s Claris brand"
replyThere's a name I haven't heard in a long time! Claris (always an Apple subsidiary, since being founded in 1987) renamed themselves to FileMaker in 1998, but apparently they rebranded back to Claris in 2019.
Looks like they've mostly just released annual upgrades to FileMaker for the past decade, but they did add MCP to it last year: https://www.claris.com/blog/2025/why-mcp-matters-for-claris-...
liuliu 23 minutes ago
https://getlocalcode.app/ runs local AI models (larger ones of course, DeepSeek 4.1 Flash 1017) easy. You can download and try it now. The problem is elsewhere: you cannot find M5 Ultra that you can purchase and set it up today.
replyzf00002 25 minutes ago
You can chat with the local model that ships with macos on your M1+ mac right now. There's a few servers on github that make it easy.
replyw10-1 44 minutes ago
OMG after 25 years, Claris gets something beyond FileMaker (among the most legacy software still alive)? Claris would not have the engineering talent, so why would Apple use them as a vector?
replydetourdog 24 minutes ago
Currently FileMaker is a really expensive but sophisticated developer deployment environment. They stayed pretty true to the original vision in the mid 80’s when they merged their DOS database and added a gui layer for the Macintosh. I started on version 2 and it was at its best at when it went relational in version 3. Since then they have been focusing on deployment of graphical data applications and being a better database.
replyMBCook 53 minutes ago
But you’re still in for a ton of pain if you want to run them headless right?
replyThey desperately need to fix that.
myphpgothacked 30 minutes ago
Only took them 3 years for something that's inevitably worse than lm studio.
replyUsers will praise it still. What's the phrase, Apple distortion field?
Distillation works: we can get models leaner, have better performance with lesser and lesser parameters, more efficient, running locally. Apple gets this and we'll see the result with M7 Max/ultra chips and I reckon this will be one of the titular apps when M7 line of chips are introduced.
I guess it explains the haste Anthropic and OpenAI are in to IPO, cash out and leave the the retail investor holding the bag.
Right now 128GB MacBook is the top of the line and you could do Qwen 3.8 Flash or similar.
There is a rumor that the M7 chip can use 1.5TB of memory which would imply Apple is aiming for more memory on devices.[1]
Would that imply the entry-level MacBook will have 128GB and top of the line models could run larger reasoning models? Then the question is price and if any of this will translate to iPhone for on-phone models.
With how expensive memory is, IDK if they can pull this off but I hope they do
[1] https://www.tomshardware.com/tech-industry/semiconductors/ap...
If Apple, in 2030 has a compute product that a worker can BYO(X) to work that has 2TB RAM, with an encrypted personalized context that can float between agents, then they will be in a very interesting place.
holy shit
Even so, DDR5 is so high-demand that it's likely that Apple can't outbid customers like Nvidia or OpenAI when they drive the margins they do.
Where I am, it's cheaper to purchase multiple claude subscriptions than it is for the power bill from running a local model. Factor in the hardware costs, and you're looking at a break over a decade in the future, for comparable cloud models. Yes, there's privacy, etc, but now you're down into fractions of a percent of users who care about the government reading the memory of their computer.
It's not comparable to huge models of course, but given the power/size ratio here it shows that serious gains are on the table for models that can run fast on a high-end laptop.
Factoring in the increased cost of memory, Apple's threatened service revenue and the stagnation of ecosystem products like the Mac and iPad, I think they have a really challenging future to navigate. The whole "sell people a B2C ecosystem" business model is more threatened than ever.
If you are an investor, you should remember they are a fashion product more than a tech company.
If you are a user, you should remember they are a fashion company more than a tech company.