OpenAI models are coming to Google Cloud
155 points by armcat 7 hours ago | 59 comments

anthonypasq 20 minutes ago
Sergey better really go into "founder mode" or else Thomas Kurian (head of GCP) will continue to eat Deepmind's lunch.

Between selling TPUs to external companies and now hosting competitor models, Gemini just doesnt have the full faith of the Alphabet capital allocators, and I can't really blame them. A mature company like google would rather just expand their extremely profitable cloud business rather than dump billions into a black hole on the off chance they achieve RSI or superintelligence or whatever.

reply
nsagent 3 hours ago
Gotta love the disclaimer at the bottom:

  Microsoft remains OpenAI’s primary cloud partner.
reply
hobofan 3 hours ago
Things that you only say because you are contractually forced to say them.
reply
merelydev 3 hours ago
Or don't want to crash stock price.
reply
echelon 2 hours ago
OpenAI buys from Azure because of the Microsoft investment deal.

OpenAI sells and reaches enterprise customers via GCP.

Enterprises want zero data retention guarantees and they're already on AWS or GCP, so this is how OpenAI reaches those customers and makes more money.

reply
_boffin_ 30 minutes ago
Microsoft has had ZDR for inference since pretty much the beginning. Just needed to fill out a form and get approved.
reply
keerthiko 2 hours ago
isn't the largest portion of openAI's reach to (overwhelming cloud provider leader AWS) enterprise customers via amazon bedrock?
reply
paxy 44 minutes ago
OpenAI only launched on bedrock ~3 months ago, so I doubt it. It has been running on azure since day 1.
reply
londons_explore 2 hours ago
> Enterprises with Google Cloud spend commitments will be able to draw down their GCP commitments for these purchases.

This is a fairly big move by Google... It means revenue they have already booked and reported to shareholders they now might have to give away - potentially all of it. Bean counters hate that!

reply
paxy 38 minutes ago
“Reported to shareholders” doesn’t really mean anything. There are thousands of such line items on financial reports. The ones that matter, such as recognized revenue, don’t count future bookings. It is understood that customers renege on these commitments all the time.

Google is simply telling customers - there’s a new Google Cloud service, and you can use it under your existing account.

reply
game_the0ry 2 hours ago
Prediction: google cloud will pivot to being a hyperscaler versus a model + hyperscaler. Kind of like how xAI started hosting anthropic workloads with colossus cluster.

bc the alpha is not the model, the alpha is having the physical infra (chips, power, etc).

reply
paxy 51 minutes ago
A company is allowed to do two things
reply
hackernudes 59 minutes ago
But x.ai also hosts Grok? Why would google stop developing their own models? I think you're right that Google will try to make money from their infrastructure (that's basically what Google Cloud is too).
reply
ReptileMan 13 minutes ago
As much as I like Elon, if Grok was a hero shooter its concurrent steam player count will be in low hundreds.
reply
barumrho 58 minutes ago
Is that a long term prediction? Are you saying that physical infra will always lag demand from here on?
reply
cma 41 minutes ago
>Kind of like how xAI started hosting anthropic workloads with colossus cluster.

Google has been hosting part of Anthropic's load long before that deal. They had a big degradation due to compiler bug for TPUs in an optimization they made to work around TPUs not being able sample from the logits efficiently.

reply
123haw 3 hours ago
Preparing for Oracle bankruptcy.
reply
kps 50 minutes ago
There's always a silver lining!
reply
esseph 39 minutes ago
I could only hope...
reply
bananzamba 3 hours ago
How are they trusting Google not to destill them
reply
dumberquestions 3 hours ago
This is speculation, but funnily enough Gemini models show the least evidence of being distilled from OAI or Anthropic compared to everything else in the market.
reply
BudaDude 2 hours ago
I feel this is correct. Google has probably the most data of any company in the world. For better or worse, they don't need to train on the outputs of other models.
reply
aviinuo 3 hours ago
Nvidia GPUs let you load encrypted weights onto them and to decrypt on chip so Google would need to have some sort of Nvidia management firmware attack to read from HBM while the GPU is live
reply
jayd16 2 hours ago
Isn't distillation more of a black box type affair?
reply
zeroxfe 57 minutes ago
Distillation does not require access to weights.
reply
binlog 3 hours ago
Doesn’t really matter what happens at the GPU level when Google can see all API traffic.
reply
worldsavior 3 hours ago
Except google cloud doesn't use Nvidia GPUs but TPUs.
reply
Mond_ 54 minutes ago
Google has both. Afaik we don't know whether OpenAI models will run on TPUs or GPUs here.
reply
tgma 12 minutes ago
I bet it would be the NVIDIA, at least initially, not for the encryption capability per se, but for simple fact that adapting to TPU at high performance is non-trivial.
reply
iamdelirium 3 hours ago
GCP already hosts Anthropic models so probably trusts and lawyers.
reply
lrvick 3 hours ago
Probably a very strict contract, and letting OpenAI read all the session logs like they do for their own customers.
reply
tgma 2 hours ago
America is a high-trust society.
reply
toephu2 6 minutes ago
Japan is a high-trust society. America is the opposite.
reply
tgma 2 minutes ago
Everything is relative, but fair enough.
reply
paxy 2 hours ago
More like - America is a high-litigation society.
reply
tgma 32 minutes ago
I don't believe threat of litigation alone explains the extent of it.

The way an American company, esp a reputable one like Google, conducts itself internally is different. There will be much more internal backlash to do the wrong thing way before litigation.

reply
amelius 2 hours ago
First answer this: How are they trusting OpenRouter not to distill them?
reply
WarmWash 3 hours ago
Google Cloud couldn't give a shit about Google Deepmind, and backdooring Clouds customers only stands to hurt Cloud.
reply
binlog 3 hours ago
Contracts and lawyers are more powerful than any technical tool.
reply
amelius 2 hours ago
Yeah like the copyright lawyers of content owners that got their works trained on?
reply
paxy 51 minutes ago
How many trillions of dollars were those content owners worth?
reply
kridsdale1 33 minutes ago
Enough. They just weren’t working in coordination.
reply
lemonish97 2 hours ago
"OpenAI models will soon be available in the Gemini Agent"

They definitely need to have a better name if they're going to use 3p models

reply
torben-friis 37 minutes ago
New to Google?
reply
AznHisoka 2 hours ago
Does this mean OpenAI is going to use TPU now?
reply
AndrewKemendo 3 hours ago
We need a new acronym

Google, NVIDIA, OpenAI, MSFT…

GNOM…oh wait no

The strategy that I’ve heard said out loud now by all the major technology companies is “we’re all doing it (AI) together”

In my view this was more or less the political result of the White House summit

So I think we’re seeing what is basically going to be a giant amorphous set of collaborations such that nobody gets taken down, and the whole market doesn’t collapse

If Alphabet, OAI, MSFT, AMZ…etc all agree to be interoperable then they will be acting more or less as a single body in tension.

Whether that’s good or not is a question of your worldview but I think that’s the strategy

reply
simonw 2 hours ago
Add Anthropic and you get MANGO. MSFT, Anthropic, NVIDIA, Google, OpenAI.
reply
AndrewKemendo 59 minutes ago
Let’s go with Mango!
reply
paxy 2 hours ago
Giant companies working together isn’t an AI-age phenomenon. Go back 10, 20, 30 years and you’ll see that despite the public perception of competitiveness all the largest tech companies (Apple, Microsoft, Google, Samsung, Amazon) buy/sell to each other, sign partnerships and have tight economic interdependencies.
reply
AndrewKemendo 57 minutes ago
Who said it’s new? :)

However if you look at the trust busting era what preceded it was this exact kind of private “cooperation” to prevent government involvement

reply
selimthegrim 3 hours ago
This is like that SNL skit with Tim Meadows where Will Ferrell has the F on his shirt on the kids TV show and keeps getting in the inappropriate order
reply
solyin 2 hours ago
Add in Meta (Muse app is a winner)

MOM-NG GNOMM NGMOM MGNOM MGMNO MGMON ONMGM NOMGM NOMMG

reply
cubefox 3 hours ago
Is this the begging of the end of Gemini?
reply
tancop 2 hours ago
Why would it? The point of Gemini is provide user facing services cheaper than if they were paying OpenAI, make some money on the side with API credits and position themselves as a leader when investors want to see AI everywhere.

Google Cloud is competing with AWS. Amazon has Bedrock so Google needs to keep up with them by serving both Claude and GPT, along with Gemini and open models.

reply
iamdelirium 3 hours ago
GCP has been hosting Anthropic models for a while.
reply
cubefox 2 hours ago
Google owns Anthropic stock.
reply
dgellow 3 hours ago
No? Why would you think that’s the case? Gemini fills its own niche
reply
cubefox 33 minutes ago
Gemini and GPT fill the same niche. They are direct competitors.
reply
open592 3 hours ago
I don't understand all the wild speculation and question here - openai is selling a shit ton of inference through third parties. these third parties want to provide inference to their customers who use gcp (and don't want to also inference through bedrock or azure ai foundary.

these are all zdr engagements and thus "enterprise" contracts.

basically it boils down to - anthropic already provides inference direct through GCP, Azure, and AWS - so to compete openai is doing the same.

reply