Data Processing Incidents on Inference Providers
138 points by sdko 8 hours ago | 53 comments

usernomdeguerre 3 hours ago
Wow I missed this story entirely. I'd seriously considered moving to OpenRouter at my next external AI renewal due to the breadth of options and pricing but this has absolutely ended that consideration.

It's clear from the breadth and variety of exposures that there's no due diligence or guardrails inside OpenRouter on who they market and how they classify their providers. Their response to this indicates a few first steps but none seem to have the force of law and i'd have expected more from a Stripe aquisition.

Very glad that my daily driver is a local model and I only use these external services sparingly.

reply
redrix 7 hours ago
Nice to see this move by OR.

That being said, the best ZDR agreement is the one that your company has directly with the inference provider(s). Unfortunately:

- Not everyone is large enough (or has enough $$) for that. - Ultimately you’re in the same position of having to “trust” that they’re doing ZDR; even after auditing their security docs.

reply
rkagerer 7 hours ago
I'd say that's the second-best one. The most robust ZDR policy is running your own AI locally and enforcing the retention policy yourself.
reply
az226 7 hours ago
This right here.

ZDR is a marketing ploy. It’s not real. Only naive people believe it’s real.

reply
fc417fc802 25 minutes ago
I generally trust (for example) bedrock to honor the ZDR agreement as written and to have secure infrastructure. However I don't fully trust the routing service I use to access bedrock to have rigorous security practices.
reply
msdz 5 hours ago
> Ultimately you’re in the same position of having to “trust” that they’re doing ZDR

Could it be a moat to offer a zero-trust (based on technical impossibility) ZDR solution for corporate customers, or is everyone who’s paranoid enough about that just going to host local models on-prem eventually?

reply
edoceo 5 hours ago
Not an expert, I consult with medium size firms that so far have seen nice things from the AI. However, the lightly-informed C-Suite hears about the hacks and the data threats on CNBC/Bloomberg which has made them cautious. Even with their cursory understanding they are saying "can we look at these open models". N=2
reply
392 4 hours ago
I think there's definitely a market, on prem feels expensive and intimidating for many no matter what it actually costs or takes
reply
wmf 5 hours ago
Multiple companies are already advertising TEE-based private inference.
reply
the_lucifer 5 hours ago
> Nice to see this move by OR.

Unfortunately, I highly disagree. I'm deeply disappointed that they don't even have the gall to call the violators out so we can be informed. Dug around for so long and I can't still find all the rule-breaking providers. It's a bunch of "trust us bro" nonsense. Name and shame should be the minimum here.

reply
doctorpangloss 4 hours ago
what move? OpenRouter is garbage, how could Stripe have thought it was a good idea to buy them? $7b for revenues that will evaporate, inevitably, all at once, in weeks!
reply
a012 6 hours ago
I was affected with just one prompt by this incident, which is non issue to me because I was trying different models at that time so there was nothing serious. The troubling problem I see in this incident is the “providers” in OR just casually forwarding prompts to upstream (MiniMax) instead of providing inference service them selves.

Coincidentally later on I set my OR settings to only allow some providers that I can rely on, not blindly let OR route to wherever they like.

reply
yard2010 23 minutes ago
For those who don't know this is the first thing you have to do when using openrouter, change guardrails settings from blacklist to whitelist, pick 1-2 providers you trust (do your homework, or let $agent do it for you), and if you want to go the extra mile pick the fastest/cheapest provider for you model (again do the research). The defaults can't be trusted if you care about privacy.
reply
leobg 3 hours ago
As an aside, I always wondered about decision models. They are so cheap. I can’t help but think that providers must be using them as honeypots for data acquisition:

You do dont find real world company documents on the web that you could train on. And companies certainly won’t upload them to you so you can improve your models, not even with incentives. But provide a model with dirt cheap input pricing and free outputs - and you gut yourself a firehose.

To think that the “labs” wouldn’t train on this is like thinking they’d never have trained on shadow library books because, “well, it’s illegal”. They did it back then and it gave them an advantage over the competition. So why wouldn’t they now?

reply
jofzar 2 hours ago
> As an aside, I always wondered about decision models. They are so cheap. I can’t help but think that providers must be using them as honeypots for data acquisition:

This one is actually the simplest for me, you can run decision models on your own laptop, and you can see how cheap and fast they are, it's actually amazing how "good" (jev etc is still better) they are.

So instead of thinking of them as a "LLM" for hosting pricing, it's easier to think of them as a API as a service, it's practically "how much can we charge someone for processing in bulk for an action and to get them sticky".

You setup whatever workflow you want for the decision models and then you practically never change it, because why would you, it's dirt cheap (for you and they provider), they (the provider) is making money on your outsourcing for every API action and it's going to be consistent because it's going to be for a long time.

reply
pyinstallwoes 18 minutes ago
But nobody knows how jev is actually built , what open source decision models? All the ones available kind of jerryrig it on top of a LLM last I looked into it.
reply
janalsncm 2 hours ago
Decision models can be cheap because it’s a fundamentally cheaper technology than LLMs. So that part isn’t suspicious at all to me.

That said, if you don’t believe OpenAI when they say they don’t train on your decision API inputs you shouldn’t trust them regarding LLM inputs either.

reply
mbgerring 6 hours ago
You should assume that no inference provider is honoring any public commitment they have made about data retention. You should assume that 100% of what you share with an LLM over the wire is being recorded, saved, and used as training data. Any other stance is indefensible naïveté for anyone who has been around the tech industry for more than, let’s say, 5 years.
reply
kqr 3 hours ago
There are real exceptions to this rule, like Tinfoil.sh who cryptographically ensure they cannot retain the data. (As long as one trusts the chipmaker, I suppose.)

Of course, even with a privacy-respecting inference provider, if a modern, relentlessly proactive LLM runs in a harness with internet access, it can easily accidentally exfiltrate your data anyway.

reply
fc417fc802 32 minutes ago
> As long as one trusts the chipmaker

Rather you have to trust the equipment operator (which in this era of clouds isn't necessarily the vendor) not to intentionally compromise their own hardware (see https://tee.fail/). But other than that quibble yeah, tinfoil looks like an excellent option that's much less likely to leak than current alternatives.

reply
g-b-r 2 hours ago
It seems great
reply
LeBit 5 hours ago
That’s why I never use a real email or real name.

The payment is where you have to provide real infos.

I just hope the payment infos is stored at a different place than prompt/conversations storage so mapping of user id to payment id is not trivial.

reply
octoberfranklin 5 hours ago
The payment is where you have to provide real infos.

What? I've never provided real world info when paying.

I always use Monero when paying for AI tokens. Crazy to do anything else.

reply
eddythompson80 4 hours ago
More insane to use cloud provider AI. Do you care about security or privacy at all? I run my own models. Crazy to do anything else.
reply
kqr 3 hours ago
How do you prevent the model from exfiltrating data? Are you running it in a harness with no internet access or doing something more sophisticated?
reply
exe34 2 hours ago
Don't give it internet access.
reply
codeulike 2 hours ago
Mistral are bound by EU law
reply
ozgrakkurt 2 hours ago
All citizens are bound by law but this doesn't mean you will have 100% confidence while walking in a dark alley at 3AM in a city you don't know.
reply
dhakiptk 3 hours ago
I think tinfoil provides that(if CPU manufacturer can be trusted)
reply
Fordec 5 hours ago
I fully expect them to be storing it, just the period of time they are storing it for is up for debate. Even everything older than six months ago, at this stage for me would be pure junk. If you want to train on that when I was still using soul files and barely any harness, heh, well that's your problem now!
reply
smuhakg 6 hours ago
I got the email. The tl;dr is MiniMax (the Chinese AI lab) is actively reading your prompts, and a security researcher discovered this by putting decoy URLs into their requests which were accessed by MiniMax.

More importantly, many providers (AtlasCloud, Novita and StreamLake were named but there seems to be more implied in the blog post) have been rerouting requests to MiniMax servers on the backend and not processing their own prompts.

The obvious question is whether OpenRouter has done any auditing on their inference providers. Based on the researcher's blog post, I guess not.

https://www.dragos.com/blog/ai-supply-chain-security-canary-...

reply
amluto 4 hours ago
Novita’s blog post is unreal:

https://novita.ai/blog/minimax-requests-privacy-notice/

> A routing configuration issue caused an API forwarding path intended for specific customers to apply more broadly.

> If you used MiniMax models through Novita between 2026-05-28 and 2026-11-11, your request contents may have been accessed or retained by a third party. This includes requests made directly through Novita and those routed to Novita through OpenRouter.

“routing configuration issue”?!? Imagine if AWS got caught storing your S3 on some other provider’s disks and they said it was a “routing configuration error”! They shouldn’t have software that can do this at all! The API is supposed to be for their own GPUs!

Together’s is weird:

> As part of routine software testing, we collected prompt samples authorized for that use and stored them in a private Hugging Face repository. The samples came from requests to the MiniMax M3, GLM-5.2, and Kimi K2.6 models, primarily on June 24, July 4, July 8, and July 14, 2026.

Did Dragos really “authorize” Together to store their canary “prompt samples”? Somebody screwed up here.

reply
speedping 4 hours ago
You left out the best part from Together’s “During development of our public GitHub repository, xorl, an AI coding agent committed a credential that provided access to the private Hugging Face repository”
reply
g-b-r 2 hours ago
So surprising that these services are vibecoded
reply
jofzar 2 hours ago
[dead]
reply
odie5533 2 hours ago
Is Minimax basically an untrusted scammer at this point?
reply
hasyimibhar 2 hours ago
ZDR through AWS Bedrock is still safe right? AFAIK Bedrock self hosts all models they provide. Even proprietary weight models like Claude are run within AWS network.
reply
cedws 51 minutes ago
Yes, however some models don’t allow ZDR IIRC. I think Fable requires enabling data retention.
reply
yard2010 20 minutes ago
[dead]
reply
the_lucifer 7 hours ago
Is there any information on the three companies that violated ZDR? I could only find mention of one of those affected providers in the original article (that OR links in their post): Lark. Trying to figure out if I ended up routing to one of the affected "ZDR" endpoints.

I don't understand why these names are being coyly tiptoed around as if they're trying to protect the privacy of these companies blatantly lying about ZDR. Why isn't OR calling out the actual providers they off-boarded by name? Why is OR basically protecting them under a cover of anonymity?

Lost a lot of trust in OR that's for sure, in-spite of some other positive reception I see here for this move.

Edit: Wording update.

reply
SwellJoe 6 hours ago
They state they notified customers who used any of the problem models via email (I got an email about it), which answers your question of whether you ended up routing to one of those endpoints. They apparently know who was routed to all those providers, so you don't have to guess.

That still leaves the desire of people to make informed decisions about what providers to use unresolved. If reputation is the only thing we have to go on when choosing a provider to send a bunch of sensitive data to, it'd be nice if the folks who actually know whether a provider is trustworthy would share that info.

But, since the email they sent identified the provider and the model (MiniMax, in my case) and the dates of use, it seems like it won't be secret for long what the other problem providers are. I'll assume the email to users of other providers will also include those details, so people can post about it even if OpenRouter is cagey about it in their blog post.

reply
the_lucifer 5 hours ago
> OpenRouter is cagey about it in their blog post.

That's exactly what's confusing me though? Why is OR basically covering for these providers by not naming them?

reply
jofzar 2 hours ago
So they don't get sued, you bet this was reviewed by lawyers.
reply
miohtama 3 hours ago
Here:

https://x.com/nateberkopec/status/2123992018850595164?a=UMOK...

> Just got the email from Openrouter and now the story is confirmed

> Atlascloud, Novita (who I know was flagged US with ZDR on openrouter) and Streamlake were… oops! Forwarding your data BACK TO MINIMAX IN CHINA

reply
leafingensemble 6 hours ago
They just don't care. That is the reason.
reply
fedpost 6 hours ago
Given how trust based the LLM world has to be right now, there should be zero tolerance for anyone doing stupid shit like this
reply
octoberfranklin 5 hours ago
Is there any information on the three companies that violated ZDR?

I have my harness set to show me "diffs" of the catalog when I start a new session.

There was a mass-downgrade to non-ZDR a few days ago. At the time I wondered why.

It was all older (not latest release) Chinese models being run by second-party inference providers.

reply
g-b-r 6 hours ago
I hope this time this stays on the frontpage, every LLM user should be aware of it.

There's also a good article at https://arstechnica.com/security/2026/11/a-leaky-ai-supply-c... , and a few earlier comments at https://news.ycombinator.com/item?id=50582794 , https://news.ycombinator.com/item?id=50585962 and https://news.ycombinator.com/item?id=50562582 .

reply
Ungh 2 hours ago
As usual, if you really give a shit about your data, don’t give it to someone else.
reply
amauriya 3 minutes ago
[flagged]
reply
solarkraft 7 hours ago
With this change, everything is good in the world and we can just take everyone’s word that they’re actually ZDR without any audits or technical enforcement again. Right?
reply
cobychapple 6 hours ago
Zero data retention, give or take 125 endpoints.
reply
Havoc 7 hours ago
Solid move.

Though frankly I would think anyone even slightly bothered about ZDR does not start their train of thought with "OK so we're going to put a middle man in"

reply
g-b-r 6 hours ago
This revealed something as delightful as a purported TEE provider having their "software TEE" root keys hacked, through "a legacy internet-facing service with management interfaces that relied on loopback access for trust and did not independently authenticate callers" (https://phala.com/posts/phala-november-preliminary-incident-...)
reply
fc417fc802 13 minutes ago
> having their "software TEE" root keys hacked

Did they? It says the attacker was able to create unauthorized CVMs (makes sense), able to obtain application credentials (significance unclear to me), and that they rotated their KMS root key in response (which is confusing to me because if they use hardware backed keys then I don't understand how the root key could ever be compromised).

So does this imply they aren't actually providing a proper hardware backed TEE? But that's also confusing because at least if you provision a VM you can have the hardware attest to its state.

reply
pathadd 41 minutes ago
[flagged]
reply
miohtama 3 hours ago
[dead]
reply
emer_sec 3 hours ago
[flagged]
reply
djdeluso 5 hours ago
[dead]
reply
veeragoni 7 hours ago
[flagged]
reply