Optimizely Compromised, Served Malware on Zoom, GitLab
137 points by kristjansson 4 hours ago | 75 comments

stickfigure 4 hours ago
The whole concept of Google Tag Manager was that you could give marketing departments the ability to add "tags" to the website without having to involve engineering. That's how we got 10MB of javascript with every news article.

I hope folks are re-evaluating that now.

reply
goalieca 2 hours ago
It also makes adding csp a nightmare. Your marketing department is putting in 30 trackers, changing monthly. And then there’s different countries for end clients with different TLDs for connect-src. You can’t possibly get anything locked down enough. That’s bad for security when you rely on csp for mitigating other factors.
reply
ranger_danger 2 hours ago
relying on any client-side "security" is probably a bad idea
reply
johncolanduoni 19 minutes ago
CSP is there to protect your user’s browser, not your servers. It’s ultimately their credentials that are going to get compromised with an XSS attack.
reply
adrr 2 hours ago
Most of it is server to server now with server side tagging. 3rd party cookies are now 1st party and beacon call is server to server.
reply
ihsw 3 hours ago
[dead]
reply
taurath 3 hours ago
The owners of the ad platforms end up dictating what data is used, they have the leverage and also marketing departments with power end up forcing engineering to use the audience tools Google and Meta provide. At least GTM gets blocked by ad-blockers.

We got 10MB of javascript (maybe 10 years ago...) because engineering needs to build one frontend with multi browser and multi screen support so they picked an off-the-shelf do-everything framework like Amber or Angular, or a react/redux build with 300 nested dependencies.

reply
01284a7e 2 hours ago
No, the 10MB (sometimes way more) of JavaScript for a damn news article has nothing to do with SPA frameworks (Angular) or libraries like React. It is tracking malware put there by marketing/advertising idiots.
reply
wang_li 3 hours ago
What is that saying? A person will not understand something that their paycheck requires them to not understand.

That’s why it needs to become criminal for a website to serve malware, including through third party channels like ad networks and analytics services. Serving shit websites is no different than knowingly, or negligently, dumping toxic waste and should be treated the same.

reply
gruez 3 hours ago
If it's criminal for sites to accidentally serve malware, what does it mean for open source projects to accidentally get hit by supply chain attacks, or for them to get compromised by a rogue contributor (eg. xz)?
reply
wang_li 24 minutes ago
A business in the US has legal liability if they fail to do their due diligence in their supply chain and it turns out their suppliers are involved in human trafficking, child labor, forced labor, etc. or is using hazardous materials in the product.

There should be standards that people have to live up to if they are going to provide a product, even for free, to others.

reply
bloppe 2 hours ago
One could distinguish between criminal negligence and forgivable negligence in court. Unfortunately for GP that probably means you can't actually stick charges on anybody who serves malware via an ad network like this.
reply
ceejayoz 2 hours ago
> One could distinguish between criminal negligence and forgivable negligence in court.

Open source is already expensive from a time standpoint, you wanna make it expensive from a monetary standpoint too?

reply
cowlevel 3 hours ago
Yes. It means the legitimate maintainer of xz would be in prison right now.
reply
hedora 3 hours ago
Liability should aggregate up to the largest platform involved. Optimizely in this case, I guess. Google for Google Tags.

We should also enforce antitrust laws.

reply
DaiPlusPlus 3 hours ago
> A person will not understand something that their paycheck requires them to not understand.

I never really understood this idiom, because how can a PHB engineering manager (for example) be required to not understand their team's technology in order to retain their job? Surely if that manager knows their team's work inside out then they would be a more effective manager - which is good for everyone?

If I squint-my-brain, I can see how (for example) that anyone who works full-time as an SEO "consultant" in the year 2026 would only be if they actually believed that SEO tricks actually worked, which requires them to not understand how modern search-engines' spiders actually work (because it's my belief that "SEO" has been either nonsense bollocks - or a complete grift - since the mid-2010s). Am I close?

reply
LorenPechtel 2 hours ago
It's not the team's technology that's being referred to. It's about hazards. People whose job it is to do X have a hard time understanding that X shouldn't be done.

In this case, it's the dangers of the tracking and advertising frameworks being used for hostile purposes.

reply
nemomarx 2 hours ago
If you're only still there because your boss believes SEO works, you better keep acting like your SEO tricks work.
reply
blacksqr 56 minutes ago
"It is difficult to get a man to understand something, when his salary depends on his not understanding it."

--Upton Sinclair

reply
JumpCrisscross 3 hours ago
> it needs to become criminal

I know we really like mass incarceration in America. But maybe start with civil liability and a private right to enforcement?

reply
mcoliver 4 hours ago
This stuff is so avoidable but unless we implement meaningful reprocussions things aren't going to change. There is no accountability.

In this case optimizely should have had better systems to spot a release like this (internal cool downs, check and balances, phased rolouts, automatic security checks). And sites that have massive user bases (cnn, bbc, etc..) have zero excuse to not have the same.

I would go so far as to say those sites should not be serving from vendors but should be vendoring their own scripts that they also are passing through security audits and serving them selves with cool downs.

How do these companies not have better dedication to protecting their users is beyond me.

reply
noir_lord 3 hours ago
> How do these companies not have better dedication to protecting their users is beyond me.

It doesn't cost them anything but a "whoops" post when they fuck up, so the incentive is misaligned (as you noted under repercussions).

The cost is externalised onto everyone else not them so it's not going to change.

reply
geetee 3 hours ago
This is the only answer
reply
ec109685 10 minutes ago
This wasn’t a release. It was their engine that emits the variants being compromised.
reply
marcus_holmes 3 hours ago
None of that is part of commercial web dev culture. Leftpad-level dependencies are.
reply
augment_me 3 hours ago
Please tell me in whose incentive it is to change any of this and hold the sites accountable?

Who cares? Next week you forget about this and move on

reply
thought-gap 2 hours ago
This is exactly the kind of use case for NoScript - reduce exposure to potentially malicious content.
reply
mcoliver 3 hours ago
This stuff is so avoidable but unless we implement meaningful reprocussions things aren't going to change. There is no accountability. In this case optimizely should have had better systems to spot a release like this (internal cool downs, check and balances, phased rolouts, automatic security checks). And sites that have massive user bases (cnn, bbc, etc..) have zero excuse to not have the same.

I would go so far as to say those sites should not be serving from vendors but should be vendoring their own scripts that they also are passing through security audits and serving them selves with cool downs.

How do these companies not have better dedication to protecting their users is beyond me.

reply
ea016 4 hours ago
> On iPhone/iPad/iPod only: injects boot.js from two .icu hosts and, on iOS ≤ 18.6, a hidden iframe.

Anyone knows what this might be? Can you jailbreak from safari on those versions?

[edit] From the other link, it seems to be Coruna and DarkSword exploits

reply
muglug 5 hours ago
Optimizely Status site: https://status.optimizely.com/

Currently says "Partial Outage Affecting Recommendations Tracking and Reporting"

reply
robrain 4 hours ago
dupe 2 hours ago, 15 comments: https://news.ycombinator.com/item?id=50523300
reply
robrain 17 minutes ago
it's been merged
reply
NetOpWibby 40 minutes ago
Nope
reply
Animats 2 hours ago
Why should browsers be allowed to read or write user files without user intervention and serious warnings?
reply
pamcake 5 hours ago
Unfortunate with this nonsense slop report for a seemingly significant event like this.

> Your origin can be clean while your visitors are robbed — the compromise sits in the tag layer.

reply
DaiPlusPlus 3 hours ago
If my Origin was "clean" then it wouldn't be loading any scripts from external websites...
reply
wry_xy 25 minutes ago
Still better than the human slop filter Gizmodo ran it through in their rehashed article. Actual quote:

> On mobile, Report URI says they attempted to install exploit kids.

reply
slopnt 5 hours ago
ahhh yes, the famous tag layer
reply
lukeify 3 hours ago
That's layer 8 of the OSI model.
reply
bombcar 4 hours ago
It’s right above the egg layer.
reply
mattmatters 4 hours ago
Optimizely is a pretty garbage platform so this is unsurprising. Love the work though folks like report uri are doing finding this.
reply
binaryturtle 3 hours ago
Is there anything useful served from any *.icu domain? I wonder if I just should block the whole TLD and be done with it.
reply
ijidak 3 hours ago
Risk is when *.icu is guaranteed to be ICU.

Sorry I had to say it ;-)

reply
karmajunkie 2 hours ago
what are the practical effects of this? Does this mean that a customer of Zoom was downloading malware all day?
reply
duxup 6 hours ago
Let’s say I use Optimizely (I don’t), is there a good best practice to say?:

“yeah load this JS m, but it can’t load / random other JS referencing sketchy places”

reply
JoshTriplett 4 minutes ago
Yes. You install a CSP that says "my site cannot load any scripts from third parties". And then any script you run, you audit thoroughly and then host on your own website, ensuring it doesn't try to load anything third-party.

Never load third-party JavaScript on your site. Zero exceptions.

reply
Jach 4 hours ago
Besides specifying scripts by hashes, you can also whitelist various domains: https://developer.mozilla.org/en-US/docs/Web/HTTP/Guides/CSP (and https://developer.mozilla.org/en-US/docs/Web/HTTP/Reference/...)

Feels nice knowing several years ago I worked on forcing CSP (including removing unsafe-eval) on some customers for a site builder product, as they have to manually whitelist domains which limits the impact of these sorts of attacks...

This writeup https://blog.report-uri.com/worlds-largest-brands-infected-w... has a section on how CSP helped (or didn't) in this attack.

reply
horsawlarway 3 hours ago
Yeah, honestly I wish they'd move that section higher up - it's probably he most genuinely useful tidbit in the article.

As an aside - I'm rabidly against "analytics" companies that come in and suggest that the right "getting started" choice is to drop untrusted JS they own (and can update at any time) onto your site.

It's "easy", but it completely breaks your security model.

If I were a lawyer... I'd be taking a serious look at putting optimizely into the meat grinder for recommending 'unsafe-eval' as a script source... it literally has "unsafe" in the fucking name for a reason. This alone should end the company. It won't, because this space is absolutely FILLED with scummy behavior, but it should.

---

A strict CSP is one of the most meaningful ways you have right now as a web developer to reduce attack surface. People should take advantage of it.

There's a reason browser vendors now force basically all extensions into a strict CSP by default... https://developer.chrome.com/docs/extensions/reference/manif... They won't even let you manually relax it anymore.

reply
cowlevel 3 hours ago
I think the kinds of people with "security models" are not the kinds of people with third-party analytics. They're marketing to people who want it to Just Work.
reply
1a527dd5 6 hours ago
reply
skeeter2020 3 hours ago
this will prevent an unexpected version but doesn't stop a legit but compromised include from loading nefarious resources
reply
stavros 4 hours ago
SRI helps you make sure the script you're loading is what you initially thought, but doesn't ensure that script doesn't load other scripts, no? You need CSP for that.
reply
technion 4 hours ago
Specifying scripts by hashes is always a solid defense that platforms like this don't change their script after compromise - but in practice the whole point of optimizely and similar tools it that it's expected the script will change.

Common examples like analytics tools happily change their script bundles whenever they feel like it without just tagging a new version and letting you upgrade.

I wish SRI could be used more,

reply
skeeter2020 3 hours ago
I remember a team at my old place bringing down the entire app with insufficient defense around an Optimizely script that failed. Seems bonkers to take on these dependencies and I think it's only going to get worse.
reply
computerfriend 3 hours ago
It's a feature. Changes to prod should always be reviewed and this fundamental incompatibility with insecurely hosted JavaScript is a signal that it is a bad idea.
reply
mook 3 hours ago
Unfortunately, in this case the insecurely hosted JavaScript is the feature; that is, people who are not responsible for sites going down or breaches want to be able to add things nilly-willy (which therefore necessitates a way to bypass review).
reply
duxup 5 hours ago
Very cool thank you.
reply
r1ch 5 hours ago
In theory yes, in practice no since every SaaS wants to ship 5 times a day and add 15 new dependencies on other SaaS providers each release, and marketing wants to load gobs of 3rd party tracking and analytics code from their favorite SaaS of the day without having to get approval from those pesky security people. Let's not even mention ad networks.
reply
bluepeter 25 minutes ago
Optimizely is such crap... like, all it does is A/B test different landing pages/etc for "conversions." We don't need this.
reply
Exoristos 4 hours ago
Perhaps at last these unserious names will be abandoned as newsworthy failures become more common in the industry. Viz., gravitas may start to have obvious market value again.
reply
tehlike 4 hours ago
reply
back_to_basics 3 hours ago
@tehlike is protected

Only followers this account has approved can see its posts.

reply
tehlike 50 minutes ago
Sorry my bad. Opened. Not a particularly novel insight either.
reply
ronsor 3 hours ago
Reminder that this problem has been solved for a while now if admins were not so lazy: https://developer.mozilla.org/en-US/docs/Web/Security/Defens...
reply
jawns 3 hours ago
These are not static scripts. Their content changes frequently. The customer is using them to inject dynamic content into their own sites. What you are describing would not work for this use case.
reply
theseamusjames 4 hours ago
Every time one of these new attacks drops, you know there's a couple devs at OpenAI that look at each other and go, "This definitely wasn't us, right? ...right?" And how confident are they that out of Outlook, FAA, banks, and now Optimizely skimmer that none of them were either 1) agents up to some fuckery or 2) someone using their system to get up to some fuckery? It can't be 100% confident, right? ...right?
reply
swozey 2 hours ago
Aren't these all mathematicians who have never had to toil in the operations trenches fixing this stuff, thats why they make 4x my salary right

Can't wait until they start killing hardware

reply
breakwaterlabs 4 hours ago
> The malware was a multi-purpose kit.

Somehow this sentence immediately flags this article as AI slop.

reply
voidhorse 3 hours ago
It's one of those sentences that seems like it's meaningful on first glance but that in reality conveys no information. For whatever reason LLMs are experts at cranking these sentences out.
reply
stogot 4 hours ago
Is it just me or is there an increase of these events or increase of these posts?
reply
joegibbs 4 hours ago
Yes, AI is making it much easier to hack - you can just spin up a bunch of instances to look for vulnerabilities, you don't even need to do much manual work
reply
sershe 2 hours ago
Optimizely is ~~infected with~~ malware FTFY!
reply
jawns 4 hours ago
tl;dr: Someone gained write access to the script Optimizely serves on its customers' websites, and they injected malware.

What is interesting is that the write access wasn't just for a single customer, but hundreds. So either tenancy isn't strong enough, or the level of access involved in the compromise was pretty severe.

reply
zenincognito 4 hours ago
Just stop using JS... If you control the server why not have the vendor have a server level integtration that way you are not serving any remote scripts. It would be interesting to do a study on how many of these compromise emnate from third party scripts and I am willing to bet it is over 90%
reply
br0ceph 4 hours ago
stop using scripts fullstop the web was never intended to send program code

any program code should run on the webserver

browsers should be minimalist and only support html

reply
Kuyawa 4 hours ago
In the age of AI if you use third party libraries you deserve all hell unleashed on you

First thing I add to my agents.md is do not use third party libraries, frameworks, fonts, icons, etc unless strictly necessary, ask first

reply
roundup 3 hours ago
[flagged]
reply