Dario, Please
74 points by 0x5FC3 7 hours ago | 22 comments

vb-8448 2 minutes ago
> “a swarm of agents could be capable of taking over the entire internet with a persistent botnet.”

I'm wonder why no one is mentioning the "accountability" word. Why these companies are allowed to damage others with impunity?

Start making managers pay the price for their actions, and watch how the models magically slow down on their own.

reply
dmoose 24 minutes ago
If we can get everyone to slow down we can hemorrhage less money going into our ipo.
reply
ebcode 2 hours ago
While I have my reservations about Amodei and his company, I'm nevertheless a happy user of their software. And I'm in agreement with him (and Sanders) that we should all. slow. down.

To my mind, the last great arms race between nation states was a misdirected love triangle between USA, Russia, and The Bomb, and look at all the damage that did.

Since AI is the new arms race between USA and China, slowing down may just give the humans involved enough time to realize they should be loving one another, instead of the machines.

Maybe saying, "let's slow down", is another way of saying, "I love you."

Or, maybe it's just: "let's not all of humanity kill ourselves like some bad ending to a Shakespearean tragedy."

Either way, it's a better note than, "We must achieve sea/air/nuclear/quantum/AI/spiritual supremacy before those other bastards do!"

reply
fooker 44 minutes ago
> look at all the damage that did.

Prevented a world war for 80+ years.

reply
mococa 55 minutes ago
China will not slow down.
reply
TutleCpt 43 minutes ago
This. There's no slowing down whatsoever. If the US slows down AI development, China will just leapfrog them, which they're getting close to doing. The US AI companies saying they need to slow down is just PR nonsense.
reply
dragonwriter 28 minutes ago
The US companies talking about “pacing” aren't actually talking about slowing down their own development efforts, they are talking about slowing down competition. That is, specifically, they are seeking to have government, on the pretext of “safety”:

(1) Give the big AI incumbents an anti-trust exemption so the they can coordinate without it being an illegal agreement not to compete, and

(2) Adopt mandatory supervision (by giving priveleged access to monitors) to the shared safety protocols of the big labs, by a nonprofit funded by the big labs, of everyone training, distributing, or hosting models.

(3) Adopt a policy of seeking international agreements to extend substantially the same rules to foreign actors training, distributing, and hosting models.

The part they are doing voluntarily isn't to promote the lobbying effort for these mandates isn't slowing down, it is giving their pet nonprofit the access for “independwht supervision” of their own operations to their own existing safety rules.

reply
jcranmer 4 minutes ago
I've seen two theories as to what's going on. One is the theory you've espoused, that AI companies are trying to do regulatory capture. The other theory is that they're starting to worry about running out of cash, so they want to do a Washington Naval Treaty-style pause to lower the amount of money they have to shovel at model development to stay competitive.

These theories aren't entirely incompatible with each other, so both could be true at the same time.

reply
felixgallo 26 minutes ago
And yet we all have failed to die so far from nuclear holocaust, despite Russia being our dire enemy, because of a system of agreed controls and limits between even nations that hate each other.
reply
Rover222 12 minutes ago
What damage was done by the last arms race you mentioned?

There have been precisely 0 nuclear weapons detonated (outside of testing) since that arms race began.

reply
abletonlive 17 minutes ago
> was a misdirected love triangle between USA, Russia, and The Bomb, and look at all the damage that did.

Can you be specific about the damage? We currently live in the most prosperous times on earth for humans. I'm not sure what you mean by damage.

Nobody can explain why an LLM can be so capable as to be able to wipe out humanity and pose a greater threat than nuclear bombs but not be so capable as to be able to protect humanity against that threat. Are we just handwaving this with "entropy"?

> Maybe saying, "let's slow down", is another way of saying, "I love you." Or, maybe it's just: "let's not all of humanity kill ourselves like some bad ending to a Shakespearean tragedy."

Okay nevermind, I think it's pretty clear you just want to wax poetic about all of this.

reply
stuxnet79 43 minutes ago
Amodei is just another SV grifter trying to use ethics / morals to hide his monopolistic tendencies. Instead of writing essays he should put his money where his mouth is and open source all the models Anthropic has, the harnesses and donate some much needed compute to science.
reply
1qw376 2 hours ago
Yes, especially the botnet creation by agents is ludicrous. Anthropic has an insecure garbage stack and assumes all companies in the world do, too.

This article will be drowned out unfortunately by the press and bloggers following the Misanthropic cult.

reply
axegon_ 3 minutes ago
Almost as if pushing for constant updates and adding new features without addressing security at all has consequences. Who would have thought, right?
reply
luxuryballs 3 hours ago
"Deaths from economic disruption and loss of jobs is okay" is a curious sentiment, how many deaths can we trace directly back to an economic disruption driven by advancement but then conclude that the economy should thus never change or advancement must be curtailed because it might cause deaths?

I don't even know how to approach such a thing, I can't imagine even in the stereotypical examples like the typewriter becoming obsolete, were any downstream deaths worth it? Or is this a totally nonsensical sentiment to begin with?

reply
cyanydeez 3 hours ago
During COVID republicans in America called for economic support by keeping unnecessary commerce.
reply
luxuryballs 21 minutes ago
the government loves to maintain the bubble economy since it is directly upstream from getting re-elected
reply
balltar 30 minutes ago
[dead]
reply
pixl97 4 hours ago
[dead]
reply
eimrine 7 hours ago
I am surprised the halfway crooks phrase is not coined by Tupac Shakur
reply
arionhardison 5 hours ago
Mobb Deep
reply
pipes 5 hours ago
I can't find the quote in the article (and for anyone wondering which song "shook ones", which is an amazing track).
reply
tanseydavid 3 hours ago
Heading: "OAI-HF Incident"

First sentence: "This incident has Dario shook, there ain’t no such thing as halfway crooks."

reply
arm32 3 hours ago
I agree with everything the author says here, and additionally, semi-off-topic, I'm surprised how quickly we've moved on from talking about Dario's wife's involvement in the Epstein files.
reply