Sycophantic AI Decreases Prosocial Intentions and Promotes Dependence (2025)
54 points by robin_reala 4 hours ago | 42 comments

donatj 2 hours ago
> This suggests that people are drawn to AI that unquestioningly validate, even as that validation risks eroding their judgment

I believe this is a larger problem than just AI.

The internet has helped people surround themselves with only voices that agree with them and validate them, often to their detriment.

There are entire online communities urging people to cut others out of their lives over the slightest disagreement.

reply
overgard 21 minutes ago
Yeah, a lot of it isn't even really about people's choice though. Like, I have so many click-baity things in my YouTube feed even though I ignore almost all of it, because just one click and suddenly that's a thing it's going to show me 10x. I wish there was a place I could go for tech news that just didn't talk about AI. I'm so over it.
reply
jaggederest 15 minutes ago
Agreed, I think AI is the bees knees but I already spend 6+ hours a day thinking about it, more is unhelpful. I wish for something with the quality of discourse of HN but without being so monomaniacally focused on tech-du-jour.
reply
darkmarmot 24 minutes ago
It's like it turns everyone into a CEO with all the yes men they could ever ask for! Never goes wrong!
reply
Kattywumpus 2 hours ago
I don't know. Upvotes often do the same thing, especially in siloed communities. I feel like this is a larger problem -- people leaning into extremifying their views or just playing to an audience -- even though one might frame it as "prosocial" because it happens within the context of an online community.
reply
matheusmoreira 2 hours ago
> Upvotes often do the same thing, especially in siloed communities.

Yeah. I've gotten caught in this pattern here on HN. Post something, there's some disagreement but then I see the quiet upvotes trickling in, sometimes by the dozen. That sort of signal slowly convinced me I was right about plenty of stuff.

I used AI to datamine all of my HN comments and find those patterns. Then I started asking the AI to steelman the hell out of my world view, every single argument.

reply
gryfft 49 minutes ago
How would you say your views have changed since then?
reply
smcg 2 hours ago
Both could be true. People follow incentives.
reply
accountrequired 3 hours ago
You're absolutely right!
reply
pwdisswordfishq 2 hours ago
It's a pretty overdone joke at this point, don't you think?
reply
tom_ 2 hours ago
It's not a joke-it's an honest fact.
reply
jihadjihad 30 minutes ago
I dunno. The seams of the joke are still load-bearing IMO.
reply
accountrequired 2 hours ago
You made an excellent point! (could not resist that one)
reply
almostdeadguy 38 minutes ago
You're right to push back. And honestly, this reframes the entire thing.
reply
LAC-Tech 3 hours ago
I think this goes along way to explain people's very defensive reactions when you are skeptical about Agentic Development.
reply
artnanika 2 hours ago
Those are two different things. Chatgpt being sycophantic while playing the role of a therapist with a teenager is much different from Codex being sycophantic while reviewing user feedback. The former is extremely dangerous for society.
reply
LAC-Tech 57 minutes ago
I make no societal judgments; just that the nastiness of the reactions I get suggests something more than technical choice is going on.

I had one prominent "influencer" publicly challenge me to a coding competition over it. It was very weird.

reply
andy99 45 minutes ago
I think this is more insecurity. Is it possible that sycophancy is a cause of insecurity, like deep down people can tell if an idea has been battle tested?

I dont know if that would even matter because it’s not like AI is whispering to people about how good it is. There’s some cult like quality, like with blockchain or whatever, people want to be part of what they think is a major societal revolution, and anything that challenges their world view really shakes them. Presumably they say the same thing about no-coiners or denialists or whatever the AI equivalent is.

reply
qarl2 2 hours ago
I'm one of the people who gets accused of this. I don't mind skepticism. But every time I turn around, someone's claiming nobody gets any value from these tools and anyone who says otherwise is deluded or running a scam. That gets really old.
reply
sidrag22 58 minutes ago
I've had one conversation that was sorta like this, it was around the time some kid kept releasing videos of him interacting with a very bad TTS gpt model or something and it would give very very bad answers confidently.

Their frame of reference was that, and this was at a time when opus 4.5 was around. Hard to expect a reasonable conversation when one person has such a different view of what the tools are capable of.

reply
chrisjj 3 minutes ago
[delayed]
reply
LAC-Tech 2 hours ago
I can believe people get value out of them. I think I do.

But "OH MY GOD EVERYTHING HAS CHANGED THE OLD WAY IS DEAD 10X MORE PRODUCTIVE" - no. If that were true, we'd notice it in the software all around us.

reply
qarl2 54 minutes ago
I think we are noticing it. Are you not?

I've shipped three software projects in the last two months. I shipped zero in the preceding year.

Right now I'm building a system to decompile MAME ROM games into idiomatic JavaScript. It completes one game in about 3 days - complete with extensive commenting. I started it about 2 weeks ago.

I'm not sure "EVERYTHING HAS CHANGED" but if you're not seeing dramatic change, I suspect you're not looking.

reply
LAC-Tech 2 minutes ago
I think we are noticing it. Are you not?

I am not. Congratulations on your side project.

reply
Planktonne 48 minutes ago
> if you're not seeing dramatic change, I suspect you're not looking

If the people claiming that everything has changed were even a fraction as productive as they think, then it would be visible even to people who weren't looking.

As it is, a lot of people are actively looking but still not seeing it.

reply
qarl2 44 minutes ago
I'm curious - do you understand how hard decompilation from machine code is?

In 2 weeks I've built a system to do exactly that. Autonomously.

https://github.com/qarl/arcade-js

If you can't see this - you should probably get your eyes checked.

EDIT: It's doing TimePilot right now. You watch the progress in the commits.

reply
chaps 14 minutes ago
"you should probably get your eyes checked."

Don't be a jerk. A lot of people have had bad experiences with these systems from people basically saying exactly what you're saying. This "you should get your eyes checked" mentality is pervasive with the nerds who confidently say that their analysis is solid when it's... not. It's a big problem in communities that have non-conventional videogame puzzles for example. Someone will come in, announce some novel solution.... leading to a four hour fight about the efficacy of LLMs, only to find a mistake in their code the next day.. never to be seen again.

Mind you, I'm not saying that these systems aren't great at reverse engineering and whatnot. They're spectacularly good at that. But RE is a relatively constrained problem because everything is still right in front of you. For complicated problems where the signal is mixed between noise... less so.

reply
qarl2 5 minutes ago
As near as I can tell - your argument boils down to "I've seen other people make mistakes so you must be also."
reply
chaps 3 minutes ago
If that's what you got from it, then I hope you have a good life.

Be kinder, friend.

reply
Planktonne 25 minutes ago
I'm pleased for you, but these tools have been out for many, many weeks, and there are many, many people claiming incredible productivity gains.

Where's the rest of it?

reply
qarl2 19 minutes ago
I just showed you something that would have been considered a miracle one year ago.

And your response was "So what - show me another one."

reply
Planktonne 11 minutes ago
I'm not disputing that it's a hard thing to do, but we had decompilers before; "miracle" is rather stretching it.

Even granting that framing though, the claimed increase in productivity isn't a one-off, but asserted for everyone using them; you're claiming mass-produced miracles but trying to depend on a single example.

reply
overgard 19 minutes ago
I'm sure it's useful for that, but we've had pretty good decompilers before AI.
reply
qarl2 12 minutes ago
I would love for you to cite a single one.

It must take a binary executable and derive English names for the memory addresses.

reply
overgard 4 minutes ago
I used to use dotPeek all the time back in like 2012. There are also things like Ghidra that the NSA made. I dunno, google them, there are a lot. I'm not saying LLMs aren't useful here, just that it's not a huge deal. Also, why are AI people always making tools to take other people's IP? You are kind of fucking with people's intellectual property without permission it seems like. I'm not saying it's the crime of the century or anything but it's distressing how many AI projects come out of "let me repackage something someone else made"
reply
veqq 43 minutes ago
> I think we are noticing it. Are you not?

The software around us seems worse than ever, constantly breaking and significantly worse than 1-3 decades ago.

reply
qarl2 37 minutes ago
I guess my experience is different than yours - and I'm providing evidence.
reply
pc86 36 minutes ago
You think the software around today is worse than software in the late 90s?
reply
bigstrat2003 45 minutes ago
> if you're not seeing dramatic change, I suspect you're not looking.

Ironically, this is the inverse of the very thing you complained about people doing to you.

reply
qarl2 43 minutes ago
Except I'm providing evidence.
reply
theturtle 18 minutes ago
[dead]
reply
davesiknow 2 hours ago
[dead]
reply
daun_gee 2 hours ago
[flagged]
reply
atleastoptimal 3 hours ago
This is true, but likely happening in talk therapy too with overly sycyphantic therapists
reply
jalev 3 hours ago
Sure, but there is a marked difference between a therapist and an LLM Chatbot: you can't talk to your therapist for +4h a day, at any time convenient to yourself. It's also not a guarantee you're going to hit upon a therapist that is like that, versus a product that is very literally intended to maximise your usage of it.
reply
paimapi 2 hours ago
a therapist should, if they follow their training, not be a sycophant whatsoever. CBT, for eg, is a multi-step process including Socratic self-dialogue, reframing practices, etc to guide the person towards the development of insight and healthier coping mechanisms
reply