GPT‑Rosalind for life sciences research
81 points by babelfish 11 hours ago | 21 comments

Cynddl 7 hours ago
Is it me or they very carefully do not report performance on GPT-5.4 Pro, only the default GPT-5.4? They also very carefully left Anthropic models out of their comparison.

I went back to the BixBench benchmark which they mentioned. I couldn't find official results for Anthropic models, but I found a project taking Opus 4.6 from 65.3% to 92.0% (which would be above GPT-Rosalind) with nearly 200 carefully crafted skills [1]. There also appears to be competitive competitor models with scores on par with this tuned GPT.

[1] https://github.com/jaechang-hits/SciAgent-Skills

reply
jadusm 7 hours ago
Bix Bench seems like a really interesting/useful idea but most of the value for a layperson (like me) is comparing the results of different models on the benchmark. From what I can find there is no centralised & updated model results set. Shame.
reply
an0malous 6 hours ago
“GPT-5 is the first time that it really feels like talking to an expert in any topic, like a PhD-level expert.”

Sam Altman, August 2025

https://www.bbc.com/news/articles/cy5prvgw0r1o

reply
falcor84 5 hours ago
What of it?

For me too, it was around that time last year, with GPT-5, Claude Sonnet 4.5 and then Gemini 3 that I started feeling that these models are clearly becoming great at reasoning. I'm not at all opposed to saying that they are around PhD-level on at least some domains.

reply
kmaitreys 2 hours ago
I think there's a lot of difference between sounding like someone and being someone. The models are excellent at pretending indeed.
reply
0123456789ABCDE 52 minutes ago
exactly. this is what whole RL thing is optimizing for, even if that is not the intent.
reply
shwn2989 35 minutes ago
I prefer GPT 5 pro, which i found expert in coding and reasoning.
reply
furyofantares 8 hours ago
I'm all for naming things in honor of Rosalind Franklin, but this seems like incredible misplaced hubris instead.
reply
peyton 7 hours ago
> GPT‑Rosalind is now available … for qualified customers …

It’s kind of gross to make money off her name (if that’s what’s happening) posthumously. It’s a complicated story anyway. IIRC her sister referred to it as “the Cult of Rosalind” when people were cashing in on books about her.

reply
bombcar 7 hours ago
I'd rather the AI companies make up names, or name their products things like "Clod" than use my name (if they were to ask) - as no matter how good it looks today eventually it'll be some form of laughingstock.
reply
Sanzig 6 hours ago
Claude is most likely a nod to Claude Shannon, father of information theory and an early AI pioneer.
reply
bombcar 4 hours ago
The real hubris will be to name a model Turing, or Alan if you’re a bit more discrete.
reply
huslage 4 hours ago
I work for a life sciences company. It will be a long time before anyone trusts a generative model to do the actual science when mathematically provable models are as good as they are today. There is room for AI in the field, but it's not in the science directly.
reply
oofbey 18 minutes ago
What would be a good use of AI? Writing code to do the modeling?
reply
modeless 6 hours ago
The voiceover in the promo video on this page seems to be AI generated, with some weird artifacts. Right at the beginning it sounds like it says "cormbiying structure daya retrieval and lirrachure search".
reply
jostmey 6 hours ago
The real issue isn’t finding therapies but getting them tested in clinical trials
reply
XenophileJKO 3 hours ago
I would argue that while you still have failed trials, then we have room to improve trial vetting.
reply
tonfreed 6 hours ago
Who's at fault when it suggests feeding someone cyanide?
reply
falcor84 5 hours ago
> We want to make these capabilities available to the scientists and research organizations best positioned to advance human health, while maintaining strong safeguards against biological misuse. The Life Sciences model is launching through a trusted-access deployment structure for qualified Enterprise customers in the U.S. to start, with controls around eligibility, access management, and organizational governance.

I'm absolutely ok with a legitimate lab scientist conducting biochemical research getting suggestions about substances that are generally considered dangerous but might be appropriate for their study, and it'll be up to the scientist to discern whether it is indeed appropriate to use.

reply
34pasKj 9 hours ago
[flagged]
reply
mrcwinn 9 hours ago
Is society's behavior determined by the administration? Odd way to live your life. This model is a tool, not a servant, but in any case I think paying homage to someone who made incredible contributions is a positive. Eye of the beholder, I suppose.
reply
3asuH 9 hours ago
[flagged]
reply
ceejayoz 8 hours ago
> Rosalind, make me a coffee! There are other ways to pay homage.

Isn't this more akin to "Rosalind! You are a respected world-class expert! Can you help me?"

reply