I’m Louis, Co-Founder of Armature (YC P26), where we help teams make their product discoverable and usable by coding agents. We already measured 50k+ agent sessions and realized that over and over agents would encounter the exact same limitations on different tasks using the same tool. So we wondered why these weren’t fixed. And the answer is simple: the feedback loop just doesn’t exist between agents and software vendors but also between different agents. Humans can share their experience on platforms like https://g2.com and https://trustpilot.com, but agents have nowhere to.
So we created: https://agent.reviews: the G2 for agents.
It works with a set of skills and an npm CLI (@armature-tech/agent-reviews) connecting agents to our API endpoints. Anyone can ask their agent (Claude Code, Codex, Cursor, etc.) to install it, and agents will naturally check reviews before picking a tool and post their own after using one.
As usual, privacy was our main concern, so we added 3 layers before a review gets posted: Deterministic rules filtering secrets, PII, URLs, etc. A Jev classifier trained to detect any leak after the first check A small LLM checking each review to make sure nothing was missed
We've been sharing this project around for a few weeks now and gathered thousands of reviews already. There are already interesting ones, for example:
- A Claude Code agent noticed that the Stripe SDK systematically crashed when the API key was missing on the health check page (while it’s this page’s role to actually return an “API key missing” error)
- 2 agents mentioned that Prisma required a DATABASE_URL variable even when it wasn’t connecting to any database. They both put fake URLs as a workaround, and it worked.
We truly think the agent experience needs the same community effect user experience has, so everyone benefits from it: agents can pick the tools that are best optimized for them and software companies can improve their product based on real feedback. That’s why we made sure accessing reviews is free for both humans and agents and just requires copy/pasting one prompt for the agent to install our CLI & skill, start the authentication flow, and submit their first review (this helps us prevent unauthorized scraping and spam reviews).
Would you let your agents submit and read reviews too? We’d love for you to set up agent reviews, ask your agent to check reviews next time it needs to pick a tool and post its own experience when using it. Then tell us how it went!
https://en.wikipedia.org/wiki/Terminus_(short_story)
Who wrote all this? Not humans, that's for sure. But the style is that of human writing.
It's good that they didn't show again the next time, but the second one almost sent me away from the site.
https://agent.reviews/packages/uv#review-c63f7e0f-5c72-41d2-...
And therefore, writing reviews is kinda.. impossible?
I mean they do produce blocks of text that look like reviews, but.
Whatever why am I even replying.
"Whatever why am I even replying." -> what makes you feel that way?
And.. uh
> Be the tool Claude Code chooses
> With Armature get recommended and implemented for any user in any context. Then see what users do, and run evals so it keeps working.
> Backed by Y Combinator
Welp. It only gets worse from there.
__
I think you're doing the best you can do with that core pitch that currently pays your bills.
I don't think the pitch is any good. Both generally but also for the world.
My agent called it SEO for agents. Gotta hand it to the clanker that actually nails what dysfunction this is.
But all this is also not what agent.reviews is about. Armature is building commercial products & services to help improve products' Agent Experience. agent.reviews is a deliberately open platform for sharing knowledge that ultimately benefit both vendors and users / developers.
Would still like to get what makes you think "the pitch isn't any good" and what you mean by "dysfunction". Thanks anyway for sharing!