https://www.allthingsdistributed.com/2026/11/aws-emulator-an...
> Don’t use the emulator to test the following:
> - IAM policies and permissions boundaries
> - Resource-based policies, such as bucket policies
> - AWS KMS key policies
> - Access across AWS accounts or across AWS Regions
> - Any other security control
> Some services in the emulator evaluate IAM policies for IAM users and roles that you create in the emulator, but not the same way as AWS. The emulator never denies a request signed with its own key. It doesn’t check AWS KMS key policies or Amazon S3 bucket policies. It also doesn’t support calls across accounts or Regions. So a request that AWS denies might succeed in the emulator. A request that AWS allows might fail.
This is a shame because I'd love for the official AWS product to be better than e.g. ministack and localstack on this, which will go some of the distance. I think because the agents were only building on the public API surface, it's hard to build this part. But they should've tried and let the agents read whatever policy engines AWS has. Or maybe it's a way to prevent someone from trivially running aws-emulator as AWSaaS?
[0] https://docs.aws.amazon.com/emulator/latest/userguide/securi...
I am shocked TBH that this is the new normal. Agents writing code in one of the most difficult to use languages. And ugly as well TBH, it pokes into your eyes. Subjective I know but it is a horrible language for humans.
Arguably, languages with strong static guarantees are exceptionally effective for LLMs since they're much quicker to provide feedback to the LLM than a dynamically typed language (which only fails once you actually run it - often several times to find the actual problem). You also get very well-designed build error messages rather than having to parse unstructured stderr output, etc etc.
I'm curious just how realistic the "internal" behaviour is emulated. It's been a while (since I got my stack working and I just don't like touching it now...), but I recall it being a real pain that sometimes odd, sometimes inconsistent things happened with setup and teardown (even through Terraform), which led to long timeouts if you did things in the wrong (but seemingly valid) order.
It seems like some reasonable shortcuts are taken, like services reading from each other's states directly instead of using APIs [0]. But then it will go so far as to run an in-process NodeJS emulator for lambda functions, and give it a shim so the code it runs can call other emulated AWS services using the main router [1].
[0] https://app.ilograph.com/demo.ilograph.AWS%2520Emulator/Serv... [1] https://app.ilograph.com/demo.ilograph.AWS%2520Emulator/Invo...
Agentic development is all about closing off a system as much possible, then mocking up or simulating any inputs or dependencies that cannot be closed off. At that point, you let Claude crawl over the system and do its thing.
This inevitably runs into problems with infrastructure and any tools that help mock up those interfaces will be tremendously valuable. Thank you!
Cloud provider neutral. Tear it up and tear it down with 100% reproducibility.
I'm curious how many versions they made and the token spend on each one. There are a lot of failure modes to projects like these (e.g. gas town endlessly developing itself). Is this more of a sly marketing stunt or a real indication that this methodology is practical and economical?
FYI I checked out the repo. `du --apparent-size -h` output for some dirs:
2.2G .
1.3G .git
58M issues/things-that-do-not-work
74M issues/things-that-now-work
311 MiB of rust code in /tests/ directories. 357 MiB of rust code outside of /tests/ directories. 117 MiB of json. 1 MiB of toml.https://github.com/faiscadev/fakecloud
I had a good time using its SDK inside my integration tests. I'll give a couple months before even moving to this because it's weird how similar both projects look like.
EDIT: After checking AWS's project I'd say stay away from it, looks heavily vibe slopped.
one can also argue that offering SKDs for python / typescript / golang makes the project superior still. So you are not stuck with Rust-only projects.
Now doing the math I feel old.
I’ve been having it build local mock APIs for any service that exposes its OpenAPI spec. Works like a charm.
> AI agents keep the emulator up to date with AWS.
Is pretty interesting! No more detail than that tease though.
https://docs.aws.amazon.com/emulator/latest/userguide/what-i...
Once your new version has no disagreements, it's a really clean swap. I am working towards developing this way and I think, if taken to extremes and carefully, it can remove the review requirement most of the time.
https://blog.localstack.cloud/2026-upcoming-pricing-changes/
https://github.com/search?q=repo%3Aaws%2Faws-emulator+load-b...
https://github.com/search?q=repo%3Aaws%2Faws-emulator+%2Fno+...
https://github.com/search?q=repo%3Aaws%2Faws-emulator+golden...
I was able to create a TV emulator at my work with a mostly independent agentic loop, because we have a lot of tests to examine a smart TVs APIs. The agents mostly just need to make the tests pass.
Is AWS offering such a lock service for its costumers ? Multi regional?
https://github.com/opencost/opencost/blob/v2.5.3/pkg/cloud/a... is the source URL, and while I haven't been in the opencost ecosystem for a while, I'd guess there's a non-zero chance you could legitimately just ask it to price your aws-emulator resources. I am pretty sure there is a terraform/opentofu integration, too, although I don't this second know if it is within opencost or is a separate project
I mean that's a job, but in many orgs it's been done by (cheaper) non-engineers (business analysts, QA professionals) for decades. So what does an engineer do?
We haven’t. QA has been part of the process but only one stage of the process mentioned above. How do cheaper non engineers decide if you’ve designed and implemented your query planner, payments gateway, auth, caching strategy, or other similar features correctly?
P.s I don’t doubt that incompetent orgs would do this incorrectly but it’s not sensible to take that as norm.
Code frequency pages shows:
"There are too many commits to generate this graph."
[0] https://www.aboutamazon.com/news/aws/how-autonomous-ai-agent...
It's better than a lot of AI-generated documentation, but it also comes across as a gruff LLM that it is annoyed that it has to write the documentation at all.
Claudeslop snuck in at the very end
(Compared to 12,700 entries in the `things-that-now-work`. I'm not sure if that is a list of bugs found that were then fixed, or if the total list of ~20k things is meant to be the list of features they intend to support.)
They can't help themselves, can they?
I'll stick with Floci and Testcontainers.
So, it's possible that some things would work after patching aws-emulator to cough up CORS headers, but I don't know what the state of affairs is for any reverse engineering of their console proxy endpoint. Likely it's available in localstack somewhere, given who made the extension, but I didn't go digging
ironically localstack is solid enough to probably not need this for most things
https://www.aboutamazon.com/news/aws/how-autonomous-ai-agent...
I've been prompting the agents to build everything using stdlib
I'll continue to choose both though, depending on the thing being tested.
“Claude, make my LLC into the largest global logistics business and largest U.S. cloud provider overnight. Thanks.”
Nevermind the massive logistics and network infrastructure, enormous market position, etc.
Sure, you can build something in a few days. Replicating their business model? Yeah. No.
Call me when Claude can design, manufacture, ship, and build a data centre.
Floci[0] has been great for me. Use the Testcontainers[1], too.
Bonus: works for GCP and Azure, too (so far have only used in limited capacity, though).
[0] https://floci.io/
[1] https://testcontainers.com/modules/floci/
Edit: The current one: https://github.com/aws/aws-emulator/releases/download/v1.0.3...
You can get some idea if the product name is unique enough with <ctrl-f> and looking at each of the related test scores.
And output something meaningful for some of the more popular services:
Pass rates from the release's scores.json (commit 7753983), joined with the eval suite's manifest.jsonl. Tests = behavioral checks touching the service. All = overall pass rate. Happy/Reject = valid requests vs. requests AWS should refuse. Ctrl/Data = control plane vs. data plane. Solo/Integ = single-service vs. multi-service checks. Wire# / Wire% = count and pass rate of recorded request/response replay tests (a test passes only if every call matches).Edit: Also worth a look: https://ministack.org/blog/aws-emulator
They'll have something like this:
Except, this is not defined in schemas, this is merely defined in prose around the documentation.So your Rust API is full of Option, and it gets really annoying when you're testing things like say Bedrock, which takes 10 minutes, and then fails because what you submitted 10 minutes before doesn't match their schema.
I understand this can be fixed by reading the documentation in more detail, but it has gotten so verbose, and sometimes you just want to start something.
Edit: Comment is in the spirit of "it gets tiring to build on sand which is at the whims of corporate management folks far disconnected from the actual work." If someone is asserting "this will stick around," words are insufficient, words are free. Show me the contract, show me the penalties for failure to abide by the assertion.
[0] https://aws.github.io/copilot-cli/
Google builds up a product over time and abandons it. This is annoying for long term adopters.
AWS has a habit of throwing a bunch of products at the wall, but only bothering to maintain & build up a few of them. This is annoying for early adopters.
Not many, and not often but it is annoying.
The Copilot CLI https://aws.github.io/copilot-cli/ you can feel polish and pride of the team that built this, as an example.
Official statements made by a company are still poor representations of their current business plans, and don't mean anything 3 months later (no matter how much they pinky promise). But a HN post isn't even that.
That said, it’s been announced publicly here: https://www.aboutamazon.com/news/aws/how-autonomous-ai-agent...
Additionally Swami, our SVP of AI blogged about it separately and our CTO is tweeting about it - which is more than a number of products get in terms of coverage.
I think this is a super interesting direction, but how can we trust the accuracy of this simulator? Agentic loops are great and all, but they can still miss plenty of things.
Or maybe a better question: where is the accuracy of this simulator going to be guaranteed enough that we should trust it?
Like, what am I actually getting here? Is it just happy path operations being correct here?
Hopefully AWS has had enough internal guinea pigs before they published this!
The border between AWS and AWS emulator becomes fuzzy. And the users of AWS will be agents as well. A completely offline emulator will save a lot of resources and could be a great training ground for more focused (offline) models.
This feels like table stakes for an emulator.
Can we just appreciate that they _appear_ to be doing the right thing here? Save the criticism for when (if?) they turn their backs.
I appreciate the effort dang and team have put into keeping the quality high here over the years, and I'm not sure what the optimal solution is.
Fig: "The open-source project will continue to be maintained!" https://news.ycombinator.com/item?id=39684576
And yet: https://github.com/withfig/autocomplete/issues/2068
Work from home: "My team's never going back to the office." https://news.ycombinator.com/item?id=32779047
Same commenter a few months later: "I (work at Amazon and) already have to go in once a week, and I literally do NOTHING that day. [...] This is a disaster in the making."
You choose the attitude you want to have in your life to disappointment and the attitude you bring to this site. You chose cynicism. You're going to crowd out people who don't make the same choice.
I crashed my motorcycle years ago and have mild but still lifetime injuries. As a result, I've changed my behaviors and have put away my motorcycle. It's given me a place to reflect on what my own life is about, where I want to go, and the pain my family felt when they heard about the crash.
I choose the attitude of learning from the past and adjusting my behaviors.
I try not to share my cynicism with the world too broadly because I think our modern era has too much of it. I think humanity is advanced by the wild dreamers.
Yes, we're obviously different, but... dude.... dude. this is a damned conversation about a damned cloud server emulator that's not even close to 100% in-parity. It's perfectly healthy to inductively recognize that using such a system, like its sibling tools, might not continue receiving support.
Also, I'd argue that your post right before this one is cynicism so I'm not really sure I follow your point. https://news.ycombinator.com/item?id=50459315
Sometimes things suck and it's okay to express our frustrations about them.
I guess I care because I've been on this forum for a very long time and everyone individually says that, but then the comment section as a whole turns into a hazard zone. Anyway I think I've engaged too much on this site for today.
Now if they abandon it, then sure, light them torches.
I didn't have a good experience with test containers, but perhaps it'd work better with fast starting containers. We run our test fixture with compose, and have the tests manage their data in isolation - so we don't pay the startup penalty in our test suites.
I think I'd trust this project at least as much as Floci. Embedded Rust mode also looks very interesting for us.
Doesn't feel like a real product. But I also didn't look very hard for docs; I kind of expect it to be linked on the GH in the site and have a nice `llms.txt` for me to give to my agents.
The product documentation is here: https://docs.aws.amazon.com/emulator/latest/userguide/what-i...
While the GitHub project is young, the internal effort to build this has been going for quite some time now.
> Doesn't feel like a real product. But I also didn't look very hard for docs
You should try, they're there.
> I kind of expect it to be linked on the GH in the site and have a nice `llms.txt` for me to give to my agents.
There's an official Amazon Documentation site that's linked. There's also an `AGENTS.md` file in the repository.
This post https://www.aboutamazon.com/news/aws/how-autonomous-ai-agent... doesn't set the right tone for me at all and it has nothing to do with agents and everything to do with the lens of looking at this as a science experiment instead of a real enterprise tool.
This feels like such a weird nit-pick when AWS is criticized for not moving quickly enough. Why should I care if there's a link in the side bar, when there's plenty of links in the `README`? If anything, I'm happy that there's alternatives to Localstack that are supported by AWS themselves that I can begin incorporating. They have a well written `README` that I can start working with and a User Guide to get me started. What else could I want?
> Did you look at the blog post as well?
I did.
> Does it look like a product that some team there loved and will care for? Or the output of some exercise for some enterprise content?
Do you even have the grounds to cast judgement like this when you admittedly didn't even look hard enough?
This lacks polish.
Small details like getting your GH repo set up for a public audience. Lacking. Compatibility and support matrix clearly advertised? None.
If this public facing artifact exhibits a lack of care and love, what does it say about the code? I am all for vibe coding and agent software factories, but then the humans should show some love with all of that extra time saved.
Look at Floci (I have no affiliation) https://floci.io/ the blog https://floci.io/chronicle/ and the labs https://floci.io/labs/
Do you agree that there's a polish here that shows a team's pride in that work that is clearly missing in this work?
??? You and I are the customers. What even is this statement? Are AWS employees our benefactors? Wow. I do not care if their feelings are hurt because this "product" clearly shows a lack of polish and love.No and I think the inverse is also possible and if anything more likely. You can make a website look really pretty, really easily and have the product still suck. This is "product as a slide" in a new age where making visual eye candy with AI has never been easier.
> I do not care if their feelings are hurt because this "product" clearly shows a lack of polish and love.
The point isn't about hurting feelings. The point is about providing critque and feedback based in reality, not based on "vibes." You're trying to gatekeep people releasing software because you dont like the way they're launching it lol.
??? It's in bold just before the "Quick start" section
The team didn't even take the time to review these small details of the repo, you know, by editing the repository details to place the docs URL there.
I mean, I don't know about you, but I feel like I still like to see people care about the stuff they produce and missing something as basic as the repo website URL in GH settings shows a lack of polish and love.