I completely understand this. I’ve worked on robot hands and 5.6/Fable 5 were practically useless at helping me debug anything visually.

What I have found super useful actually is having models make a interactive 3d viewer in which I use move / highlight / paint (soft body painting directly onto the geometry for issues and different colors mean different failures). This gives a much better way to communicate the physical relationships and positions that are hard to get across in a labeled screenshot.

Its for sure still a lot of manual work so the "seeing-eye dog" description definitely holds. But I have found that after a couple of examples with the extra context the model gets much better at handling the problem and becomes useful.

These people need to take a vacation and come back in a few months when the vision models get better/cheaper.

Astra is already good at taking screenshots and acting on it (part of the agi claims).

I like to think of training and improving AIs as bringing freedom to the world. The useless toil and labor associated with rebuilding the same solutions into different contexts is finally at an end.

Coding was never the reward. Acting as a translator for a machine is far worse than allowing the machine to solve the mundane parts and leave you with bigger building blocks to play with.

After 25 years I have to confess I hated being a software engineer. It felt like grinding in a video game.

Now I can finally create and innovate at the speed of thought, and I'm very grateful to have this technology now.