Coding agents report "verified " when the check never tested the thing

Posted by Oscalemor 4 hours ago

Counter2Comment1OpenOriginal

Comments

Comment by Oscalemor 4 hours ago

Ran 6 cases checking what verified means when it comes to agents and pulled together a case study just from one operator POV describing how the agentic setup can go wrong. Claude code in CMUX