Effective AI PMs must build and iterate on evals
“Building 10 great evals is important for helping the team quantify what the goal is and what their progress towards it is and what they're missing. I think evals is this like underappreciated thing that more PMs and more engineers should be working on. It varies a lot based on the exact feature, but features such as memory benefit a lot from it.”