STOCKTAKE: Measuring the Gap Between Perception and Action in LLM Agents with a Fair Oracle
A new evaluation framework called STOCKTAKE aims to distinguish between perception errors and execution failures in LLM agents during long-term decision-making tasks.