Terminal-Bench is a framework and set of tasks for evaluating how well AI agents can accomplish complex tasks in a terminal environment. It consists of a dataset of tasks and an execution harness. Each task includes a description in English, a Docker environment, and a test script to verify successful completion by the agent.
No results indexed yet — be the first to submit a score.
Submit a checkpoint and a reproduction script. We will run it, publish the score, and — if it takes the top — annotate the step on the progress chart with your name.