MirrorCode: how far can coding agents work on their own?
MirrorCode tests whether a coding agent can reimplement a complete program under strict end-to-end tests and project-scale resource budgets.
Coding agent benchmark notes
Sourced notes on coding-agent benchmarks, including what each evaluation measures, its reported results, and the limits on interpreting them.
Open the comparison chartArticles
2 sourced benchmark summaries
SlopCodeBench: coding agents degrade on long tasks
SlopCodeBench follows agents as they repeatedly extend their own code, measuring correctness, cost, structural erosion, and verbosity at each checkpoint.
Method
Sources
Each note starts with the benchmark paper or maintained source page. Material claims link to those primary sources.
Changing results
Leaderboard values are paired with their observation date and named configuration. They can change after publication.
Limits
Methodology limits and interpretation are kept near the results they qualify. Benchmark performance is not treated as a general production claim.