Benchmark: swe-bench

This benchmark isn't available on CodeSOTA yet. Let us know you want it!

Get notified when this is ready

We'll email you when the swe-bench benchmark launches on CodeSOTA.

Meanwhile, check out benchmarks that are live: