Code Generation2022multilingual

CodeContests Competitive Programming

13,610 competitive programming problems from CodeForces. ~200 private test cases per problem. 12+ programming languages.

Metrics:pass@1, pass@5, pass@100
Paper / WebsiteDownload

No benchmark results indexed for this dataset yet.

Contribute results on GitHub

Other Code Generation Datasets

HumanEvalSWE-BenchMBPPHumanEval+MBPP+APPSSWE-Bench Verified
CodeContests Benchmark - Code Generation | CodeSOTA