CodeSearchNet (CodeSearchNet Corpus) is a benchmark and large corpus for semantic code search. The corpus contains about 6 million functions from open-source code spanning six programming languages (Go, Java, JavaScript, PHP, Python, and Ruby). For roughly 2 million functions the dataset includes automatically generated, query-like natural language derived from function documentation (docstrings). The CodeSearchNet Challenge portion provides a manually annotated evaluation set consisting of 99 natural language queries with ~4k expert relevance annotations to measure retrieval performance. The dataset is commonly used for code--text retrieval / semantic code search and supports evaluation with IR metrics such as MRR and nDCG.
No results indexed yet — be the first to submit a score.
Submit a checkpoint and a reproduction script. We will run it, publish the score, and — if it takes the top — annotate the step on the progress chart with your name.