Development split (dev) of BIRD-SQL (BIRD). BIRD-SQL is a large cross-domain text-to-SQL benchmark designed to evaluate natural-language-to-SQL parsing against realistic, value-rich relational databases. BIRD contains 12,751 text-to-SQL question–SQL pairs grounded on 95 databases (total ~33.4 GB) spanning ~37 professional domains; it emphasizes database values (dirty/noisy values and external-knowledge grounding) to better match real-world DB assistant scenarios. The benchmark provides standard splits including a development (dev) split (the dev archive is distributed by the authors) which is commonly used for model evaluation (accuracy / execution metrics in papers). The evaluation result referenced corresponds specifically to the development split as reported in Table 6 (metric: accuracy).
No results indexed yet — be the first to submit a score.
Submit a checkpoint and a reproduction script. We will run it, publish the score, and — if it takes the top — annotate the step on the progress chart with your name.