This collection contains the versions of the benchmark in fine-tune ready format
AI & ML interests
None defined yet.
Recent Activity
View all activity
Organization Card
LLMSQL Organization on Hugging Face
Description:
LLMSQL is a patched and improved version of WikiSQL for Text-to-SQL tasks.
We provide fully prepared datasets, scripts for SQL generation, evaluation tools, and easy-to-use pipelines for Hugging Face models.
Highlights:
- Full benchmark: questions, tables, train/val/test splits (llmsql-bench/llmsql-benchmark)
- Ready-to-use evaluation scripts (https://github.com/LLMSQL/llmsql-benchmark)
- Compatible with Hugging Face causal LMs
- Optimized for direct inference and evaluation without fine-tuning
- Optional fine-tuning datasets available on Hugging Face for research or domain adaptation
Documentation:
- Full guides and manuals are available online (Documentation)
Citation:
Please cite LLMSQL if you use it in your work:
@inproceedings{llmsql_bench,
title={LLMSQL: Upgrading WikiSQL for the LLM Era of Text-to-SQL},
author={Pihulski, Dzmitry and Charchut, Karol and Novogrodskaia, Viktoria and Koco{'n}, Jan},
booktitle={2025 IEEE International Conference on Data Mining Workshops (ICDMW)},
year={2025},
organization={IEEE}
}
models 0
None public yet
datasets 5
llmsql-bench/llmsql-benchmark-finetune-ready
Viewer
• Updated
• 241k • 73
llmsql-bench/llmsql-benchmark
Viewer
• Updated
• 80.3k • 390 • 2
llmsql-bench/llmsql-2.0
Viewer
• Updated
• 80.3k • 103 • 2
llmsql-bench/llmsql-2.0-fine-tune-ready
Viewer
• Updated
• 241k • 60
llmsql-bench/benchmark-evaluation-results
Viewer
• Updated
• 1.04M • 9