Anna Mitsopoulou from ATHENA RC presented “Analysis of Text-to-SQL Benchmarks: Limitations, Challenges and Opportunities” at EDBT/ICDT 2025 Conference. A comprehensive methodology is introduced for analysing text-to-SQL datasets and identifying their limitations. The proposed evaluation approach, which combines dataset analysis with automatic error analysis, provides deeper insights into models’ strengths and weaknesses.
The EDBT/ICDT 2025 was held in Barcelona from 25th to 28th March, 2025
DataGEMS is a Research and Innovation Action funded by European Union under Horizon Europe Research and Innovation Programme via Grant Agreement No 101188416