Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Ambrosia

Benchmarks

Task NameDataset NameSOTA ResultTrend
Text-to-SQLAmbrosia
AUPRC64.18
12
Text-to-SQL ParsingAmbrosia Unambiguous (test)
Recall88.7
11
Text-to-SQL ParsingAmbrosia Ambiguous subset (test)
Recall82.4
11
Text-to-SQLAmbrosia (out-of-domain)
Single Interpretation Coverage84.4
7
NL2SQLAMBROSIA Unambiguous
Execution Accuracy (EX)94.7
3
NL2SQLAMBROSIA Ambiguous
Execution Accuracy (EX)92
3
Text-to-SQL ambiguity resolutionAmbrosia Ambiguous
Recall82.4
2
Interpretation AlignmentAmbrosia sampled 30 ambiguous examples
Alignment Score0.917
1
Showing 8 of 8 rows