Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
NL-to-Scala on Spider
Loading...
50.4
Execution Accuracy
Table-Specialist
23.88
30.765
37.65
44.535
Oct 16, 2024
Execution Accuracy
Updated 25d ago
Evaluation Results
Method
Method
Links
Execution Accuracy
Table-Specialist
Base Model=GPT-3.5, Tr...
2024.10
50.4
Table-Specialist
Base Model=GPT-4, Trai...
2024.10
46.6
Table-Specialist
Base Model=Llama3.1-8B...
2024.10
35.6
GPT-3.5
Base Model=GPT-3.5, Tr...
2024.10
30.8
GPT-4
Base Model=GPT-4, Trai...
2024.10
29.4
Llama3.1-8B
Base Model=Llama3.1-8B...
2024.10
24.9
Feedback
Search any
task
Search any
task