Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
NL-to-SQL on WikiSQL
Loading...
87.4
Execution Accuracy
Table-Specialist
30.928
45.589
60.25
74.911
Oct 16, 2024
Execution Accuracy
Updated 25d ago
Evaluation Results
Method
Method
Links
Execution Accuracy
Table-Specialist
Base Model=GPT-4, Trai...
2024.10
87.4
GPT-4
Base Model=GPT-4, Trai...
2024.10
86.9
Table-Specialist
Base Model=GPT-3.5, Tr...
2024.10
85.5
Table-Specialist
Base Model=GPT-4, Trai...
2024.10
82.7
GPT-3.5
Base Model=GPT-3.5, Tr...
2024.10
82.3
Table-Specialist
Base Model=Llama3.1-8B...
2024.10
81.6
Table-Specialist
Base Model=GPT-4, Trai...
2024.10
81.5
Table-Specialist
Base Model=GPT-3.5, Tr...
2024.10
79.4
Table-Specialist
Base Model=GPT-3.5, Tr...
2024.10
77.6
GPT-4
Base Model=GPT-4, Trai...
2024.10
75.9
GPT-4
Base Model=GPT-4, Trai...
2024.10
74.5
Table-Specialist
Base Model=Llama3.1-8B...
2024.10
72.8
GPT-3.5
Base Model=GPT-3.5, Tr...
2024.10
56.7
Llama3.1-8B
Base Model=Llama3.1-8B...
2024.10
52.5
GPT-3.5
Base Model=GPT-3.5, Tr...
2024.10
51
Table-Specialist
Base Model=Llama3.1-8B...
2024.10
40.9
Llama3.1-8B
Base Model=Llama3.1-8B...
2024.10
35.9
Llama3.1-8B
Base Model=Llama3.1-8B...
2024.10
33.1
Feedback
Search any
task
Search any
task