Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
NL-to-SQL on WikiTQ
Loading...
59.7
Execution Accuracy
Table-Specialist
-2.24448
13.83726
29.919
46.00074
Oct 16, 2024
Execution Accuracy
Updated 25d ago
Evaluation Results
Method
Method
Links
Execution Accuracy
Table-Specialist
Base Model=GPT-4, Trai...
2024.10
59.7
GPT-4
Base Model=GPT-4, Trai...
2024.10
55.9
Table-Specialist
Base Model=GPT-3.5, Tr...
2024.10
51.3
Table-Specialist
Base Model=Llama3.1-8B...
2024.10
44.9
GPT-3.5
Base Model=GPT-3.5, Tr...
2024.10
42.1
Llama3.1-8B
Base Model=Llama3.1-8B...
2024.10
30
Table-Specialist
Base Model=GPT-4, Trai...
2024.10
0.55
GPT-4
Base Model=GPT-4, Trai...
2024.10
0.416
Table-Specialist
Base Model=GPT-3.5, Tr...
2024.10
0.404
Table-Specialist
Base Model=Llama3.1-8B...
2024.10
0.257
GPT-3.5
Base Model=GPT-3.5, Tr...
2024.10
0.209
Llama3.1-8B
Base Model=Llama3.1-8B...
2024.10
0.138
Feedback
Search any
task
Search any
task