Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Question Answering on FinQA (val)
Loading...
0.6122
Execution Accuracy
FinQANet
-0.01544
0.147505
0.31045
0.473395
Sep 1, 2021
Execution Accuracy
Program Accuracy
Updated 3d ago
Evaluation Results
Method
Method
Links
Execution Accuracy
Program Accuracy
FinQANet
Backbone=RoBerta-large
2021.09
0.6122
0.5805
FinQANet
Backbone=RoBerta-base
2021.09
0.5627
0.5349
FinQANet
Backbone=BERT-large
2021.09
0.5386
0.5095
FinQANet
Backbone=BERT-base
2021.09
0.4991
0.4715
Retriever + NeRd
Backbone=BERT-base
2021.09
0.4753
0.4537
FinQANet
Backbone=FinBert
2021.09
0.4664
0.4411
Pre-Trained Longformer
Backbone=base
2021.09
0.2383
0.2256
Retriever + Seq2seq
2021.09
0.1876
0.1752
TF-IDF + Single Op
2021.09
0.0165
0.0165
Retriever + Direct Generation
2021.09
0.0087
-
Feedback
Search any
task
Search any
task