Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Medical Question Answering on PubMedQA Synthetic IID 1.0 (test)
Loading...
75.1
Accuracy
FedDQC
67.82
69.71
71.6
73.49
Oct 15, 2024
Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Accuracy
FedDQC
Backbone=LLama2-7b, Fi...
2024.10
75.1
FedAvg (oracle)
Backbone=LLama2-7b, Fi...
2024.10
75
FedAvg+DataInf
Backbone=LLama2-7b, Fi...
2024.10
72.8
FedAvg+IFD
Backbone=LLama2-7b, Fi...
2024.10
71.4
FedAvg+NUGGETS
Backbone=LLama2-7b, Fi...
2024.10
70.8
FedAvg+PPL
Backbone=LLama2-7b, Fi...
2024.10
70.3
FedAvg
Backbone=LLama2-7b, Fi...
2024.10
68.1
Feedback
Search any
task
Search any
task