Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Medical Question Answering on PubMedQA Synthetic NIID 1.0 (test)
Loading...
75.1
Accuracy
FedDQC
66.052
68.401
70.75
73.099
Oct 15, 2024
Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Accuracy
FedDQC
Backbone=LLama2-7b, Fi...
2024.10
75.1
FedAvg (oracle)
Backbone=LLama2-7b, Fi...
2024.10
74.7
FedAvg+IFD
Backbone=LLama2-7b, Fi...
2024.10
69.9
FedAvg+PPL
Backbone=LLama2-7b, Fi...
2024.10
68.4
FedAvg+NUGGETS
Backbone=LLama2-7b, Fi...
2024.10
68.2
FedAvg+DataInf
Backbone=LLama2-7b, Fi...
2024.10
67.5
FedAvg
Backbone=LLama2-7b, Fi...
2024.10
66.4
Feedback
Search any
task
Search any
task