Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Medical Question Answering on PubMedQA Synthetic IID 1.0 (test)
Loading...
75.1
Accuracy
FedDQC
67.82
69.71
71.6
73.49
Oct 15, 2024
Accuracy
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
FedDQC
Backbone=LLama2-7b, Fi...
2024.10
75.1
FedAvg (oracle)
Backbone=LLama2-7b, Fi...
2024.10
75
FedAvg+DataInf
Backbone=LLama2-7b, Fi...
2024.10
72.8
FedAvg+IFD
Backbone=LLama2-7b, Fi...
2024.10
71.4
FedAvg+NUGGETS
Backbone=LLama2-7b, Fi...
2024.10
70.8
FedAvg+PPL
Backbone=LLama2-7b, Fi...
2024.10
70.3
FedAvg
Backbone=LLama2-7b, Fi...
2024.10
68.1
Feedback
Search any
task
Search any
task