Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

FiQA

Benchmarks

Task NameDataset NameSOTA ResultTrend
Financial Question AnsweringFiQA
Accuracy82.7
85
RAG Leakage AttackFIQA
CCL66.8
72
Retrieval Attack DefenseFiQA
ASR0
70
End-to-End Defense in RAGFiQA
ASR0
63
Information RetrievalFIQA BEIR (test)
nDCG@1093.19
44
Adversarial Attack on RAGFiQA
SASR98.47
24
Information RetrievalFIQA
MRR54
22
Information RetrievalFiQA
NDCG@10 (Dense)0.479
21
Passage RerankingFiQA BEIR
NDCG@1029.88
19
Information RetrievalFiQA
Faithfulness79
18
Information RetrievalFiQA
nDCG@1055.6
16
Information RetrievalFiQA benign retrieval
Success Rate (SR)79
16
Privacy-utility tradeoffFIQA
Leakage8.48
16
Document RetrievalFiQA BEIR 2018
Delta nDCG@101.36
15
Information RetrievalFiQA 2018 (test)
NDCG@100.6197
14
Question Answering RetrievalFiQA
nDCG@1038.6
9
Vector LinkingFiQA
Precision79.8
8
AI-generated text detectionFiQA
AUROC79.67
7
RAG Utility EvaluationFiQA
Hit Rate49.4
7
Question AnsweringFiQA
Answerability Rate100
6
Financial Question AnsweringFIQA Synthetic NIID 1.0 (test)
Win Rate82.1
6
Financial Question AnsweringFIQA Synthetic IID 1.0 (test)
Win Rate72.1
6
Adversarial AttackFiQA 2018
Contriever86.54
6
Information RetrievalFiQA 2018
Accuracy42.05
6
FAQ matchingFiQA
Top-1 Accuracy61.2
5
Showing 25 of 44 rows