Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Mocheg

Benchmarks

Task NameDataset NameSOTA ResultTrend
Claim VerificationMocheg
Macro F149.7
32
Veracity PredictionMOCHEG
Macro F1 Score57
13
Fact VerificationMOCHEG (test)
Accuracy90.5
7
Explanation generationMocheg (test)
ROUGE-132.1
7
Explanation GenerationMocheg
ROUGE-L23.4
7
Evidence RetrievalMocheg
Recall@124.4
7
Evidence RetrievalMocheg
Prec@153.1
7
Explanation generationMocheg 1.0 (test)
ROUGE-130.3
7
Evidence RetrievalMocheg
MAP41.6
7
Fact-checkingMOCHEG DEFAME target system (original (non-adversarial) and adversarial)
Accuracy78.7
6
Fact-checkingMOCHEG LEMMA target system (original (non-adversarial) and adversarial)
Accuracy66.1
6
Fact VerificationMOCHEG Gold (test)
Accuracy61.2
5
Fact-checkingMOCHEG HiSS target system (original (non-adversarial) and adversarial)
Accuracy77.5
5
Showing 13 of 13 rows