Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

MR

Benchmarks

Task NameDataset NameSOTA ResultTrend
Sentiment ClassificationMR
Accuracy90.8
148
Sentiment AnalysisMR
Accuracy0.939
142
Sentiment ClassificationMR (test)
Accuracy90.8
142
Text ClassificationMR (test)
Accuracy91.27
99
Text ClassificationMR
Accuracy93.3
93
Sentiment ClassificationMR
Accuracy72.96
24
Sentiment AnalysisMR
Spearman's rho0.8882
23
Text ProcessingMR
Latency (ms)2
20
Backdoor DefenseMR
AUC0.99
20
Text ClassificationMR
CA89.85
20
Maximum Common Connected Subgraph (MCCS) Similarity EstimationMR 20% (test)
MSE0.131
18
Maximum Common Edge Subgraph (MCES) Similarity EstimationMR 20% (test)
MSE0.154
18
Graph RetrievalMR (test)
MAP90.2
17
Sentiment AnalysisMR few-shot zero-shot
Accuracy88
16
Graph RetrievalMR 25% (test)
MRR1
15
Sentiment ClassificationMR (10-fold cross-validation)
Accuracy83.1
13
Graph RetrievalMR 25% split (test)
MAP90.2
13
Sentiment AnalysisMR
Avg Accuracy89.6
11
Text ClassificationMR small-scale (test)
Accuracy86.5
10
Graph Similarity Ranking (MCCS)MR 20% MCCS ground truth (test)
PairRank0.925
9
Graph Similarity Ranking (MCES)MR MCES ground truth (test)
PairRank0.937
9
Sentence ClassificationMR full (test)
Accuracy92.5
9
Sentiment AnalysisMR
Clean Accuracy Change1.3
6
Sentiment AnalysisMR adversarial (test)
Accuracy82.1
6
Sentence ClassificationMR (Movie Review) (10-fold cross-validation)
Accuracy79.5
4
Showing 25 of 28 rows