Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Diagonal Fisher Information Matrix Estimation on MNLI
Loading...
0.11
RelMAE
Low-rank FIM estimator
-2.0416
12.4817
27.005
41.5283
May 19, 2025
RelMAE
Speedup Factor
Updated 1mo ago
Evaluation Results
Method
Method
Links
RelMAE
Speedup Factor
Low-rank FIM estimator
Backbone=RoBERTa-base
2025.05
0.11
0.96
Low-rank(2) FIM estimator
Backbone=RoBERTa-base
2025.05
0.12
0.95
Hutchinson's FIM estimator
Backbone=RoBERTa-base
2025.05
0.16
1
Diagonal Gauss-Newton FIM estimator
Backbone=RoBERTa-base
2025.05
8.36
0.97
Empirical FIM
Backbone=RoBERTa-base
2025.05
53.9
1
Feedback
Search any
task
Search any
task