Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Task addition on Task Arithmetic Benchmark (test)
Loading...
88.5
Avg Absolute Accuracy
Linear. FT
46.796
57.623
68.45
79.277
May 22, 2023
Avg Absolute Accuracy
Normalized Accuracy
Updated 3mo ago
Evaluation Results
Method
Method
Links
Avg Absolute Accuracy
Normalized Accuracy
Linear. FT
Backbone=ViT-L/14, Mod...
2023.05
88.5
93.5
Non-lin. FT
Backbone=ViT-L/14, Mod...
2023.05
85.1
88.8
Linear. FT
Backbone=ViT-B/16, Mod...
2023.05
81.3
86
Linear. FT
Backbone=ViT-B/32, Mod...
2023.05
76.5
85.4
Non-lin. FT
Backbone=ViT-B/16, Mod...
2023.05
75.5
80
Post-hoc lin.
Backbone=ViT-L/14, Mod...
2023.05
75.2
90
Non-lin. FT
Backbone=ViT-B/32, Mod...
2023.05
71.4
76.5
Post-hoc lin.
Backbone=ViT-B/16, Mod...
2023.05
65
85.2
Pre-trained
Backbone=ViT-L/14, Mod...
2023.05
64.4
-
Post-hoc lin.
Backbone=ViT-B/32, Mod...
2023.05
57.1
81.9
Pre-trained
Backbone=ViT-B/16, Mod...
2023.05
55.2
-
Pre-trained
Backbone=ViT-B/32, Mod...
2023.05
48.4
-
Feedback
Search any
task
Search any
task