Share your thoughts, 1 month free Claude Pro on usSee more

Instruction Following on Super-Natural Instructions v2 (test)

62RougeL

Tk-Instruct

Updated 1mo ago

Evaluation Results

Method	Links
Tk-Instruct 2024.06		62	1
TAGI 2024.06		58.4	0.39
HINT 2024.06		56.4	0.37
TAGI 2024.06		56.3	0.39
Tk-Instruct 2024.06		54	1
Tk-Instruct 2024.06		53.6	1
HINT 2024.06		53.2	0.37
TAGI 2024.06		52.3	0.39
OPT (13B) 2024.06		51.5	0.36
HINT 2024.06		51.1	0.37
HyperTuning 2024.06		48.6	0.34
TAGI 2024.06		48.4	0.39
Tk-Instruct 2024.06		48	1
HINT 2024.06		47.2	0.37
GPT-2 XL (1.5B) 2024.06		45.3	0.33
OPT (13B) 2024.06		44.8	0.36
TAGI 2024.06		42.5	0.39
Tk-Instruct 2024.06		42.1	1
HINT 2024.06		41.8	0.37
HyperTuning 2024.06		38.9	0.34
GPT-2 XL (1.5B) 2024.06		38.2	0.33
Tk-Instruct 2024.06		35.3	1
TAGI 2024.06		35.3	0.39
HINT 2024.06		33.3	0.37
No FT 2024.06		30.5	1
No FT 2024.06		26.2	1
Hypter 2024.06		16.8	0.35
Hypter 2024.06		15.5	0.35
No FT 2024.06		14.3	1
Hypter 2024.06		14.2	0.35
No FT 2024.06		13.6	1
Hypter 2024.06		13.4	0.35
Hypter 2024.06		12.1	0.35
Hypter 2024.06		10.6	0.35
No FT 2024.06		9.4	1
No FT 2024.06		8.8	1