Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Sequence Scheduling on Instruction-in-Wild
Loading...
1.24
Throughput (samples/s)
Instruction Tuning
0.7616
0.8858
1.01
1.1342
May 22, 2023
Throughput (samples/s)
Average Length
Error Rate
Accuracy (50)
Accuracy (100)
Error Score
Updated 3mo ago
Evaluation Results
Method
Method
Links
Throughput (samples/s)
Average Length
Error Rate
Accuracy (50)
Accuracy (100)
Error Score
Instruction Tuning
Model=Vicuna-7B, Confi...
2023.05
1.24
299
-
43
68
139
Estimation Only
Model=Vicuna-7B, Confi...
2023.05
1.07
422
-
20
38
358
Vanilla
Model=Vicuna-7B
2023.05
0.78
475
-
-
-
-
Feedback
Search any
task
Search any
task