Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Decoding latency on Synthetic Context Sequences (test)

0.019Latency (16k Context)

Full Cache

0.002440.114220.2260.33778May 26, 2025
Updated 4d ago

Evaluation Results

MethodLinks
2025.05
0.0190.0210.0290.0360.044
2025.05
0.0240.0330.050.0620.082
2025.05
0.0290.0320.0430.0550.07
2025.05
0.0410.0620.0980.1320.17
2025.05
0.0410.0420.0460.0490.056
2025.05
0.0450.0470.0540.0540.056
2025.05
0.0450.0770.14--
2025.05
0.0660.1180.2210.3250.43
2025.05
0.0660.0670.0720.0760.079
2025.05
0.0850.0870.090.0920.094
2025.05
0.1020.2050.4170.6260.843
2025.05
0.1040.1050.1080.1080.11
2025.05
0.1080.1110.1120.1150.12
2025.05
0.1240.2270.4350.7430.992
2025.05
0.130.1380.1390.1440.15
2025.05
0.4330.8381.7673.2534.468