Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Energy Consumption Estimation on SOTA Language Models
Loading...
24.1
Representative Energy (MWh)
GShard
-26.416
314.567
655.55
996.533
Jun 22, 2026
Representative Energy (MWh)
FSDP Estimated Energy (MWh) per Epoch
FSDP Estimated Total Energy (MWh)
TP Estimated Energy (MWh) per Epoch
TP Estimated Total Energy (MWh)
Updated 1mo ago
Evaluation Results
Method
Method
Links
Representative Energy (MWh)
FSDP Estimated Energy (MWh) per Epoch
FSDP Estimated Total Energy (MWh)
TP Estimated Energy (MWh) per Epoch
TP Estimated Total Energy (MWh)
GShard
Dev.=Google, Params (B...
2026.06
24.1
0.04
1.72
1.45
69.08
T5
Dev.=Google, Params (B...
2026.06
85.7
0.02
2.65
0.85
106.47
Switch
Dev.=Google, Params (B...
2026.06
179
0.03
8.4
1.29
337.34
Meena
Dev.=Google, Params (B...
2026.06
232
0.02
6.9
0.79
276.94
GPT-3
Dev.=OpenAI, Params (B...
2026.06
1,287
0.12
17.33
4.88
696.13
Feedback
Search any
task
Search any
task
