Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Energy Consumption Estimation on OPT-2.7B
Loading...
95.67
Energy (J)
ShiftAddLLM (Lat.)
74.4648
217.5999
360.735
503.8701
Jun 10, 2024
Energy (J)
Updated 4d ago
Evaluation Results
Method
Method
Links
Energy (J)
ShiftAddLLM (Lat.)
Bits=2
2024.06
95.67
ShiftAddLLM (Mixed)
Bits=2.2
2024.06
96.98
ShiftAddLLM (Lat.)
Bits=3
2024.06
103.53
LUT-GEMM
Bits=2
2024.06
127.07
OPTQ
Bits=2
2024.06
132.3
LUT-GEMM
Bits=3
2024.06
137.08
OPTQ
Bits=3
2024.06
167.37
FP16
Bits=16
2024.06
625.8
Feedback
Search any
task
Search any
task