Share your thoughts, 1 month free Claude Pro on usSee more

Best Arm Identification

Benchmarks

Dataset Name	SOTA Method	Metric
Unstructured instances K=40	k-Learner	Samples5.43	31	3mo ago
Linear instances K=50, d=20 Appendix G (randomly generated)	LinGapE	Samples14.71	30	3mo ago
MovieLens		True Rank6.633	15	3mo ago
Jester		True Rank of Reported Winner2.067	15	3mo ago
Synthetic		True Rank of Reported Winner3.233	15	3mo ago
Stair arm-to-reward function K=55	CR-A	Error Rate0.57	15	3mo ago
Stair arm-to-reward function K=21	CR-A	Error Probability0.09	15	3mo ago
Stair arm-to-reward function K=15	CR-C	Error Rate0.02	15	3mo ago
Linear arm-to-reward function K=40	CR-A	Error Rate10.67	15	3mo ago
Linear arm-to-reward function K=20	CR-A	Error Probability3.73	15	3mo ago
Linear arm-to-reward function K=10	CR-A	Error Probability0.0055	15	3mo ago
Concave arm-to-reward function (K=40) (synthetic)		Error Rate0.02	15	3mo ago
Concave arm-to-reward function K=20 (synthetic)	CR-A	Error Probability0.09	15	3mo ago
Concave arm-to-reward function K=10 (synthetic)	CR-A	Error Rate0.04	15	3mo ago
55-arm convex mapping bandit	CR-A	Error Probability0.6	15	3mo ago
Two groups of suboptimal arms (K=40)	CR-C	Error Probability2.24	15	3mo ago
Two groups of suboptimal arms K=20	CR-A	Error Probability4.27	15	3mo ago
Two groups of suboptimal arms (K=10)	CR-A	Error Probability0.99	15	3mo ago
Convex arm-to-reward function K=40 (test)	CR-C	Error Rate0.25	15	3mo ago
Convex arm-to-reward function K=20 (test)	CR-A	Error Probability0.21	15	3mo ago
Convex arm-to-reward function K=10 (test)	CR-A	Error Rate0.62	15	3mo ago
10 Synthetic Gaussian Instances K=40 arms	Simple Tracking	H153.7	10	1mo ago
New Yorker Cartoon Caption Contest Caption 854	iKG	False Selection Probability0.04	10	3mo ago
Drug Review Dataset Selection	iKG	Probability of False Selection23	10	3mo ago
Dose-finding ACR50	iKG	Probability of False Selection1	10	3mo ago

Showing 25 of 66 rows