Share your thoughts, 1 month free Claude Pro on usSee more

Best Arm Identification

Benchmarks

Dataset Name	SOTA Method	Metric
Unstructured instances K=40	k-Learner	Samples5.43	31	1mo ago
Linear instances K=50, d=20 Appendix G (randomly generated)	LinGapE	Samples14.71	30	1mo ago
MovieLens		True Rank6.633	15	1mo ago
Jester		True Rank of Reported Winner2.067	15	1mo ago
Synthetic		True Rank of Reported Winner3.233	15	1mo ago
Stair arm-to-reward function K=55	CR-A	Error Rate0.57	15	1mo ago
Stair arm-to-reward function K=21	CR-A	Error Probability0.09	15	1mo ago
Stair arm-to-reward function K=15	CR-C	Error Rate0.02	15	1mo ago
Linear arm-to-reward function K=40	CR-A	Error Rate10.67	15	1mo ago
Linear arm-to-reward function K=20	CR-A	Error Probability3.73	15	1mo ago
Linear arm-to-reward function K=10	CR-A	Error Probability0.0055	15	1mo ago
Concave arm-to-reward function (K=40) (synthetic)		Error Rate0.02	15	1mo ago
Concave arm-to-reward function K=20 (synthetic)	CR-A	Error Probability0.09	15	1mo ago
Concave arm-to-reward function K=10 (synthetic)	CR-A	Error Rate0.04	15	1mo ago
55-arm convex mapping bandit	CR-A	Error Probability0.6	15	1mo ago
Two groups of suboptimal arms (K=40)	CR-C	Error Probability2.24	15	1mo ago
Two groups of suboptimal arms K=20	CR-A	Error Probability4.27	15	1mo ago
Two groups of suboptimal arms (K=10)	CR-A	Error Probability0.99	15	1mo ago
Convex arm-to-reward function K=40 (test)	CR-C	Error Rate0.25	15	1mo ago
Convex arm-to-reward function K=20 (test)	CR-A	Error Probability0.21	15	1mo ago
Convex arm-to-reward function K=10 (test)	CR-A	Error Rate0.62	15	1mo ago
10 Synthetic Gaussian Instances K=40 arms	Simple Tracking	H153.7	10	9d ago
New Yorker Cartoon Caption Contest Caption 854	iKG	False Selection Probability0.04	10	1mo ago
Drug Review Dataset Selection	iKG	Probability of False Selection23	10	1mo ago
Dose-finding ACR50	iKG	Probability of False Selection1	10	1mo ago

Showing 25 of 59 rows