High-dimensional Level Set Estimation with Trust Regions and Double Acquisition Functions
About
Level set estimation (LSE) classifies whether an unknown function's value exceeds a specified threshold for given inputs, a fundamental problem in many real-world applications. In active learning settings with limited initial data, we aim to iteratively acquire informative points to construct an accurate classifier for this task. In high-dimensional spaces, this becomes challenging where the search volume grows exponentially with increasing dimensionality. We propose TRLSE, an algorithm for high-dimensional LSE, which identifies and refines regions near the threshold boundary with dual acquisition functions operating at both global and local levels. We provide a theoretical analysis of TRLSE's accuracy and show its superior sample efficiency against existing methods through extensive evaluations on multiple synthetic and real-world LSE problems.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Level Set Estimation | AA33 | Average Runtime (min)11.5 | 4 | |
| Level Set Estimation | Levy 10-dimensional | Runtime (min)4.2 | 4 | |
| Level Set Estimation | Mazda 74-dimensional | Average Runtime (min)24.4 | 4 | |
| Level Set Estimation | Levy 100-dimensional | Average Runtime (min)24.3 | 4 | |
| Level Set Estimation | Vehicle 124-dimensional | Average Runtime (min)58.7 | 4 | |
| Level Set Estimation | Ackley 200-dimensional | Avg Runtime (min)992.2 | 4 | |
| Level Set Estimation | Trid 1000-dimensional | Average Runtime (min)433.9 | 4 | |
| Level Set Estimation | Rosenbrock 1000-dimensional | Runtime (min)450.7 | 4 | |
| Level Set Estimation | Levy10 | Wilcoxon p-value (Random)0.0117 | 2 | |
| Level Set Estimation | Mazda74 | Wilcoxon p-value (Random)0.0117 | 2 |