Context-measure: Contextualizing Metric for Camouflage
About
Camouflage is primarily context-dependent yet current metrics for camouflaged scenarios overlook this critical factor. Instead, these metrics are originally designed for evaluating general or salient objects, with an inherent assumption of uncorrelated spatial context. In this paper, we propose a new contextualized evaluation paradigm, Context-measure, built upon a probabilistic pixel-aware correlation framework. By incorporating spatial dependencies and pixel-wise camouflage quantification, our measure better aligns with human perception. Extensive experiments across three challenging camouflaged object segmentation datasets show that Context-measure delivers more reliability than existing context-independent metrics. Our measure can provide a foundational evaluation benchmark for various computer vision applications involving camouflaged patterns, such as agricultural, industrial, and medical scenarios. Code is available at https://github.com/pursuitxi/Context-measure.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Meta-Measure 1 (Semantic Alignment) | CamoHR | Error Rate3.25 | 7 | |
| Meta-Measure 2 (Ground-Truth Switch) | COD10K | Error Rate0.01 | 7 | |
| Meta-Measure 2 (Ground-Truth Switch) | NC4K | Error Rate3 | 7 | |
| Meta-Measure 2 (Ground-Truth Switch) | Trans10K | Error Rate3 | 7 | |
| Meta-Measure 4 (Structural Sensitivity - Dilate) | COD10K | Error Rate0.8 | 7 | |
| Meta-Measure 4 (Structural Sensitivity - Dilate) | NC4K | Error Rate0.61 | 7 | |
| Meta-Measure 4 (Structural Sensitivity - Dilate) | Trans10K | Error Rate14 | 7 | |
| Meta-Measure 4 (Structural Sensitivity - Erode) | COD10K | Error Rate1.21 | 7 | |
| Meta-Measure 4 (Structural Sensitivity - Erode) | NC4K | Error Rate0.8 | 7 | |
| Meta-Measure 4 (Structural Sensitivity - Erode) | Trans10K | Error Rate29 | 7 |