Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Frequency-Spatial Entanglement Learning for Camouflaged Object Detection

About

Camouflaged object detection has attracted a lot of attention in computer vision. The main challenge lies in the high degree of similarity between camouflaged objects and their surroundings in the spatial domain, making identification difficult. Existing methods attempt to reduce the impact of pixel similarity by maximizing the distinguishing ability of spatial features with complicated design, but often ignore the sensitivity and locality of features in the spatial domain, leading to sub-optimal results. In this paper, we propose a new approach to address this issue by jointly exploring the representation in the frequency and spatial domains, introducing the Frequency-Spatial Entanglement Learning (FSEL) method. This method consists of a series of well-designed Entanglement Transformer Blocks (ETB) for representation learning, a Joint Domain Perception Module for semantic enhancement, and a Dual-domain Reverse Parser for feature integration in the frequency and spatial domains. Specifically, the ETB utilizes frequency self-attention to effectively characterize the relationship between different frequency bands, while the entanglement feed-forward network facilitates information interaction between features of different domains through entanglement learning. Our extensive experiments demonstrate the superiority of our FSEL over 21 state-of-the-art methods, through comprehensive quantitative and qualitative comparisons in three widely-used datasets. The source code is available at: https://github.com/CSYSI/FSEL.

Yanguang Sun, Chunyan Xu, Jian Yang, Hanyu Xuan, Lei Luo• 2024

Related benchmarks

TaskDatasetResultRank
Camouflaged Object DetectionCOD10K
S-measure (S_alpha)0.877
178
Camouflaged Object DetectionChameleon
S-measure (S_alpha)89.3
150
Camouflaged Object DetectionNC4K
M Score0.045
67
Camouflaged Object DetectionNC4K
Sm89.2
58
Camouflaged Object DetectionCAMO
Weighted F-beta (Fwβ)0.85
44
Video Camouflaged Object DetectionCAD (test)
mDice43.4
41
Camouflaged Object DetectionCAMO
M Score0.04
37
Referring Camouflaged Object DetectionR2C7K
Sm85.1
32
Polyp SegmentationKvasir-SEG 100 random images
Dice Coefficient80.54
27
Camouflaged Object DetectionCAMO 1.0 (test)
MAE0.068
23
Showing 10 of 20 rows

Other info

Follow for update