Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

DR-TANet: Dynamic Receptive Temporal Attention Network for Street Scene Change Detection

About

Street scene change detection continues to capture researchers' interests in the computer vision community. It aims to identify the changed regions of the paired street-view images captured at different times. The state-of-the-art network based on the encoder-decoder architecture leverages the feature maps at the corresponding level between two channels to gain sufficient information of changes. Still, the efficiency of feature extraction, feature correlation calculation, even the whole network requires further improvement. This paper proposes the temporal attention and explores the impact of the dependency-scope size of temporal attention on the performance of change detection. In addition, based on the Temporal Attention Module (TAM), we introduce a more efficient and light-weight version - Dynamic Receptive Temporal Attention Module (DRTAM) and propose the Concurrent Horizontal and Vertical Attention (CHVA) to improve the accuracy of the network on specific challenging entities. On street scene datasets `GSV', `TSUNAMI' and `VL-CMU-CD', our approach gains excellent performance, establishing new state-of-the-art scores without bells and whistles, while maintaining high efficiency applicable in autonomous vehicles.

Shuo Chen, Kailun Yang, Rainer Stiefelhagen• 2021

Related benchmarks

TaskDatasetResultRank
Semantic Change DetectionChangeSim
F1 (t0->t1)40.3
25
Semantic Change DetectionVL-CMU-CD
F1-score (t0->t1)74.2
25
Semantic Change DetectionTSUNAMI
F1 Score (t0->t1)82
25
Semantic Change DetectionChangeVPR SF-XL (U) (test)
F1 (t0->t1)38.6
25
Change DetectionPCD (full)
F1-score (GSV)74.3
15
Change DetectionVL-CMU-CD 1 (test)
Aligned F157.7
10
Change DetectionVL-CMU-CD (test)
F1-score (best)75.1
8
Scene Change DetectionVL-CMU-CD Aligned
F1 Score60.7
7
Scene Change DetectionVL-CMU-CD Diff-2
F1 Score56.9
6
Change DetectionPSCD 21 (test)
Aligned F119
4
Showing 10 of 11 rows

Other info

Follow for update