Efficient Semantic Image Communication for Traffic Monitoring at the Edge
About
Many visual monitoring systems operate under strict communication constraints, where transmitting full-resolution images is impractical and often unnecessary. In such settings, visual data is often used for object presence, spatial relationships, and scene context rather than exact pixel fidelity. This paper presents two semantic image communication pipelines for traffic monitoring, MMSD and SAMR, that reduce transmission cost while preserving meaningful visual information. MMSD (Multi-Modal Semantic Decomposition) targets very high compression together with data confidentiality, since sensitive pixel content is not transmitted. It replaces the original image with compact semantic representations, namely segmentation maps, edge maps, and textual descriptions, and reconstructs the scene at the receiver using a diffusion-based generative model. SAMR (Semantic-Aware Masking Reconstruction) targets higher visual quality while maintaining strong compression. It selectively suppresses non-critical image regions according to semantic importance before standard JPEG encoding and restores the missing content at the receiver through generative inpainting. Both designs follow an asymmetric sender-receiver architecture, where lightweight processing is performed at the edge and computationally intensive reconstruction is offloaded to the server. On a Raspberry Pi~5, the edge-side processing time is about 15s for MMSD and 9s for SAMR. Experimental results show average transmitted-data reductions of 99% for MMSD and 99.1% for SAMR. In addition, MMSD achieves lower payload size than the recent SPIC baseline while preserving strong semantic consistency, whereas SAMR provides a better quality-compression trade-off than standard JPEG and SQ-GAN under comparable operating conditions.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Semantic Image Compression | Semantic Image Evaluation Dataset (test) | Mean Score260.5 | 10 | |
| Edge Deployment Performance Evaluation | Raspberry Pi 5 CPU-only | Latency (s)0.08 | 7 | |
| Perceptual Quality Comparison | MMSD (test) | Wins325 | 3 | |
| Semantic Preservation Evaluation | MMSD (evaluation) | Position Preservation (Q1)97.61 | 3 | |
| Human Perceptual Evaluation | Human Preference Survey Traffic Scene Reconstruction 1.0 (test) | Position Preservation (Q1)63.2 | 2 | |
| Semantic segmentation | Raspberry PI 5 | Inference Time (s)8.35 | 2 | |
| End-to-End Inference | Raspberry PI 5 | Inference Time (s)15.46 | 2 | |
| Edge extraction | Raspberry PI 5 | Execution Time (s)0.02 | 1 | |
| Image Captioning | Raspberry PI 5 | Inference Time (s)7.07 | 1 |