Missing-by-Design: Certifiable Modality Deletion for Revocable Multimodal Sentiment Analysis
About
As multimodal systems increasingly process sensitive personal data, the ability to selectively revoke specific data modalities has become a critical requirement for privacy compliance and user autonomy. We present Missing-by-Design (MBD), a unified framework for revocable multimodal sentiment analysis that combines structured representation learning with a certifiable parameter-modification pipeline. Revocability is critical in privacy-sensitive applications where users or regulators may request removal of modality-specific information. MBD learns property-aware embeddings and employs generator-based reconstruction to recover missing channels while preserving task-relevant signals. For deletion requests, the framework applies saliency-driven candidate selection and a calibrated Gaussian update to produce a machine-verifiable Modality Deletion Certificate. Experiments on benchmark datasets show that MBD achieves strong predictive performance under incomplete inputs and delivers a practical privacy-utility trade-off, positioning surgical unlearning as an efficient alternative to full retraining.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Multimodal Sentiment Analysis | CMU-MOSI (test) | F190 | 238 | |
| Multimodal Sentiment Analysis | CMU-MOSI | MAE0.62 | 59 | |
| Multimodal Sentiment Analysis | CMU-MOSI 43 (test) | 2-Class Accuracy88.9 | 56 | |
| Multimodal Emotion Recognition | IEMOCAP full-modality comparison | Weighted Accuracy82 | 9 |