Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Selective Capability Unlearning in End-to-End Spoken Language Understanding

About

Modern spoken language understanding (SLU) systems are increasingly deployed in real-world settings, where specific functionalities may need to be removed due to policy or safety constraints. In SLU, a functionality corresponds to an intent and its associated slot-generation behavior. However, in autoregressive models, suppressing a target intent does not eliminate the conditional mapping that generates slots conditioned on that intent. When the intent prefix is externally supplied, the model can reconstruct the original intent-slot structure. We identify this structural failure as \textbf{\emph{capability persistence}}. We propose \textit{\underline{B}inding \underline{S}ubspace (BSU)}, a representation-level framework that isolates and attenuates intent-conditioned directions underlying this mapping. Across SLU benchmarks, BSU substantially reduces forced-prefix recoverability while preserving retained performance.

Akanksha Singh, Vinod Kumar Kurmi• 2026

Related benchmarks

TaskDatasetResultRank
Selective capability unlearningSLURP Retain Set 1.0 (DR)
IF87.9
40
Selective capability unlearningSLURP Forget Set (DF) 1.0
IF28.4
20
Selective capability unlearningSpeechMassive Forget Set (DF) 1.0
IF25.37
20
Showing 3 of 3 rows

Other info

Follow for update