Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

COBRA: Catastrophic Bit-flip Reliability Analysis of State-Space Models

About

State-space models (SSMs), exemplified by the Mamba architecture, have recently emerged as state-of-the-art sequence-modeling frameworks, offering linear-time scalability together with strong performance in long-context settings. Owing to their unique combination of efficiency, scalability, and expressive capacity, SSMs have become compelling alternatives to transformer-based models, which suffer from the quadratic computational and memory costs of attention mechanisms. As SSMs are increasingly deployed in real-world applications, it is critical to assess their susceptibility to both software- and hardware-level threats to ensure secure and reliable operation. Among such threats, hardware-induced bit-flip attacks (BFAs) pose a particularly severe risk by corrupting model parameters through memory faults, thereby undermining model accuracy and functional integrity. To investigate this vulnerability, we introduce RAMBO, the first BFA framework specifically designed to target Mamba-based architectures. Through experiments on the Mamba-1.4b model with LAMBADA benchmark, a cloze-style word-prediction task, we demonstrate that flipping merely a single critical bit can catastrophically reduce accuracy from 74.64% to 0% and increase perplexity from 18.94 to 3.75 x 10^6. These results demonstrate the pronounced fragility of SSMs to adversarial perturbations.

Sanjay Das, Swastik Bhattacharya, Shamik Kundu, Arnab Raha, Souvik Kundu, Kanad Basu• 2025

Related benchmarks

TaskDatasetResultRank
Question AnsweringARC Easy
Accuracy (After Attack)60
44
Commonsense ReasoningHellaSwag
Accuracy (Baseline)62.69
31
Commonsense ReasoningWinoGrande
Accuracy (Pre-Attack)66.61
19
Language ModelingWikiText
Perplexity (Baseline)9.91
11
Question AnsweringPIQA
Accuracy (Baseline)77.31
11
Word PredictionLAMBADA
Accuracy (Original)82.2
11
Image ClassificationImageNet-1K
Accuracy (Baseline)86.1
2
Showing 7 of 7 rows

Other info

Follow for update