SafeGene: Reusable Adapters for Transferable Safety Alignment
About
Open-weight LLMs are increasingly fine-tuned into customized assistants, but downstream fine-tuning can weaken safety alignment and make models more vulnerable to malicious prompts, even when the training data is not intentionally harmful. This creates a recurring safety recovery problem as target models are repeatedly updated with new task data or user interactions. We propose SafeGene, a reusable safety-adapter module designed for cross-task reuse within each architecture-compatible model family. Rather than treating safety recovery as a model-specific repair step, SafeGene treats safety capability as an independent, reusable adapter representation decoupled from task-specific updates. This representation is obtained from aligned--degraded model discrepancies, refined into task-transferable safety vectors through data-aware layer selection, and expressed in each downstream task-adapted model via few-shot layer-wise coefficient recalibration. Experiments across multiple model families, downstream tasks, and safety judges show that SafeGene-enhanced models reduce harmful response rates while maintaining downstream performance, outperforming representative safe adaptation methods in safety--utility trade-off.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Question Answering | BoolQ | Accuracy87.86 | 233 | |
| Natural Language Inference | MNLI | -- | 80 | |
| Safety Evaluation | Beavertails | ASR34.16 | 44 | |
| Safety Evaluation | DirectRefusal | Attack Success Rate (ASR)30.66 | 25 | |
| Safety Evaluation | BeaverTails & DirectRefusal Average | Average ASR32.84 | 25 | |
| Sentiment Analysis | SST2 | Top-1 Accuracy96.56 | 10 | |
| Natural Language Inference | MNLI | Accuracy84.45 | 5 | |
| Sentiment Analysis | SST2 | Accuracy95.3 | 5 | |
| Text Classification | AG-News | Accuracy88.91 | 5 | |
| Question Answering | BoolQ | Accuracy79.63 | 5 |