Hey, That's My Model! Introducing Chain & Hash, An LLM Fingerprinting Technique
About
Growing concerns over the theft and misuse of Large Language Models (LLMs) underscore the need for effective fingerprinting to link a model to its original version and detect misuse. We define five essential properties for a successful fingerprint: Transparency, Efficiency, Persistence, Robustness, and Unforgeability. We present a novel fingerprinting framework that provides verifiable proof of ownership while preserving fingerprint integrity. Our approach makes two main contributions. First, a chain and hash technique that cryptographically binds fingerprint prompts to their responses, preventing collisions and enabling irrefutable ownership claims. Second, we address a realistic threat model in which instruction-tuned models' output distribution can be significantly altered through meta-prompts. By incorporating random padding and varied meta-prompt configurations during training, our method maintains robustness even under significant output style changes. Experiments show that our framework securely proves ownership, resists both benign transformations (e.g., fine-tuning) and adversarial fingerprint removal, and extends to fingerprinting LoRA adapters\footnote{We release our code at: https://github.com/microsoft/Chain-Hash.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Attack Success Rate | CTCC fingerprinting scenario b | SVA100 | 18 | |
| General Capability Harmlessness | General LLM Task Benchmark | Average Accuracy59.8 | 12 | |
| Input Perturbation Robustness | Input Perturbation Remove 5% | FSR (5% Removal)100 | 10 | |
| Fingerprinting Effectiveness | Fingerprinted Model Clean | FSR100 | 10 | |
| Input Perturbation Robustness | Input Perturbation Remove 10% | FSR92 | 10 | |
| Fine-tuning Robustness | ShareGPT | FSR1.00e+3 | 10 | |
| Fine-tuning Robustness | Alpaca Dataset | FSR0.00e+0 | 10 | |
| Fine-tuning Robustness | Dolly Dataset | FSR0.00e+0 | 10 | |
| Input Stealthiness Assessment | Narrative-based corpus | PPL86.31 | 8 | |
| Input Stealthiness Evaluation | Fingerprint Input Triggers (test) | Perplexity (PPL)86.31 | 6 |