Your "Pro" LLM Subscription May Actually Be "Free": Exposing Fingerprint Spoofing Risks in LLM Inference Services
About
As Large Language Model (LLM) APIs become ubiquitous, users increasingly rely on black-box fingerprinting to verify that providers are serving the advertised premium models. However, these methods may overlook adversarial providers who manipulate model weights to cheat the fingerprint process. We introduce a novel threat termed fingerprint spoofing, where a malicious provider stealthily serves a weaker model that has been parameter-efficiently fine-tuned to mimic a stronger model, thereby evading user-side fingerprinting. We first formally prove that user-side resource constraints (i.e., finite query budgets and weak fingerprinting classifiers) make current fingerprinting vulnerable to fingerprint spoofing. Guided by this theoretical analysis, we propose GhostPrint, a cost-effective attack framework leveraging surrogate modeling, reward-ranked fine-tuning, and knowledge distillation. Extensive evaluations in both static and continual fingerprinting settings demonstrate that GhostPrint allows weak models to consistently bypass representative fingerprint methods while maintaining utility at a low fine-tuning cost, exposing a critical vulnerability in current LLM fingerprinting pipelines.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Fingerprint Spoofing | LLMmap official query set (8:2) | LLMmap Attack Success Rate (ASR)95 | 21 | |
| Fingerprint Spoofing | UltraChat (8:2) | MET ASR60 | 21 | |
| Cross-family weak-to-weak spoofing | LLMmap Gemma-2B to Qwen2-1.5B | ASR46.7 | 14 | |
| Fingerprint Spoofing | LLM-idio on UltraChat (test) | ASR96.7 | 14 | |
| Fingerprint Spoofing | MET on UltraChat (test) | ASR33.3 | 14 | |
| Fingerprint Spoofing | LLMmap (test) | ASR6 | 14 | |
| Mathematical Reasoning | GSM8K | GSM8K Utility78.01 | 9 | |
| Question Answering | ARC Challenge | ARC-C Utility62.8 | 9 | |
| Language Understanding | MMLU | MMLU Utility69.7 | 9 | |
| Cross-family weak-to-weak spoofing | LLM-idio Gemma-2B to Qwen2-1.5B | ASR97.5 | 7 |