| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| System Prompt Extraction Out-of-domain SystemCheck and ChatGPT-Prompts | RogueMerge | Exact Match Score93.5 | 20 | 1mo ago | |
| System Prompt Extraction In-domain ShareGPT | RogueMerge | Exact Match Score91 | 20 | 1mo ago | |
| System Prompts 41-model | Self-Consistency Score0.915 | 10 | 5mo ago | ||
| attack prompts Out-of-domain | RogueMerge | ASR (TA)78 | 5 | 1mo ago | |
| Attack Prompts In-domain | RogueMerge | Attack Success Rate (TA)78 | 5 | 1mo ago | |
| System Prompt Extraction Set Out-of-merge | RogueMerge | Attack Success Rate77.5 | 4 | 1mo ago | |
| System Prompt Extraction Set In-merge | RogueMerge | Attack Success Rate75 | 4 | 1mo ago | |
| Instruction Hierarchy (test) | Attack Success Rate (Realistic User)99.7 | 4 | 5mo ago |
