HEX-PHI
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Safety Evaluation | HEx-PHI | HEx-PHI Score97.2 | 162 | |
| Safety Evaluation | HEx-PHI | Attack Success Rate (ASR)1.8 | 107 | |
| Attack Success Rate | HEx-PHI | Attack Success Rate0 | 63 | |
| Safety Evaluation | HEX-PHI (test) | Harmfulness Score (Llama-Guard-3B)2 | 56 | |
| Safety Evaluation | HEx-PHI (out-of-domain) | ASR (OM)0 | 26 | |
| Malicious Fine-tuning Attack | HEx-PHI | Attack Success Rate (ASR)95.1 | 24 | |
| Safety Evaluation | HEx-PHI Alpaca risk-ranked subsets | S1 ASR (%)13.1 | 21 | |
| Safety Evaluation | HEx-PHI Dolly risk-ranked | S1 ASR8.97 | 21 | |
| Backdoor Poisoning Attack | HEx-PHI (150 questions) | ASR (No Trigger)18.94 | 20 | |
| Identity Shifting Attack | HEx-PHI Identity Shifting Attack (300 questions) | ASR22.83 | 20 | |
| Safety Alignment Evaluation | HEx-PHI | Harmful Response Rate0.7 | 18 | |
| Safety Alignment | HEx-PHI | HEx-PHI Score98.8 | 18 | |
| Safety Evaluation | HEx-PHI | Harmfulness Score2.06 | 16 | |
| Jailbreak Attack | HEX-PHI | ASR54.9 | 16 | |
| Jailbreak Defense | HEX-PHI | Harmful Score1.74 | 16 | |
| Safety Evaluation | HEx-PHI | Harm Score1.26 | 15 | |
| Prosocial Alignment | HEx-PHI (test) | MIP76.3 | 14 | |
| Jailbreak Attack Success Rate | HEx-PHI (test) | ASR Category 186.67 | 12 | |
| Safety Evaluation | HEx-PHI | Safety Score (HEx-PHI)69.87 | 10 | |
| Safety Evaluation | HEx-PHI | Accuracy99.06 | 9 | |
| Adversarial Safety Evaluation | HEx-PHI (first 100 harmful prompts) | ASR45 | 8 | |
| Safety Evaluation | HEx-PHI Direct | Safety Score (1-ASR)99.67 | 8 | |
| Prefill Attack | HEx-PHI Harmful | Attack Success Rate95.76 | 6 | |
| Harmfulness Evaluation | HEx-PHI | Harmfulness Score1.26 | 6 | |
| Adversarial Attack | HEx-PHI out | Attack Success Rate (OM)67.29 | 6 |
Showing 25 of 28 rows