PII
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Query-Unrelated PII Masking | PII-Real | F1 Score83.8 | 30 | |
| Query-Related PII Detection | PII-multi | F1 Score84.6 | 30 | |
| Query-Unrelated PII Masking | PII-single and PII-multi | F1 Score82 | 30 | |
| Query-Related PII Detection | PII-single 1.0 (test) | F1 Score84 | 30 | |
| PII Recovery | PII dataset | ASR Recovery (Phone)42 | 9 | |
| PII Processing | PII 300k 4096 records | Failure Rate0 | 4 | |
| PII Processing | PII-300k 64 records | Failure Rate0 | 4 | |
| PII Extraction | PII-300k 4096 | Failure Rate (FR)0 | 4 | |
| PII Extraction | PII-300k PII-512 | FR0 | 4 | |
| PII Extraction | PII-300k PII-64 | Failure Rate0 | 4 | |
| Structural and Semantic Evaluation | PII-300k 4096 (evaluation) | Structural Score1 | 3 | |
| Structural and Semantic Evaluation | PII-300k 512 (eval) | Structural Score100 | 3 | |
| Structural and Semantic Evaluation | PII-300k PII-64 (evaluation) | Structural Score100 | 3 | |
| Personally Identifiable Information Processing | PII-300k 4096 records | Structural Score1 | 3 | |
| Personally Identifiable Information Processing | PII-300k 512 records | Structural Score1 | 3 | |
| Personally Identifiable Information Processing | PII-300k 64 records | Structural Score100 | 3 | |
| Named Entity Recognition | PII datasets minority classes | F1 Score53 | 1 | |
| Named Entity Recognition | PII datasets (overall) | F1 Score96 | 1 |
Showing 18 of 18 rows