SAP
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Psychometric Predictive Power | SAP ROI | MVRR14.1 | 38 | |
| Automatic Speech Recognition | SAP rated (test) | WER13.38 | 19 | |
| Syntactic Surprisal Update Measurement (KL-divergence) | SAP All (full) | MVRR38.5 | 19 | |
| Psychometric Predictive Power | SAP All | MVRR11.7 | 19 | |
| Human Reading Time Prediction | SAP Region of Interest | MVRR8.8 | 19 | |
| Human Reading Time Prediction | SAP All sentences | MVRR33.7 | 19 | |
| Prompt Injection Attack Evaluation | SAP10 | Attack Success Percentage (ASP)99.4 | 14 | |
| Document-level Machine Translation | SAP ID → EN | d-BLEU57.2 | 12 | |
| Document-level Machine Translation | SAP VI → ZH | d-BLEU43.8 | 12 | |
| Document-level Machine Translation | SAP VI → EN | d-BLEU57.2 | 12 | |
| Document-level Machine Translation | SAP EN → ID | d-BLEU58.2 | 12 | |
| Document-level Machine Translation | SAP EN → ZH | d-BLEU45.1 | 12 | |
| Document-level Machine Translation | SAP EN → VI | d-BLEU67.3 | 12 | |
| Dysarthric speech severity assessment | SAP In-domain (test) | SRCC0.726 | 10 | |
| Text-to-Speech | SAP Dysarthric | WER10.39 | 5 | |
| Automatic Speech Recognition | SAP Overall (test-1) | WER (%)5.3 | 5 | |
| Speech Recognition | SAP 5-fold CV (test) | WER6.59 | 4 | |
| Automatic Speech Recognition | SAP Overall 2 (test) | WER8.1 | 3 |
Showing 18 of 18 rows