Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Scaling Human and G2P Supervision for Robust Phonetic Transcription

About

Expert phonetic annotation is costly, especially for non-standard dialects and atypical speech. A common alternative is using Grapheme-to-Phoneme (G2P) models to auto-generate phonetic labels from text transcripts at scale. We study how automatic phonetic transcription performance scales with human and G2P supervision in English. Using a curated 80-hour benchmark spanning native, non-native and post-stroke speech, we identify a supervision quality threshold: G2P supervision helps only when fewer than 20-30 hours of human annotation are available. Beyond this threshold, it provides no significant benefit and can reduce cross-dialect robustness. What is effective after this threshold is ASR pretraining which we use to achieve a 2.3x reduction in weighted phone feature error rate over prior systems, with strong gains on non-native and aphasic speech. These results suggest that quantity-driven G2P scaling may yield diminishing returns for robust generalization.

Alexander Metzger, Aruna Srivastava, Ruslan Mukhamedvaleev• 2026

Related benchmarks

TaskDatasetResultRank
Phone recognitionTIMIT (test)--
23
Phone TranscriptionEpaDB (test)
WPFER2.5
9
Phone TranscriptionPSST (test)
WPFER5.3
9
Phone TranscriptionAggregate (TIMIT, EpaDB, PSST, Speech Ocean, ISLE) (test)
Average WPFER3.5
9
Phone TranscriptionSpeech Ocean (test)
WPFER3.7
9
Phone TranscriptionISLE (test)
WPFER3.6
9
Showing 6 of 6 rows

Other info

Follow for update