Our new X account is live! Follow @wizwand_team for updates

Performance prediction on MNLI source domains (out-of-domain)

0.683ROC AUC

Cosine distance (fine-tuned)

Updated 4d ago

Evaluation Results

Method	Links
Cosine distance (fine-tuned) 2023.05		0.683	141.9
Structural drift 2023.05		0.531	80.6
Vocabulary, structural, semantic drift 2023.05		0.531	81
Semantic drift 2023.05		0.521	79.1
Combined prev. model-agnostic 2023.05		0.514	99.8
Token frequency cross-entropy 2023.05		0.512	96.8
Cosine distance (pre-trained) 2023.05		0.508	107.5
Token frequency JS-div 2023.05		0.503	118.8
Baseline (no-performance drop) 2023.05		0.5	100
Vocabulary drift 2023.05		0.5	81.5