Our new X account is live! Follow @wizwand_team for updates

Performance prediction on Sentiment categories (out-of-domain)

0.822ROC AUC

Cosine distance (fine-tuned)

Updated 4d ago

Evaluation Results

Method	Links
Cosine distance (fine-tuned) 2023.05		0.822	81.9
Vocabulary, structural, semantic drift 2023.05		0.601	52.4
Semantic drift 2023.05		0.591	58.4
Structural drift 2023.05		0.575	91.4
Vocabulary drift 2023.05		0.57	51.8
Cosine distance (pre-trained) 2023.05		0.558	93.6
Combined prev. model-agnostic 2023.05		0.557	70.3
Token frequency cross-entropy 2023.05		0.551	71.4
Token frequency JS-div 2023.05		0.517	98.4
Baseline (no-performance drop) 2023.05		0.5	100