Share your thoughts, 1 month free Claude Pro on usSee more

Social Interaction Question Answering on SIQA

86.9Accuracy

Human Performance

Updated 2d ago

Evaluation Results

Method	Links
Human Performance 2024.01		86.9
T5 2020.05		81.4
UNIFIEDQA 2020.05		81.4
LoRA-RITE 2026.03		80.25
Stable-LoRA 2026.03		80.25
DeBERTa-v3-L (Supervised) 2024.01		80.1
VERA-T5 (Multitask Supervised) 2024.01		80.1
LoRA+ 2026.03		79.94
AdamW 2026.03		79.89
Riemann 2026.03		79.89
RoBERTa 2020.05		78
Stable-LoRA 2026.03		77.64
LoRA+ 2026.03		77.38
AdamW 2026.03		77.33
LoRA-RITE 2026.03		77.23
Riemann 2026.03		76.87
ROBERTa-L (Supervised) 2024.01		76.6
BART-large 2020.05		74
UnifiedQA-BART 2020.05		73.2
Stable-LoRA 2026.03		72.26
AdamW 2026.03		71.7
LoRA-RITE 2026.03		71.6
LoRA+ 2026.03		71.19
ChatGPT + Chain-of-thought 2024.01		70.7
Riemann 2026.03		70.62
ChatGPT + Self-consistent chain-of-thought 2024.01		69.7
ChatGPT 2024.01		69.5
Stable-LoRA 2026.03		68.27
GPT-3.5 2024.01		68
LoRA+ 2026.03		67.91
AdamW 2026.03		67.04
Riemann 2026.03		66.94
LoRA-RITE 2026.03		66.89
ZS-Fusion 2024.01		66.7
DeBERTa-v3-L (CANDLE Distilled) 2024.01		65.9
CAR-ROBERTa-L 2024.01		64.8
Baseline 2025.05		64.8
STL-Adapter 2024.01		64.7
STL-Adapter 2024.01		64.4
CAR-ROBERTa-L 2024.01		64
CAR-DEBERTa-v3-L 2024.01		64
CAR-DEBERTa-v3-L 2024.01		63.8
STL-PLM 2024.01		63.2
ROBERTa-L (MR) 2024.01		63.2
ROBERTa-L (MR) 2024.01		63.1
DeBERTa-v3-L (MR) 2024.01		62.1
MTL 2024.01		61.9
SEED 2026.05		61.8
ROBERTa-L (MR) 2024.01		61
DeBERTa-v3-L (MR) 2024.01		59.7
VERA-T5-xxl (CANDLE Distilled) 2024.01		59.4
FULL 2026.05		59.4
Tensor RMS + C 2025.05		58.6
Task-specific FT 2026.02		58.39
VERA-T5-xxl 2024.01		58.2
VERA-T5-xxl 2024.01		58.1
TSV-M 2026.02		58.03
VERA-T5-xxl 2024.01		57.7
GPT-4 2024.01		57
TIES 2026.02		56.96
Task-specific FT 2026.02		56.81
MICO 2024.01		56
RANDOM 2026.05		55.6
OrthoMerge 2026.02		55.17
TSV-M 2026.02		55.02
ROBERTa-L (MR) 2024.01		54.8
ProQA 2023.05		54.5
TA 2026.02		54.15
DARE 2026.02		53.84
TIES 2026.02		53.74
ZS-Fusion 2024.01		53.7
Tensor RMS + Sp 2025.05		53.6
KoCo 2026.04		53.4
URL Prefix (MeCo) 2026.04		52.9
Standard CPT 2026.04		52.7
Muppet 2023.05		52.63
Data Selection 2026.04		52.6
OLTQA 2023.05		52.51
Hyperformer++ 2023.05		52.46
TA 2026.02		52.2
DARE 2026.02		52.1
MTL 2024.01		52
OLTQA 2023.05		51.76
OLTQA 2023.05		51.48
OLTQA 2023.05		51.23
OLTQA 2023.05		50.72
OLTQA 2023.05		50.67
OLTQA 2023.05		50.41
LLAMA2 2024.01		50.3
UnifiedQA 2023.05		50.15
COMET-DynGen 2024.01		50.1
OLTQA 2023.05		49.85
Distributed Lion-MaVo 2024.03		49.75
G-Lion 2024.03		49.64
OLTQA 2023.05		49.64
G-AdamW 2024.03		48.97
LLAMA2 2024.01		48.3
BASE 2026.05		48.3
Llama-3.1-8B 2026.02		48.11
Distributed Lion-Avg 2024.03		48.06

Showing 100 of 157 rows