Our new X account is live! Follow @wizwand_team for updates

Semantic Consistency on Consistency evaluation suite N=720 (test)

0.583Semantic Consistency Score

Claude-3.5-Haiku

Updated 4d ago

Evaluation Results

Method	Links
Claude-3.5-Haiku 2025.11		0.583
Claude-3.7-Sonnet 2025.11		0.565
Claude-3.7-Sonnet 2025.11		0.547
Claude-3.5-Haiku 2025.11		0.537
Claude-3.5-Sonnet-V2 2025.11		0.535
Claude-3.7-Sonnet 2025.11		0.535
Claude-3.7-Sonnet 2025.11		0.508
Claude-3.7-Sonnet 2025.11		0.498
Claude-3.5-Sonnet-V2 2025.11		0.481
Claude-3.7-Sonnet 2025.11		0.476
Claude-3.5-Sonnet-V2 2025.11		0.464
Claude-3.5-Sonnet-V2 2025.11		0.464
Claude-3.5-Sonnet-V2 2025.11		0.463
Claude-3.7-Sonnet 2025.11		0.462
Claude-3-Haiku 2025.11		0.456
Claude-3.7-Sonnet 2025.11		0.454
Claude-3.5-Sonnet-V2 2025.11		0.45
Claude-3.5-Haiku 2025.11		0.443
Claude-3.5-Sonnet-V2 2025.11		0.432
Claude-3.5-Haiku 2025.11		0.427
Claude-3.5-Haiku 2025.11		0.424
Claude-3.5-Sonnet-V2 2025.11		0.423
Claude-3.5-Sonnet-V2 2025.11		0.416
Claude-3.7-Sonnet 2025.11		0.414
Claude-3-Haiku 2025.11		0.406
Nova-Pro 2025.11		0.404
Claude-3-Haiku 2025.11		0.402
Llama-3.3-70B 2025.11		0.39
Llama-3.3-70B 2025.11		0.387
Claude-3.5-Haiku 2025.11		0.38
Nova-Pro 2025.11		0.377
Claude-3.5-Haiku 2025.11		0.354
Nova-Pro 2025.11		0.354
Nova-Pro 2025.11		0.348
Nova-Pro 2025.11		0.342
Claude-3.5-Haiku 2025.11		0.339
Nova-Pro 2025.11		0.338
Claude-3-Haiku 2025.11		0.337
Claude-3-Haiku 2025.11		0.336
Llama-3.3-70B 2025.11		0.326
Claude-3.5-Haiku 2025.11		0.319
Nova-Pro 2025.11		0.314
Nova-Pro 2025.11		0.3
Llama-3.3-70B 2025.11		0.292
Claude-3-Haiku 2025.11		0.283
Nova-Pro 2025.11		0.283
Claude-3-Haiku 2025.11		0.279
Claude-3-Haiku 2025.11		0.264
Claude-3-Haiku 2025.11		0.263
Llama-3.3-70B 2025.11		0.263
Llama-3.3-70B 2025.11		0.257
Llama-3.3-70B 2025.11		0.246
Llama-3.3-70B 2025.11		0.222
Llama-3.3-70B 2025.11		0.215