Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Reasoning Faithfulness on US driving scenarios (held-out)
Loading...
64.8
Overall Consistency Score
Pinocchio (Ours)
23.096
33.923
44.75
55.577
Jul 6, 2026
Overall Consistency Score
Element 1 Consistency Score
Element 2 Consistency Score
Element 3 Consistency Score
Element 4 Consistency Score
Element 5 Consistency Score
Updated 19d ago
Evaluation Results
Method
Method
Links
Overall Consistency Score
Element 1 Consistency Score
Element 2 Consistency Score
Element 3 Consistency Score
Element 4 Consistency Score
Element 5 Consistency Score
Pinocchio (Ours)
Model=Ours
2026.07
64.8
74
88.8
97.7
83.5
73.2
VLM-Judge
Model=VLM-Judge
2026.07
62.4
81.9
92.1
98.4
81
68
ADE-Swap
Model=ADE-Swap
2026.07
48.9
60
78.3
96.7
76.7
62
ADE
Model=ADE
2026.07
47.4
56.5
75.5
96.1
75.8
62.5
SFT
Model=SFT
2026.07
31.8
50.5
71.1
96
64.2
46.6
ADE-Reason
Model=ADE-Reason
2026.07
24.7
51.9
72.1
96.3
46.5
36
Feedback
Search any
task
Search any
task