ProtoBias
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Image-Text Alignment | ProtoBias Objects (300 human annotated samples) | SC Score1 | 7 | |
| Image-Text Alignment | ProtoBias Demography | SC75 | 7 | |
| Image-Text Alignment | ProtoBias Animals (300 human annotated samples) | SC Score0.89 | 7 | |
| Prototypicality Bias Evaluation | ProtoBias Objects | Correct Ranking Margin0.653 | 6 | |
| Prototypicality Bias Evaluation | ProtoBias Demography | Correct Ranking Margin0.515 | 6 | |
| Prototypicality Bias Evaluation | ProtoBias (Animals) | Correct Ranking Margin0.667 | 6 |
Showing 6 of 6 rows