Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Warden Alert

Benchmarks

Task NameDataset NameSOTA ResultTrend
Complex query answeringWarden Alert Inductive, 33% qualifier coverage
MR (Mean Rank)1.78
16
Knowledge Graph CompletionWarden Alert Transductive
MR589.8
16
Knowledge Graph CompletionWarden Alert (Inductive)
MR2,532.5
16
Complex query answeringWarden Alert Transductive 100% qualifier coverage
MR18.725
8
Complex query answeringWarden Alert Transductive, 66% qualifier coverage
Mean Rank (MR)22.145
8
Complex query answeringWarden Alert (Transductive, 33% qualifier coverage)
Mean Rank (MR)6.75
8
Complex query answeringWarden Alert Inductive 100% qualifier coverage
Mean Rank (MR)18.727
8
Complex query answeringWarden Alert Inductive 66% qualifier coverage
Mean Rank (MR)28.05
8
Showing 8 of 8 rows