Share your thoughts, 1 month free Claude Pro on usSee more

Question Answering on HotpotQA (ASR variants and CR)

45EM

Non-attack

Updated 11d ago

Evaluation Results

Method	Links
Non-attack 2026.04		45	-	-	-	93.2
Non-attack 2026.04		44.4	-	-	-	92.2
JailAgent 2026.04		44.4	43.8	40.8	39.2	91.8
Non-attack 2026.04		42.2	-	-	-	91.4
JailAgent 2026.04		42.2	42.4	37.2	37.6	91
JailAgent 2026.04		41.8	36.4	35.4	33.2	89.4
Non-attack 2026.04		41.8	-	-	-	89.8
Non-attack 2026.04		41.4	-	-	-	89.2
JailAgent 2026.04		41.2	36.2	33.2	33	90.6
AgentPoison 2026.04		38.4	34.2	31.2	30.4	90.8
JailAgent 2026.04		37.8	38.8	35.6	36.6	90.2
AgentPoison 2026.04		36.8	38.2	34.4	34	85.8
AgentPoison 2026.04		35.4	33.4	30.2	30	83.8
BadChain 2026.04		34.8	37.4	33.6	32.2	81.2
BadChain 2026.04		34.8	35.6	33.2	33	85.6
AgentPoison 2026.04		34.4	36.6	33.2	31.2	85.6
BadChain 2026.04		33.4	30.2	26	25.8	83.4
AgentPoison 2026.04		33.4	35.2	31.4	31.8	86.2
Non-attack 2026.04		32	-	-	-	84.4
BadChain 2026.04		31.8	33.8	30.4	29.2	82.2
JailAgent 2026.04		31.4	34.8	35.6	33.2	83.6
PAIR 2026.04		30.4	30.2	27	26.2	78.8
BadChain 2026.04		29.8	30.8	27.6	27.2	81.6
BadChain 2026.04		29.6	30.6	27.8	26.6	81.4
AgentPoison 2026.04		29.4	30.2	27.4	27.2	80.6
PAIR 2026.04		28.4	22.4	19.8	19.2	73.2
PAIR 2026.04		28.4	29.2	24	24.2	79.2
Non-attack 2026.04		27.8	-	-	-	57.8
JailAgent 2026.04		27.2	33.2	31.2	30.6	55.6
PAIR 2026.04		26.6	27.6	23.2	23.5	75.6
PAIR 2026.04		26.4	23.2	22.4	22.2	77.4
PAIR 2026.04		25.8	21.8	19.2	18.6	80.8
AgentPoison 2026.04		23.8	29.6	26.4	26.2	50.8
BadChain 2026.04		21.8	27.8	26.2	25.6	45.6
PAIR 2026.04		20.8	19.6	12.8	12.8	44.8