Share your thoughts, 1 month free Claude Pro on usSee more

Question Answering on StrategyQA (ASR & EM/CR)

85.59Exact Match (EM)

Non-attack

Updated 11d ago

Evaluation Results

Method	Links
Non-attack 2026.04		85.59	-	-	-	96.94
AgentPoison 2026.04		83.41	67.25	62.88	61.57	93.45
JailAgent 2026.04		82.97	74.67	72.05	72.49	94.32
Non-attack 2026.04		81.66	-	-	-	93.89
Non-attack 2026.04		81.22	-	-	-	90.83
PAIR 2026.04		81.22	58.08	53.71	52.4	86.03
Non-attack 2026.04		80.79	-	-	-	89.96
JailAgent 2026.04		80.79	70.31	67.69	66.81	90.83
JailAgent 2026.04		80.35	73.8	65.07	62.88	90.39
JailAgent 2026.04		79.91	72.05	67.25	65.94	89.52
AgentPoison 2026.04		79.6	66.81	62.45	61.13	91.7
AgentPoison 2026.04		78.6	69.87	58.95	55.9	86.9
BadChain 2026.04		78.17	60.7	59.83	55.46	88.65
BadChain 2026.04		76.42	62.88	54.59	52.4	83.84
AgentPoison 2026.04		75.55	63.32	55.02	53.71	88.21
BadChain 2026.04		74.67	62.88	61.14	58.52	87.34
PAIR 2026.04		74.24	58.95	49.78	45.85	82.97
BadChain 2026.04		72.93	56.33	52.4	48.91	83.84
PAIR 2026.04		71.61	55.9	49.34	48.47	79.91
JailAgent 2026.04		69.87	69.43	61.14	60.7	83.84
PAIR 2026.04		69.87	52.4	48.03	48.47	86.9
Non-attack 2026.04		69.43	-	-	-	85.15
Non-attack 2026.04		68.56	-	-	-	85.59
JailAgent 2026.04		67.69	54.59	51.52	48.91	83.41
AgentPoison 2026.04		65.94	65.5	56.77	55.9	77.73
AgentPoison 2026.04		65.5	54.15	51.09	47.16	79.04
BadChain 2026.04		63.32	49.78	46.72	44.54	78.6
PAIR 2026.04		62.45	43.67	44.1	42.36	74.24
PAIR 2026.04		59.39	54.59	48.47	42.79	74.24
Non-attack 2026.04		58.95	-	-	-	66.81
JailAgent 2026.04		58.95	57.64	58.95	56.33	65.94
BadChain 2026.04		50.66	49.34	44.1	43.67	70.74
BadChain 2026.04		48.03	46.72	45.41	43.23	56.77
AgentPoison 2026.04		47.6	48.47	45.41	44.98	59.39
PAIR 2026.04		44.98	43.67	41.92	42.36	59.83