Share your thoughts, 1 month free Claude Pro on usSee more

Travel planning on TravelPlanner (val)

100Delivery Rate

MIRROR

Updated 1mo ago

Evaluation Results

Method	Links
MIRROR 2026.04		100	73.2	13.9	27.6	13.3	2.2
Human-Like 2026.04		100	75.1	15.6	15.5	4.4	2.2
ToT 2026.04		100	75.8	16.7	44	21.1	3.9
Lats 2026.04		100	78.3	16.7	44.8	21.1	3.9
One-shot 2026.04		100	76.4	17.2	43.3	20.6	3.9
EvoAgent* 2026.04		100	76.25	15.1	38.57	28.42	4.44
HiAR-ICL 2026.04		100	81.2	20.6	47.4	22.8	6.7
RAP 2026.04		100	81	20.6	50.5	25.6	6.7
Optimizing 2026.04		100	84.93	27.22	61.19	42.78	12.78
FAFT 2026.04		100	89.1	59.4	49.8	21.7	13.9
HTP 2026.04		100	87.2	37.8	44.3	32.2	20
LLM-Modulo 2026.04		100	89.2	40.6	62.1	39.4	20.6
Behavior Forest 2026.04		100	98.4	94.44	90	91.67	91.67
Cot* 2026.04		100	63.33	0	0	0	0
Direct* 2026.04		100	63.26	2.22	2.62	3.33	0.56
EvoAgent* 2026.04		100	84.58	35	58.81	62.22	43.33
DPPM 2026.04		100	98.5	89.4	90.7	80.6	76.7
Behavior Forest 2026.04		100	99.44	96.11	93.81	94.44	94.44
Greedy Search 2026.06		100	-	-	-	-	0
DICE 2026.06		100	-	-	-	-	7.2
DICE-FT 2026.06		100	-	-	-	-	5.6
Direct 2026.06		100	-	-	-	-	4.4
Direct 2026.06		100	-	-	-	-	6.1
MA-FT 2026.06		100	-	-	-	-	9.1
DICE-PC 2026.06		100	-	-	-	-	12.9
DICE-PC 2026.06		100	-	-	-	-	8.9
DICE-FT 2026.06		100	-	-	-	-	10.6
NarrativeGuide 2026.04		99.4	94.3	63.9	64	43.3	34.4
MA-Debate 2026.06		99.4	-	-	-	-	10.1
DICE-PC 2026.06		98.3	-	-	-	-	3.9
Debate 2026.06		97.7	-	-	-	-	6.7
PMC* 2026.04		97.33	86.11	49.44	49.76	50	30
MA-FT 2026.06		97.2	-	-	-	-	3.1
MA-Debate 2026.06		96.7	-	-	-	-	3.8
Debate 2026.06		95.2	-	-	-	-	2.3
GPT-o3 2026.06		92.8	-	-	-	-	1.4
llm-rwplanning* 2026.04		90	90	90	85.95	85	85
GPT-4-Turbo 2026.06		89.4	-	-	-	-	0.6
Co-Gym 2026.04		85.3	-	-	-	-	-
ReAct* 2026.04		85	53.4	2.78	2.14	2.78	1.11
ReAct* 2026.04		85	70.07	18.89	47.86	33.89	6.67
Reflection* 2026.04		76.11	63.05	16.11	32.38	22.22	5.56
RLP 2026.04		-	95.3	68.9	62.6	39.4	25