Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

AppWorld

Benchmarks

Task NameDataset NameSOTA ResultTrend
Task and Scenario Goal CompletionAppWorld normal (test)
Task Goal Completion91.2
37
Task goal completionAppWorld (test challenge)
Goal Completion Score32
35
Agent TaskAppWorld Normal (test)
TGC92.3
29
Agentic task solvingAppWorld
TGC90
28
Agentic TaskAppWorld C (test)
PR Score48.4
26
Agentic TaskAppWorld N (test)
PR Score57.1
26
Multi-turn tool-useAppWorld
Avg@463.6
25
Agentic Task CompletionAppWorld (test-normal)
Accuracy56.5
22
Agent TaskAppWorld Challenge (test)
Task Goal Completion (TGC)84.2
21
Agentic Tool-useAppWorld (Challenge)
TGC83.7
20
Agentic Tool-useAppWorld Normal
Task Goal Completion (TGC)89.3
20
Sub-Goal CompletionAppWorld 1.0 (test_challenge)
SGC95.4
19
Sub-Goal CompletionAppWorld 1.0 (test_normal)
Sub-Goal Completion Rate97.2
19
Tool-use agentic performanceAppWorld
Avg@464.88
19
Interactive environment task executionAppWorld normal (test)
Avg@8 Success4,554
15
Agentic Task CompletionAppWorld Challenge (test)
Task Goal Completion (TGC)49.88
13
Agentic Task CompletionAppWorld LeaderBoard
Greedy Success Rate48.8
13
Scenario-level policy synthesisAppWorld normal (test)
Task Goal Completion (TGC)98.2
12
Tool-callingAppWorld (test-normal)
Task Goal Completion (TGC)45.6
11
Agentic Task CompletionAppWorld normal Hard (test)
Accuracy39.7
11
Agentic Task CompletionAppWorld Easy normal (test)
Accuracy86
11
Interactive coding-centric agent tasksAppWorld
Success Rate22.6
10
App-based Task ExecutionAppWorld-Challenge
Task Goal Completion (TGC)52.8
10
App-based Task ExecutionAppWorld Normal
Task Goal Completion (TGC)71.4
10
Tool ShortlistingAppWorld v1.0 (test)
R-precision (AZ)0.71
9
Showing 25 of 54 rows