Share your thoughts, 1 month free Claude Pro on usSee more

Tool-use performance on Tau-bench Retail (test)

66Pass Rate

gpt-4o-FC-JOSH-SFT

Updated 1mo ago

Evaluation Results

Method	Links
gpt-4o-FC-JOSH-SFT 2024.09		66
gpt-4o-FC 2024.09		65.21
gpt-4o-ACT-JOSH-SFT 2024.09		64.26
gpt-4o-ACT 2024.09		63.13
gpt-4o-ReACT-JOSH-SFT 2024.09		58.43
gpt-4o-mini-FC-JOSH-SFT 2024.09		58.26
gpt-4o-ReACT 2024.09		54.43
gpt-4o-mini-FC 2024.09		50.78
gpt-4o-mini-ACT-JOSH-SFT 2024.09		47.65
gpt-4o-mini-ACT 2024.09		44.6
gpt-4o-mini-ReACT-JOSH-SFT 2024.09		36.34
gpt-4o-mini-ReACT 2024.09		16.87