Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

NL2Bash

Benchmarks

Task NameDataset NameSOTA ResultTrend
Semantic ParsingNL2Bash
Accuracy45.19
14
Shell pipelines generationnl2bash
Strict Accuracy17.3
3
Code GenerationNL2Bash
Exact Match29.49
3
Natural Language to BashNL2Bash (test)
BLEU-4 (char)58.5
3
Showing 4 of 4 rows