Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

MeetingBank

Benchmarks

Task NameDataset NameSOTA ResultTrend
Prompt CompressionMeetingBank (test)
BLEU Score21.5
26
SummarizationMeetingBank
ROUGE-L54.1
22
SummarizationMeetingBank
BERTScore F90.8
18
Abstractive SummarizationMeetingBank (test)
ROUGE-L F-score54.1
18
Binary Fact-checkingMeetingBank
Macro-F187.6
14
Latency EvaluationMeetingBank
Latency (s)0.4
13
SummarizationMeetingBank in-domain (test)
ROUGE-148.64
10
Continual LearningMeetingBank
Average Accuracy35.9
9
Question AnsweringMeetingBank (test)
QA Score76.22
5
Question AnsweringMeetingBank in-domain (test)
EM87.75
5
Showing 10 of 10 rows