Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Extraction of Salient Sentences from Labelled Documents

About

We present a hierarchical convolutional document model with an architecture designed to support introspection of the document structure. Using this model, we show how to use visualisation techniques from the computer vision literature to identify and extract topic-relevant sentences. We also introduce a new scalable evaluation technique for automatic sentence extraction systems that avoids the need for time consuming human annotation of validation data.

Misha Denil, Alban Demiraj, Nando de Freitas• 2014

Related benchmarks

TaskDatasetResultRank
Text ClassificationIMDB (test)
CA84.83
81
Token Attribution FaithfulnessKnown 1000
Distance10.54
40
Token Attribution FaithfulnessSQuAD v2.0
Disagreement46.23
30
SimulabilityML-QE (test)
Pearson Correlation0.7141
21
Reading ComprehensionSQuAD v2.0
Disambiguation Score34.07
10
Sentiment AnalysisIMDB
Dis. Score82.65
10
Factual KnowledgeKnown 1000
Disagreement Rate12.58
10
Token Attribution FaithfulnessIMDB
Distance69.39
10
Plausibility AnalysisMLQE-PE v1 (test)
EN-DE src AUC0.58
8
Plausibility AnalysisMovieReviews (test)
AUC0.51
8
Showing 10 of 10 rows

Other info

Follow for update