Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

A Compare-Aggregate Model for Matching Text Sequences

About

Many NLP tasks including machine comprehension, answer selection and text entailment require the comparison between sequences. Matching the important units between sequences is a key to solve these problems. In this paper, we present a general "compare-aggregate" framework that performs word-level matching followed by aggregation using Convolutional Neural Networks. We particularly focus on the different comparison functions we can use to match two vectors. We use four different datasets to evaluate the model. We find that some simple comparison functions based on element-wise operations can work better than standard neural network and neural tensor network.

Shuohang Wang, Jing Jiang• 2016

Related benchmarks

TaskDatasetResultRank
Natural Language InferenceSNLI (test)
Accuracy86.1
681
Answer SelectionWikiQA (test)
MAP0.7433
149
Multi-turn Response SelectionUbuntu Dialogue Corpus V1 (test)
R10@163.1
102
Response RankingUbuntu Dialog Corpus v1 (test)
Recall@1 (1/2)88.4
16
Multi-turn Response SelectionUbuntu Dialogue Corpus V1
Recall@1 (Pool 10)63.1
14
Multi-turn Response SelectionUbuntu Dialogue Corpus V2
Recall@1 (R2 Variant)89.5
13
Answer SelectionWikiQA (dev)
MAP74.3
12
Answer RankingUbuntu v2 (test)
Recall@1 (1/2 Pool)89.5
11
Question AnsweringMovieQA Plot Synopses 1.0 (test)
Accuracy72.9
7
Question AnsweringMovieQA Plot Synopses 1.0 (val)
Accuracy72.1
6
Showing 10 of 10 rows

Other info

Follow for update