A Compare-Aggregate Model for Matching Text Sequences
About
Many NLP tasks including machine comprehension, answer selection and text entailment require the comparison between sequences. Matching the important units between sequences is a key to solve these problems. In this paper, we present a general "compare-aggregate" framework that performs word-level matching followed by aggregation using Convolutional Neural Networks. We particularly focus on the different comparison functions we can use to match two vectors. We use four different datasets to evaluate the model. We find that some simple comparison functions based on element-wise operations can work better than standard neural network and neural tensor network.
Shuohang Wang, Jing Jiang• 2016
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Natural Language Inference | SNLI (test) | Accuracy86.1 | 681 | |
| Answer Selection | WikiQA (test) | MAP0.7433 | 149 | |
| Multi-turn Response Selection | Ubuntu Dialogue Corpus V1 (test) | R10@163.1 | 102 | |
| Response Ranking | Ubuntu Dialog Corpus v1 (test) | Recall@1 (1/2)88.4 | 16 | |
| Multi-turn Response Selection | Ubuntu Dialogue Corpus V1 | Recall@1 (Pool 10)63.1 | 14 | |
| Multi-turn Response Selection | Ubuntu Dialogue Corpus V2 | Recall@1 (R2 Variant)89.5 | 13 | |
| Answer Selection | WikiQA (dev) | MAP74.3 | 12 | |
| Answer Ranking | Ubuntu v2 (test) | Recall@1 (1/2 Pool)89.5 | 11 | |
| Question Answering | MovieQA Plot Synopses 1.0 (test) | Accuracy72.9 | 7 | |
| Question Answering | MovieQA Plot Synopses 1.0 (val) | Accuracy72.1 | 6 |
Showing 10 of 10 rows