Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Textual Question Answering on bAbI English 10k (test)
Loading...
0
Failed Tasks Count (Error > 5%)
QRN
-0.12
0.69
1.5
2.31
Mar 4, 2016
Mar 21, 2016
Apr 7, 2016
Apr 24, 2016
May 11, 2016
May 28, 2016
Jun 14, 2016
Failed Tasks Count (Error > 5%)
Task 2: 2 Supporting Facts
Task 3: 3 Supporting Facts
Task 5: 3 Argument Relations
Task 6: Yes/No Questions
Task 7: Counting
Task 8: Lists/Sets
Task 9: Simple Negation
Task 11: Basic Coreference
Task 14: Time Reasoning
Task 16: Basic Induction
Task 17: Positional Reasoning
Task 18: Size Reasoning
Task 19: Path Finding
Mean Error Rate
Updated 2d ago
Evaluation Results
Method
Method
Links
Failed Tasks Count (Error > 5%)
Task 2: 2 Supporting Facts
Task 3: 3 Supporting Facts
Task 5: 3 Argument Relations
Task 6: Yes/No Questions
Task 7: Counting
Task 8: Lists/Sets
Task 9: Simple Negation
Task 11: Basic Coreference
Task 14: Time Reasoning
Task 16: Basic Induction
Task 17: Positional Reasoning
Task 18: Size Reasoning
Task 19: Path Finding
Mean Error Rate
QRN
layers=6, reset gate=t...
2016.06
0
-
-
-
-
-
-
-
-
-
-
-
-
-
0.3
DMN+
2016.06
1
-
-
-
-
-
-
-
-
-
-
-
-
-
2.8
DMN+
2016.03
1
0.3
1.1
0.5
0
2.4
0
0
0
0.2
45.3
4.2
2.1
0
2.8
DNC
2016.06
2
-
-
-
-
-
-
-
-
-
-
-
-
-
3.8
N2N
2016.06
3
-
-
-
-
-
-
-
-
-
-
-
-
-
4.2
GMemN2N
2016.06
3
-
-
-
-
-
-
-
-
-
-
-
-
-
3.7
E2E
2016.03
3
0.3
2.1
0.8
0.1
2
0.9
0.3
0.1
0.1
51.8
18.6
5.3
2.3
4.2
NR
2016.03
-
-
-
-
-
-
-
-
-
-
-
0.9
-
1.6
-
Feedback
Search any
task
Search any
task
