Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

ParlAI: A Dialog Research Software Platform

About

We introduce ParlAI (pronounced "par-lay"), an open-source software platform for dialog research implemented in Python, available at http://parl.ai. Its goal is to provide a unified framework for sharing, training and testing of dialog models, integration of Amazon Mechanical Turk for data collection, human evaluation, and online/reinforcement learning; and a repository of machine learning models for comparing with others' models, and improving upon existing architectures. Over 20 tasks are supported in the first release, including popular datasets such as SQuAD, bAbI tasks, MCTest, WikiQA, QACNN, QADailyMail, CBT, bAbI Dialog, Ubuntu, OpenSubtitles and VQA. Several models are integrated, including neural models such as memory networks, seq2seq and attentive LSTMs.

Alexander H. Miller, Will Feng, Adam Fisch, Jiasen Lu, Dhruv Batra, Antoine Bordes, Devi Parikh, Jason Weston• 2017

Related benchmarks

TaskDatasetResultRank
Dialogue Policy EvaluationPersonaChat (test)
USR RET72.5
10
Dialogue Policy EvaluationDailyDialog (test)
USR MLM40.9
8
Dialogue Policy EvaluationEmpathetic Dialogues (test)
USR MLM0.384
8
Showing 3 of 3 rows

Other info

Follow for update