Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfer
About
Style transfer is the task of automatically transforming a piece of text in one particular style into another. A major barrier to progress in this field has been a lack of training and evaluation datasets, as well as benchmarks and automatic metrics. In this work, we create the largest corpus for a particular stylistic transfer (formality) and show that techniques from the machine translation community can serve as strong baselines for future work. We also discuss challenges of using automatic metrics.
Sudha Rao, Joel Tetreault• 2018
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Formality Style Transfer | GYAFC Entertainment & Music 1.0 (test) | BLEURT-0.1 | 15 | |
| Formality Style Transfer | GYAFC Family & Relationships 1.0 (test) | BLEU0.477 | 15 | |
| Formality Style Transfer | GYAFC Entertainment & Music (test) | BLEU68.41 | 10 | |
| Formality Style Transfer | GYAFC Family & Relationships (test) | BLEU74.22 | 10 | |
| Formality Style Transfer | GYAFC E&M (test) | BLEU72.01 | 7 | |
| Formality Style Transfer | GYAFC F&R (test) | BLEU75.67 | 7 |
Showing 6 of 6 rows