Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfer

About

Style transfer is the task of automatically transforming a piece of text in one particular style into another. A major barrier to progress in this field has been a lack of training and evaluation datasets, as well as benchmarks and automatic metrics. In this work, we create the largest corpus for a particular stylistic transfer (formality) and show that techniques from the machine translation community can serve as strong baselines for future work. We also discuss challenges of using automatic metrics.

Sudha Rao, Joel Tetreault• 2018

Related benchmarks

TaskDatasetResultRank
Formality Style TransferGYAFC Entertainment & Music 1.0 (test)
BLEURT-0.1
15
Formality Style TransferGYAFC Family & Relationships 1.0 (test)
BLEU0.477
15
Formality Style TransferGYAFC Entertainment & Music (test)
BLEU68.41
10
Formality Style TransferGYAFC Family & Relationships (test)
BLEU74.22
10
Formality Style TransferGYAFC E&M (test)
BLEU72.01
7
Formality Style TransferGYAFC F&R (test)
BLEU75.67
7
Showing 6 of 6 rows

Other info

Follow for update