Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Generative Input: Towards Next-Generation Input Methods Paradigm

About

Since the release of ChatGPT, generative models have achieved tremendous success and become the de facto approach for various NLP tasks. However, its application in the field of input methods remains under-explored. Many neural network approaches have been applied to the construction of Chinese input method engines(IMEs).Previous research often assumed that the input pinyin was correct and focused on Pinyin-to-character(P2C) task, which significantly falls short of meeting users' demands. Moreover, previous research could not leverage user feedback to optimize the model and provide personalized results. In this study, we propose a novel Generative Input paradigm named GeneInput. It uses prompts to handle all input scenarios and other intelligent auxiliary input functions, optimizing the model with user feedback to deliver personalized results. The results demonstrate that we have achieved state-of-the-art performance for the first time in the Full-mode Key-sequence to Characters(FK2C) task. We propose a novel reward model training method that eliminates the need for additional manual annotations and the performance surpasses GPT-4 in tasks involving intelligent association and conversational assistance. Compared to traditional paradigms, GeneInput not only demonstrates superior performance but also exhibits enhanced robustness, scalability, and online learning capabilities.

Keyu Ding, Yongcan Wang, Zihang Xu, Zhenzhen Jia, Shijin Wang, Cong Liu, Enhong Chen• 2023

Related benchmarks

TaskDatasetResultRank
Pinyin-to-Chinese ConversionPD (test)
P@188.4
7
Pinyin-to-Chinese ConversionTP (test)
P@177
6
Full-mode K2CFK2C XF dataset 26-key (test)
P@184.6
5
Intelligent AssociationIntelAssoc (test)
MOS4.43
5
Conversational AssistanceConvAssist (test)
MOS4.52
4
Key-to-Chinese Conversion (K2C)XF Perfect Pinyin (test)
P@194.2
4
Key-to-Chinese Conversion (K2C)XF Abbreviated Pinyin (test)
P@10.67
4
Key-to-Chinese Conversion (K2C)XF Random Abbreviated Pinyin (test)
P@181.5
4
Key-to-Chinese Conversion (K2C)XF Pinyin with Noise (test)
P@175.2
4
Showing 9 of 9 rows

Other info

Follow for update