Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Personality-Guided Code Generation Using Large Language Models

About

Code generation, the automatic creation of source code from natural language descriptions, has garnered significant attention due to its potential to streamline software development. Inspired by research that links task-personality alignment with improved development outcomes, we conduct an empirical study on personality-guided code generation using large language models (LLMs). Specifically, we investigate how emulating personality traits appropriate to the coding tasks affects LLM performance. We extensively evaluate this approach using seven widely adopted LLMs across four representative datasets. Our results show that personality guidance significantly enhances code generation accuracy, with improved pass rates in 23 out of 28 LLM-dataset combinations. Notably, in 11 cases, the improvement exceeds 5%, and in 5 instances, it surpasses 10%, with the highest gain reaching 12.9%. Additionally, personality guidance can be easily integrated with other prompting strategies to further boost performance. We open-source our code and data at https://github.com/IanWalls/Persona-Code.

Yaoqi Guo, Zhenpeng Chen, Jie M. Zhang, Yang Liu, Yun Ma• 2024

Related benchmarks

TaskDatasetResultRank
Code GenerationHumanEval+
Pass@184.8
189
Code GenerationAPPS
Pass@146.2
69
Code GenerationMBPP Sanitized
Accuracy85.7
51
Code GenerationMBPP+
Pass Rate72.7
24
Code GenerationMBPP Sanitized (test)
Pass@184.3
10
Showing 5 of 5 rows

Other info

Follow for update