Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Agentic Feedback Loop Modeling Improves Recommendation and User Simulation

About

Large language model-based agents are increasingly applied in the recommendation field due to their extensive knowledge and strong planning capabilities. While prior research has primarily focused on enhancing either the recommendation agent or the user agent individually, the collaborative interaction between the two has often been overlooked. Towards this research gap, we propose a novel framework that emphasizes the feedback loop process to facilitate the collaboration between the recommendation agent and the user agent. Specifically, the recommendation agent refines its understanding of user preferences by analyzing the feedback from the user agent on the item recommendation. Conversely, the user agent further identifies potential user interests based on the items and recommendation reasons provided by the recommendation agent. This iterative process enhances the ability of both agents to infer user behaviors, enabling more effective item recommendations and more accurate user simulations. Extensive experiments on three datasets demonstrate the effectiveness of the agentic feedback loop: the agentic feedback loop yields an average improvement of 11.52% over the single recommendation agent and 21.12% over the single user agent. Furthermore, the results show that the agentic feedback loop does not exacerbate popularity or position bias, which are typically amplified by the real-world feedback loop, highlighting its robustness. The source code is available at https://github.com/Lanyu0303/AFL.

Shihao Cai, Jizhi Zhang, Keqin Bao, Chongming Gao, Qifan Wang, Fuli Feng, Xiangnan He• 2024

Related benchmarks

TaskDatasetResultRank
RecommendationCDs
NDCG@50.3908
29
RecommendationML-100K
NDCG@115
11
RecommendationClothings
NDCG@10.21
11
User behavior simulationCDs
Precision74.6
9
User behavior simulationClothings
Precision71.6
9
User behavior simulationML-100K
Precision68.83
9
Showing 6 of 6 rows

Other info

Follow for update