Item-side Fairness of Large Language Model-based Recommendation System
About
Recommendation systems for Web content distribution intricately connect to the information access and exposure opportunities for vulnerable populations. The emergence of Large Language Models-based Recommendation System (LRS) may introduce additional societal challenges to recommendation systems due to the inherent biases in Large Language Models (LLMs). From the perspective of item-side fairness, there remains a lack of comprehensive investigation into the item-side fairness of LRS given the unique characteristics of LRS compared to conventional recommendation systems. To bridge this gap, this study examines the property of LRS with respect to item-side fairness and reveals the influencing factors of both historical users' interactions and inherent semantic biases of LLMs, shedding light on the need to extend conventional item-side fairness methods for LRS. Towards this goal, we develop a concise and effective framework called IFairLRS to enhance the item-side fairness of an LRS. IFairLRS covers the main stages of building an LRS with specifically adapted strategies to calibrate the recommendations of LRS. We utilize IFairLRS to fine-tune LLaMA, a representative LLM, on \textit{MovieLens} and \textit{Steam} datasets, and observe significant item-side fairness improvements. The code can be found in https://github.com/JiangM-C/IFairLRS.git.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Sequential Recommendation | ML 1M | NDCG@100.0282 | 130 | |
| Recommendation | ML1M | NDCG@201.63 | 81 | |
| Generative Recommendation | ML OOD 10M | Hit Rate @1050 | 18 | |
| Sequential Recommendation | ML-1M Tail | NDCG@100.0136 | 10 | |
| Sequential Recommendation | Steam Tail | NDCG@103.91 | 10 | |
| Sequential Recommendation | ADM Tail | NDCG@100.85 | 10 | |
| Sequential Recommendation | ML-1M Head | NDCG@104.22 | 10 | |
| Sequential Recommendation | Steam Overall | NDCG@108.72 | 10 | |
| Sequential Recommendation | Steam Head | NDCG@1012.51 | 10 | |
| Sequential Recommendation | ADM Overall | NDCG@101.87 | 10 |