Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

CaliCausalRank: Calibrated Multi-Objective Ad Ranking with Robust Counterfactual Utility Optimization

About

Ad ranking systems must simultaneously optimize multiple objectives including click-through rate (CTR), conversion rate (CVR), revenue, and user experience metrics. However, production systems face critical challenges: score scale inconsistency across traffic segments undermines threshold transferability, and position bias in click logs causes offline-online metric discrepancies. We propose CaliCausalRank, a unified framework that integrates training-time scale calibration, constraint-based multi-objective optimization, and robust counterfactual utility estimation. Our approach treats score calibration as a first-class training objective rather than post-hoc processing, employs Lagrangian relaxation for constraint satisfaction, and utilizes variance-reduced counterfactual estimators for reliable offline evaluation. Experiments on the Criteo and Avazu datasets demonstrate that CaliCausalRank achieves 1.1% relative AUC improvement, 31.6% calibration error reduction, and 3.2% utility gain compared to the best baseline (PairRank) while maintaining consistent performance across different traffic segments.

Xikai Yang, Sebastian Sun, Yilin Li, Yue Xing, Ming Wang, Yang Wang• 2026

Related benchmarks

TaskDatasetResultRank
Click-Through Rate PredictionAvazu (test)
AUC0.7934
191
Ad RankingCriteo (test)
AUC0.7842
6
Showing 2 of 2 rows

Other info

Follow for update