Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

HiCoLoRA: Addressing Context-Prompt Misalignment via Hierarchical Collaborative LoRA for Zero-Shot DST

About

Zero-shot Dialog State Tracking (zs-DST) is essential for enabling Task-Oriented Dialog Systems (TODs) to generalize to new domains without costly data annotation. A central challenge lies in the semantic misalignment between dynamic dialog contexts and static prompts, leading to inflexible cross-layer coordination, domain interference, and catastrophic forgetting. To tackle this, we propose Hierarchical Collaborative Low-Rank Adaptation (HiCoLoRA), a framework that enhances zero-shot slot inference through robust prompt alignment. It features a hierarchical LoRA architecture for dynamic layer-specific processing (combining lower-layer heuristic grouping and higher-layer full interaction), integrates Spectral Joint Domain-Slot Clustering to identify transferable associations (feeding an Adaptive Linear Fusion Mechanism), and employs Semantic-Enhanced SVD Initialization (SemSVD-Init) to preserve pre-trained knowledge. Experiments on multi-domain datasets MultiWOZ and SGD show that HiCoLoRA outperforms baselines, achieving SOTA in zs-DST. Code is available at https://github.com/carsonz/HiCoLoRA.

Shuyu Zhang, Yifan Wei, Xinru Wang, Yanmin Zhu, Yangfan He, Yixuan Weng, Bin Li, Yujie Liu• 2025

Related benchmarks

TaskDatasetResultRank
Dialogue State TrackingMultiWOZ 2.1 (test)--
105
Dialogue State TrackingSGD
JGA (Overall)55.01
24
Dialogue State TrackingMultiWOZ zero-shot 2.1
Attraction Accuracy38.86
11
Dialogue State TrackingSGD Messaging
JGA67.79
9
Dialogue State TrackingSGD (train)
JGA55.99
9
Dialogue State TrackingSGD Media
JGA76.2
7
Dialogue State TrackingSGD Flights
Joint Goal Accuracy (JGA)30.57
5
Dialogue State TrackingSGD Music
JGA35.46
5
Showing 8 of 8 rows

Other info

Follow for update