Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

PromptGate Client Adaptive Vision Language Gating for Open Set Federated Active Learning

About

Deploying medical AI across resource-constrained institutions demands data-efficient learning pipelines that respect patient privacy. Federated Learning (FL) enables collaborative medical AI without centralising data, yet real-world clinical pools are inherently open-set, containing out-of-distribution (OOD) noise such as imaging artifacts and wrong modalities. Standard Active Learning (AL) query strategies mistake this noise for informative samples, wasting scarce annotation budgets. We propose PromptGate, a dynamic VLM-gated framework for Open-Set Federated AL that purifies unlabeled pools before querying. PromptGate introduces a federated Class-Specific Context Optimization: lightweight, learnable prompt vectors that adapt a frozen BiomedCLIP backbone to local clinical domains and aggregate globally via FedAvg -- without sharing patient data. As new annotations arrive, prompts progressively sharpen the ID/OOD boundary, turning the VLM into a dynamic gatekeeper that is strategy-agnostic: a plug-and-play pre-selection module enhancing any downstream AL strategy. Experiments on distributed dermatology and breast imaging benchmarks show that while static VLM prompting degrades to 50% ID purity, PromptGate maintains $>$95% purity with 98% OOD recall.

Adea Nesturi, David Due\~nas Gaviria, Jiajun Zeng, Shadi Albarqouni• 2026

Related benchmarks

TaskDatasetResultRank
Federated Open-Set Active LearningFedISIC R = 5 (test)
ID Purity99.5
42
Federated Open-Set Active LearningFedEMBED R = 10 (test)
ID Purity96
42
Showing 2 of 2 rows

Other info

Follow for update