Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

FedMark-FM: Auditable, Risk-Adjusted Data Markets for Federated Foundation-Model Adaptation

About

Federated foundation-model adaptation increasingly relies on heterogeneous private artifacts (retrieval corpora, prompts and demonstrations, LoRA adapters, preference and safety data, and update sketches), yet existing federated-learning incentive mechanisms price clients as homogeneous data or update providers. This assumption poorly matches foundation-model pipelines, where contribution value is heterogeneous, non-IID, pipeline-dependent, privacy-constrained, and vulnerable to strategic behavior. We propose FedMark-FM, an auditable, risk-adjusted data-market framework that models clients as sellers of typed artifacts, estimates marginal contribution with S3Val, a stratified, uncertainty-aware Shapley estimator supporting pipeline-ordered valuation, and converts lower-confidence-bound values into budget-feasible payments penalizing duplication, sybil splitting, poisoned adapters, privacy-budget gaming, and cost inflation. We evaluate FedMark-FM-Bench across FEVER retrieval, held-out generator-backed RAG, and trained PEFT/LoRA tracks. Under a held-out prompt-injection poisoner, FedMark-FM improves downstream accuracy by 7.5-8.1 points over volume, leave-one-out, and FL-Shapley while selecting zero strategic clients. Split-conformal calibration reaches full lower-bound coverage at mean width 0.0141, versus 0.33 for naive intervals. We prove pipeline-ordered valuation is the unique credit rule respecting serving causality, and show it materially changes credit assignment (Spearman 0.76, selected-set overlap 0.67) while leaving held-out task quality unchanged; the market preserves rare specialists with audit-ready ledgers at 200-1000-client scale. FedMark-FM shows incentives for federated foundation models can be engineered as auditable data infrastructure coupling valuation, mechanism design, privacy interfaces, and pipeline-order semantics.

Phat T. Tran-Truong, Xuan-Bach Le, Minh Nhat Nguyen• 2026

Related benchmarks

TaskDatasetResultRank
Downstream Task AccuracyFEVER card (test)
Accuracy (FEVER card)63.3
21
Data Valuation and Coalition SelectionFEVER market scale RAG track (test)
Quality90.56
9
Evidence RetrievalFEVER frozen 100-client instance (held-out)
Accuracy55
7
Retrieval-Augmented GenerationFEVER
Utility Score0.1321
7
Data Valuation in Federated LearningLarge FEVER Extended (val)
Utility17.92
5
LoRA TrainingTrained LoRA
Utility0.2555
4
RAG Claim VerificationFEVER held-out (test)
Accuracy39.37
4
Data Valuation in Federated LearningHF/PEFT LoRA (Extended val)--
2
Showing 8 of 8 rows

Other info

Follow for update