FedMark-FM: Auditable, Risk-Adjusted Data Markets for Federated Foundation-Model Adaptation
About
Federated foundation-model adaptation increasingly relies on heterogeneous private artifacts (retrieval corpora, prompts and demonstrations, LoRA adapters, preference and safety data, and update sketches), yet existing federated-learning incentive mechanisms price clients as homogeneous data or update providers. This assumption poorly matches foundation-model pipelines, where contribution value is heterogeneous, non-IID, pipeline-dependent, privacy-constrained, and vulnerable to strategic behavior. We propose FedMark-FM, an auditable, risk-adjusted data-market framework that models clients as sellers of typed artifacts, estimates marginal contribution with S3Val, a stratified, uncertainty-aware Shapley estimator supporting pipeline-ordered valuation, and converts lower-confidence-bound values into budget-feasible payments penalizing duplication, sybil splitting, poisoned adapters, privacy-budget gaming, and cost inflation. We evaluate FedMark-FM-Bench across FEVER retrieval, held-out generator-backed RAG, and trained PEFT/LoRA tracks. Under a held-out prompt-injection poisoner, FedMark-FM improves downstream accuracy by 7.5-8.1 points over volume, leave-one-out, and FL-Shapley while selecting zero strategic clients. Split-conformal calibration reaches full lower-bound coverage at mean width 0.0141, versus 0.33 for naive intervals. We prove pipeline-ordered valuation is the unique credit rule respecting serving causality, and show it materially changes credit assignment (Spearman 0.76, selected-set overlap 0.67) while leaving held-out task quality unchanged; the market preserves rare specialists with audit-ready ledgers at 200-1000-client scale. FedMark-FM shows incentives for federated foundation models can be engineered as auditable data infrastructure coupling valuation, mechanism design, privacy interfaces, and pipeline-order semantics.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Downstream Task Accuracy | FEVER card (test) | Accuracy (FEVER card)63.3 | 21 | |
| Data Valuation and Coalition Selection | FEVER market scale RAG track (test) | Quality90.56 | 9 | |
| Evidence Retrieval | FEVER frozen 100-client instance (held-out) | Accuracy55 | 7 | |
| Retrieval-Augmented Generation | FEVER | Utility Score0.1321 | 7 | |
| Data Valuation in Federated Learning | Large FEVER Extended (val) | Utility17.92 | 5 | |
| LoRA Training | Trained LoRA | Utility0.2555 | 4 | |
| RAG Claim Verification | FEVER held-out (test) | Accuracy39.37 | 4 | |
| Data Valuation in Federated Learning | HF/PEFT LoRA (Extended val) | -- | 2 |