本文已被:浏览 93次 下载 75次
Received:October 13, 2025 Revised:November 03, 2025
Received:October 13, 2025 Revised:November 03, 2025
中文摘要: 联邦学习在保护用户数据隐私方面具有巨大潜力, 而差分隐私为其提供了严格的隐私保障. 然而, 在非独立同分布(Non-IID)场景下, 差分隐私引入的噪声与数据异质性相互作用, 常导致模型性能显著下降. 现有方法多采用统一隐私策略, 忽略客户端间异质性差异, 难以兼顾隐私与效用. 为此, 本文提出一种面向异质性的自适应差分隐私联邦学习(HA-DPFL)方法. 该算法以Jensen-Shannon (JS)散度量化客户端与全局的数据异质性, 并据此设计双重自适应机制: (1)依据全局异质性调整客户端采样率, 以适应不同分布特征; (2)为每个客户端分配与其个体异质性匹配的个性化梯度裁剪阈值, 从而在保障隐私的同时减轻性能损失. 在MNIST和CIFAR-10数据集的多种Non-IID设置下, 实验结果表明, HA-DPFL在提供同等差分隐私保护的前提下, 显著提升了模型准确率, 实现了更优的隐私-效用权衡.
Abstract:Federated learning (FL) offers significant potential for preserving user data privacy, and differential privacy (DP) provides rigorous privacy guarantees. However, under non-independent and identically distributed (Non-IID) settings, the interaction between DP-induced noise and data heterogeneity often leads to substantial model performance degradation. Existing approaches typically employ uniform privacy strategies, neglecting heterogeneity differences among clients and failing to balance privacy protection with model utility effectively. To address this limitation, a heterogeneity-oriented adaptive differentially private federated learning (HA-DPFL) method is proposed. This method quantifies both client-level and global data heterogeneity using Jensen-Shannon (JS) divergence and introduces a dual adaptive mechanism: (1) the client sampling rate is adjusted according to global heterogeneity to accommodate varying distribution characteristics; (2) a personalized gradient clipping threshold is assigned to each client based on its individual heterogeneity, thereby reducing performance degradation while maintaining privacy guarantees. Experimental results on MNIST and CIFAR-10 datasets under various Non-IID settings demonstrate that HA-DPFL significantly improves model accuracy and achieves a better privacy-utility trade-off under equivalent DP guarantees.
keywords: federated learning (FL) differential privacy (DP) heterogeneity adaptive mechanism clipping threshold
文章编号: 中图分类号: 文献标志码:
基金项目:上海市青年科技英才扬帆计划 (20YF1414400)
引用文本:
卞欣雨,胡小明,王安保,白双杰.面向异质性的自适应差分隐私联邦学习方法.计算机系统应用,2026,35(5):74-83
BIAN Xin-Yu,HU Xiao-Ming,WANG An-Bao,BAI Shuang-Jie.Heterogeneity-oriented Adaptive Differential Privacy Federated Learning Method.COMPUTER SYSTEMS APPLICATIONS,2026,35(5):74-83
卞欣雨,胡小明,王安保,白双杰.面向异质性的自适应差分隐私联邦学习方法.计算机系统应用,2026,35(5):74-83
BIAN Xin-Yu,HU Xiao-Ming,WANG An-Bao,BAI Shuang-Jie.Heterogeneity-oriented Adaptive Differential Privacy Federated Learning Method.COMPUTER SYSTEMS APPLICATIONS,2026,35(5):74-83

