本文已被:浏览 271次 下载 1701次
Received:April 09, 2025 Revised:May 07, 2025
Received:April 09, 2025 Revised:May 07, 2025
中文摘要: 现实场景中采集的数据往往存在着噪声和偏差的问题, 为了保证训练模型的性能, 必须判断出数据的好坏并做出筛选, 然而数据清洗阶段并不能完全筛选出所有低价值的数据. 已有工作通过留一法或沙普利值来评估数据的重要性, 然而留一法被证明是不稳定的, 沙普利值方法的计算复杂度过高. 为了解决可用性和时间效率平衡的问题, 提出了一种优化梯度值的数据价值评估方法, 实现比沙普利值更快地计算所有数据点的价值. 实验结果表明, 优化梯度的评估方法能够有效识别错误标签和噪声数据, 删除低价值的数据也能帮助模型提升预测准确率.
Abstract:In real-world scenarios, the data collected often contains noise and biases. To ensure the performance of model training, it is essential to assess the quality of the data and perform appropriate selection. However, the data cleaning process cannot fully eliminate all low-value data points. Existing approaches, such as leave-one-out (LOO) and Shapley values, have been used to assess the importance of data. However, the LOO method has been shown to be unstable, while the computational complexity of the Shapley value method is excessively high. To balance usability with computational efficiency, this study proposes a gradient-based data value evaluation method, which computes the value of all data points more quickly than the Shapley value method. Experimental results demonstrate that the optimized gradient evaluation method effectively identifies mislabeled and noisy data, and the removal of low-value data points significantly improves the model’s predictive accuracy.
文章编号: 中图分类号: 文献标志码:
基金项目:
引用文本:
何宇辰,曾凡平.监督学习下数据价值评估方法的应用.计算机系统应用,2025,34(11):253-261
HE Yu-Chen,ZENG Fan-Ping.Application of Data Value Evaluation Method in Supervised Learning.COMPUTER SYSTEMS APPLICATIONS,2025,34(11):253-261
何宇辰,曾凡平.监督学习下数据价值评估方法的应用.计算机系统应用,2025,34(11):253-261
HE Yu-Chen,ZENG Fan-Ping.Application of Data Value Evaluation Method in Supervised Learning.COMPUTER SYSTEMS APPLICATIONS,2025,34(11):253-261

