Fisher信息引导的混合精度后训练量化算法
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:


Fisher Information-guided Mixed-precision Post-training Quantization Algorithm
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    随着深度神经网络在计算机视觉领域的广泛应用, 后训练量化已成为其在资源受限设备上高效部署的关键技术. 针对现有混合精度后训练量化方法在低比特量化时计算最优位宽耗时较长, 以及由于校准样本有限而导致测试精度下降的问题, 提出了一种基于Fisher信息引导的混合精度后训练量化算法. 首先从Kullback-Leibler散度出发, 使用Fisher信息矩阵的平均迹快速计算各层的量化敏感度, 并构建融合量化误差与敏感度的扰动代价矩阵, 使用整数线性规划求解最优位宽分配问题. 此外, 在后训练过程中提出一种特征分布泛化的逐块重建方法, 使用全精度模型批归一化层中的统计信息重构输入特征, 增加重建过程中特征分布的多样性, 同时结合随机均匀特征混合机制丰富量化误差, 缓解有限校准数据条件下的泛化能力不足问题. 在ImageNet数据集上对多种主流卷积神经网络架构的实验结果表明, 所提方法能够在较短时间内完成混合精度位宽搜索, 并有效提升低比特量化模型的准确率.

    Abstract:

    With the widespread adoption of deep neural networks (DNNs) in computer vision, post-training quantization has become a key technique for efficient deployment on resource-constrained devices. However, existing mixed-precision post-training quantization methods suffer from two major limitations: the long time required to compute optimal bit-width configurations for low-bit quantization, and the degradation in test accuracy caused by limited calibration samples. To address these issues, this study proposes a Fisher information-guided mixed-precision post-training quantization algorithm. Starting from the Kullback-Leibler divergence, the quantization sensitivity of each layer is efficiently estimated using the average trace of the Fisher information matrix, and a perturbation cost matrix that integrates quantization error and sensitivity is then constructed. The optimal bit-width allocation problem is then solved via integer linear programming. Furthermore, during post-training, a block-wise reconstruction method with feature distribution generalization is proposed, which uses the statistical information from batch normalization layers in the full-precision model to reconstruct input features, thus increasing the diversity of feature distributions during reconstruction. In addition, a random uniform feature-mixing mechanism is incorporated to diversify quantization errors, alleviating the insufficient generalization capability under limited calibration data. Experimental results on multiple mainstream convolutional neural network architectures on the ImageNet dataset demonstrate that the proposed method can complete mixed-precision bit-width search within a relatively short time and effectively improve the accuracy of low-bit quantized models.

    参考文献
    相似文献
    引证文献
引用本文

郝泽颖,王以桢,王彦哲,殷保群. Fisher信息引导的混合精度后训练量化算法.计算机系统应用,,():1-11

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2026-02-09
  • 最后修改日期:2026-03-02
  • 录用日期:
  • 在线发布日期: 2026-08-21
  • 出版日期:
文章二维码
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京市海淀区中关村南四街4号,邮政编码:100190
电话:010-62661041 传真: Email:csa@iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号