联合语义的深度学习行人检测
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

国家自然科学基金(61473330)


Deep Learning-Based Pedestrian Detection Combined with Semantics
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 增强出版
  • |
  • 文章评论
    摘要:

    视频行人检测是计算机视觉的一个重要应用,本文利用深度学习检测近似垂直视角的行人,但若单纯检测行人,易受与行人语义相关的行人附属属性(如背包和帽子)的干扰,容易造成误检.本文提出一种基于更快区域卷积神经网络的联合语义行人检测方法:首先调整网络模型,增强对小目标的辨别力,使其可以有效的检测行人和行人的语义属性;然后利用空间关系建立行人及其语义属性的关联,合并行人与其语义信息,并对候选行人目标进行自适应得分调整,结合行人语义属性判断候选行人目标.大量的实验表明,本文的方法精度高,速度快,具有实用价值,且检出的行人与其语义属性还可用于后续的人数统计和行人行为分析.

    Abstract:

    Pedestrian detection is an important application of computer vision. However, it mostly uses the methods of low-level features. Deep learning, by combining the low-level features of pedestrians, can get more abstract representation of high-level features which makes the detection more robust. In this study, we propose a Faster Region-based Convolutional Neural Networks (RCNN)-based pedestrian detection method in which semantics is jointly considered. Firstly, we modify and fine-tune the Faster RCNN for fitting in the pedestrian dataset and for making it more capable of detecting small objects. Secondly, we establish connections between the pedestrian and its semantic attributes by spatial relationship, then fuse the pedestrian and its semantic attributes, and meanwhile adaptively adjust the confidence of the target pedestrian. The adaptive adjustment strategy, based on the connections between the pedestrian and its semantic attributes, realizes the fusion of the individual information. Extensive experiments and comparison show that the proposed approach in this study is of high accuracy, acceptable speed, and practical value. What is more, the semantic attributes can be used to count people or analyze the pedestrian's behavior.

    参考文献
    相似文献
    引证文献
引用本文

邓炜,刘秉瀚.联合语义的深度学习行人检测.计算机系统应用,2018,27(6):165-170

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2017-09-15
  • 最后修改日期:2017-10-10
  • 录用日期:
  • 在线发布日期: 2018-05-29
  • 出版日期:
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京海淀区中关村南四街4号 中科院软件园区 7号楼305房间,邮政编码:100190
电话:010-62661041 传真: Email:csa (a) iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号