###
计算机系统应用英文版:2017,26(6):112-117
本文二维码信息
码上扫一扫!
众核与Spark结合的高速流量监测系统
(重庆邮电大学 电子信息与网络工程研究院, 重庆 400065)
High-Speed Traffic Monitoring System Based on Many-Core and Spark
(Electronic Information and Networking Research Institute, Chongqing University of Posts and Telecommunications, Chongqing 400065, China)
摘要
图/表
参考文献
相似文献
本文已被:浏览 2486次   下载 2843
Received:November 22, 2016    Revised:January 04, 2017
中文摘要: 互联网应用的广泛普及导致了互联网流量的高速增长,这给网络运营商运营带来了巨大挑战,传统的流量监测系统的性能和可扩展性已经无法满足运营商的需求.本文尝试将众核技术与Spark相结合,基于校园网流量,提出了众核与Spark结合的高速流量监测系统.其中,众核处理器负责高速的流量采集、处理以及流量日志生成;Spark平台负责存储流量日志数据,并对其进行高速并行分析;Web Server负责数据的可视化.本文以校园网DNS流量为监测对象充分验证了该方案的可行性与扩展性.
中文关键词: 众核  Spark  DNS  流量监测系统
Abstract:Popularity of Internet applications has led to the rapid growth of Internet traffic, which brings great challenges for Network operators, and the performance and scalability of traditional flow monitor system cannot meet the needs of operators. Based on the campus network traffic monitoring, this paper attempts to combine many-core technology with Spark, and presents a high-speed traffic monitor system. Many-core processor part is responsible for high-speed traffic collection, processing and log generation; Spark platform handles the distributed storage of large amounts of log data and its high-speed parallel processing. Web Server is used for data visualization. The DNS traffic of the campus network is taken as the object of monitoring, which verifies the feasibility and extensibility of the system.
文章编号:     中图分类号:    文献标志码:
基金项目:重庆市基础科学与前沿技术研究重点项目(cstc2015jcyjB0415);重庆市科技创新领军人才计划支持项目(CSTCKJCXLJRC20)
引用文本:
周小宇,雒江涛,罗林,唐刚.众核与Spark结合的高速流量监测系统.计算机系统应用,2017,26(6):112-117
ZHOU Xiao-Yu,LUO Jiang-Tao,LUO Lin,TANG Gang.High-Speed Traffic Monitoring System Based on Many-Core and Spark.COMPUTER SYSTEMS APPLICATIONS,2017,26(6):112-117