###
计算机系统应用英文版:2020,29(7):264-267
本文二维码信息
码上扫一扫!
系统日志故障预测中的ELK与LSTM应用与实践
(1.北京市首都公路发展集团有限公司, 北京 100161;2.北京云星宇交通科技股份有限公司, 北京 100078)
Application and Practice of ELK and LSTM in System Log Fault Prediction
(1.Beijing Capital Highway Development Group Co. Ltd., Beijing 100161, China;2.Beijing Yunxingyu Traffic Technology Co. Ltd., Beijing 100078, China)
摘要
图/表
参考文献
相似文献
本文已被:浏览 1376次   下载 2223
Received:December 05, 2019    Revised:January 14, 2020
中文摘要: 随着业务系统规模不断扩大, 系统结构也变得十分复杂, 常规基于规则的方法已经很难判断多个系统相互作用下的复合型故障, 也难以对潜在故障进行预测. 本文在多业务系统的复杂场景下, 使用ELK平台对日志进行集中化管理, 梳理出复杂系统环境下日志与各业务系统、主机、进程之间的关系, 筛选出系统中直接与故障相关的日志文件, 进而在深度学习框架TensorFlow中使用这些海量数据对LSTM算法模型进行训练, 从而实现对系统的实时故障预测.
中文关键词: ELK  LSTM  故障预测  深度学习  TensorFlow
Abstract:As the scale of systems continues to expand, the system structure also becomes very complex. The rule-based methods have been difficult to judge the composite faults under the interaction of multiple systems, and it is also hard to predict potential faults. Firstly, the study uses the ELK platform for centralized management of logs in complex scenarios of multi-business systems. Then, it sorts out the relationship between logs and various business systems, hosts, and processes in a complex system environment. Finally, we filter out the log files related to the failure in the system, and use these data in the deep learning framework TensorFlow to train the LSTM algorithm model, so as to realize the real-time fault prediction of the system.
文章编号:     中图分类号:    文献标志码:
基金项目:
引用文本:
徐志斌,叶晗,王晗,郜义浩.系统日志故障预测中的ELK与LSTM应用与实践.计算机系统应用,2020,29(7):264-267
XU Zhi-Bin,YE Han,WANG Han,GAO Yi-Hao.Application and Practice of ELK and LSTM in System Log Fault Prediction.COMPUTER SYSTEMS APPLICATIONS,2020,29(7):264-267