###
计算机系统应用英文版:2016,25(10):173-179
本文二维码信息
码上扫一扫!
面向主题的社交网络采集技术
(中国科学院 信息工程研究所, 北京 100093)
Topic Focused Crawling Technique on Social Network
(Institution of Information Engineering, Chinese Acadamic of Sciences, Beijing 100093, China)
摘要
图/表
参考文献
相似文献
本文已被:浏览 1124次   下载 1507
Received:January 28, 2016    Revised:April 29, 2016
中文摘要: 社交网络数据采集是开展社交网络分析的基础.针对当前面向主题的社交网络数据采集技术采集数据少、召回率低的问题,本文提出基于内置搜索引擎和基于通用搜索引擎相结合的主题消息采集方法,并将LDA(Latent Dirichlet Allocation,隐含狄利克雷分布)模型应用于主题关键词的迭代扩展,并提出了一种基于用户生存值的高效扩展策略.实验结果表明本文提出的方法可以使面向主题的社交网络数据采集系统在保证一定准确率的情况下进一步获取主题相关数据.
Abstract:Social network data is the basis of social network analysis that is why it's important to collect such data. To solve the problem of less collected data and low recall rate in current focused crawlers on social network, this paper proposes a method combining the based built-in search engine and general search engines to crawl topic messages, as well as applys the LDA model to extract the topic keywords from collected data iteratively and adds new topic keywords to the seed. Besides, an efficient expansion strategy based on users survival value is discussed. Our experiment shows that the methods proposed can improve the recall rate with a high precision.
文章编号:     中图分类号:    文献标志码:
基金项目:国家科技支撑计划(2012BAH46B03)
引用文本:
郑楷坚,沙灜.面向主题的社交网络采集技术.计算机系统应用,2016,25(10):173-179
ZHENG Kai-Jian,SHA Ying.Topic Focused Crawling Technique on Social Network.COMPUTER SYSTEMS APPLICATIONS,2016,25(10):173-179