Abstract
With the development of security technology, network security defense measures have become an important asset. How to extract and analyze data quickly and effectively through the existing threat intelligence data is a research hotspot at present. For massive security data such as open-source threat websites and blogs, we use the scrapy framework to design web crawlers to extract data, It can store the bottom data needed by knowledge map, and through the technology of crawler, it can int
爬虫系统分析与设计-11400字.docx