Skip to content

zhufree/SCP-Spider

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

38 Commits
 
 
 
 
 
 
 
 

Repository files navigation

SCP-Spider

SCP基金会的爬虫工具,主要用于app的数据更新 依赖scrapy进行抓取,主要步骤:

  • 抓取需要的页面和条目目录,写入数据库
  • 从数据库取到url批量抓取正文内容,写入数据库

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages