Skip to content

This repository store some example to learn scrapy better

License

Notifications You must be signed in to change notification settings

vvchd/scrapy_example

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

#Overview

This repository store some example to learn scrapy better, which include tutorial, zhihu, cnbeta, xiaobaihe, douban, coursera

#Requirements

  • Python: 2.7.8
  • Scrapy: 0.24
  • System: Mac OS X 10.10.1

#Install

$ git clone [email protected]:Andrew-liu/scrapy_example.git

#Usage

You can use the six scrapy simply, just to do below:

$ cd zhuhu  #into some one scarpy
$ scrapy crwal zhihu  #xiaobaihe or tutorial or cnbeta or xiaobaihe, coursera

If you want to store the result into the format of json, just to do :

$ scrapy crwal zhihu -o filename.json  

#More Detail

#License

Copyright (c) 2014 Andrew Liu

Licensed under the MIT License

About

This repository store some example to learn scrapy better

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 73.7%
  • HTML 26.3%