Skip to content

Crawler that pulls out threads and 1st level comments from multiple subreddits

Notifications You must be signed in to change notification settings

jonckr/reddit-web-crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 

Repository files navigation

Reddit Web Crawler

What it does?

  • Crawler that pulls out threads / 1st level comments
    • Subreddit name, Submission/Comment ID, Thread/Comment, Title, Author, Time, Upvote/Downvote Score, Content
  • Exports to CSV

Getting started:

  1. Edit client_id, client_secret, username, password, user_agent and limit.
  2. Run Jonckr Python Web Crawler.py.
  3. A csv file will be generated once crawling is done

About

Crawler that pulls out threads and 1st level comments from multiple subreddits

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages