Skip to content

Latest commit

 

History

History
32 lines (25 loc) · 670 Bytes

README.md

File metadata and controls

32 lines (25 loc) · 670 Bytes
Raw

Slant Scraper

Scrapes info from www.slant.co Only for educational purposes. Use at own risk, it might violate Slant policies.

  • Versus. A comparison of two techs.
  • Options. A detailed description of a particular option.
  • Topics. A comparison of different topics.

Dependencies

Install:

Tested configuration

  • Python 3.6.4 + Scrapy 1.5

Usage - Have fun!

cd slant-scraper/

Scrape and save data in JSON lines format:

scrapy crawl main -o output/result.json

For JSON format use:

scrapy crawl main -o output/result.json -t json