setup scrapy project defaults

This commit is contained in:
Xevion
2021-03-14 10:01:17 -05:00
parent 356813ed64
commit 1f6f3246ae
8 changed files with 235 additions and 0 deletions

View File

@@ -4,6 +4,8 @@ A simple Scrapy project to crawl Thesaurus.com generally.
## Setup
Clone the repository and install project dependencies with pipenv.
```
git clone git@github.com:Xevion/thesaurus-scraper.git
pipenv install
@@ -11,6 +13,8 @@ pipenv install
## Run
Run the project inside the `scraper` directory with the `scrapy` project command.
```
cd scraper
scrapy