xevion/thesaurus-scraper
1
0
Fork 0
mirror of https://github.com/Xevion/thesaurus-scraper.git synced 2025-12-05 21:16:32 -06:00
Code Issues Packages Projects Releases Wiki Activity
5 Commits 1 Branch 0 Tags
master
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Xevion a3fb052dba Working basic spider crawler 
TODO: Item generation, data export, option to use WordVariant synonym/antonyms instead of full crawl
2021-03-14 11:18:20 -05:00
scraper
Working basic spider crawler
2021-03-14 11:18:20 -05:00
.gitignore
project init
2021-03-14 09:35:39 -05:00
Pipfile
project init
2021-03-14 09:35:39 -05:00
README.md
setup scrapy project defaults
2021-03-14 10:01:17 -05:00
scrapy.cfg
setup scrapy project defaults
2021-03-14 10:01:17 -05:00

README.md

thesaurus-scraper

A simple Scrapy project to crawl Thesaurus.com generally.

Setup

Clone the repository and install project dependencies with pipenv.

git clone git@github.com:Xevion/thesaurus-scraper.git
pipenv install

Run

Run the project inside the scraper directory with the scrapy project command.

cd scraper
scrapy
Reference in New Issue View Git Blame Copy Permalink
Description
No description provided
Readme 122 KiB
Languages
Python 100%