Spiral HWY

Get to great art.

Installations

1. Node
2. Poetry
3. Chrome
4. Node modules: npm install
5. Poetry project: poetry install

Usage

Run scraper locally:

poetry run ./spiral_hwy/tools/cinema_scraper.py

Build the project:

npx eleventy

Host locally:

npx eleventy --serve

Serve Eleventy website (same as above):

poetry poe serve

Data Collection

Movie posters are saved directly to public/. The listings information is saved to spiral_hwy/_data/ to satisfy Eleventy templating file structure.

Testing

Unit tests are in tests/ and hold saved websites that are used to mock the websites and compare against the ground truth. This ensures changes to the web scraper will not break previous configurations.