Get data from smiles.com.ar and save it to future analyze.
- Pipeline -> Airflow
- Database -> PostgreSQL
- Web crawler -> Pyppeteer
-
Clone the repo
-
Install docker and docker-compose
docker-compose up -d
-
open web browser on localhost:8080
Docker image and docker-compose from puckel Modify to install Pyppeteer package