Skip to content

jamesbyars/coc-scrape-system

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Scrape For Fun

Demonstrate how to use queues and docker-compose to scrape websites across multiple "nodes"

Execution

Start up the infrastructure - building anything that hasn't been built already

docker-compose up --build

Data Visualization

Currently using Kibana to visualize data

localhost:5601

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages