Skip to content

vladimirkroupa/DTU-course-mining

Repository files navigation

Course prerequisites visualization

Running the scraper to fill the DB:

./fill_database.sh

Running the scraper to fill the DB:

python run.py --help

Running unit tests:

from the project root dir:

python -m unittest discover

List of libraries to install:

  • python-scrapy
  • mock
  • PyHamcrest

Complete list of dependencies:

  • Markdown==2.3.1
  • MarkupSafe==0.18
  • PyHamcrest==1.8.0
  • SQLAlchemy==0.8.3
  • Scrapy==0.20.0
  • Twisted==13.2.0
  • argparse==1.2.1
  • coverage==3.7
  • cssselect==0.9.1
  • distribute==0.7.3
  • lxml==3.2.4
  • mock==1.0.1
  • pdoc==0.1.8
  • pyOpenSSL==0.13.1
  • pydot==1.0.28
  • pyparsing==2.0.1
  • queuelib==1.1.1
  • schedule==0.2.0
  • six==1.4.1
  • w3lib==1.5
  • wsgiref==0.1.2
  • zope.interface==4.0.5

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages