#repo_scraper

Check your projects for possible password (or other sensitive data) leaks.

##Example

Check your dummy-project:

check-folder dummy-project

Output:

Checking folder dummy-project...

dummy-project/python_file_with_password.py
ALERT - MATCH ["password = 'qwerty'"]

dummy-project/dangerous_file.json
ALERT - MATCH ['"password": "super-secret-password"']

##How does it work?

##Installation

    pip install git+git://github.com/dssg/repo-scraper.git

##Dependencies

• glob2
• python-magic
• nose (for running tests)

##Usage

    cd path/to/your/project
    check-folder

See help for more options available:

    check-folder --help

###Using a IGNORE file

Just as with git, you can specify a file to make the program ignore some files/folders. This is specially useful when you have folder with many log files that you are sure do not have sensitive data.

Adding a IGNORE file will make execution faster, since many regular expressions are matched against all files that have certain characteristics.

##What's done

• Passwords (using regex). See test_password_check.py

##What's missing

• IPs
• URLs
• Check other branches apart from master

#TODO

• Make magic-python dependency optional
• Better installation guide
• Come up with a cool name