Skip to content

markrcote/Bugzilla-ETL

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

36 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Bugzilla-ETL

Python version of Metric's Bugzilla ETL (https://github.com/mozilla-metrics/bugzilla_etl)

Motivation and Details

https://wiki.mozilla.org/Auto-tools/Projects/PublicES

Installation

Clone from Github:

git clone https://github.com/klahnakoski/Bugzilla-ETL.git

Install requirements:

pip install -r requirements.txt

This code is based on a copy of my pyLibrary. It has further instructions for getting Python, and it's modules, running on Windows: https://github.com/klahnakoski/pyLibrary/blob/master/README.md

Setup

You will also require:

  • A MySQL/Maria database with Mozilla's Bugzilla schema (old public version can be found here)
  • An ElasticSearch cluster to hold the bug version documents
  • A settings.json file to connect everything together

The JSON file of settings must be provided as an argument in the command line (see example command line script). Examples of settings files can be found in ./resources/settings

Releases

No releases published

Packages

No packages published

Languages

  • Python 68.2%
  • JavaScript 29.0%
  • Java 2.6%
  • Shell 0.2%