Skip to content

arroway/jira-crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 

Repository files navigation

jira-crawler

JIRA crawler for very specific purpose

  • Uses scrapy to get the list of projects from Apache and Codehaus JIRA servers.
  • Generates the content of a hash with the key and the name of each project.

Dependencies

This is a scrapy project.

Running

To run the two spider scripts:

$ cd jira-crawler/jira
$ scrapy crawl apacheJira
$ scrapy crawl codehausJira

It should generate the files apacheJira.txt and codehausJira.txt.

About

basic crawler for very specific purpose with scrapy

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages