Skip to content

vishalbelsare/snapworld

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Snapworld++

Improved Distributed Graph Processing

System Requirements

  • Python 2.6.6

  • Ruby 1.8.7 (with Rake)

  • gnuplot (To prevent snap from printing spurious error messages)
  • swig (For snap-python)
  • nodejs (For running the broker)

Installing

Below are the steps to install Snapworld.

1.  Setup your SSH keys for GitHub, instructions can be found here:
    https://help.github.com/articles/generating-ssh-keys
2. % mkdir hanworks; cd hanworks
    In your workspace create a directory called hanworks and change dir. 
3. % git clone git@github.com:snap-stanford/snapworld.git
    Clone the snapworld repository.
4. % cd snapworld; rake setup
    This only needs to be run on initial setup, it pulls the other
    necessary repositiories, and builds the project.

Running

Below are the steps to install and run Snapworld.

1.  In the snapworld directory open the Rakefile and change HOST_N to
    the number of machines you want to use. This number is a total and 
    includes the master and supervisors, ex. HOST_N=5
2.  In the snapworld directory open the snapw.config and configure
    the parameters for your test. Specifically make sure to modify the
    hosts list to only include the machines you want to use. Also set the
    other parameters (nodes, range, stat_tasks, gen_tasks, drange).
3. % rake test
    In the snapworld directory kickoff the test with rake test.

Stopping

To stop a job type do the following.

1. % rake cleanup
    This command will kill all of the processes running on all of the
  machines.

Metrics

To view metrics graphs associated with a given run, log into iln01 and run rake yperf[PATH_TO_MASTER_LOG]

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 87.7%
  • Shell 8.8%
  • Ruby 2.0%
  • JavaScript 1.5%