This is the ASTRA-sim DNN training simulator.

The full description of the tool and its strength could be found in the paper below:

Saeed Rashidi, Srinivas Sridharan, Sudarshan Srinivasan, and Tushar Krishna, "ASTRA-SIM: Enabling SW/HW Co-Design Exploration for Distributed DL Training Platforms" In Proc of the IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), Apr 2020 [pdf].

Bibtex

@inproceedings{astrasim,
    author       = {Saeed Rashidi and
                   Srinivas Sridharan and
                   Sudarshan Srinivasan and
                   Tushar Krishna},
    title        = {{ASTRA-SIM: Enabling SW/HW Co-Design Exploration for Distributed DL Training Platforms}},
    booktitle     = {{IEEE} International Symposium on Performance Analysis of Systems 
                    and Software, {ISPASS} 2020, Boston, MA, USA, August 22-26, 2020},
  publisher     = {{IEEE}},
  year          = {2020},
}

1. Go to gem5/ directory
2. Run: "./my_scripts/build_Garnet_standalone.sh" to build it
3. Go to runs/ directory
4. Run: "./sampleDLRM_a2a.sh runName" where runName is an arbitrary name you choose for this specific run
5. After sim finish, go to ../results/runName-a2a directory, the detailed and EndToEnd csv files for this run are stored there (times are in microseconds in the csv files)

NOTE: you can use "./sampleDLRM_torus.sh runName" for step 5 instead. the a2a simulates on a sample physical alltoall topology while torus simulates on top of a physical 3D torus.

NOTE: The on-screen reported delays after the end of simulation are in cycles while the delays inside the csv files are in terms of microSeconds.

• Workload: workload/workload_inputs/
  • see workload_inputs/README.md
• System: system/system_inputs/
  • see system_inputs/README.md
• Network: gem5/network_inputs/
  • see network_inputs/README.md

Please email Saeed Rashidi (saeed.rashidi@gatech.edu) if you have any questions.