RoxieBench is a benchmark suite for evaluating Roxie performance. RoxieBench is scalable to run in a distributed setting that supports multiple worker nodes. RoxieBench uses a centralized model, and is scalable to run in a distributed setting that supports multiple worker nodes. This benchmark tool is designed to evaluate the Roxie performance under diverse workloads, namely arrival patterns and query distribution types.

• Workload distribution workload.distribution defines the query key distribution for certain Roxie applications
• Selection of Roxie applications workload.select desines how the Roxie applicatoins are selected

Given a key space with size N for the query key and a distribution, we devide the cumulative distribution function (CDF) to N equal partitions. Each key is assigned to the partitions with a probability. Then we use random number generator (uniform distribution) to select keys (now they will be drawn with different probabilities). This process ensures the workload generation follows a defined distribution.

• Git
  • sudo yum install git-all
• Linux
  • sudo apt-get install sshpass ( for ssh key deploymeny on VCL)
  • sudo apt-get build-dep python3-lxml ( for the lxml library in pip)
• Python

  • Python 3

  • Pip 3

wget https://bootstrap.pypa.io/get-pip.py sudo python3 get-pip.py ```

• Virtualenv

sudo pip install virtualenv ```

• bash repo/install.sh
• source init.sh

1. Create a benchmark configuatino conf/benchmark.yaml
2. Deploy benchmark programs

benchmark deploy

1. Deploy benchmark configuration only (copy conf/benchmark.yaml to other nodes)

benchmark deploy_config

1. Install required packages

benchmark install_package

1. Control the benchmark service

benchmark service start|stop|restart|status

1. Submit workload (no benchmark results collected)

benchmark submit conf/workload_template.yaml

1. Get workload info

benchmark workload status|report|statistics wid

1. Run the benchmark

benchmark run conf/workload_template.yaml --hpcc_config ~/elastic-hpcc/template/elastic_4thor_8roxie_locality.xml -o results/test1