Skip to content

dataPhysicist/iops

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

25 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

----------------------------------------
        Author: Nate McKervey
        Version/Date: 0.3 12/26/2013


What this app does:
----------------------------------------
This will measure the IOPS (input output operations per second of random seeks) on the specified locations. A bonnie++ or iozone test will give you minimum disk performance metrics. This application is designed to measure actual performance of the indexes. Because of this, it is possible you will hit cache instead of raw disk and the IOPS will be high. If you are running as root, adding a raw device to the lookups/iops_manual_file_list.csv will reduce cache hits. Also, fresh installs of Splunk will be less accurate since there will not be much data to test against. 


Installation
----------------------------------------
1. Untar to the $SPLUNK_HOME/etc/apps directory.
2. A list of files to monitor will be generated within 20 minutes (see savedsearches.conf). By default, only the _internal and main indexes will be monitored. To add more copy default/macros.conf to local/macros.conf and add additional indexes. 
3. You can manually set a files or raw devices to be monitored by adding them to lookups/iops_manual_file_list.csv
3. Restart splunk
4. If you have a distributed environment then install the iops app or TA-iops on the indexers as well. Don't forget to update the lookups/iops_manual_file_list.csv on them as well. 
5. Wait an hour and navigate to the "IOPS" app in the app dropdown of the search head.


Good to know
----------------------------------------
This application is designed to work on existing environments. Fresh installs will only have hot buckets which means this application will not have anything to test against by default.

Monitoring the raw device should eliminate the cache hits. On unix you can git a list of the raw devices by running "df | awk '{ print $1 }' | grep dev" from the command line. 

A custom command is included called "iops" that will let you test a specific file or raw device from the search web interface or from the search command line.

        Usage: | iops -n <number of threads> -t <seconds to run> <full path of file or device>
        Example: | iops -n 5 -t 1 /var/log/messages

About

Measures random seek iops on disk for use in Splunk

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages