Introduction.

cms-bot started as a single script used to drive PR approval and grew to be the core of the whole release engineering process for CMSSW.

Setup

To have it working you'll need a ~/.github-token which can access the cms-sw organization.

Release integration

process-pull-request: this is the script which updates the status of a CMSSW PR. It parses all the messages associated to the specified PR and if it spots a transition (e.g. a L2 signature) it posts a message acknowledging what happended, updates the tags etc. The state of the PR is fully obtained by parsing all the comments, so that we do not have to maintain our own state tracking DB.

watchers.yaml: contains all the information required by process-pull-requests to notify developers when a PR touches the packages they watch.

Release building

process-build-release-request
release-build: script used to build a release which has been requested through a Github issue.
upload-release: script used to upload a release to the repository. When the job processing build requests spots a request to upload, it SSH to the build machine which has the release and executes this script.
config.map: semicolon separated key=value pairs formatted file with release queue related information. Each line represent a release queue. In particular CMSDIST_TAG is used to point to the CMSDIST tag to be used by the release building process.

Logging

Logging happens at many different level but we are trying to unify things using Elasticsearch for "live" data from which we dump precomputed views on a basis.

es-templates: contains the templates for the logged dataes-templates.
es-cleanup-indexes: cleanups old indexes in elasticsearch.

Name		Name	Last commit message	Last commit date
Latest commit History 6,500 Commits
DMWM		DMWM
batch-relvals		batch-relvals
comparisons		comparisons
das-utils		das-utils
es-kibana-dashboards		es-kibana-dashboards
es-templates		es-templates
jenkins-jobs/git		jenkins-jobs/git
jenkins		jenkins
jobs		jobs
lizard-processing		lizard-processing
lxr		lxr
openstack/hg		openstack/hg
repos		repos
rv_scheduler		rv_scheduler
stitched		stitched
templates		templates
tests		tests
.gitignore		.gitignore
.travis.yml		.travis.yml
FAQ.md		FAQ.md
IBPageHead.txt		IBPageHead.txt
IBPageTail.txt		IBPageTail.txt
README.md		README.md
RelValArgs.py		RelValArgs.py
add-externals-gh-labels.py		add-externals-gh-labels.py
auto-create-pull-requests		auto-create-pull-requests
auto-update-git-branches		auto-update-git-branches
autoInstall.sh		autoInstall.sh
autoInstallLogs.sh		autoInstallLogs.sh
backport-pr.py		backport-pr.py
build-cmssw-ib-with-patch		build-cmssw-ib-with-patch
build-fwlite-ib		build-fwlite-ib
build-node-stats		build-node-stats
build-release		build-release
build-release-watchers.yaml		build-release-watchers.yaml
buildLogAnalyzer.py		buildLogAnalyzer.py
buildSetTest.py		buildSetTest.py
build_hosts.txt		build_hosts.txt
cache-pull-request.py		cache-pull-request.py
categories.py		categories.py
categories_map.py		categories_map.py
category-watchers.yaml		category-watchers.yaml
checkDirSizes.py		checkDirSizes.py
checkLibDeps.py		checkLibDeps.py
checkLogFile.py		checkLogFile.py
checkPyConfigs.py		checkPyConfigs.py
checkTestLog.py		checkTestLog.py
cleanup-auto-build		cleanup-auto-build
cleanup-cmssdt		cleanup-cmssdt
cleanup-tags		cleanup-tags
cms-externals-pr-test		cms-externals-pr-test
cms-filename-checks.py		cms-filename-checks.py
cms-jenkins-api		cms-jenkins-api
cms_static.py		cms_static.py
cmsdist-comp-pr-process.py		cmsdist-comp-pr-process.py
cmsdist-tool-update.sh		cmsdist-tool-update.sh
cmsdist_merge_permissions.py		cmsdist_merge_permissions.py
cmssw-pr-test-config		cmssw-pr-test-config
cmssw_known_errors.py		cmssw_known_errors.py
cmsutils.py		cmsutils.py
comment-gh-pr		comment-gh-pr
compare-material-budget		compare-material-budget
config-disabled.map		config-disabled.map
config.map		config.map
create-gh-issue.py		create-gh-issue.py
create-gh-pr.py		create-gh-pr.py
create-gh-release.py		create-gh-release.py
create-github-hooks		create-github-hooks
cvmfsInstall.sh		cvmfsInstall.sh
cvmfsdirtab		cvmfsdirtab
deprecate-releases		deprecate-releases
deprecate_releases.py		deprecate_releases.py
docker_launcher.sh		docker_launcher.sh
es-cleanup-indexes		es-cleanup-indexes
es-reindex		es-reindex
es_cmsdoxygen_apache.py		es_cmsdoxygen_apache.py
es_cmsrep_apache.py		es_cmsrep_apache.py
es_cmssdt_apache.py		es_cmssdt_apache.py
es_doxygen_apache.py		es_doxygen_apache.py
es_hypernews.py		es_hypernews.py
es_hypernews_log.py		es_hypernews_log.py
es_ib_build_stats.py		es_ib_build_stats.py
es_ibs_log.py		es_ibs_log.py
es_iwyu_logs.py		es_iwyu_logs.py
es_relval_log.py		es_relval_log.py
es_relval_stats.py		es_relval_stats.py
es_utils.py		es_utils.py
fix-backport-labels.py		fix-backport-labels.py
fix-igprof-sql.py		fix-igprof-sql.py
forward-pull-requests		forward-pull-requests
forward_ports_map.py		forward_ports_map.py
gen-relval-jobs.py		gen-relval-jobs.py
generate-categories-json		generate-categories-json
generate-json-performance-charts		generate-json-performance-charts
generate-performance-summary		generate-performance-summary
get-git-tags		get-git-tags
get-pr-branch		get-pr-branch
get-pr-changed-files		get-pr-changed-files
get-production-arch		get-production-arch
getWorkflowStatsFromES.py		getWorkflowStatsFromES.py

jan-kaspar/cms-bot

Folders and files

Latest commit

History