Interfaces and shared infrastructure for generic task processing (also known as taskproc) at Yelp.
From the root of the repository, run:
make
Plugins can be chained to create a task execution pipeline with more than one property.
Implements all required interfaces to talk to Kubernetes. This plugin uses kubernetes-client to communicate with Kubernetes.
Runners provide specific concurrency semantics and are supposed to be platform independent.
Running a task is a blocking operation. sync runners block until the running task has completed or a stop event is received.
Provide callbacks for different events in tasks' lifecycle. async runners allow tasks to specify one or more EventHandlers which consist of predicates and callbacks. Predicates are evaluated when an update is received from the task (e.g. that it has terminated and whether or not it has succeded) and if the predicate passes, the callback is called.
Running a task returns future object.
Provide a queue object and receive all events in there.