Buku (javanese for book) is a Kafka Appliance for STUPS.
Buku uses port 8004 as JMX_PORT.
After building the docker image, start Buku like this:
sudo docker run -d -e ZOOKEEPER_STACK_NAME=localhost -e JMX_PORT=8004 -p 8004:8004 -p 9092:9092 --net=host <IMAGE_ID>
Docker run option --net=host is needed, so kafka can bind the interface from the host, to listen for leader elections. Ref. https://docs.docker.com/articles/networking/#how-docker-networks-a-container
For local test, ZOOKEEPER_STACK_NAME should be set to the DNS name or IP adresse of one of your ZooKeeper node, such as in this example, ZooKeeper is running on localhost, you can set it with the host alias ZOOKEEPER_STACK_NAME=localhost, or the local loopback IP like ZOOKEEPER_STACK_NAME=127.0.0.1
Push your docker image to STUPS Pier One, see here: http://docs.stups.io/en/latest/user-guide/deployment.html#prepare-the-deployment-artifact
Docs: http://docs.stups.io/en/latest/components/yourturn.html
if needed, you need to adjust later in the yaml-file the Stackname or the application_id to suit the one you have put in Yourturn/Kio
wget https://raw.githubusercontent.com/zalando/saiki-buku/master/buku.yaml
senza create buku.yaml <STACK_VERSION> <DOCKER_IMAGE_WITH_VERSION_TAG> <MINT_BUCKET> <SCALYR_LOGGING_KEY> <APPLICATION_ID> <ZOOKEEPER_STACK_NAME> <Hosted_Zone> [--region AWS_REGION]
A real world example would be:
senza create buku.yaml 1 pierone.example.org/myteam/buku:0.1-SNAPSHOT example-stups-mint-some_id-eu-west-1 some_scalyr_key buku zookeeper-stack example.org. --region eu-west-1
An autoscaling group will be created and Buku docker container will be running on all of the EC2 instances in this autoscaling group.
Your Kafka Producer/Consumer can connect to this Buku cluster with its Route53 DNS name: <STACK_NAME>.<Hosted_Zone>, such as: buku.example.org. This is a CNAME record with value of Buku's AppLoadBalancer (ELB), this LoadBalancer is an internal LoadBalancer, so that means, in order to access this Buku cluster, your Producer or Consumer also need to be deployed in the same region's VPC in AWS.
Check the STUPS documention for additional options: http://docs.stups.io