Skip to content

w00fel/cloudera

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

HDFS URI Acceptance Test Suite

Table of contents:

Overview

There are 101 tests in total:

The tests are self-documenting executable Robot Framework test suite/test case files packaged as a self-contained maven project.

The only external requirement is Python 2.7.x installed locally to provision/teardown the test environment - not required if only running tests against an existing environment.

Test Environment:

  • MIT Kerberos 5 version 1.12
  • Harmony 5.3.0.3 Standalone with HDFS URI installed - no VLProxy
  • CDH 5.5.4 Cluster w/Kerberos authentication
    • 1 node for CDH Manager
    • 3 nodes for replicated HDFS file system
    • 2 nodes for name service - 1 primary/1 secondary configured for HA
    • 1 node for other Hadoop services (YARN/ZooKeeper)

Test Environment

The test environment is hosted on AWS and an account with IAM privileges is required in order to authenticate to Amazon and provision the environment. Generate an AWS Access Key ID and an AWS Secret Access Key and then set the following environment variables before attempting to create a new test environment:

export AWS_ACCESS_KEY_ID=<your aws access key id>
export AWS_SECRET_ACCESS_KEY=<your aws secret access key>

Test Suite

The test suite is run via maven. The default goal of the maven project is 'clean verify' so simply typing mvn will run all of the tests.

Since provisioning a new test environment is a very time consuming operation it needs to be explicitly requested via mvn -Dprovision=true and teardown also needs to be explicitly requested via mvn -Dteardown=true

Once an environment has been provisioned the tests may be run as many times as required before tearing it back down.

Jenkins job

There is a Jenkins job that can be run on demand:

  • Provisions the test execution environment
  • Runs the test suite
  • Tears down the test execution environment

Note: AWS credentials are not required to run the Jenkins Job, there is a set of credentials pre-configured for the job.

About

Cloudera HDFS URI Acceptance Test Suite

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published