Leexportpy is an application which transforms and pushes Logentries statistics data from Logentries to 3rd party applications. After getting the instructions from config.ini file which can include multiple exports with query and destination configs, leexportpy runs every export concurrently to meet configured needs.

If you want to use supported 3rd parties only, all you need to do is fill the config file and run the app!

If your desired 3rd party is not on the supported list, following the rules for creating a new service and adding a new service support to the app is as easy as pie! You are more than welcome if you want to contribute to the project with your 3rd party service modules.

Custom search destination configs:

widget_type = "Geckoboard widget type where letters are all lowercase and spaces replaced by underscores (_)" E.g: "line_chart"

widget_type = line_chart
name = "Name of the series to be drawn"

widget_type = bar_chart

widget_type = pie_chart

widget_type = number_stat
text = "Text to show at Number Stat widget"

metric_name = "hosted graphite metric name"

This service module is an example to show how to create a new service module. Simply, transform() method returns data directly without any manipulation and push() method logs some info in the logger.

Leexportpy is completely installable via pip:

pip install <url_to_repository>

After a successful install, you will be able to manage the app with leexportpy start or leexportpy stop commands. See Running for details.

The user managing leexportpy should have sudo privileges because of pid file location and log file location.

usage: leexportpy start [-h] -c CONFIG_FILE [-d]

optional arguments:
  -h, --help            show this help message and exit
  -c CONFIG_FILE, --config-file CONFIG_FILE
                        Config file path.
  -d, --daemonize       Daemonize the process or not

Example: sudo application start -c /etc/leexportpy/config.ini -d

There are two types of running modes are available:

In the background(as a daemon):

sudo application start -c /etc/leexportpy/config.ini -d

In the foreground:

sudo application start -c /etc/leexportpy/config.ini

Note: if it is going to be run in daemonized mode, config file path should be absolute path of the file.

If running in the background as a daemon(with -d argument):

sudo application stop

Note stop command is applicable for daemonized mode only.

Configuration file should given to the leexportpy as an argument along with start command and a mandatory option of -c or --config-file with the absolute path of file config file. For example: `sudo leexportpy.py start -c /etc/leexportpy/config.ini -d

[LE]
    x_api_key = {your logentries read-only or read/write api key}

[Services]
    [[{your 3rd party service name}]]
        api_key = {your api key for the 3rd party service}

    [[{another service names}]]
        api_key = {another api key}

[Searches]
    [[Search0]] # search section names should be unique, other than that they don't affect the functionality.
        [[[query]]]
            logs = {le log-key to query}
            query_period = {querying interval in secodns}
            statement = {your leql query}
            query_range = {your timerange from now() in seconds}
        [[[destination]]]
            push_url = {your 3rd party url to push transformed data}
            service = {your service name - must match with the one in the Services section}
            custom_key0 = {custom_value0}
            custom_keyn = {custom_valuen}

    [[SearchN]] # search section names should be unique, other than that they don't affect the functionality.
        [[[query]]]
            ...
        [[[destination]]]
            ...

As leexportpy automatically discovers available 3rd party services at runtime, some rules should be followed by developers.

All service modules should be placed under services package directory.

Module name should always end with _service.py. The prefix should be the name of the service, spaces replaced by underscores (_) and all letters must be lowercase. Example: module name for the service My Application should be: my_application_service.py

Class name should be the capitalized version of the module name, underscores (_) replaced with empty string. Example: class name for my_application_service.py should be: MyApplicationService

process() method should call push with the payload created by transform(). This is the module that triggers transforming and pushing. transform() method should be used to transform the data returned by Logentries REST API to the format expected by 3rd party. push(url, api_key, payload) method gets a url to push transformed data, an api key and a payload returned by transform() method which is your data to be pushed to the provided url. This method should be doing the necessary HTTP request such as POST/GET/PUT etc.

The service provided in every search in config.ini should be your module name without the _service.py or in other words, your service name with only lowercase letters and spaces replaced by underscores. Example: service name: My Application, module name: my_application_service.py and service key in config ini: my_application