GitHub - zaratsian/Apache_NiFi: Code, projects, and references for Apache NiFi

NiFi Template - Execute Python Script

This Apache NiFi tempalate show how to execute a python script with the NiFi flow. More importantly, it shows how to capture the input and output flowFile metadata. This has been tested within NiFi 1.0.0.

Here's the NiFi flow:
1.) Read data.json file
2.) Use the ExecuteScript processor to parse json and perform arbitrary python processing.
3.) Write attributes to json
4.) From here, the results can be saved to a simple .json file, to HDFS, sent to Kafka, Solr, etc.

NiFi REST API

Reference:
NiFi Expression Language
ExecuteScript Cookbook - Part 1
ExecuteScript Cookbook - Part 2
ExecuteScript Cookbook - Part 3

Name		Name	Last commit message	Last commit date
Latest commit History 37 Commits
Turbofan_Project		Turbofan_Project
DSX_API_Call.py		DSX_API_Call.py
DSX_API_Call.xml		DSX_API_Call.xml
DZ_NIFI_FLOW.xml		DZ_NIFI_FLOW.xml
DanZ_NiFi_Demos_20180718.xml		DanZ_NiFi_Demos_20180718.xml
Meetup_Complete.xml		Meetup_Complete.xml
NFL_Spark_Model_Scoring.xml		NFL_Spark_Model_Scoring.xml
NIFI_DSX_NFL_Predictions.py		NIFI_DSX_NFL_Predictions.py
NIFI_DSX_NFL_Predictions.xml		NIFI_DSX_NFL_Predictions.xml
README.md		README.md
data.json		data.json
nifi_api_client.py		nifi_api_client.py
nifi_meetup_flow.xml		nifi_meetup_flow.xml
nifi_python_simulation.py		nifi_python_simulation.py
nifi_python_split_flowfile.py		nifi_python_split_flowfile.py
nifi_python_split_regex.py		nifi_python_split_regex.py
nifi_telematics.xml		nifi_telematics.xml
python_ExecuteScript.xml		python_ExecuteScript.xml

zaratsian/Apache_NiFi

Folders and files

Latest commit

History

Repository files navigation

NiFi Template - Execute Python Script

About

Resources

Stars

Watchers

Forks

Languages