Installation of Apache Flume TNT4J-Streams Plugin

This article shows how to install and set up the Apache Flume TNT4J-Streams plugin with the required files and configurations.

1. Copy tnt4j-streams-core.jar and tnt4j-streams-flume-plugin.jar to [flume_path]/lib directory

2. Copy Apache Flume tnt4j-streams plugin sample config files to [flume_path]/config/:

   • my-flume.properties - located at [tnt4j-streams-dir]/samples/apache-flume-parsed/
   • tnt4.properties - located at [tnt4j-streams-dir]/config/
   • log4j.properties/log4j2.xml - located at [tnt4j-streams-dir]/config/ NOTE: overwrite or merge this file into one provided by flume
   • tnt-data-source.xml - located at [tnt4j-streams-dir]/samples/apache-flume-parsed/

3. Adjust properties to your needs

   • Change my-flume.properties to your log directory or a sink of your choice.

     agent.sources.seqGenSrc.spoolDir=<LOGS DIR>

   • Change the source interceptor configuration according to your log format

   • Change tnt4.properties by adding your jKoolCloud token.

     event.sink.factory.Token: ##############################

4. Run Flume:

   [flume_path]/bin/flume-ng agent --conf ./conf/ -f conf/my-flume.properties -n agent