Analyze Big Data Platforms For Security and Performance

Quick Start

Guide To Install Apache Eagle 0.4.0-incubating On Hortonworks sandbox.

For older versions: Apache Eagle 0.3.0-incubating Quick Start

  • Setup Environment
  • Download + Patch + Build
  • Setup Hadoop1 Environment.
  • Install Eagle.
  • Sample Application: Hive2 query activity monitoring in sandbox

Setup Environment

Eagle requires a streaming environment to run various applications. For more details, please check Setup Environment

Download + Patch + Build

  • Download latest Eagle source released From Apache [Tar], [MD5].
  • Build manually with Apache Maven:

    $ tar -zxvf apache-eagle-0.4.0-incubating-src.tar.gz
    $ cd apache-eagle-0.4.0-incubating-src 
    $ curl -O https://patch-diff.githubusercontent.com/raw/apache/eagle/pull/268.patch
    $ git apply 268.patch
    $ mvn clean package -DskipTests
    

    After building successfully, you will get a tarball under eagle-assembly/target/ named apache-eagle-0.4.0-incubating-bin.tar.gz

Install Eagle

 $ scp -P 2222 eagle-assembly/target/apache-eagle-0.4.0-incubating-bin.tar.gz root@127.0.0.1:/root/
 $ ssh root@127.0.0.1 -p 2222 (password is hadoop)
 $ tar -zxvf apache-eagle-0.4.0-incubating-bin.tar.gz
 $ mv apache-eagle-0.4.0-incubating eagle
 $ mv eagle /usr/hdp/current/
 $ cd /usr/hdp/current/eagle
 $ examples/eagle-sandbox-starter.sh


Sample Application: Hive query activity monitoring in sandbox

After executing examples/eagle-sandbox-starter.sh, you have a sample application (topology) running on the Apache Storm (check with storm ui), and a sample policy of Hive activity monitoring defined.

Next you can trigger an alert by running a Hive query.

$ su hive
$ hive
$ set hive.execution.engine=mr;
$ use xademo;
$ select a.phone_number from customer_details a, call_detail_records b where a.phone_number=b.phone_number;



Footnotes

  1. Apache Hadoop.

  2. All mentions of “hive” on this page represent Apache Hive.

Copyright © 2015 The Apache Software Foundation, Licensed under the Apache License, Version 2.0.
Apache Eagle, Eagle, Apache Hadoop, Hadoop, Apache HBase, HBase, Apache Hive, Hive, Apache Ambari, Ambari, Apache Spark, Spark, Apache Kafka, Kafka, Apache Storm, Storm, Apache Maven, Maven, Apache Tomcat, Tomcat, Apache Derby, Derby, Apache Cassandra, Cassandra, Apache ZooKeeper, ZooKeeper, Apache, the Apache feather logo, and the Apache project logo are trademarks of The Apache Software Foundation.