Apache Oozie : The Workflow Scheduler for Hadoop

Format:

Book

Author/Creator:

Islam, Mohammad Kamrul.

Contributor:

Srinivasan, Aravind.

Language:

English

Subjects (All):

Apache Hadoop.

Computer scheduling.

Electronic data processing--Distributed processing.

Electronic data processing.

Local Subjects:

Apache Hadoop.

Computer scheduling.

Electronic data processing--Distributed processing.

Physical Description:

1 online resource (271 p.)

Edition:

First edition.

Other Title:

Sub-title on cover: The workflow schedule for Hadoop

Place of Publication:

Sebastopol, California : O'Reilly Media, 2015.

Language Note:

English

System Details:

text file

Summary:

Get a solid grounding in Apache Oozie, the workflow scheduler system for managing Hadoop jobs. With this hands-on guide, two experienced Hadoop practitioners walk you through the intricacies of this powerful and flexible platform, with numerous examples and real-world use cases. Once you set up your Oozie server, you’ll dive into techniques for writing and coordinating Workflows, and learn how to write complex data pipelines. Advanced topics show you how to handle shared libraries in Oozie, as well as how to implement and manage Oozie’s security capabilities.

Contents:

""Copyright""; ""Table of Contents""; ""Foreword""; ""Preface""; ""Contents of This Book""; ""Conventions Used in This Book""; ""Using Code Examples""; ""Safari® Books Online""; ""How to Contact Us""; ""Acknowledgments""; ""Chapter 1. Introduction to Oozie""; ""Big Data Processing""; ""A Recurrent Problem""; ""A Common Solution: Oozie""; ""A Simple Oozie Job""; ""Oozie Releases""; ""Some Oozie Usage Numbers""; ""Chapter 2. Oozie Concepts""; ""Oozie Applications""; ""Oozie Workflows""; ""Oozie Coordinators""; ""Oozie Bundles""; ""Parameters, Variables, and Functions""

""Application Deployment Model""""Oozie Architecture""; ""Chapter 3. Setting Up Oozie""; ""Oozie Deployment""; ""Basic Installations""; ""Requirements""; ""Build Oozie""; ""Install Oozie Server""; ""Hadoop Cluster""; ""Start and Verify the Oozie Server""; ""Advanced Oozie Installations""; ""Configuring Kerberos Security""; ""DB Setup""; ""Shared Library Installation""; ""Oozie Client Installations""; ""Chapter 4. Oozie Workflow Actions""; ""Workflow""; ""Actions""; ""Action Execution Model""; ""Action Definition""; ""Action Types""; ""MapReduce Action""; ""Java Action""; ""Pig Action""

""FS Action""""Sub-Workflow Action""; ""Hive Action""; ""DistCp Action""; ""Email Action""; ""Shell Action""; ""SSH Action""; ""Sqoop Action""; ""Synchronous Versus Asynchronous Actions""; ""Chapter 5. Workflow Applications""; ""Outline of a Basic Workflow""; ""Control Nodes""; "" and ""; "" and ""; """"; """"; "" and ""; ""Job Configuration""; ""Global Configuration""; ""Job XML""; ""Inline Configuration""; ""Launcher Configuration""; ""Parameterization""; ""EL Variables""; ""EL Functions""; ""EL Expressions""; ""The job.properties File""

""Command-Line Option""""The config-default.xml File""; ""The Section""; ""Configuration and Parameterization Examples""; ""Lifecycle of a Workflow""; ""Action States""; ""Chapter 6. Oozie Coordinator""; ""Coordinator Concept""; ""Triggering Mechanism""; ""Time Trigger""; ""Data Availability Trigger""; ""Coordinator Application and Job""; ""Coordinator Action""; ""Our First Coordinator Job""; ""Coordinator Submission""; ""Oozie Web Interface for Coordinator Jobs""; ""Coordinator Job Lifecycle""; ""Coordinator Action Lifecycle""; ""Parameterization of the Coordinator""

""EL Functions for Frequency""""Day-Based Frequency""; ""Month-Based Frequency""; ""Execution Controls""; ""An Improved Coordinator""; ""Chapter 7. Data Trigger Coordinator""; ""Expressing Data Dependency""; ""Dataset""; ""Example: Rollup""; ""Parameterization of Dataset Instances""; ""current(n)""; ""latest(n)""; ""Parameter Passing to Workflow""; ""dataIn(eventName):""; ""dataOut(eventName)""; ""nominalTime()""; ""actualTime()""; ""dateOffset(baseTimeStamp, skipInstance, timeUnit)""; ""formatTime(timeStamp, formatString)""; ""A Complete Coordinator Application""

""Chapter 8. Oozie Bundles""

Notes:

Description based upon print version of record.

ISBN:

9781449369910

144936991X

9781449369927

1449369928

OCLC:

910352357