Monitoring Hadoop.

Format:

Book

Author/Creator:

Singh, Gurmukh.

Series:

Community experience distilled

Language:

English

Subjects (All):

Apache Hadoop.

Adobe Hadoop (Computer file).

Electronic data processing--Distributed processing.

File organization (Computer science).

Open source software.

Local Subjects:

Adobe Hadoop (Computer file).

Electronic data processing--Distributed processing.

File organization (Computer science).

Open source software.

Physical Description:

1 online resource (101 p.)

Edition:

1st ed.

Place of Publication:

Birmingham : Packt Publishing, 2015.

Language Note:

English

Biography/History:

Singh Aman: Gurmukh Singh is a seasoned technology professional with 14+ years of industry experience in infrastructure design, distributed systems, performance optimization, and networks. He has worked in big data domain for the last 5 years and provides consultancy and training on various technologies. He has worked with companies such as HP, JP Morgan, and Yahoo. He has authored Monitoring Hadoop by Packt Publishing

Summary:

This book is useful for Hadoop administrators who need to learn how to monitor and diagnose their clusters. Also, the book will prove useful for new users of the technology, as the language used is simple and easy to grasp.

Contents:

Cover; Copyright; Credits; About the Author; About the Reviewers; www.PacktPub.com; Table of Contents; Preface; Chapter 1: Introduction to Monitoring; The need for monitoring; The monitoring tools available in the market; Nagios; Nagios architecture; Installing and configuring Nagios; Installing Nagios; Web interface configuration; Nagios plugins; Verification; Configuration files; Set up monitoring for clients; Ganglia; Ganglia components; Ganglia installation; System logging; Collection; Transportation; Storage; Alerting and analysis; The syslogd and rsyslogd daemons; Summary

Chapter 2: Hadoop Daemons and ServicesHadoop daemons; NameNode; DataNode and TaskTracker; Secondary NameNode; JobTracker and YARN daemons; The communication between daemons; YARN framework; Common issues faced on Hadoop cluster; Host level checks; Nagios server; Configuring Hadoop nodes for monitoring; Summary; Chapter 3: Hadoop Logging; The need for logging events; System logging; Logging levels; Logging in Hadoop; Hadoop logs; Hadoop log level; Hadoop audit; Summary; Chapter 4: HDFS Checks; HDFS overview; Nagios master configuration; The Nagios client configuration; Summary

Chapter 5: MapReduce ChecksMapReduce overview; MapReduce control commands; MapReduce health checks; Nagios master configuration; Nagios client configuration; Summary; Chapter 6: Hadoop Metrics and Visualization Using Ganglia; Hadoop metrics; Metrics contexts; Named contexts; Metrics system design; Metrics configuration; Configuring Metrics2; Exploring the metrics contexts; Hadoop Ganglia integration; Hadoop metrics configuration for Ganglia; Setting up Ganglia nodes; Hadoop configuration; Metrics1; Metrics2; Ganglia graphs; Metrics APIs; The org.apache.hadoop.metrics package

The org.apache.hadoop.metrics2 packageSummary; Chapter 7: Hive, HBase, and Monitoring Best Practices; Hive monitoring; Hive metrics; HBase monitoring; HBase Nagios monitoring; HBase metrics; Monitoring best practices; The Filter class; Nagios and Ganglia best practices; Summary; Index

Notes:

Description based upon print version of record.