Open Source Hadoop Administration

Open Source Hadoop Administration (OSHA)

Kurskode: OSHA

varighet: 4 Dag(er)

Sted: Virtual, Instructor Led Training

Katergori: EMC

Course Overview

This open source course provides participants with a comprehensive understanding of the steps necessary to install, configure, operate and maintain Hadoop. The course begins with an overview of the Big Data landscape, and then dives into a system administration working view of running Hadoop.

• The content of this course is designed to support the course objectives.
Hadoop Introduction

• A Brief History of Hadoop

• Core Hadoop Components

• Fundamental Concepts
Planning Your Hadoop Cluster

• General Planning Considerations

• Choosing Hardware

• Network Considerations

• Configuring Nodes

• Planning for Cluster Management
HDFS

• HDFS Features

• Writing and Reading Files

• NameNode Considerations

• HDFS Security

• Namenode Web UI

• Hadoop File Shell
Getting Data into HDFS

• Pulling data from External Sources with Flume

• Importing Data from Relational Databases with Sqoop

• REST Interfaces

• Best Practices
• MapReduce

• MapReduce overview

• Features of MapReduce

• Architectural Overview

• YARN MapReduce Version 2

• Failure Recovery

• The JobTracker Web UI
Hadoop Installation & Initial Configuration

• Configuration & Deployment Types

• Installing Hadoop

• Specifying the Hadoop Configuration

• Initial HDFS & MapReduce Configuration

• Log Files
Installing/Configuring Hive, Impala, and Pig

• Hive

• Impala

• Pig
Hadoop Clients

• What is a Hadoop Client?

• Installing and Configuring Hadoop Clients

• Installing and Configuring Hue

• Hue Authentication and Configuration
Advanced Cluster Configuration

• Advanced Configuration Parameters

• Configuring Hadoop Ports

• Explicitly Including and Excluding Hosts

• Configuring HDFS for Rack Awareness & HDFS High Availability
Hadoop Security

• Why Hadoop Security Is Important

• Hadoop’s Security System Concepts

• What Kerberos Is and How it Works

• Securing a Hadoop Cluster with Kerberos
Managing and Scheduling Jobs

• Managing Running Jobs

• Scheduling Hadoop Jobs

• Configuring the FairScheduler
Cluster Maintenance

• Checking HDFS Status

• Copying Data Between Clusters

• Adding/Removing Cluster Nodes

• Rebalancing the Cluster

• NameNode Metadata Backup

• Cluster Upgrades
Cluster Monitoring and Troubleshooting

• General System Monitoring

• Managing Hadoop’s Log Files

• Monitoring the Clusters

• Common Troubleshooting Issues

Upon successful completion of this course, participants should be able to:

• Describe the fundamental concepts of using Big Data

• Identify where Hadoop fits into a Big Data strategy

• Learn to plan your Hadoop cluster.

• Learn HDFS features.

• Learn how to get data into HDFS.

• Learn to work with MapReduce.

• Learn installation and configuration of Hadoop.

• Learn cluster maintenance.

Not available. Please contact.

This course is intended for System administrators, DevOps engineers, and software developers responsible for managing and maintaining Hadoop clusters.

Kurskode: OSHA Kategori: EMC, Network Storage Underkategori: Network Storage

Salar Ghadani

Salg

Har du spørsmål, ta kontakt

918 34 713 salar@sgpartner.no

varighet: 4 Dag(er)

Underkatergori: Network Storage

Relaterte kurs