Advanced Hadoop for Developers Training Course

Audience:

This course is designed for IT professionals seeking a solution to store and process large datasets within a distributed system environment.

Goal:

To develop in-depth expertise in Hadoop cluster administration.

Big data analytics involves the process of examining large volumes of diverse datasets to uncover correlations, hidden patterns, and other valuable insights.

The health sector manages vast quantities of complex, heterogeneous medical and clinical data. Applying big data analytics to health data holds significant potential for generating insights that can enhance healthcare delivery. However, the sheer scale of these datasets presents considerable challenges for analysis and practical application in clinical settings.

In this instructor-led, live training (delivered remotely), participants will learn how to perform big data analytics in the health domain by working through a series of hands-on, live lab exercises.

By the end of this training, participants will be able to:

• Install and configure big data analytics tools such as Hadoop MapReduce and Spark
• Understand the characteristics of medical data
• Apply big data techniques to manage medical data effectively
• Examine big data systems and algorithms within the context of health applications

Audience

• Developers
• Data Scientists

Course Format

• A blend of lecture, discussion, exercises, and extensive hands-on practice.

Note

• To request a customised training programme for this course, please contact us to make arrangements.

Apache Hadoop is the most popular framework for processing Big Data across clusters of servers. In this three-day course (with an optional fourth day), attendees will explore the business benefits and use cases for Hadoop and its ecosystem, learn how to plan cluster deployment and growth, and gain hands-on experience installing, maintaining, monitoring, troubleshooting and optimising Hadoop. Participants will also perform bulk data loads into clusters, become familiar with various Hadoop distributions, and practice installing and managing Hadoop ecosystem tools. The course concludes with a discussion on securing clusters using Kerberos.

“…The materials were very well prepared and covered thoroughly. The Lab was very helpful and well organised”
— Andrew Nguyen, Principal Integration DW Engineer, Microsoft Online Advertising

Audience

Hadoop administrators

Format

Lectures and hands-on labs, with an approximate balance of 60% lectures and 40% labs.

Apache Hadoop is the most widely used framework for processing Big Data across clusters of servers. This course introduces developers to the various components of the Hadoop ecosystem, including HDFS, MapReduce, Pig, Hive, and HBase.

Audience:

This course is designed to demystify big data and Hadoop technology, demonstrating that it is accessible and straightforward to understand.

This instructor-led, live training in New Zealand (online or on-site) is tailored for system administrators who want to learn how to set up, deploy, and manage Hadoop clusters within their organisation.

By the end of this training, participants will be able to:

• Install and configure Apache Hadoop.
• Understand the four core components of the Hadoop ecosystem: HDFS, MapReduce, YARN, and Hadoop Common.
• Leverage the Hadoop Distributed File System (HDFS) to scale a cluster to hundreds or even thousands of nodes.
• Configure HDFS as the storage engine for on-premises Spark deployments.
• Set up Spark to interface with alternative storage solutions such as Amazon S3 and NoSQL database systems including Redis, Elasticsearch, Couchbase, Aerospike, and others.
• Perform key administrative tasks such as provisioning, managing, monitoring, and securing an Apache Hadoop cluster.

This course introduces HBase – a NoSQL store built on top of Hadoop. It is designed for developers who will use HBase to build applications, as well as administrators responsible for managing HBase clusters.

We will guide developers through HBase architecture, data modelling, and application development on HBase. The course also covers using MapReduce with HBase and explores key administrative topics, including performance optimisation. With a strong emphasis on practical learning, the course includes numerous hands-on lab exercises.

Duration : 3 days

Audience : Developers & Administrators

Apache NiFi is an open-source, flow-based data integration and event-processing platform. It enables automated, real-time data routing, transformation, and system mediation between disparate systems, with a web-based UI and fine-grained control.

This instructor-led, live training (onsite or remote) is aimed at intermediate-level administrators and engineers who wish to deploy, manage, secure, and optimise NiFi dataflows in production environments.

By the end of this training, participants will be able to:

• Install, configure, and maintain Apache NiFi clusters.
• Design and manage dataflows from varied sources and sinks.
• Implement flow automation, routing, and transformation logic.
• Optimise performance, monitor operations, and troubleshoot issues.

Format of the Course

• Interactive lecture with real-world architecture discussion.
• Hands-on labs: building, deploying, and managing flows.
• Scenario-based exercises in a live-lab environment.

Course Customisation Options

• To request a customised training for this course, please contact us to arrange.

In this instructor-led, live training in New Zealand, participants will learn the fundamentals of flow-based programming as they develop a range of demo extensions, components, and processors using Apache NiFi.

By the end of this training, participants will be able to:

• Understand NiFi's architecture and dataflow concepts.
• Develop extensions using NiFi and third-party APIs.
• Custom-develop their own Apache NiFi processor.
• Ingest and process real-time data from diverse and uncommon file formats and data sources.

This instructor-led, live training in New Zealand (available online or on-site) is tailored for developers seeking to use and integrate Spark, Hadoop, and Python to process, analyse, and transform large and complex data sets.

By the end of this training, participants will be able to:

• Set up the necessary environment to begin processing big data using Spark, Hadoop, and Python.
• Understand the key features, core components, and architecture of both Spark and Hadoop.
• Learn how to integrate Spark, Hadoop, and Python for efficient big data processing.
• Explore tools within the Spark ecosystem, including Spark MLlib, Spark Streaming, Kafka, Sqoop, and Flume.
• Build collaborative filtering recommendation systems similar to those used by Netflix, YouTube, Amazon, Spotify, and Google.
• Use Apache Mahout to scale machine learning algorithms.