Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 16 hours
Course Outline
Module 1: Introduction to Confluent Apache Kafka Architecture and Cluster Configuration
- An overview of Apache Kafka and the Confluent Platform
- Core concepts: Kafka brokers, producers, consumers, and topics
- The role of Kafka in data streaming and messaging pipelines
- Confluent extensions: REST Proxy, Schema Registry, and Control Center
- Kafka cluster architecture: understanding brokers, partitions, and replication
Module 2: Configuring Zookeeper Quorums
- Introduction to Zookeeper
- The function of Zookeeper within a Kafka cluster
- Determining appropriate Zookeeper quorum sizes
- Configuring Zookeeper components
- Implementing SSH access on servers
- Hands-on: Configuring Zookeeper (both as a team and as a service)
- Utilising the Zookeeper Command Line Interface (CLI)
- Hands-on: Setting up a Zookeeper quorum
- Understanding the Zookeeper internal file system
- Performance factors influencing Zookeeper
- Demo: Exploring Zookeeper management tools and Zoonavigator
Module 3: Kafka Cluster Configuration
- Essential Kafka concepts
- Basic Kafka configuration settings
- Hands-on: Configuring Kafka on a single broker
- Hands-on: Executing basic Kafka commands
- Hands-on: Establishing a multi-broker (cluster) setup
- Hands-on: Testing Kafka cluster functionality
- Verifying connectivity to your Kafka cluster
- Configuring advertised.listeners: critical settings
- Topic configuration best practices
- Setting up message ingestion and delivery within topics
- Hands-on: Demonstrating Kafka resilience
- Kafka performance considerations: I/O, network, RAM, CPU, and OS
- Additional factors affecting Kafka performance
- Hands-on: Modifying broker configurations
Module 4: Advanced Kafka Configuration
- Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
- Handling message sending and receiving (via CLI, Java, and Spring Framework)
- Utilising metrics and monitoring tools (such as Confluent Control Center and Elasticsearch)
- Managing log files and offsets
- Strategies for high availability and disaster recovery
- Achieving high availability through replication
- Performance tuning for producers and consumers
- Implementing disaster recovery strategies
- Controlling failover and managing data recovery
- Setting up connectors
- Implementing Kafka Connect
- Exploring Kafka security features
Summary and Next Steps
Requirements
- Practical experience with Linux-based systems and command-line interfaces
- Working knowledge of distributed system concepts
- Foundational understanding of networking and system configuration
Target Audience
- DevOps and SRE teams responsible for managing Kafka deployments
- System administrators working with Confluent and Zookeeper
- Kafka developers and architects focused on building scalable systems
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)