Course Outline
Overview of Distributed Messaging Systems
- Typical Use Cases
- Alternatives to Kafka
Kafka API
- Producer API
- High Level Consumer API
- Simple Consumer API
- Kafka Hadoop Consumer API
Configuration
- New Producer Settings
- Broker Configuration
- Consumer and Producer Parameters
Design Principles
- Motivation behind the Design
- Data Persistence
- System Efficiency
- The Producer Component
- The Consumer Component
- Message Delivery Semantics
- Replication Strategies
Implementation Details
- API Design Considerations
- Network Layer Architecture
- Message Handling
- Message Formatting
- Log Structure
- Distribution Mechanics
Basic Kafka Operations
- Managing Topics (Adding and Removing)
- Modifying Existing Topics
- Graceful Shutdown Procedures
- Leader Balancing
- Verifying Consumer Position
- Replicating Data Between Clusters
- Scaling the Cluster
- Decommissioning Brokers
- Adjusting Replication Factors
Additional Topics
- Datacentre Considerations
- Key Server Configurations
- Key Client Configurations
- Production Environment Settings
- Monitoring Strategies
- Integration with ZooKeeper
Requirements
Familiarity with basic system administration tasks and a solid understanding of any object-oriented programming language are required.
Testimonials (7)
Good prepared testing envoirment
Maciej Grabski
Course - Distributed Messaging with Apache Kafka
The documents
Jing Li - si ke xi tong (zhong guo) yan fa you xian gong si hang zhou fen gong si
Course - Distributed Messaging with Apache Kafka
Summary for the day, using white board to explain things step by step and the personal use cases that we are tasked to do.
Chee Meng Lee - CSIT
Course - Distributed Messaging with Apache Kafka
The preparation of virtual environments for participants to use and perform hands on learning.
marcus lim
Course - Distributed Messaging with Apache Kafka
Concepts, the way it presented, very communicative, very helpful, wide knowledge.
Sreenivasulu Narasingu - Welcome Real-time (ASPAC) Pte Ltd
Course - Distributed Messaging with Apache Kafka
The training was steered in the direction what the team wanted. The trainer is too good with vast experience in handling concepts like capability, performance, development and deployment standards and very swift in the training in addressing queries from different levels like regarding code, design, architecture and best practices etc.
Sarita Velagapudi - Welcome Real-time (ASPAC) Pte Ltd
Course - Distributed Messaging with Apache Kafka
The trainer really knows Kafka very well, and has a lot of production experience in the matter.