Administration of Confluent Apache Kafka Training Course

Module 1: Introduction to Confluent Apache Kafka Architecture and Configuration

• The role of Kafka in contemporary data pipelines.
• Key distinctions between Apache Kafka and Confluent Kafka.
• Core components: producers, consumers, brokers, topics, and partitions.
• Deployment models for Kafka clusters and considerations for scaling.

Module 2: Zookeeper Quorum Configuration

• An overview of Zookeeper.
• The function of Zookeeper within a Kafka cluster.
• Determining the appropriate Zookeeper Quorum size.
• Configuring Zookeeper settings.
• Implementing SSH on server infrastructure.
• Hands-on exercise: Configuring Zookeeper as both a team and a service.
• Utilizing the Zookeeper Command Line Interface (CLI).
• Hands-on exercise: Setting up the Zookeeper Quorum.
• Understanding the Zookeeper internal file system.
• Performance factors that impact Zookeeper.
• Demonstration of Zookeeper management tools and Zoonavigator.

Module 3: Kafka Cluster Configuration

• Fundamental Kafka concepts.
• General Kafka configuration processes.
• Hands-on exercise: Configuring Kafka brokers.
• Hands-on exercise: Executing standard Kafka commands.
• Hands-on exercise: Setting up a Kafka Multi-Broker Cluster.
• Hands-on exercise: Testing the Kafka cluster.
• Verifying connectivity to the Kafka cluster.
• The critical Advertised.listeners configuration setting.
• Topic-specific configuration details.
• Configurations for downloading and ingesting messages into topics.
• Hands-on exercise: Demonstrating Kafka resilience.
• Kafka performance optimization: I/O operations.
• Kafka performance optimization: Network (RED).
• Kafka performance optimization: RAM usage.
• Kafka performance optimization: CPU utilization.
• Kafka performance optimization: Operating System (OS) level adjustments.
• Other factors influencing Kafka performance.
• Hands-on exercise: Modifying Kafka broker configurations.

Module 4: Advanced Kafka Configuration

• Configuring the Landoop Kafka topic user interface, Confluent REST Proxy, and Confluent Schema Registry.
• Methods for sending and receiving messages via CLI, Java, and the Spring framework.
• Monitoring metrics using tools such as Confluent Control Center and Elasticsearch.
• Managing log files and offsets.
• Strategies for high availability and disaster recovery.
• Achieving high availability through replication techniques.
• Optimizing producer and consumer performance.
• Developing disaster recovery strategies.
• Managing failover controls and data recovery.
• Configuring Kafka connectors.
• Implementing Kafka Connect.
• Implementing Kafka security features.

Summary and Next Steps