Hands-On Training on ZooKeeper Quorum Setup, Kafka Cluster Setup, and Administration in AWS
About This Video
Hands-On Training on ZooKeeper Quorum Setup, Kafka Cluster Setup, and Administration in AWS
About This Video
In Detail
This course is designed for system administrators, architects and developers. It includes a step-by-step guide for installing a ZooKeeper quorum and a Kafka cluster. Hands-on training on Kafka administration is also provided.This course has Amazon Web Services for our cloud environment, which is used by many companies around the world. AWS knowledge is a pre-requisite. This course reveals exactly how your Kafka cluster on multiple machines should be set up and configured. We will start with understanding the Kafka basics, cluster size and the configuration. We will also have hands-on learning on the AWS set up, single broker set up, multi broker set up, testing the cluster, Kafka manager (cluster management), demonstrating Kafka resiliency and so on. We will enlighten you on Kafka performance with respect to I/Os, network, RAM, CPU, OS (Operating System) and so on. Includes hands-on learning on how to run Kafka in production on AWS, how to change a Kafka broker configuration and we will also cover the advanced Kafka configurations.
Downloading the example code for this course: You can download the example code files for all Packt video courses you have purchased from your account at http://www.PacktPub.com. If you purchased this course elsewhere, you can visit http://www.PacktPub.com/support and register to have the files e-mailed directly to you.
Chapter 1 : Course Introduction and Pre Requisites
Course Objectives 00:03:28
What is not covered in this course? 00:02:59
Pre-Requisites: This is a Challenging course! 00:03:03
Who is this course for? 00:01:06
About me! 00:00:55
5 Golden Course Rules 00:02:13
Chapter 2 : Target Architecture
Cloud Provider: AWS & Alternatives 00:02:16
Zookeeper Quorum Architecture 00:01:06
Kafka Cluster Architecture 00:02:43
Final Architecture (with Web Tools) 00:01:10
Note on IP addresses and DNS 00:03:21
Chapter 3 : Zookeeper Quorum Setup
What is Zookeeper? 00:04:56
Zookeeper Role in a Kafka Cluster 00:02:50
Zookeeper Quorum Sizing 00:05:33
Zookeeper Configuration 00:03:15
Hands-On: Zookeeper AWS Setup 00:11:26
How to SSH Into our Servers? 00:04:19
Hands-On: Single Zookeeper Machine Setup 00:12:52
Hands-On: Zookeeper Service Setup 00:06:23
Using the Zookeeper Command Line Interface (CLI) 00:08:13
Hands-On: Zookeeper Quorum setup - Part 1 AWS 00:08:04
Hands-On: Zookeeper Quorum Setup - Part 2 Zookeeper 00:15:08
Zookeeper Four Letter Words 00:04:52
Zookeeper Internal File System 00:02:00
Factors impacting Zookeeper Performance 00:01:58
Note: Zookeeper in AWS 00:01:49
Hands-On: Web tools AWS machine Docker setup 00:06:21
Management Tools for Zookeeper & Zoonavigator demo 00:07:29
Chapter 4 : Kafka Cluster Setup
Kafka Basics 00:01:50
Kafka Cluster Size Discussions 00:04:26
Kafka Configuration 00:08:27
Hands-On: Kafka AWS Setup 00:11:29
Hands-On: Single Kafka Broker Setup 00:12:07
Hands-On: Running Kafka Commands 00:05:11
Hands-On: Kafka Multi Broker (Cluster) Setup 00:10:52
Hands-On: Testing the Kafka Cluster 00:05:37
Can I connect to my Kafka cluster? 00:03:29
advertised.listeners setting - most important setting 00:06:11
Hands-On: Kafka Manager (Cluster Management) 00:10:30
Hands-On: Demonstrating Kafka Resiliency 00:14:25
Kafka Performance: I/O 00:01:48
Kafka Performance: Network 00:02:06
Kafka Performance: RAM 00:03:28
Kafka Performance: CPU 00:01:35
Kafka Performance: OS (Operating System) 00:01:28
Kafka Performance: Other 00:01:10
Running Kafka in Production on AWS 00:01:36
Hands-On: How to change a Kafka Broker Configuration 00:04:02
Advanced Kafka Configuration 00:05:43
Landoop Kafka Topics UI, Confluent REST Proxy, Confluent Schema Registry Setup 00:05:38
Chapter 5 : Next steps!
What’s Next? Learning further 00:01:13