Apache Kafka Series - Kafka Streams for Data Processing

Video description

Learn the Kafka Streams API with hands-on examples. Learn exactly once, build and deploy apps with Java 8

About This Video

The easiest way to transform your data using the High Level DSL
Exactly once semantics support out of the box!
Deploy and scale your Kafka Streams application without a cluster!
Perform aggregations, joins, and any operations you may think of using only a few lines of code!
Built on top of Kafka, for …

Apache Kafka Series - Kafka Streams for Data Processing

Video description

Learn the Kafka Streams API with hands-on examples. Learn exactly once, build and deploy apps with Java 8

About This Video

The easiest way to transform your data using the High Level DSL
Exactly once semantics support out of the box!
Deploy and scale your Kafka Streams application without a cluster!
Perform aggregations, joins, and any operations you may think of using only a few lines of code!
Built on top of Kafka, for fault tolerance, scalability and resiliency

In Detail

The new volume in the Apache Kafka Series! Learn the Kafka Streams data-processing library, for Apache Kafka. Join hundreds of knowledge savvy students in learning one of the most promising data-processing libraries on Apache Kafka. This course is based on Java 8, and will include one example in Scala. Kafka Streams is Java-based and therefore is not suited for any other programming language. This course is the first and only available Kafka Streams course on the web. Get it now to become a Kafka expert!

Who this book is for

Developers and devops who would like to learn how to write, package, deploy and run a Kafka Streams applications. Architects who would like to understand how Kafka Streams works and its position in the Kafka-centered data pipeline and enterprise architecture. People who fully understand the basics of Kafka. Java 8 and Scala developers only

Publisher resources

Download Example Code

Chapter 1 : Kafka Streams - First Look

What is Kafka Streams?

Course Objective / Prerequisites / Target Students

About your Instructor: Stephane Maarek

Running your first Kafka Streams Application: WordCount

Kafka Streams vs other stream processing libraries (Spark Streaming, NiFi, Flink

Code Download for this Class

Chapter 2 : End to End Kafka Streams Application - Word Count

Section Objective

Kafka Streams Core Concepts

Environment and IDE Setup: Java 8, Maven, IntelliJ IDEA

Starter Project Setup

Kafka Streams Application Properties

Java 8 Lambda Functions - quick overview

Word Count Application Topology

Printing the Kafka Streams Topology

Kafka Streams Graceful Shutdown

Running Application from IntelliJ IDEA

Debugging Application from IntelliJ IDEA

Internal Topics for our Kafka Streams Application

Packaging the application as Fat Jar Running the Fat Jar

Scaling our Application

Section Wrap-Up

Chapter 3 : KStreams and KTables Simple Operations (Stateless)

Section Objectives

KStream KTables

Stateless vs Stateful Operations

MapValues / Map

Filter / FilterNot

FlatMapValues / FlatMap

Branch

SelectKey

Reading from Kafka

Writing to Kafka

Streams Marked for Re-Partition

Refresher on Log Compaction

KStream and KTables Duality

Transforming a KTable to a KStream

Transforming a KStream to a KTable

Section Summary

Chapter 4 : Practice Exercise – FavouriteColour

FavouriteColour - Practice Exercise Description Guidance

Stuck? Here are some Hints!

Java Solution

Running the application

Scala Solution

Chapter 5 : KStreams and KTables Advanced Operations (Stateful)

Section Objective

KTable groupBy

KGroupedStream / KGroupedTable Count

KGroupedStream / KGroupedTable Aggregate

KGroupedStream / KGroupedTable Reduce

KStream peek

KStream Transform / TransformValues

What if I want to write to an external System?

Summary Diagram

Chapter 6 : Exactly Once Semantics – Theory

What’s Exactly Once?

Exactly Once in Kafka 0.11

What’s the problem with at least once anyway?

How to do exactly once in Kafka Streams

Chapter 7 : Exactly Once Semantics - Practice Exercise – BankBalance

BankBalance - Exercise Overview

Kafka Producer Guidance

Kafka Producer Solution

Kafka Streams Guidance Hints

Kafka Streams Solution

Running the BankBalance Application

Section Summary

Chapter 8 : Joins - KStream to GlobalKTable example

What are joins in Kafka Streams?

Join Constraints and GlobalKTables

The different types of joins: Inner Join, Left Join, Outer Join

Creating a join with UserEnrich Kafka Streams App

Running the Kafka Streams Join application

Chapter 9 : Testing your Kafka Streams Application

Testing in Kafka Streams

Setup your Kafka Streams project

Hands-On: Test your WordCount application

Chapter 10 : Next Steps

Congratulations and next steps

Start your Free Trial

Self paced

Go to the Course
We have partnered with providers to bring you collection of courses, When you buy through links on our site, we may earn an affiliate commission from provider.