Why Should You Take Apache Kafka?

  • Kafka is used heavily in the Big Data space as a reliable way to ingest and move large amounts of data very quickly

  • LinkedIn, Yahoo, Twitter, Netflix, Uber, Goldman Sachs,PayPal, Airbnb​ ​​& other fortune 500 companies use Kafka

  • The average salary of a Software Engineer with Apache Kafka skill is $87,500 per year. (Payscale.com salary data)

Kafka Training Key Features

  • High Quality Course Content

    Our 15+ hours of self paced course content will help you to learn Apache Kafka and prepares you for the certification exam.

  • Practical Knowledge

    You will get practical knowledge about Apache Kafka through our 20+ demo sessions

  • Course End Project

    Our course end project will help you to prepare for your next job/project

Supporting Enterprises Around the Globe

Target Audience

  • Developers who want to build a streaming data application

  • Teams getting started or working on Kafka based projects

Pre-requisites

  • Basic Java programming knowledge is required

Course Curriculum

  • 2

    Lesson 1 - Getting Started with Big Data and Apache Kafka

    • Learning Objectives

    • 1.1 Data Evolution Over Time

    • 1.2 Big Data Overview

    • 1.3 Big Data Analytics

    • 1.4 Messaging System

    • 1.5.1. Introduction and Features of Kafka

    • 1.5.2. Kafka Use-cases

    • 1.6.1. Kafka Terminologies

    • 1.6.2. Kafka Components

    • 1.6.3. Kafka Architecture

    • 1.7 Kafka Clusters

    • 1.8 Kafka Industry Use-cases

    • 1.9.1 Demo - Install zookeeper

    • 1.9.2 Demo - Install Kafka

    • 1.10.1 Demo - Setup A Single Node Single Broker Cluster

    • 1.10.2 Demo - Setup A multi Node Single Broker Cluster

    • 1.11 Key Takeaway

    • Test Your Knowledge

  • 3

    Lesson 2 - Kafka Producer

    • Learning Objectives

    • 2.1 Overview of Producer and Architecture

    • 2.2.1 Kafka Producer Configuration

    • 2.2.2 Kafka Producer Optional Configuration

    • 2.2.3. Kafka Producer Configuration Objects

    • 2.2.4 Demo - Create a Kafka Producer

    • 2.3 Sending Messages

    • 2.4.1 Serializers and Custom Serializers

    • 2.4.2 Demo - Serializing Using Apache Avro

    • 2.4.3 Serializers Challenges and Serializing using Apache Avro

    • 2.4.4. Demo - Creating a Custom Serializer

    • 2.5 Partitions

    • 2.6 Key Takeaway

    • Test Your Knowledge

  • 4

    Lesson 3 - Kafka Consumer

    • Learning Objectives

    • 3.1.1 Overview of Kafka Consumers

    • 3.1.2 Consumer Groups

    • 3.1.3 Partition Rebalance and Creating a Consumer

    • 3.2 Poll loop and its functioning

    • 3.3.1 Kafka Configuring Consumer - Part 1

    • 3.3.2 Kafka Consumer Configuration - Part 2

    • 3.3.3 Demo - Create Kafka Consumer

    • 3.4.1 Commit and Offset

    • 3.4.2 Ways of Commiting Offset - Automatic Offset

    • 3.4.3 Ways of Commiting Offset - Commit Current Offset

    • 3.4.4 Ways of Commiting Offset - Asynchronous Commit

    • 3.4.5 Ways of Commiting Offset - Combining Synchronous and Asynchronous Commits

    • 3.4.6 Ways of Commiting Offset - Commit Specified Offset

    • 3.5 Rebalance Listeners

    • 3.6 Consuming Records with Specific Offset

    • 3.7.1 Deserializers

    • 3.7.2 Demo - Create and Use Custom Deserializer

    • 3.8 Key Takeaway

    • Test Your Knowledge

  • 5

    Lesson 4 - Kafka Operations and Performance Tuning

    • Learning Objectives

    • 4.1 Kafka Internals Overview

    • 4.2.1 Replication and Replica Types

    • 4.2.2 Preferred Ladder, Request and Request Processing

    • 4.2.3 Types of Requests

    • 4.3.1 Partition Allocation, File Management and Segments

    • 4.3.2 File Format, Index and Compaction

    • 4.4.1 Kafka Reliability and Reliability Methods

    • 4.4.2 Broker Configuration for Replication

    • 4.4.3 Producer in Reliable System

    • 4.4.4 Consumer in Reliable System

    • 4.5 Key Takeaway

    • Test Your Knowledge

  • 6

    Lesson 5 - Kafka Cluster Architecture and Administering Kafka

    • Learning Objectives

    • 5.1 Cluster Mirroring

    • 5.2.1 Hub and Spokes Architecture and Active-Active Architecture

    • 5.2.2 Active-Standby Architecture and Stretch Clusters

    • 5.3.1 MirrorMaker Configuration

    • 5.3.2 MirrorMaker Deployment and Tuning

    • 5.3.3 Demo - Setting up MirrorMaker

    • 5.4.1 Administering Kafka - Topic Operations

    • 5.4.2 Administering Kafka - Consumer Group Operations

    • 5.5.1. Dynamic Configuration Changes

    • 5.5.2. Partition Management

    • 5.6 Console Producer Tool

    • 5.7 Console Consumer Tool

    • Key Takeaway

    • Test Your Knowledge

  • 7

    Lesson 6 - Kafka Monitoring and Schema Registry

    • Learning Objectives

    • 6.1.1 Monitoring and it_s importance

    • 6.1.2 Server or Infrastructure Monitoring and Application Monitoring

    • 6.1.3 Kafka Monitoring

    • 6.1.4 Kafka Broker Metrics - Under Replicated Partitions

    • 6.1.5 Kafka Broker Metrics - Others

    • 6.1.6 Topic and Partition Specific Metrics

    • 6.1.7 Logging and Client Monitoring

    • 6.1.8 Producer and Consumer Metrics

    • 6.1.9 Quotas and Lag Monitoring

    • 6.1.10 Monitoring Dashboard

    • 6.1.11 Demo - Setting up Open Source Health Monitor

    • 6.2 Kafka Schema Registry

    • 6.3.1 Kafka Component and Architecture

    • 6.3.2 Kafka Schema Registry - Internal working and Use-cases

    • 6.4.1 Kafka Schema Registry Working

    • 6.4.2 Demo - Using Kafka Schema Registry With Kafka

    • 6.5 Key Takeaway

    • Test Your Knowledge

  • 8

    Lesson 7 - Kafka Streams and Kafka Connectors

    • Learning Objective

    • 7.1.1 Kafka Stream Overview

    • 7.1.2 Kafka Stream

    • 7.2.1 Kafka Stream Architecture and Working

    • 7.2.2 Kafka Stream Components

    • 7.2.3 Kafka Stream Architecture Tasks, Threading Model and Local State Store

    • 7.2.4 Kafka Stream Architecture - Record Buffer

    • 7.2.5 Memory Management and Streaming Data Pipeline

    • 7.2.6 Kafka Stream DSL

    • 7.2.7 KStream Operations

    • 7.2.8. KTable

    • 7.2.9. KTable Operations

    • 7.2.10 Aggregation and Windowing

    • 7.3.1 Processor Topology and Stream Processor

    • 7.3.2 Stream and Processor APIs

    • 7.3.3 Processor APIs - Create Topology

    • 7.4 Kafka Connectors

    • 7.5.1 Standalone and Sink Connector Configuration

    • 7.5.2 Running Kafka Connect

    • 7.5.3 Kafka Connector Distributed Mode

    • 7.5.4 HTTP Rest Interface

    • 7.5.5 Demo - Kafka Connector

    • 7.5.6 Demo - Create an Application using Kafka Streams

    • 7.6 Key Takeaway

    • Test Your Knowledge

  • 9

    Lesson 8 - Integration of Kafka with Storm

    • Learning Objectives

    • 8.1.1 Apache Storm

    • 8.1.2 Real-time Analytics

    • 8.2.1 Apache Storm Architecture

    • 8.2.2 Apache Storm Components

    • 8.3.1 Apache Storm Topology - Part 1

    • 8.3.2 Apache Storm Topology - Part 2

    • 8.4 Kafka Spout

    • 8.5.1 Integration of Apache Storm and Kafka

    • 8.5.2 Demo - Simple Standalone Application using Kafka and Storm

    • 8.6 Key Takeaway

    • Test Your Knowledge

  • 10

    Lesson 9 - Kafka Integration with Spark and Flume

    • Learning Objectives

    • 9.1.1 Introduction to Spark

    • 9.1.2 Spark Components

    • 9.2.1 RDD

    • 9.2.2 RDD Operations - Transformation - Map, FlatMap and Filter

    • 9.2.3 RDD Operations - Transformation - Join, Distinct, First and Take

    • 9.2.4 RDD Operations - Actions

    • 9.2.5 Data Sets and Spark Session

    • 9.2.6 Data Sets and Spark Session Operations

    • 9.3 Spark Stream

    • 9.4.1 Spark Integration with Kafka

    • 9.4.2 Demo - Running Small Standalone Application in Spark with Kafka

    • 9.5.1 Apache Flume

    • 9.5.2 Flume Connectors

    • 9.6.1 Flume Kafka to HDFS Configuration

    • 9.6.2 Demo - Creating Flume agent Sending data from Kafka to HDFS

    • 9.7 Key Takeaway

    • Test Your Knowledge

  • 11

    Lesson 10 - Admin Client and Securing Kafka

    • Learning Objectives

    • 10.1.1 Admin Client

    • 10.1.2 Demo - Perform Various Admin Tasks using Admin Client

    • 10.2 Kafka Security

    • 10.3.1 Kafka Security Component

    • 10.3.2 SASL

    • 10.4 Configure SSL in Kafka

    • 10.5 Secure using ACLs

    • 10.6 Key Takeaway

    • Test Your Knowledge

  • 12

    Course End Project

    • Project for Certification

FAQ

  • After signing up for the course, after how much time would I get access to the Learning Content?

    As soon as you signed-up, you will have full access to the complete self-paced content.

  • How my doubts will be resolved?

    There is a discussion forum attached to each course in your LMS. You can post your questions and our expert(s) will answer the queries.

  • For how long do I have access to the course material?

    The training course content is available to you for lifetime.

Our Students Love Us.

Vishal Agnihotri

This is my first experience to online learning from learnkarts. The course was very engaging and the support provided was awesome. Overall, it is was a great learning experience and it helped me to get job in Python.

Yana Sri

The instructor of the training explained all the doubts patiently. It is very easy to learn from anywhere without any problem. Online forum support is excellent.

Ankit Vohra

The project was very good. Highly recommend this for anyone looking to learn Python.

Coming soon!

Add your email to the mailing list to get the latest updates.

Related Courses

  • ₹11,999.00

    ₹11,999.00AWS Certified Big Data Specialty 2020

    ENROLL NOW