Learn about Red Hat OpenShift Streams for Apache Kafka, a service that provides fully hosted and managed Kafka instances. This enables you to focus on building your real-time, data streaming applications while Red Hat takes care of your infrastructure. After this session you'll be familiar with the features of OpenShift Streams for Apache Kafka, the related CLI tooling, and understand how it can be integrated with applications running on OpenShift (or elsewhere!)

1. CONFIDENTIAL Designator
An Introduction
Red Hat OpenShift Streams for
Apache Kafka
Evan Shortiss
Principal Technical Marketing Manager
1
@evanshortiss

2. CONFIDENTIAL Designator
What we’ll be
discussing today
AGENDA
2
What is Apache Kafka?
Apache Kafka Use Cases & Examples
Red Hat OpenShift Streams for Apache Kafka Introduction
Using OpenShift Streams with Quarkus and OpenShift Serverless

3. CONFIDENTIAL Designator
3
What is Apache
Kafka?

4. CONFIDENTIAL designator
4
INTRODUCTION
What is Apache Kafka?
Source: https://kafka.apache.org/

5. CONFIDENTIAL designator
▸ The Admin API to manage and inspect topics, brokers, and other Kafka objects.
▸ The Producer API to publish (write) a stream of events to one or more Kafka topics.
▸ The Consumer API to subscribe to (read) one or more topics and to process the
stream of events produced to them.
▸ The Kafka Streams API to implement stream processing applications and
microservices.
▸ The Kafka Connect API to build and run reusable data import/export connectors that
consume (read) or produce (write) streams of events from and to external systems
and applications so they can integrate with Kafka.
5
INTRODUCTION
What is Apache Kafka?
Kafka APIs
Source: https://kafka.apache.org/intro

6. CONFIDENTIAL designator
6
INTRODUCTION
What is Apache Kafka?
Architecture
Broker A Broker B Broker C
Consumers
Topic: Clicks Topic: Purchases
P1 P2 P3 P1 P2 P3
Producer
Kafka Cluster

7. CONFIDENTIAL designator
Kafka Cluster
7
INTRODUCTION
What is Apache Kafka?
Architecture
Broker A Broker B Broker C
Consumer Group
Topic: Clicks Topic: Purchases
P1 P2 P3 P1 P2 P3
Producer Group

8. CONFIDENTIAL designator
▸ Key: An identifier, e.g “jane@example.com”
▸ Value: The event data, e.g “Purchased 1 copy of The Shining”
▸ Timestamp
8
INTRODUCTION
What is Apache Kafka?
Event Structure
Source: https://kafka.apache.org/intro
Kafka uses a binary message protocol, this JSON is for illustrative
purposes only.

9. CONFIDENTIAL Designator
9
Apache Kafka
Use Cases

10. CONFIDENTIAL designator
USE CASES
10
Kafka in use today
Digital experiences
Delivers real-time experiences with immediate
access to information and response time
Microservices
applications
Loosely couples microservices so
development teams can remain agile
Streaming ETL/CDC
Modernize applications driven by batch data
for real-time performance
Real-time analytics
Ingest data from multiple sources for better
business insights
Edge & hybrid scenarios
Collect data from diverse and disparate
devices and systems

11. CONFIDENTIAL designator
11
USE CASES
Spotify uses Kafka & Debezium CDC for Real-time metrics

12. CONFIDENTIAL designator
12
USE CASES
Uber uses Kafka for reliable retries in distributed systems

13. CONFIDENTIAL designator
13
USE CASES
Scalable high-throughput payment networks

14. CONFIDENTIAL designator
USE CASES
14
A practical example at Red Hat Summit 2021
Image Credit: Hasbro / Amazon
Battleship-esque Game
▸ Fun board/tabletop game.
▸ Player vs. player.
▸ Choose your ship positions in secret.
▸ Declare both players are ready to play.
▸ Try to score hits/shots on opponent ships.
▸ Opponent must declare:
･ Hit
･ Miss
･ Sunk
▸ Winner declared when they sink all opponent ships.

15. CONFIDENTIAL designator
USE CASES
15
A practical example at Red Hat Summit 2021
Wait for an opponent

16. CONFIDENTIAL designator
USE CASES
16
A practical example at Red Hat Summit 2021
Position your ships

17. CONFIDENTIAL designator
USE CASES
17
A practical example at Red Hat Summit 2021
Make shots (Red is a hit, white is a miss)

18. CONFIDENTIAL designator
USE CASES
18
A practical example at Red Hat Summit 2021
Underlying event stream

19. CONFIDENTIAL designator
USE CASES
19
A practical example at Red Hat Summit 2021
Real-time metrics and event processing

20. CONFIDENTIAL designator
USE CASES
20
A practical example at Red Hat Summit 2021
Aggregation using the Kafka Streams API

21. CONFIDENTIAL designator
USE CASES
21
A practical example at Red Hat Summit 2021
Aggregating events into a complete record, from multiple clusters

22. CONFIDENTIAL Designator
22
Why use Red Hat
OpenShift
Streams for
Apache Kafka?

23. CONFIDENTIAL designator
OPENSHIFT STREAMS FOR APACHE KAFKA
Long names, short names... names!
23
Red Hat OpenShift Streams for Apache Kafka is the official name
OpenShift Streams is the preferred shortened version of the product
But….. often you’ll hear
RHOSAK
Managed Kafka
Or just Kafka

24. CONFIDENTIAL designator
24
OPENSHIFT STREAMS FOR APACHE KAFKA
Why Red Hat OpenShift Streams for Apache Kafka?
Reduced Complexity
Brokers
Load
Balancers
VMs
Applications
Components
Events

25. CONFIDENTIAL designator
25
OPENSHIFT STREAMS FOR APACHE KAFKA
Why Red Hat OpenShift Streams for Apache Kafka?
Reduced Complexity
Brokers
Load
Balancers
VMs
Applications
Components
Events

26. CONFIDENTIAL designator
OPENSHIFT STREAMS FOR APACHE KAFKA
The value of Red Hat OpenShift Streams for Apache Kafka
26
Faster application
velocity
Unified experience across all
clouds
Kafka ecosystem for
streams-based applications
Begin developing
immediately and
continuously respond to
change
Seamlessly connects
applications across public
and private clouds
Delivers a curated set of
cloud services to simplify
delivery of stream-based
applications

27. CONFIDENTIAL Red Hat associate and NDA partner use only,
No further distribution
RED HAT MANAGEMENT
27
Hosted & managed service offering
Red Hat cloud services are managed and operated by Red Hat’s Site Reliability Engineers
▸ SREs serve as the cloud provider account owner and cluster
administrator owning the SLA
▸ Responsible for the 24x7 support for all managed and hosted
environments
■ Including for building, installing, upgrading, managing
and maintaining every cluster
▸ SRE teams are distributed across 3 regions: APAC, EMEA
and Americas
▸ The team ensures open communications channels
centralized around the dedicated customer portal
Americas EMEA APAC

28. CONFIDENTIAL designator
28
OPENSHIFT STREAMS FOR APACHE KAFKA
Red Hat’s commitment to Kafka-based products
A history of innovation and success
Red Hat brings Kafka to
Kubernetes and launches Red Hat
AMQ Streams (Red Hat
Integration)
Ecosystem to deliver
event-driven solutions
Customer success
Kafka innovation since
2018

29. CONFIDENTIAL Designator
29
Getting Started
with Red Hat
OpenShift
Streams for
Apache Kafka

30. CONFIDENTIAL designator
cloud.redhat.com
Sign-in
Red Hat
Developer
OPENSHIFT STREAMS FOR APACHE KAFKA
30
Streams for Apache Kafka Evaluations
Spin-up a Kafka
cluster
User get access to
Kafka UI
Develop and
deploy
Kafka-based
applications

31. CONFIDENTIAL designator
Connect Cloud
Service to your
OpenShift cluster
(CLI, OpenShift Console,
RHOAS Operator)
31
Developer Workflow
Create Cloud
Service
(RHOAS CLI, UI)
Bind to your
application
(SBO, ODO, Quarkus, Node.js,
OpenShift Console, ...)
RHOAS OPENSHIFT STREAMS FOR APACHE KAFKA

32. CONFIDENTIAL designator
32
OPENSHIFT STREAMS FOR APACHE KAFKA
Getting access to OpenShift Streams
https://developers.redhat.com/products/rhosak/overview

33. CONFIDENTIAL designator
33
OPENSHIFT STREAMS FOR APACHE KAFKA
Getting access to OpenShift DevSandox
https://developers.redhat.com/developer-sandbox/get-started

34. CONFIDENTIAL designator
34
OPENSHIFT STREAMS FOR APACHE KAFKA
Follow the Guides & Quickstarts

35. CONFIDENTIAL Designator
Demo
35

36. CONFIDENTIAL Designator
linkedin.com/showcase/red-hat-developer
youtube - bit.ly/2YRIWTk
facebook.com/redhatdeveloperprogram
twitter.com/rhdevelopers
Red Hat is the world’s leading provider of enterprise
open source software solutions. Award-winning
support, training, and consulting services make
Red Hat a trusted adviser to the Fortune 500.
Thank you
36