Apache Flink on Kafka: Reliable Data Pipelines Everyone Can Code with Ela Demir
Signaler
HostedbyConfluentSuivre
2 Jun 2023•0 j'aime•212 vues
Apache Flink on Kafka: Reliable Data Pipelines Everyone Can Code with Ela Demir
2 Jun 2023•0 j'aime•212 vues
Télécharger pour lire hors ligne
Signaler
Technologie
In this session, you can find out how to build crazy fast stream data pipelines using Apache Flink® over Kafka. Apache Flink® is a distributed stream processing engine that can be used with Kafka's ability to handle high volume, high throughput, and low latency data streams. It is also a cluster framework that allows you to use various data sources and data formats by defining one of its various connectors. This lighting talk will inspire everyone who is interested in streaming data with Kafka and wants to process tens of millions of Kafka events per second with latencies of mere milliseconds in Flink. If you are interested, join this 10 minute session and discover what Apache Flink is and learn some best practices for how to get started.
HostedbyConfluentSuivre
Recommandé
Robust stream processing with Apache FlinkAljoscha Krettek
Flink Community Update 2015 JuneMárton Balassi
Introducing Confluent Cloud: Apache Kafka as a Service confluent
Extending the Yahoo Streaming BenchmarkJamie Grier
Apache Kafka in the Telco Industry (OSS, BSS, OTT, IMS, NFV, Middleware, Main...Kai Wähner
Event Streaming in the Telco Industry with Apache Kafka® and Confluentconfluent
Contenu connexe
Similaire à Apache Flink on Kafka: Reliable Data Pipelines Everyone Can Code with Ela Demir
Kafka Vienna Meetup 020719Patrik Kleindl
Building Real-time Pipelines with FLaNK_ A Case Study with Transit DataTimothy Spann
Trivadis TechEvent 2016 Apache Kafka - Scalable Massage Processing and more! ...Trivadis
Kafka for ScaleEyal Ben Ivri
Fast Data – Fast Cars: Wie Apache Kafka die Datenwelt revolutioniertconfluent
Introduction to Apache Kafka and why it matters - MadridPaolo Castagna
Plus de HostedbyConfluent
Chill, Distill, No Overkill: Best Practices to Stress Test Kafka with Siva Ku...HostedbyConfluent
Manage Consistent Configurations Across Multiple Kafka Environments with Naga...HostedbyConfluent
The Cost of Kafka’s High Availability on Cloud with Geetha AnneHostedbyConfluent
Case-Study: Building Real-Time Applications at Scale-Cyclist Crash Detection ...HostedbyConfluent
Migrating Your System to the Different Kafka Platforms Available wtih Bhavesh...HostedbyConfluent
Eliminating the Double Write Problem in Apache Kafka Using the Outbox Pattern...HostedbyConfluent
Dernier
"Stateful app as an efficient way to build dispatching for riders and drivers...Fwdays
CamundaCon NYC 2023 Keynote - Shifting into overdrive with process orchestrationBernd Ruecker
"Exploring MACH Principles", Nikita GalkinFwdays
"The Intersection of architecture and implementation", Mark RichardsFwdays
Deep Dive Microsoft Viva Insights - Collabdays Bletchley Park 2023Chirag Patel
Take Control of Podcasting thanks to Open Source and Podcasting 2.0🎙 Benjamin Bellamy
Apache Flink on Kafka: Reliable Data Pipelines Everyone Can Code with Ela Demir
- 1. C2 General Apache Flink on Kafka: Reliable Data Pipelines Everyone Can Code Ela Demir
- 2. C2 General Hello, I am ELA elanur.demir@vodafone.com Big Data Engineer @Vodafone
- 3. C2 General 2000 2010 2023 Stanford University AT&T, Oracle, IBM Brown University Timeline Apache Kafka Twitter Storm Kafka Streams Apache Flink Spark Streaming Microservices Cloud Apps
- 5. C2 General BEFORE AFTER No Fear, Apache Flink is Here
- 6. C2 General Alibaba : Blink with Power of Flink Global Shopping Festival State Size: 100 TB Peak: 470 million events per second! >500k CPU cores >5k nodes Alibaba Tech Medium
- 7. C2 General Netflix Keystone: Real-time Stream Processing Platform with Flink 3 trillion events/day 10,000 containers petabytes worth of data per day 2,000 routing jobs 200,000 parallel operator instances Netflix Tech Blog
- 8. C2 General Apache Flink Overview
- 10. C2 General Best Practices With Flink on Kafka
- 11. C2 General Last But Not Least -one of the fastest growing engine in the market -a leader tool in its marketplace -a cluster framework that allows you to use various data sources and data formats -Both stream and batch pipelines Confluent acquired Apache Flink vendor at the beginning of 2023
- 12. C2 General elanur.demir@vodafone.com Big Data Engineer @Vodafone Kafka Summit London 2023