From Batch to Stream Processing with Hadoop
•Télécharger en tant que PPTX, PDF•
0 j'aime•868 vues
Learn Kafka and Event Streams with fun. This is a start point for me to explore some ideas to learn Kafka and Event Streams in a fun way. My plan is to create a way to teach people Kafka concepts combining with some kind of hardware or game. Something like from scrap, for dummies, for kids, or from zero to one. http://www.igfasouza.com/blog/learn-kafka-and-event-streams-with-fun
Recommandé
Recommandé
Contenu connexe
Dernier
Dernier (20)
En vedette
En vedette (20)
From Batch to Stream Processing with Hadoop
- 1. •Solution Architect •Hadoop - developer •Maker @igfasouza
- 7. 7 From batch to stream processing
- 8. Copyright © 2019 Oracle and/or its affiliates.
- 9. Copyright © 2019 Oracle and/or its affiliates.
- 10. Copyright © 2019 Oracle and/or its affiliates.
- 28. Thank you Igor De Souza Solution Architect @igfasouza igfasouza@gmail.com www.igfasouza.com/blog
Notes de l'éditeur
- Stream processing and Kafka with Fun Introduction
- Stream processing is becoming something like a “grand unifying paradigm” for data processing. Stream processing is the act of continuous incorporate new data to compute a result. Event stream processing (ESP) is the practice of taking action on a series of data points that originate from a system that continuously creates data.
- Streaming is processing of data in motion Streaming is data that is continuously generated by different sources. Streaming is the continuous high-speed transfer of large amounts of data from a source system to a target. Programming paradigm that allows some applications to more easily exploit a limited form of parallel processing.
- Kafka core Kafka connect Kafka stream KSQL
- ksqlDB Rocksdb – key value store
- The idea here is to focus on scenarios where the Kafka clients and the Kafka brokers are running on the edge. This enables edge processing, integration, decoupling, low latency, and cost-efficient data processing.
- Real-Time Locating System (RTLS) enables identifying and tracking the location of objects or people in real-time. It is used everywhere in transportation and logistics across industries.
- Smart devices are all of the everyday objects made intelligent with advanced computers, including AI and machine learning, and networked to form the internet of things (IoT). Not just computers and smartphones, but everything: clocks, speakers, lights, doorbells, cameras, windows, window blinds, hot water heaters, appliances, cooking utensils, you name it.
- The term connected vehicles refer to applications, services, and technologies that connect a vehicle to its surroundings. A connected vehicle includes the different communication devices (embedded or portable) present in the vehicle, that enable in-car connectivity with other devices present in the vehicle and/or enable connection of the vehicle to external devices, networks, applications, and services.
- It is a basic, but functional setup to run experiments and collect data from our small cars