Cómo construir pipelines para streaming de datos en visualizaciones: Un ejemplo divertido usando Minecraft

•

0 j'aime•371 vues

La visualización de flujos continuos (streams) de datos brindan un mecanismo poderoso de monitoreo. En esta plática mostraremos cómo utilizar distintas herramientas para construir un pipeline de streaming de datos utilizando un ejemplo divertido del videojuego Minecraft. Por Ángel Alvarado

Technologie

Angel Alvarado
@angel_angelio
https://sg.com.mx/dataday
#DataDayMx
STREAMING DATA INTO
MINECRAFT

File Tail 1
Geo IP 1
Field Remover 1
Kafka Producer 1

186.226.38.166
lat -14.60472
long -57.6561

Github
https://github.com/AngelAlvarado/docker-streamsets-kafka-minecraft

DONEC QUIS NUNC
PREGUNTAS?
angel@molanco.com@angel_angelio

Recommandé

Chaos Engineering 시작하기 - 윤석찬 (AWS 테크에반젤리스트) :: 한국 카오스엔지니어링 밋업Channy Yun

Stable Coin Use Cases LiveStream with MakerDAO: 9/11/18ChronoLogic

Introduction of k8s ranchercyberblack28 Ichikawa

Prepare to defend thyself with Blue/GreenSonatype

Max Gallo - Reinventing RxJS - Codemotion Rome 2019Codemotion

Continual Delivery with Maven Microreposjgcloudbees

What's rancher v2.1.0 JAcyberblack28 Ichikawa

What's Riocyberblack28 Ichikawa

Recommandé

Chaos Engineering 시작하기 - 윤석찬 (AWS 테크에반젤리스트) :: 한국 카오스엔지니어링 밋업Channy Yun

Stable Coin Use Cases LiveStream with MakerDAO: 9/11/18ChronoLogic

Introduction of k8s ranchercyberblack28 Ichikawa

Prepare to defend thyself with Blue/GreenSonatype

Max Gallo - Reinventing RxJS - Codemotion Rome 2019Codemotion

Continual Delivery with Maven Microreposjgcloudbees

What's rancher v2.1.0 JAcyberblack28 Ichikawa

What's Riocyberblack28 Ichikawa

Traefik on Kubernetes at MySocialApp (CNCF Paris Meetup)Pierre Mavro

App modernization and evented architectures with Node.jsScott Persinger

Trash Robotic Router PlatformData Driven Innovation

Re invent 2018 - The Evolution of AircraftMLjerryhargrove

Traefik on google kubernetes engineManuel Zapf

Мониторинг облачной CI-системы на примере Jenkins / Александр Акбашев (HERE T...Ontico

FrenchKit 2017: Server(less) SwiftChris Bailey

PyParis2018 - Python tooling for continuous deploymentArthur Lutz

You, Mix and KubeeFernand Galiana

Hands-on K8s: Deployments, Pods and FunQAware GmbH

JCConf 2020 Observing in MicroservicesMatt Ho

Python performance engineering in 2017Alex Chistyakov

Building Serverless applications with PythonAndrii Soldatenko

คอมพ วเตอร TaaTao Smile

Hola Mundo del Internet de las CosasSoftware Guru

Estructuras de datos avanzadas: Casos de uso realesSoftware Guru

Building bias-aware environmentsSoftware Guru

El secreto para ser un desarrollador SeniorSoftware Guru

Cómo encontrar el trabajo remoto idealSoftware Guru

Automatizando ideas con Apache AirflowSoftware Guru

How thick data can improve big data analysis for business:Software Guru

Introducción al machine learningSoftware Guru

Contenu connexe

Tendances

Traefik on Kubernetes at MySocialApp (CNCF Paris Meetup)Pierre Mavro

App modernization and evented architectures with Node.jsScott Persinger

Trash Robotic Router PlatformData Driven Innovation

Re invent 2018 - The Evolution of AircraftMLjerryhargrove

Traefik on google kubernetes engineManuel Zapf

Мониторинг облачной CI-системы на примере Jenkins / Александр Акбашев (HERE T...Ontico

FrenchKit 2017: Server(less) SwiftChris Bailey

PyParis2018 - Python tooling for continuous deploymentArthur Lutz

You, Mix and KubeeFernand Galiana

Hands-on K8s: Deployments, Pods and FunQAware GmbH

JCConf 2020 Observing in MicroservicesMatt Ho

Python performance engineering in 2017Alex Chistyakov

Building Serverless applications with PythonAndrii Soldatenko

คอมพ วเตอร TaaTao Smile

Tendances (14)

Traefik on Kubernetes at MySocialApp (CNCF Paris Meetup)

App modernization and evented architectures with Node.js

Trash Robotic Router Platform

Re invent 2018 - The Evolution of AircraftML

Traefik on google kubernetes engine

Мониторинг облачной CI-системы на примере Jenkins / Александр Акбашев (HERE T...

FrenchKit 2017: Server(less) Swift

PyParis2018 - Python tooling for continuous deployment

You, Mix and Kubee

Hands-on K8s: Deployments, Pods and Fun

JCConf 2020 Observing in Microservices

Python performance engineering in 2017

Building Serverless applications with Python

คอมพ วเตอร

Plus de Software Guru

Hola Mundo del Internet de las CosasSoftware Guru

Estructuras de datos avanzadas: Casos de uso realesSoftware Guru

Building bias-aware environmentsSoftware Guru

El secreto para ser un desarrollador SeniorSoftware Guru

Cómo encontrar el trabajo remoto idealSoftware Guru

Automatizando ideas con Apache AirflowSoftware Guru

How thick data can improve big data analysis for business:Software Guru

Introducción al machine learningSoftware Guru

Democratizando el uso de CoDiSoftware Guru

Gestionando la felicidad de los equipos con Management 3.0Software Guru

Taller: Creación de Componentes Web re-usables con StencilJSSoftware Guru

El camino del full stack developer (o como hacemos en SERTI para que no solo ...Software Guru

¿Qué significa ser un programador en Bitso?Software Guru

Colaboración efectiva entre desarrolladores del cliente y tu equipo.Software Guru

Pruebas de integración con Docker en Azure DevOpsSoftware Guru

Elixir + Elm: Usando lenguajes funcionales en servicios productivosSoftware Guru

Así publicamos las apps de Spotify sin stressSoftware Guru

Achieving Your Goals: 5 Tips to successfully achieve your goalsSoftware Guru

Acciones de comunidades tech en tiempos del Covid19Software Guru

De lo operativo a lo estratégico: un modelo de management de diseñoSoftware Guru

Plus de Software Guru (20)

Hola Mundo del Internet de las Cosas

Estructuras de datos avanzadas: Casos de uso reales

Building bias-aware environments

El secreto para ser un desarrollador Senior

Cómo encontrar el trabajo remoto ideal

Automatizando ideas con Apache Airflow

How thick data can improve big data analysis for business:

Introducción al machine learning

Democratizando el uso de CoDi

Gestionando la felicidad de los equipos con Management 3.0

Taller: Creación de Componentes Web re-usables con StencilJS

El camino del full stack developer (o como hacemos en SERTI para que no solo ...

¿Qué significa ser un programador en Bitso?

Colaboración efectiva entre desarrolladores del cliente y tu equipo.

Pruebas de integración con Docker en Azure DevOps

Elixir + Elm: Usando lenguajes funcionales en servicios productivos

Así publicamos las apps de Spotify sin stress

Achieving Your Goals: 5 Tips to successfully achieve your goals

Acciones de comunidades tech en tiempos del Covid19

De lo operativo a lo estratégico: un modelo de management de diseño

Dernier

Apidays New York 2024 - The value of a flexible API Management solution for O...apidays

Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1

AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin

Why Teams call analytics are critical to your entire businesspanagenda

WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfOrbitshub

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelDeepika Singh

Architecting Cloud Native ApplicationsWSO2

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra

FWD Group - Insurer Innovation Award 2024The Digital Insurer

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWERMadyBayot

Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez

MS Copilot expands with MS Graph connectorsNanddeep Nachan

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...apidays

TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc

presentation ICT roal in 21st century educationjfdjdjcjdnsjd

Corporate and higher education May webinar.pptxRustici Software

Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya

Dernier (20)

Apidays New York 2024 - The value of a flexible API Management solution for O...

Boost Fertility New Invention Ups Success Rates.pdf

AWS Community Day CPH - Three problems of Terraform

Why Teams call analytics are critical to your entire business

WSO2's API Vision: Unifying Control, Empowering Developers

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Architecting Cloud Native Applications

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

FWD Group - Insurer Innovation Award 2024

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

MS Copilot expands with MS Graph connectors

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

presentation ICT roal in 21st century education

Corporate and higher education May webinar.pptx

Artificial Intelligence Chap.5 : Uncertainty

Cómo construir pipelines para streaming de datos en visualizaciones: Un ejemplo divertido usando Minecraft

1. Angel Alvarado @angel_angelio https://sg.com.mx/dataday #DataDayMx STREAMING DATA INTO MINECRAFT

2. Data Engineering

5. Apache access logfiles Json objects

6. File Tail 1

7. File Tail 1 Geo IP 1

8. File Tail 1 Geo IP 1 Field Remover 1

9. File Tail 1 Geo IP 1 Field Remover 1 Kafka Producer 1

10.

11. /kafka world log true kafkahost

12.

13. 186.226.38.166 lat -14.60472 long -57.6561

14. DEMO

15. DEMO + API ip.molanco.com

16. Github https://github.com/AngelAlvarado/docker-streamsets-kafka-minecraft

17.

18. DONEC QUIS NUNC PREGUNTAS? angel@molanco.com@angel_angelio