SpaceONE is an open-source multi-cloud management platform consisting of microservices including frontend, backend, and plugins. The backend and plugins have a common software framework and use gRPC APIs and python-core libraries. SpaceONE uses a microservices architecture with components like identity, inventory, monitoring, and billing that can scale independently. It also has a plugin mechanism to extend the capabilities of core services like inventory to support multiple cloud providers.
Creating microservices architectures using node.js and KubernetesPaul Goldbaum
This document discusses creating microservices architectures using Node.js and Kubernetes. It covers the author's migration from a monolithic PHP stack to a microservices architecture using Node.js, Express, MongoDB, Kubernetes, and other tools. Key points include choosing programming languages, communicating between microservices, deploying services to Kubernetes, monitoring services, and creating a custom microservices framework to make developing services easier.
OpenShift Meetup - Tokyo - Service Mesh and Serverless OverviewMaría Angélica Bracho
This document provides an overview of service mesh and serverless technologies. It discusses the evolution of microservices and how service mesh addresses needs like service discovery, routing and monitoring. It introduces concepts like sidecars and shows the architecture of Istio service mesh. It then defines serverless computing and discusses how the Knative project implements a serverless platform on Kubernetes. It shows examples of using Knative to deploy serverless applications on OpenShift and highlights the roadmap for integrating technologies like Tekton.
OpenSource API Server based on Node.js API framework built on supported Node.js platform with Tooling and DevOps. Use cases are Omni-channel API Server, Mobile Backend as a Service (mBaaS) or Next Generation Enterprise Service Bus. Key functionality include built in enterprise connectors, ORM, Offline Sync, Mobile and JS SDKs, Isomorphic JavaScript and Graphical API creation tool.
Load Balancing in the Cloud using Nginx & KubernetesLee Calcote
Presented on March 16, 2017 through O'Reilly - http://www.oreilly.com/pub/e/3864
Modern day applications bring modern day infrastructure requirements. Whether you bring your own or you use your cloud provider's managed load-balancing services, even moderately sophisticated applications are likely to find their needs underserved.
Sebastien Thomas, System Architect at Coyote Amerique, gave a presentation on operator frameworks. His talk covered how Operator SDK can be used to create Kubernetes Operators with Go.
MicroProfile, Docker, Kubernetes, Istio and Open Shift lab @dev nexusEmily Jiang
This document provides an overview of Eclipse MicroProfile, Open Liberty, and hands-on cloud-native Java microservices. It discusses key MicroProfile APIs for REST, configuration, fault tolerance, health checks, metrics, and more. It also covers deploying microservices on Docker, Kubernetes, and using a service mesh like Istio. The document concludes with a link to a GitHub repository containing a tutorial lab for getting started with a MicroProfile application on Open Liberty.
Anthos Security: modernize your security posture for cloud native applicationsGreg Castle
In this talk we describe a high-level workflow for securing Kubernetes clusters across GKE, Anthos on AWS, and Anthos On-Prem. There's a lot to cover: about 30 products and features across 3 platforms!
Monitoring a Kubernetes-backed microservice architecture with PrometheusFabian Reinartz
As many startups of the last decade, SoundCloud’s architecture started as a Ruby-on-Rails monolith, which later had to be broken into microservices to cope with the growing size and complexity of the site. The microservices initially ran on an in-house container management and deployment platform. Recently, the company has started to migrate to Kubernetes.
With the introduction of microservices, the existing conventional monitoring setup failed both conceptually and in terms of scalability. Thus, starting in 2012, SoundCloud invested heavily into the development of the open-source monitoring system Prometheus, which was designed for large-scale highly dynamic service-oriented architectures.
Migrating to Kubernetes, it became apparent that Prometheus and Kubernetes are a match made in open-source heaven. The talk will demonstrate the current Prometheus setup at SoundCloud, monitoring a large-scale Kubernetes cluster.
Creating microservices architectures using node.js and KubernetesPaul Goldbaum
This document discusses creating microservices architectures using Node.js and Kubernetes. It covers the author's migration from a monolithic PHP stack to a microservices architecture using Node.js, Express, MongoDB, Kubernetes, and other tools. Key points include choosing programming languages, communicating between microservices, deploying services to Kubernetes, monitoring services, and creating a custom microservices framework to make developing services easier.
OpenShift Meetup - Tokyo - Service Mesh and Serverless OverviewMaría Angélica Bracho
This document provides an overview of service mesh and serverless technologies. It discusses the evolution of microservices and how service mesh addresses needs like service discovery, routing and monitoring. It introduces concepts like sidecars and shows the architecture of Istio service mesh. It then defines serverless computing and discusses how the Knative project implements a serverless platform on Kubernetes. It shows examples of using Knative to deploy serverless applications on OpenShift and highlights the roadmap for integrating technologies like Tekton.
OpenSource API Server based on Node.js API framework built on supported Node.js platform with Tooling and DevOps. Use cases are Omni-channel API Server, Mobile Backend as a Service (mBaaS) or Next Generation Enterprise Service Bus. Key functionality include built in enterprise connectors, ORM, Offline Sync, Mobile and JS SDKs, Isomorphic JavaScript and Graphical API creation tool.
Load Balancing in the Cloud using Nginx & KubernetesLee Calcote
Presented on March 16, 2017 through O'Reilly - http://www.oreilly.com/pub/e/3864
Modern day applications bring modern day infrastructure requirements. Whether you bring your own or you use your cloud provider's managed load-balancing services, even moderately sophisticated applications are likely to find their needs underserved.
Sebastien Thomas, System Architect at Coyote Amerique, gave a presentation on operator frameworks. His talk covered how Operator SDK can be used to create Kubernetes Operators with Go.
MicroProfile, Docker, Kubernetes, Istio and Open Shift lab @dev nexusEmily Jiang
This document provides an overview of Eclipse MicroProfile, Open Liberty, and hands-on cloud-native Java microservices. It discusses key MicroProfile APIs for REST, configuration, fault tolerance, health checks, metrics, and more. It also covers deploying microservices on Docker, Kubernetes, and using a service mesh like Istio. The document concludes with a link to a GitHub repository containing a tutorial lab for getting started with a MicroProfile application on Open Liberty.
Anthos Security: modernize your security posture for cloud native applicationsGreg Castle
In this talk we describe a high-level workflow for securing Kubernetes clusters across GKE, Anthos on AWS, and Anthos On-Prem. There's a lot to cover: about 30 products and features across 3 platforms!
Monitoring a Kubernetes-backed microservice architecture with PrometheusFabian Reinartz
As many startups of the last decade, SoundCloud’s architecture started as a Ruby-on-Rails monolith, which later had to be broken into microservices to cope with the growing size and complexity of the site. The microservices initially ran on an in-house container management and deployment platform. Recently, the company has started to migrate to Kubernetes.
With the introduction of microservices, the existing conventional monitoring setup failed both conceptually and in terms of scalability. Thus, starting in 2012, SoundCloud invested heavily into the development of the open-source monitoring system Prometheus, which was designed for large-scale highly dynamic service-oriented architectures.
Migrating to Kubernetes, it became apparent that Prometheus and Kubernetes are a match made in open-source heaven. The talk will demonstrate the current Prometheus setup at SoundCloud, monitoring a large-scale Kubernetes cluster.
Extended and embedding: containerd update & project use casesPhil Estes
A talk given at FOSDEM 2020 in the containers devroom on the current status of the CNCF containerd project as well as a dive into the ways users are extending and embedding containerd in other platforms and projects.
Up and Running with gRPC & Cloud Career [GDG-Cloud-Dhaka-IO/2022}Md. Sadhan Sarker
The document discusses gRPC and cloud computing. It provides an overview of gRPC including that it is an open source RPC framework created by Google. It compares gRPC to REST and describes how gRPC uses HTTP/2 and protocol buffers. The document also discusses cloud computing concepts like IaaS, PaaS, SaaS and common cloud jobs. It lists skills needed for cloud engineering and certifications from Google Cloud.
This half-day tutorial introduces Protocol Buffers, gRPC, and the open source tools that Google uses to publish and support some of the world's biggest APIs. We'll show how the Protocol Buffer language allows APIs to be described, reviewed, and implemented in a programming-language independent way, how gRPC enables high-performance streaming APIs, and how \ a few simple conventions can enable related tools to serve robust REST APIs and generate production-quality client libraries in seven popular programming languages. This is API publishing the Google way, but large teams aren't required. With shared open-source tooling, even the smallest developer can build scalable, usable APIs that delight.
https://apistrat18.sched.com/event/FTR3/usable-apis-at-scale-with-protocol-buffers-and-grpc-tim-burks-andrew-gunsch-google
Mastering Microservices with Kong (DevoxxUK 2019)Maarten Mulders
When architecting microservice solutions, you'll often find yourself struggling with cross-cutting concerns. Think security, rate limiting, access control, monitoring, location-aware routing… Things can quickly become a nightmare.
The API Gateway pattern can help you solve such problems in an elegant and uniform way. Using Kong, an open source product, you can get started today. In this session we'll look at the why and how of this approach.
Running gRPC Services for Serving Legacy API on KubernetesSungwon Lee
gRPC is best suited for microservice communication. gRPC is fast, clear and powerful. It is an excellent alternative to address the verbose client problem when architecting a microservice infrastructure.
But the legacy environment is always a big hurdle for changes. You must support existing clients that only understand RESTful HTTP API. In other cases, you need to provide RESTful APIs to the outside world. This session suggests solutions to resolve these problems.
The session covers:
- Why the team chose gRPC as the inter-service communication protocol while moving from a monolith to microservices and the challenges they faced.
- How they leveraged Istio to support RESTful APIs using gRPC servers without additional development.
- How they set up CI/CD to deliver API changes (including legacy API) using Helm and Spinnaker.
- What they have learned through it and future improvements.
gRPC는 마이크로서비스 커뮤니케이션에 가장 적합합니다. gRPC는 빠르고 명확하고 강력합니다. 이는 마이크로서비스 인프라를 설계할 때 복잡한 클라이언트의 문제를 해결하는데 있어 훌륭한 대안입니다.
하지만 기존 레거시 환경은 항상 변화의 큰 장애물입니다. RESTful HTTP API만을 이해하는 기존 클라이언트를 지원해야 합니다. 다른 경우, RESTful API를 외부에 제공해야 합니다. 본 세션에서는 이러한 문제를 해결할 솔루션을 제안합니다.
이 세션에서 다루는 내용:
- 팀이 모놀리스에서 마이크로서비스로 전환하면서 서비스 간 커뮤니케이션 프로토콜로 gPRC를 선택한 이유 및 직면했던 난관들
- 추가 개발 없이 gRPC 서버를 이용해 RESTful API를 지원하기 위해 이스티오를 활용한 방법
- 헬름 및 스피네이커를 사용해 API 변경 사항 (레거시 API 포함)을 전달하기 위해 CI/CD를 설정하는 방법
- 이를 통해 배운 것과 앞으로 개선할 점
Node Interactive: Node.js Performance and Highly Scalable Micro-ServicesChris Bailey
The fundamental performance characteristics of Node.js, along with the improvements driven through the community benchmarking workgroup, makes Node.js ideal for highly performing micro-service workloads. Translating that into highly responsive, scalable solutions however is still far from easy. This session will discuss why Node.js is right for micro-services, introduce the best practices for building scalable deployments, and show you how to monitor and profile your applications to identify and resolve performance bottlenecks.
Using Istio to Secure & Monitor Your ServicesAlcide
Good observability in a microservice architecture is not easy. Istio can help to remove the complexity from developers and leave the work to the operator. Learn how to gain a deeper understanding of using Istio for monitoring tasks, while using Istio security features to secure your microservices and spot security anomalies.
For the recorded webinar: https://bit.ly/2KNaGmc
This document provides information about upgrading to ASP.NET Core 3.0, Blazor, gRPC, and SignalR. It includes links to documentation and tutorials about these technologies. Key topics covered include how Blazor works, using Blazor on the client or server, building a pizza store UI with Blazor, gRPC concepts like protocol buffers and remote procedure calls, demonstrating gRPC, advantages of gRPC like performance and multiple languages, and an overview of SignalR.
Cloud Native Night, April 2018, Mainz: Workshop led by Jörg Schad (@joerg_schad, Technical Community Lead / Developer at Mesosphere)
Join our Meetup: https://www.meetup.com/de-DE/Cloud-Native-Night/
PLEASE NOTE:
During this workshop, Jörg showed many demos and the audience could participate on their laptops. Unfortunately, we can't provide these demos. Nevertheless, Jörg's slides give a deep dive into the topic.
DETAILS ABOUT THE WORKSHOP:
Kubernetes has been one of the topics in 2017 and will probably remain so in 2018. In this hands-on technical workshop you will learn how best to deploy, operate and scale Kubernetes clusters from one to hundreds of nodes using DC/OS. You will learn how to integrate and run Kubernetes alongside traditional applications and fast data services of your choice (e.g. Apache Cassandra, Apache Kafka, Apache Spark, TensorFlow and more) on any infrastructure.
This workshop best suits operators focussed on keeping their apps and services up and running in production and developers focussed on quickly delivering internal and customer facing apps into production.
You will learn how to:
- Introduction to Kubernetes and DC/OS (including the differences between both)
- Deploy Kubernetes on DC/OS in a secure, highly available, and fault-tolerant manner
- Solve operational challenges of running a large/multiple Kubernetes cluster
- One-click deploy big data stateful and stateless services alongside a Kubernetes cluster
Apache Pulsar with MQTT for Edge Computing - Pulsar Summit Asia 2021StreamNative
This document discusses using Apache Pulsar with MQTT for edge computing. It provides an overview of Apache Pulsar and how it enables message queuing and data streaming with features like pub-sub, geo-replication, and multi-protocol support including MQTT. It also discusses edge computing characteristics and challenges, and how running Apache Pulsar on edge devices can address these by extending data processing to the edge and integrating with sensors using the MQTT protocol. Examples are provided of ingesting IoT data into Pulsar from Python and using NVIDIA Jetson devices with Pulsar.
Mastering the IoT With JavaScript and C++ - Günter ObiltschnigWithTheBest
Mastering The IoT With JavaScript And C++ discusses macchina.io, an open source toolkit for building embedded IoT applications. It uses C++ for performance and efficiency and JavaScript for parts of the web interface. It combines the POCO C++ Libraries, Google V8 JavaScript engine, and other open source projects. The toolkit allows connecting sensors and devices to cloud services via protocols like MQTT and REST. It also features a service platform, automatic JavaScript wrappers for C++ objects, and examples of using sensors, databases, and SMS notifications with JavaScript.
MuleSoft Meetup Roma - Processi di Automazione su CloudHubAlfonso Martino
The document summarizes an event held by the Rome MuleSoft Meetup Group to discuss automation of processes on CloudHub using MuleSoft's Anypoint Platform. The agenda included presentations on using infrastructure as code to automate CloudHub setup, managing API proxies, and a Q&A session. A tool called the CloudHub Automation Tool was demonstrated, which uses Terraform and other open source tools to automate CloudHub configuration and setup of environments, users, and other resources through code. The document also provided information on migrating APIs from a legacy system to the Anypoint Platform at scale.
The magic behind your Lyft ride prices: A case study on machine learning and ...Karthik Murugesan
Rakesh Kumar and Thomas Weise explore how Lyft dynamically prices its rides with a combination of various data sources, ML models, and streaming infrastructure for low latency, reliability, and scalability—allowing the pricing system to be more adaptable to real-world changes.
Running the next generation of cloud-native applications using Open Application Model
Open Application Model (OAM) is an abstraction standard that allows platform builders to build developer friendly, highly extensible applications platforms. OAM is designed for platform builders to create application centric platforms by bringing their own workloads and leveraging existing cloud native capabilities through a traits system. Application developers can define applications using components to represent services and traits to define operational aspects like auto-scaling, routing, and monitoring.
This document discusses using serverless architecture for real-time analysis. It describes using API Gateway and Lambda functions to process streaming data from Kinesis and index it into Elasticsearch. The architecture provides real-time analysis at a low cost by automatically scaling Lambda as event volume increases and decreases. Key benefits of the serverless approach include flexible scaling, increased efficiency, simplified deployment and management, and focusing only on code.
Kubernetes is an open-source system for automating deployment, scaling, and management of containerized applications. It groups containers that make up an application into logical units for easy management and discovery called Pods. ReplicaSets ensure that a specified number of pod replicas are running at any given time. Key components include Pods, Services for enabling network access to applications, and Deployments to update Pods and manage releases.
Building Advanced Serverless Workflows with AWS Step Functions | AWS Floor28Amazon Web Services
AWS Step Functions lets you coordinate multiple AWS services into serverless workflows so you can build and update apps quickly. Using Step Functions, you can design and run workflows that stitch together services such as AWS Lambda and Amazon ECS into feature-rich applications. Application development is simpler and more intuitive using Step Functions, because it translates your workflow into a state machine diagram that is easy to understand, easy to explain to others, and easy to change.
This presentation will introduce you to Container, Docker, and Kubernetes with a live demo. This also explains Kubernetes basic concepts such as Pod, Deployment, Service, Ingress, and Rolling Update.
Facebook Live: https://www.facebook.com/imcinstitute/videos/4199946253380670
Youtube Recorded: https://youtu.be/vW1Yq5ftWZ4
IMC Live Webinar on July 17, 2020
How Can Hiring A Mobile App Development Company Help Your Business Grow?ToXSL Technologies
ToXSL Technologies is an award-winning Mobile App Development Company in Dubai that helps businesses reshape their digital possibilities with custom app services. As a top app development company in Dubai, we offer highly engaging iOS & Android app solutions. https://rb.gy/necdnt
Extended and embedding: containerd update & project use casesPhil Estes
A talk given at FOSDEM 2020 in the containers devroom on the current status of the CNCF containerd project as well as a dive into the ways users are extending and embedding containerd in other platforms and projects.
Up and Running with gRPC & Cloud Career [GDG-Cloud-Dhaka-IO/2022}Md. Sadhan Sarker
The document discusses gRPC and cloud computing. It provides an overview of gRPC including that it is an open source RPC framework created by Google. It compares gRPC to REST and describes how gRPC uses HTTP/2 and protocol buffers. The document also discusses cloud computing concepts like IaaS, PaaS, SaaS and common cloud jobs. It lists skills needed for cloud engineering and certifications from Google Cloud.
This half-day tutorial introduces Protocol Buffers, gRPC, and the open source tools that Google uses to publish and support some of the world's biggest APIs. We'll show how the Protocol Buffer language allows APIs to be described, reviewed, and implemented in a programming-language independent way, how gRPC enables high-performance streaming APIs, and how \ a few simple conventions can enable related tools to serve robust REST APIs and generate production-quality client libraries in seven popular programming languages. This is API publishing the Google way, but large teams aren't required. With shared open-source tooling, even the smallest developer can build scalable, usable APIs that delight.
https://apistrat18.sched.com/event/FTR3/usable-apis-at-scale-with-protocol-buffers-and-grpc-tim-burks-andrew-gunsch-google
Mastering Microservices with Kong (DevoxxUK 2019)Maarten Mulders
When architecting microservice solutions, you'll often find yourself struggling with cross-cutting concerns. Think security, rate limiting, access control, monitoring, location-aware routing… Things can quickly become a nightmare.
The API Gateway pattern can help you solve such problems in an elegant and uniform way. Using Kong, an open source product, you can get started today. In this session we'll look at the why and how of this approach.
Running gRPC Services for Serving Legacy API on KubernetesSungwon Lee
gRPC is best suited for microservice communication. gRPC is fast, clear and powerful. It is an excellent alternative to address the verbose client problem when architecting a microservice infrastructure.
But the legacy environment is always a big hurdle for changes. You must support existing clients that only understand RESTful HTTP API. In other cases, you need to provide RESTful APIs to the outside world. This session suggests solutions to resolve these problems.
The session covers:
- Why the team chose gRPC as the inter-service communication protocol while moving from a monolith to microservices and the challenges they faced.
- How they leveraged Istio to support RESTful APIs using gRPC servers without additional development.
- How they set up CI/CD to deliver API changes (including legacy API) using Helm and Spinnaker.
- What they have learned through it and future improvements.
gRPC는 마이크로서비스 커뮤니케이션에 가장 적합합니다. gRPC는 빠르고 명확하고 강력합니다. 이는 마이크로서비스 인프라를 설계할 때 복잡한 클라이언트의 문제를 해결하는데 있어 훌륭한 대안입니다.
하지만 기존 레거시 환경은 항상 변화의 큰 장애물입니다. RESTful HTTP API만을 이해하는 기존 클라이언트를 지원해야 합니다. 다른 경우, RESTful API를 외부에 제공해야 합니다. 본 세션에서는 이러한 문제를 해결할 솔루션을 제안합니다.
이 세션에서 다루는 내용:
- 팀이 모놀리스에서 마이크로서비스로 전환하면서 서비스 간 커뮤니케이션 프로토콜로 gPRC를 선택한 이유 및 직면했던 난관들
- 추가 개발 없이 gRPC 서버를 이용해 RESTful API를 지원하기 위해 이스티오를 활용한 방법
- 헬름 및 스피네이커를 사용해 API 변경 사항 (레거시 API 포함)을 전달하기 위해 CI/CD를 설정하는 방법
- 이를 통해 배운 것과 앞으로 개선할 점
Node Interactive: Node.js Performance and Highly Scalable Micro-ServicesChris Bailey
The fundamental performance characteristics of Node.js, along with the improvements driven through the community benchmarking workgroup, makes Node.js ideal for highly performing micro-service workloads. Translating that into highly responsive, scalable solutions however is still far from easy. This session will discuss why Node.js is right for micro-services, introduce the best practices for building scalable deployments, and show you how to monitor and profile your applications to identify and resolve performance bottlenecks.
Using Istio to Secure & Monitor Your ServicesAlcide
Good observability in a microservice architecture is not easy. Istio can help to remove the complexity from developers and leave the work to the operator. Learn how to gain a deeper understanding of using Istio for monitoring tasks, while using Istio security features to secure your microservices and spot security anomalies.
For the recorded webinar: https://bit.ly/2KNaGmc
This document provides information about upgrading to ASP.NET Core 3.0, Blazor, gRPC, and SignalR. It includes links to documentation and tutorials about these technologies. Key topics covered include how Blazor works, using Blazor on the client or server, building a pizza store UI with Blazor, gRPC concepts like protocol buffers and remote procedure calls, demonstrating gRPC, advantages of gRPC like performance and multiple languages, and an overview of SignalR.
Cloud Native Night, April 2018, Mainz: Workshop led by Jörg Schad (@joerg_schad, Technical Community Lead / Developer at Mesosphere)
Join our Meetup: https://www.meetup.com/de-DE/Cloud-Native-Night/
PLEASE NOTE:
During this workshop, Jörg showed many demos and the audience could participate on their laptops. Unfortunately, we can't provide these demos. Nevertheless, Jörg's slides give a deep dive into the topic.
DETAILS ABOUT THE WORKSHOP:
Kubernetes has been one of the topics in 2017 and will probably remain so in 2018. In this hands-on technical workshop you will learn how best to deploy, operate and scale Kubernetes clusters from one to hundreds of nodes using DC/OS. You will learn how to integrate and run Kubernetes alongside traditional applications and fast data services of your choice (e.g. Apache Cassandra, Apache Kafka, Apache Spark, TensorFlow and more) on any infrastructure.
This workshop best suits operators focussed on keeping their apps and services up and running in production and developers focussed on quickly delivering internal and customer facing apps into production.
You will learn how to:
- Introduction to Kubernetes and DC/OS (including the differences between both)
- Deploy Kubernetes on DC/OS in a secure, highly available, and fault-tolerant manner
- Solve operational challenges of running a large/multiple Kubernetes cluster
- One-click deploy big data stateful and stateless services alongside a Kubernetes cluster
Apache Pulsar with MQTT for Edge Computing - Pulsar Summit Asia 2021StreamNative
This document discusses using Apache Pulsar with MQTT for edge computing. It provides an overview of Apache Pulsar and how it enables message queuing and data streaming with features like pub-sub, geo-replication, and multi-protocol support including MQTT. It also discusses edge computing characteristics and challenges, and how running Apache Pulsar on edge devices can address these by extending data processing to the edge and integrating with sensors using the MQTT protocol. Examples are provided of ingesting IoT data into Pulsar from Python and using NVIDIA Jetson devices with Pulsar.
Mastering the IoT With JavaScript and C++ - Günter ObiltschnigWithTheBest
Mastering The IoT With JavaScript And C++ discusses macchina.io, an open source toolkit for building embedded IoT applications. It uses C++ for performance and efficiency and JavaScript for parts of the web interface. It combines the POCO C++ Libraries, Google V8 JavaScript engine, and other open source projects. The toolkit allows connecting sensors and devices to cloud services via protocols like MQTT and REST. It also features a service platform, automatic JavaScript wrappers for C++ objects, and examples of using sensors, databases, and SMS notifications with JavaScript.
MuleSoft Meetup Roma - Processi di Automazione su CloudHubAlfonso Martino
The document summarizes an event held by the Rome MuleSoft Meetup Group to discuss automation of processes on CloudHub using MuleSoft's Anypoint Platform. The agenda included presentations on using infrastructure as code to automate CloudHub setup, managing API proxies, and a Q&A session. A tool called the CloudHub Automation Tool was demonstrated, which uses Terraform and other open source tools to automate CloudHub configuration and setup of environments, users, and other resources through code. The document also provided information on migrating APIs from a legacy system to the Anypoint Platform at scale.
The magic behind your Lyft ride prices: A case study on machine learning and ...Karthik Murugesan
Rakesh Kumar and Thomas Weise explore how Lyft dynamically prices its rides with a combination of various data sources, ML models, and streaming infrastructure for low latency, reliability, and scalability—allowing the pricing system to be more adaptable to real-world changes.
Running the next generation of cloud-native applications using Open Application Model
Open Application Model (OAM) is an abstraction standard that allows platform builders to build developer friendly, highly extensible applications platforms. OAM is designed for platform builders to create application centric platforms by bringing their own workloads and leveraging existing cloud native capabilities through a traits system. Application developers can define applications using components to represent services and traits to define operational aspects like auto-scaling, routing, and monitoring.
This document discusses using serverless architecture for real-time analysis. It describes using API Gateway and Lambda functions to process streaming data from Kinesis and index it into Elasticsearch. The architecture provides real-time analysis at a low cost by automatically scaling Lambda as event volume increases and decreases. Key benefits of the serverless approach include flexible scaling, increased efficiency, simplified deployment and management, and focusing only on code.
Kubernetes is an open-source system for automating deployment, scaling, and management of containerized applications. It groups containers that make up an application into logical units for easy management and discovery called Pods. ReplicaSets ensure that a specified number of pod replicas are running at any given time. Key components include Pods, Services for enabling network access to applications, and Deployments to update Pods and manage releases.
Building Advanced Serverless Workflows with AWS Step Functions | AWS Floor28Amazon Web Services
AWS Step Functions lets you coordinate multiple AWS services into serverless workflows so you can build and update apps quickly. Using Step Functions, you can design and run workflows that stitch together services such as AWS Lambda and Amazon ECS into feature-rich applications. Application development is simpler and more intuitive using Step Functions, because it translates your workflow into a state machine diagram that is easy to understand, easy to explain to others, and easy to change.
This presentation will introduce you to Container, Docker, and Kubernetes with a live demo. This also explains Kubernetes basic concepts such as Pod, Deployment, Service, Ingress, and Rolling Update.
Facebook Live: https://www.facebook.com/imcinstitute/videos/4199946253380670
Youtube Recorded: https://youtu.be/vW1Yq5ftWZ4
IMC Live Webinar on July 17, 2020
How Can Hiring A Mobile App Development Company Help Your Business Grow?ToXSL Technologies
ToXSL Technologies is an award-winning Mobile App Development Company in Dubai that helps businesses reshape their digital possibilities with custom app services. As a top app development company in Dubai, we offer highly engaging iOS & Android app solutions. https://rb.gy/necdnt
8 Best Automated Android App Testing Tool and Framework in 2024.pdfkalichargn70th171
Regarding mobile operating systems, two major players dominate our thoughts: Android and iPhone. With Android leading the market, software development companies are focused on delivering apps compatible with this OS. Ensuring an app's functionality across various Android devices, OS versions, and hardware specifications is critical, making Android app testing essential.
Mobile App Development Company In Noida | Drona InfotechDrona Infotech
Drona Infotech is a premier mobile app development company in Noida, providing cutting-edge solutions for businesses.
Visit Us For : https://www.dronainfotech.com/mobile-application-development/
Everything You Need to Know About X-Sign: The eSign Functionality of XfilesPr...XfilesPro
Wondering how X-Sign gained popularity in a quick time span? This eSign functionality of XfilesPro DocuPrime has many advancements to offer for Salesforce users. Explore them now!
What to do when you have a perfect model for your software but you are constrained by an imperfect business model?
This talk explores the challenges of bringing modelling rigour to the business and strategy levels, and talking to your non-technical counterparts in the process.
Liberarsi dai framework con i Web Component.pptxMassimo Artizzu
In Italian
Presentazione sulle feature e l'utilizzo dei Web Component nell sviluppo di pagine e applicazioni web. Racconto delle ragioni storiche dell'avvento dei Web Component. Evidenziazione dei vantaggi e delle sfide poste, indicazione delle best practices, con particolare accento sulla possibilità di usare web component per facilitare la migrazione delle proprie applicazioni verso nuovi stack tecnologici.
Artificia Intellicence and XPath Extension FunctionsOctavian Nadolu
The purpose of this presentation is to provide an overview of how you can use AI from XSLT, XQuery, Schematron, or XML Refactoring operations, the potential benefits of using AI, and some of the challenges we face.
14 th Edition of International conference on computer visionShulagnaSarkar2
About the event
14th Edition of International conference on computer vision
Computer conferences organized by ScienceFather group. ScienceFather takes the privilege to invite speakers participants students delegates and exhibitors from across the globe to its International Conference on computer conferences to be held in the Various Beautiful cites of the world. computer conferences are a discussion of common Inventions-related issues and additionally trade information share proof thoughts and insight into advanced developments in the science inventions service system. New technology may create many materials and devices with a vast range of applications such as in Science medicine electronics biomaterials energy production and consumer products.
Nomination are Open!! Don't Miss it
Visit: computer.scifat.com
Award Nomination: https://x-i.me/ishnom
Conference Submission: https://x-i.me/anicon
For Enquiry: Computer@scifat.com
Most important New features of Oracle 23c for DBAs and Developers. You can get more idea from my youtube channel video from https://youtu.be/XvL5WtaC20A
Microservice Teams - How the cloud changes the way we workSven Peters
A lot of technical challenges and complexity come with building a cloud-native and distributed architecture. The way we develop backend software has fundamentally changed in the last ten years. Managing a microservices architecture demands a lot of us to ensure observability and operational resiliency. But did you also change the way you run your development teams?
Sven will talk about Atlassian’s journey from a monolith to a multi-tenanted architecture and how it affected the way the engineering teams work. You will learn how we shifted to service ownership, moved to more autonomous teams (and its challenges), and established platform and enablement teams.
UI5con 2024 - Keynote: Latest News about UI5 and it’s EcosystemPeter Muessig
Learn about the latest innovations in and around OpenUI5/SAPUI5: UI5 Tooling, UI5 linter, UI5 Web Components, Web Components Integration, UI5 2.x, UI5 GenAI.
Recording:
https://www.youtube.com/live/MSdGLG2zLy8?si=INxBHTqkwHhxV5Ta&t=0
3. Powered
by
Megazone
Cloud
Micro Service Overview
Frontend
Backend
Plugins
console, console-api, console-assets
identity, secret, repository, plugin, config,
inventory, monitoring, statistics, billing,
cost-analysis
supervisor, plugin-xxxx
Github Repositories
standalone micro-services common library
relationship of
micro-services
python-core
api
SpaceONE consists of three micro service groups, Frontend, Backend, and Plugins
4. Powered
by
Megazone
Cloud
Micro Service Overview
Interface
CMP
Function
SpaceONE CMP Features
Management Portal
• Dashboard
• Reporting *
SDK
• API
• CLI
Inventory
• Resource Discovery
• Resource Classification
• On-premise integration *
• Multi-cloud
Identity
• User management
• Service Account mgmt.
• Project management
Monitoring
• Monitoring and Analysis
• Application Performance
monitoring *
Billing (Hyper billing)
• Consolidated billing
• Expense management
Basic features
Each component becomes standalone micro service.
ex) identity, inventory, monitoring, billing, console (Management portal)
Special functionality which supports other
micro services.
ex) secret, repository, plugin, config, supervisor
secret Saving encrypted credentials.
(ex. AWS secret_id, API_TOKEN …)
repository Provides available plugin
information. (ex. AWS collector)
Provides metadata like Policy,
Schema
plugin Manage running plugin list.
config Manage user or global variables.
supervisor Deploy plugins.
5. Powered
by
Megazone
Cloud
gRPC API
gRPC API gRPC API gRPC API
Plugin Interface
AWS Collector GCP Collector Azure Collector
...
Micro Service Overview
python-core
api
inventory
api
python-core
plugin-azure-cloud-services-inven-colle
ctor
Interface specification of
each micro service’s functionality
Backend micro service
framework
Implementation of micro service
inventory
micro service
inventory collector
micro services
Backend
Plugins
Github Repositories
Backend and Plugins has same S/W structure using API and python-core as common libraries. Each micro service implements API
spec.
10. Powered
by
Megazone
Cloud
SpaceONE API (gRPC protobuf)
https://github.com/spaceone-dev/api.git
gRPC (https://grpc.io)
● RPC based Framework from Google (Open-source version of Google
Stubby)
● Efficient communication protocol for distributed MSA
Proto
Buffer
(servicer)
gRPC
Server
Proto
Buffer
(stub)
gRPC
Client
Protobuf (IDL)
Protobuf Request
Protobuf Response
Interface Description between Server and Client
Byte stream communication with encoding message
Message size is 3~10 times smaller than XML, 20~100 times faster
Easy to implement different languages, C/C++, Java, Python, NodeJS,
Go
Interface Description Language based on Google
Protocol Buffer
Client Server
11. Powered
by
Megazone
Cloud
SpaceONE API (gRPC protobuf)
syntax = "proto3";
package spaceone.api.sample.v1;
// desc: The greeting service definition.
service HelloWorld {
// desc: Sends a greeting
rpc say_hello (HelloRequest) returns (HelloReply) {}
}
// desc: The request message containing the user's name.
message HelloRequest {
// is_required: true
string name = 1;
}
// desc: The response message containing the greetings
message HelloReply {
string message = 1;
}
https://github.com/spaceone-dev/api/blob/master/proto/spaceone/api/sample/v1/helloworld.proto
helloworld.proto
helloworld_pb2.py
helloworld_pb2_grpc.py
Compile
Descriptor of Messages
HelloRequest
HelloReply
Class of Service
HelloWorldStub
HelloWorldServicer
add_HelloWorldServicer_to_server
12. Powered
by
Megazone
Cloud
SpaceONE API (gRPC API)
SpaceONE API is a specification of each micro service’s functionalities.
gRPC API
The inventory micro service is a manipulation of cloud resources.
DB
micro service
name
Verb
(gRPC: method)
Resource
(gRPC: Service)
https://spaceone-dev.gitbook.io/spaceone-apis/inventory/v1
Server
Cloud Service
Job
…
…
For example, the inventory creates Server information on DB, and provides update, delete, list functionalities.
Resources
Verb
13. Powered
by
Megazone
Cloud
SpaceONE API (Plugin Interface)
Plugin Interface is an extension of micro service’s functionalities which are delegated to plugin micro services for scalability and
flexibility.
gRPC API For example, inventory micro service wants to collect multi cloud(AWS, Google, Azure)
resources.
https://spaceone-dev.gitbook.io/spaceone-apis/inventory/plugin/collector
Plugin Interface
gRPC API
AWS Collector
Resource: Collector
verb:
- init
- verify
- collect
Plugins
gRPC API
GCP Collector Verb
(gRPC: method)
Resource
(gRPC: Service)
Verb
(gRPC: method)
Resource
(gRPC: Service)
Every plugin should implement “init”, “verify”, and “collect” methods.
method parameters
(gRPC: message)
method return
(gRPC: message)
14. Powered
by
Megazone
Cloud
SpaceONE API (Plugin Interface)
gRPC API For example, inventory micro service wants to collect multi cloud(AWS, Google, Azure)
resources.
https://spaceone-dev.gitbook.io/spaceone-apis/
Plugin Interface
gRPC API
AWS Collector
Resource: Collector
verb:
- init
- verify
- collect
Plugins
Name Collector ID Plugin Info (metadata of collector plugin)
AWS Collector collector-1234 plugin_id: plugin-aws-collector
plugin version: 1.0.1
GCP Collector collector-5678 plugin_id: plugin-gcp-collector
plugin version: 1.2.3
…
inventory.Collector Table
gRPC API
GCP Collector
DB
Collector
API call: inventory.Collector( collector_id: collector-1234
).collect( )
micro service
name
Verb
(gRPC: method)
Resource
(gRPC: Service)
API call: plugin.Collector.collect( )
15. Powered
by
Megazone
Cloud
Hands-on Lab (2) build API
https://spaceone.org/docs/developers/api_sdk/api/
(2) make python
(1) git clone
https://github.com/spaceone-dev/api.git
16. Powered
by
Megazone
Cloud
SpaceONE Framework (Backend S/W Framework)
SpaceONE development team has created our own S/W framework like Python Django or Java Spring. We especially supports a
gRPC interface.
Layer Description
Interface
(API)
Entry point of Service Request
Handler Pre, Post processing of service call
Service Business logic of service
Cache Caching for manager
function(optional)
Manager Unit Operation for each service
function
Connector Interface for Data Source(ex. DB,
Other micro services)
https://spaceone.org/docs/developers/architecture/microservice_framework/
17. Powered
by
Megazone
Cloud
SpaceONE Framework (Software Skeleton)
Every backend and plugin micro services has same software directories.
Running micro service (gRPC)
COMMAND: spaceone grpc spaceone.<micro service name> <options>
service name Command
identity spaceone grpc spaceone.identity
inventory spaceone grpc spaceone.inventory
secret spaceone grpc spaceone.secret
sample spaceone grpc spaceone.sample
Software Skeleton
18. Powered
by
Megazone
Cloud
SpaceONE Framework (Server Type)
Backend S/W framework acts as various types, gRPC server, scheduler, worker, and rest server.
identity
(gRPC)
inventory
(gRPC)
inventory
(scheduler)
inventory
(worker)
monitoring
(gRPC)
monitoring
(rest)
Single code, use multiple
way!
identity service inventory service monitoring service
19. Powered
by
Megazone
Cloud
SpaceONE Framework (Handler)
Handler is pre/post processing of service
Handler is an annotation of service.
sequential processing
authentication → authorization →
mutation → event
Add annotation
handler implementation:
python-core
20. Powered
by
Megazone
Cloud
SpaceONE Framework (Handler)
Every micro services contacts identity, before executing API body.
inventory identity
Server.list( )
TOKEN: xxxx
Domain.get_public_key( )
@authentication
@authorization Authorization.verify(service, resource, verb )
domain_id, key, key_type
role_type, projects[],
project_groups[]
AUTHENTICATION_FAILURE
AUTHORIZATION_FAILURE
You are valid user!
Permit to execute this API
!
Execute main
body
Server list
21. Powered
by
Megazone
Cloud
SpaceONE Framework (Transaction)
Keep track of API call flow via Transaction ID.
inventory identity
Collector.collect( )
TOKEN: xxxx
@authentication, authorization
Execute main
body
Response
secret
Secret.get_data(
) plugin
Plugin.get_plugin_endpoint( )
tnx-1234
tnx-1234
tnx-1234
create New Transaction
transfer previous Transaction
Used as debugging and performance analysis
Transaction is automatically
created or delivered by core
framework. @transaction
22. Powered
by
Megazone
Cloud
SpaceONE Framework (Database Model)
Each micro service maintains its own database model.
micro service B
micro service A
Database (ex. MySQL)
micro service B
micro service A
Database
(ex. MySQL)
Database
(ex. NoSQL)
Conventional way, just separate Application only.
Easy to implement.
Separate Application and Database.
Each application has its own appropriate database.
Relationship is maintained by DB level.
ex. Primary key, secondary key
Relationship is maintained by Application
level.
ex. tenant_id, domain_id
V.S
23. Powered
by
Megazone
Cloud
SpaceONE Framework (Database Model)
Developer is not familiar with Database! No SQL statement in a program (Database Persistence Layer)
Database is abstracted as class.
from spaceone.inventory.model.server_model import Server
…
server_vo: Server = self.server_model.create(params)
just call class methods
ex) create, update, delete , list
Create class than call method!
DB table ⇒ Class
Field member ⇒ Class
member
25. Powered
by
Megazone
Cloud
[Hands-on Lab] Plugins
Create Service Account
Asset Inventory > Service Account
Create AWS Account
check AWS in Service
Providers
https://spaceone.org/docs/guides/service_account/aws_service_account_policy_management/