OpenNebulaConf2017EU: FairShare Scheduling by Valentina Zaccolo, INDIGO

•

1 like•246 views

OpenNebula Project

FairShare Scheduling

Technology

Valentina Zaccolo – OpenNebulaConf 2
Why scheduling fairly?
Large public cloud
•  approximately infinite resources
•  tenants are charged a posteriori
!  applications scale in/out freely
Small scientific datacenter
•  saturated regime
•  tenants are charged a priori
!  advanced resource allocation needed
FairShare Scheduling (FaSS) service
https://github.com/indigo-dc/one-fass
task priorities assigned according to
•  v1.0 released with ElectricIndigo in April 2017 with ONE patch
•  v1.2 ONE 5.4 compatibility!
check installation and usage demo: https://vimeo.com/216656868, pass: fass
Default OpenNebula (ONE) scheduler is FIFO and based only on static
resources partitioning among the projects " not suitable for scientific DC
initial weight
historical resource usage

Valentina Zaccolo – OpenNebulaConf 3
High-level architecture
FIFO SCHEDULER
XML-RPC INTERFACE
fassd
RPC PM TERMINATOR
asynchronous modules
- kills running VMs- only handles
queue
FaSS
- stateless
(no duplicated info in DB)

Valentina Zaccolo – OpenNebulaConf 3
High-level architecture
FIFO SCHEDULER
XML-RPC INTERFACE
fassd
RPC PM TERMINATOR
asynchronous modules
asks queue
queue
- reorders queue
- kills pending VMs
(synchronous)
- kills running VMs
influxDB
- nosql
- holds internal data (initial priorities,
historical usage, recalculated priorities)
Algorithms - MultiFactor
FaSS
- stateless
(no duplicated info in DB)
- only handles
queue

Valentina Zaccolo – OpenNebulaConf 3
High-level architecture
FIFO SCHEDULER
XML-RPC INTERFACE
FaSS
fassd
RPC PM TERMINATOR
asynchronous modules
queue
- reorders queue
- kills pending VMs
(synchronous)
- kills running VMs
influxDB
- nosql
- holds internal data (initial priorities,
historical usage, recalculated priorities)
sendsqueue
Algorithms - MultiFactor
- stateless
(no duplicated info in DB)
- only handles
queue

4
Performances
Test with three users: initial shares configured in /etc/fass/shares.conf :
[huey]
uid=4
gid=1
share=50
[louie]
uid=6
gid=1
share=25
[dewey]
uid=5
gid=1
share=25
Periodically instatiates VMs
for all 3 users
Stops instantiating Louie Reaches configured shares
Instantiates
all 3 users again

What's hot

OCCI (Open Cloud Computing Interface ) [1] is an open protocol for management tasks in the cloud environment focused on integration, portability and interoperability with a high degree of extensibility. It is designed to bridge differences between various cloud platforms (or cloud middleware) and provide common ground for users and developers alike. The rOCCI framework [2], originally developed by GWDG [3], was written to simplify the implementation of the OCCI 1.1 protocol in Ruby and later provided the base for a working client and server implementation targeting OpenNebula as its primary back-end cloud platform. The initial server-side implementation provided basic functionality and served as a proof of concept when it was adopted by the EGI Federated Cloud Task Force [4] and chosen to act as the designated VM management interface. This led to further funding from EGI-InSPIRE [5] and involvement of CESNET [6]. This talk aims to provide basic information about the OCCI protocol, introduce its implementation in rOCCI, describe and/or demonstrate some of the functionality provided by rOCCI client and rOCCI-server in concert with OpenNebula. It also briefly examines its use in the EGI FedCloud environment and explores the possibility of further integration with OpenNebula as a part of the ON ecosystem or even as an integral part of OpenNebula itself in the future. All this with interoperability in mind.

rOCCI – Providing Interoperability through OCCI 1.1 Support for OpenNebula

NETWAYS

The platform currently runs several solutions for Earth Sciences Researchers: Developer Cloud Sandboxes for scalable scientific processors integration, Virtual Archives federating distributed data repositories, Data Challenges for Earth Observation contests, and Digital Marketplaces for reproducible scientific experiments. OpenNebula is also powering our Cloud development environment, that has been enhanced during the past year. Terradue’s Cloud development environment is both our laboratory to test the latest developments from OpenNebula, especially for the integration of our own OpenNebula extensions, and our Engineering team facility to provision servers supporting project-based software developments. OpenNebula provides the virtualization and management of hardware clusters, that we rent from commercial ‘bare-metal’ providers. We have recently further developed several specific drivers for Multi-Cloud bursting, in order to provision virtual machines over public commercial clouds. When their processor integration and validation phase concludes, our researcher users can seamlessly burst their applications at scale, leveraging OpenNebula drivers for on-demand processing tasks.

OpenNebula Conf 2014: Expanding OpenNebula´s support for Cloud Bursting - Emm...

NETWAYS

OpenNebula Conf | Lightning talk: Managing a Scientific Computing Facility wi...

NETWAYS

This talk shows how to setup a virtual infrastructure using OpenNebula as cloud management platform, SaltStack for configuration management and Foreman for bare-metal/ virtual host provisioning. You will see how to combine OpenNebula with bare-metal deployment on standard server hardware using non-shared storage in an environment without physical access to the hardware and no existing base infrastructure like DNS, NTP, DHCP, VPN or other. The infrastructure installation has been done automatically using public code and free Open Source software.

OpenNebula Conf 2014 | Bootstrapping a virtual infrastructure using OpenNebul...

NETWAYS

OpenContrail Implementations

Jakub Pavlik

CEPH DAY BERLIN - DEPLOYING CEPH IN KUBERNETES WITH ROOK

Ceph Community

OpenNebula Conf: 2014 | Lightning talk: Managing Docker Containers with OpenN...

NETWAYS

Openstack platform -Red Hat Pizza and technology event - Israel

Arthur Berezin

以 Kubernetes 部屬 Spark 大數據計算環境

inwin stack

Cloud database vendors tend to report performance numbers for the sweet spot or running in highly optimized hardware with specific workload parameters. Moreover, many of these systems are not tested under different failure scenarios that may appear in the public cloud. At Netflix, as a cloud-native enterprise, our focus is on high availability. We achieve high availability by deploying at multiple regions. Hence, our data store system performance is highly affected by our global deployment model, instance types and workload patterns. Hence, we were interested in a Cloud database benchmark tool that could be deployed in a loosely-coupled fashion, as a microservice, and with the ability to dynamically change the configurations parameters at run time. In this paper, we present Netflix Data Benchmark (NDBench). NDBench offers pluggable patterns and loads and support for different client APIs. It offers the ability to deploy, manage and monitor multiple instances from a single point. NDBench was designed to run for infinite time. This nature offered us with the ability to test long-running database maintenance jobs, test database systems under conditions that affect the performance, such as compactions, repairs etc., and also gives us a view on client side issues like memory leaks and heap pressure. We have been running NDBench for almost 3 years having validated multiple database versions, tested numerous NoSQL systems running on the Cloud, and tested new functionalities. NDBench is major component of our testing and validation pipelines.

Netflix Data Benchmark @ HPTS 2017

Ioannis Papapanagiotou

CoreOS fest 2016 Summary - DevOps BP 2016 June

Zsolt Molnar

OpenNebula Conf 2014 | Using Ceph to provide scalable storage for OpenNebula ...

NETWAYS

Object Storage in a Cloud-Native Container Envirnoment

Minio

OpenNebula Conf 2014 | Lightning talk: OpenNebula Puppet Module - Norman Mess...

NETWAYS

How does Ceph perform when used in high-performance computing? This talk will cover a year of running Ceph on a (small) Cray supercomputer. I will describe how Ceph was configured to perform in an all-NVME configuration, and the process of analysis and optimisation of the configuration. I'll also give details on the efforts underway to adapt Ceph's messaging to run over high performance network fabrics, and how this work could become the next frontier in the battle against storage performance bottlenecks.

CEPH DAY BERLIN - CEPH ON THE BRAIN!

Ceph Community

State of the Container Ecosystem

Vinay Rao

Into the cold - Object Storage in SWITCHengines

Simon Leinen

Operators experience and perspective on SDN with VLANs and L3 Networks

Jakub Pavlik

Alluxio Online Community Office Hours Jan 28, 2020 Speakers: Bin Fan, Alluxio Calvin Jia, Alluxio Alluxio 2.0 release was the biggest update since the birth of the project “Tachyon” from UC Berkley’s AmpLab. Gathering feedback from our Open Source Community and enterprise users, Alluxio 2.0 expands the system in three major directions including improving the operability of the system, having more advanced data management, as well as re-architecting the system to be able to scale to 1 billion + file. The system is now cloud native on AWS, Google Cloud, and allow users to enable native deployment with K8s. The new advanced data management enables data migration and replication from diff storage systems. In this office hour, we introduce what’s new in the Alluxio 2 release, and dive deeper in each major direction the system has expanded on. In this Office Hour, we will go over: - Introduction and motivation of focus areas of Alluxio 2 - Overview of cloud native deployment methods - New data management features - System scalability improvements

What’s new in Alluxio 2: from seamless operations to structured data management

Alluxio, Inc.

What's hot (19)

rOCCI – Providing Interoperability through OCCI 1.1 Support for OpenNebula

OpenNebula Conf 2014: Expanding OpenNebula´s support for Cloud Bursting - Emm...

OpenNebula Conf | Lightning talk: Managing a Scientific Computing Facility wi...

OpenNebula Conf 2014 | Bootstrapping a virtual infrastructure using OpenNebul...

OpenContrail Implementations

CEPH DAY BERLIN - DEPLOYING CEPH IN KUBERNETES WITH ROOK

OpenNebula Conf: 2014 | Lightning talk: Managing Docker Containers with OpenN...

Openstack platform -Red Hat Pizza and technology event - Israel

以 Kubernetes 部屬 Spark 大數據計算環境

Netflix Data Benchmark @ HPTS 2017

CoreOS fest 2016 Summary - DevOps BP 2016 June

OpenNebula Conf 2014 | Using Ceph to provide scalable storage for OpenNebula ...

Object Storage in a Cloud-Native Container Envirnoment

OpenNebula Conf 2014 | Lightning talk: OpenNebula Puppet Module - Norman Mess...

CEPH DAY BERLIN - CEPH ON THE BRAIN!

State of the Container Ecosystem

Into the cold - Object Storage in SWITCHengines

Operators experience and perspective on SDN with VLANs and L3 Networks

What’s new in Alluxio 2: from seamless operations to structured data management

Similar to OpenNebulaConf2017EU: FairShare Scheduling by Valentina Zaccolo, INDIGO

High Performance Flow Matching Architecture for Openflow Data Plane

Mahesh Dananjaya

PFQ@ 9th Italian Networking Workshop (Courmayeur)

Nicola Bonelli

PFQ@ PAM12

Nicola Bonelli

PF_DIRECT@TMA12

Nicola Bonelli

The aim of the EU FP 7 Large-Scale Integrating Project LarKC is to develop the Large Knowledge Collider (LarKC, for short, pronounced “lark”), a platform for massive distributed incomplete reasoning that will remove the scalability barriers of currently existing reasoning systems for the Semantic Web. The LarKC platform is available at larkc.sourceforge.net. This talk, is part of a tutorial for early users of the LarKC platform, and introduces the platform and the project in general.

LarKC Tutorial at ISWC 2009 - Introduction

LarKC

Spark Summit EU talk by Sameer Agarwal

Spark Summit

Fast and Simplified Streaming, Ad-Hoc and Batch Analytics with FiloDB and Spa...

Helena Edelson

EEDC - Apache Pig

javicid

Aricent’s presentation on “Micro VNFs and Micro service environment” on next generation Virtualized Network Functions (VNFs) is heating up. In debate on micro services, carriers has requested communities to step up research on micro service deployments. Aricent believes that existing VNFs, which comes directly from the physical appliances software are not rightly designed and are less suited for cloud operations. These first generation VNFs are replication of physical appliances, monolithic architecture and need more computational power. These are heavy with physical appliance platform features i.e. HA, ISSU, Nonstop Routing/Switching and they have lots of redundant code which may not be necessary on cloud. As cloud platform provides these feature through its inherent platform capabilities.

Mpls conference 2016-data center virtualisation-11-march

Aricent

Network research

Jisc

Archiving data from Durham to RAL using the File Transfer Service (FTS)

Jisc

Feec telecom-nw-softwarization-aug-2015

Christian Esteve Rothenberg

On SDN Research Topics - Christian Esteve Rothenberg

CPqD

TransPAC3/ACE Measurement & PerfSONAR Update

International Networking at Indiana University

Datasets and tools_from_ncbi_and_elsewhere_for_microbiome_research_v_62817

Ben Busby

In this talk we’ll introduce an open source project being used to monitor large Power Systems clusters, such as in the IBM collaboration with Oak Ridge and Lawrence Livermore laboratories for the Summit project, a large deployment of custom AC922 Power Systems nodes augmented by GPUs that work in tandem to implement the (currently) largest Supercomputer in the world. Data is collected out-of-band directly from the firmware layer and then redistributed to various components using an open source component called Crassd. In addition, in-band operating-system and service level metrics, logs and alerts can also be collected and used to enrich the visualization dashboards. Open source components such as the Elastic Stack (Elasticsearch, Logstash, Kibana and select Beats) and Netdata are used for monitoring scenarios appropriate to each tool’s strengths, with other components such as Prometheus and Grafana in the process of being implemented. We’ll briefly discuss our experience to put these components together, and the decisions we had to make in order to automate their deployment and configuration for our goals. Finally, we lay out collaboration possibilities and future directions to enhance our project as a convenient starting point for others in the open source community to easily monitor their own Power Systems environments.

OSMC 2019 | Monitoring Alerts and Metrics on Large Power Systems Clusters by ...

NETWAYS

Service Function Chaining (SFC) uses software-defined networking (SDN) capabilities to create a service chain of connected network services (such as L4-7 like firewalls, network address translation [NAT], intrusion protection) and connect them in a virtual chain. This capability can be used by network operators to set up suites or catalogs of connected services that enable the use of a single network connection for many services, with different characteristics. networking-sfc is a service plugin of Openstack neutron. The talk will go over the architecture, implementation, use-cases and latest enhancements to networking-sfc (the APIs and implementation to support service function chaining in neutron). About the speaker: Farhad Sunavala is currently a principal architect/engineer working on Network Virtualization, Cloud service, and SDN technologies at Huawei Technology USA. He has led several wireless projects in Huawei including virtual EPC, service function chaining, etc. Prior to Huawei, he worked 17 years at Cisco. Farhad received his MS in Electrical and Computer Engineering from University of New Hampshire. His expertise includes L2/L3/L4 networking, Network Virtualization, SDN, Cloud Computing, and mobile wireless networks. He holds several patents in platforms, virtualization, wireless, service-chaining and cloud computing. Farhad was a core member of networking-sfc.

Service Function Chaining in Openstack Neutron

Michelle Holley

EEDC Apache Pig Language

Roger Rafanell Mas

"Apache Spark is today’s fastest growing Big Data analysis platform. Spark workloads typically maintain a persistent data set in memory, which is accessed multiple times over the network. Consequently, networking IO performance is a critical component in Spark systems. RDMA’s performance characteristics, such as high bandwidth, low latency, and low CPU overhead, offer a good opportunity for accelerating Spark by improving its data transfer facilities." "In this talk, we present a Java-based, RDMA network layer for Apache Spark. The implementation optimized both the RPC and the Shuffle mechanisms for RDMA. Initial benchmarking shows up to 25% improvement for Spark Applications." Watch the video presentation: http://wp.me/p3RLHQ-gzN Learn more: http://mellanox.com Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter

Accelerating apache spark with rdma

inside-BigData.com

Distributed Clouds and Software Defined Networking

US-Ignite

Similar to OpenNebulaConf2017EU: FairShare Scheduling by Valentina Zaccolo, INDIGO (20)

High Performance Flow Matching Architecture for Openflow Data Plane

PFQ@ 9th Italian Networking Workshop (Courmayeur)

PFQ@ PAM12

PF_DIRECT@TMA12

LarKC Tutorial at ISWC 2009 - Introduction

Spark Summit EU talk by Sameer Agarwal

Fast and Simplified Streaming, Ad-Hoc and Batch Analytics with FiloDB and Spa...

EEDC - Apache Pig

Mpls conference 2016-data center virtualisation-11-march

Network research

Archiving data from Durham to RAL using the File Transfer Service (FTS)

Feec telecom-nw-softwarization-aug-2015

On SDN Research Topics - Christian Esteve Rothenberg

TransPAC3/ACE Measurement & PerfSONAR Update

Datasets and tools_from_ncbi_and_elsewhere_for_microbiome_research_v_62817

OSMC 2019 | Monitoring Alerts and Metrics on Large Power Systems Clusters by ...

Service Function Chaining in Openstack Neutron

EEDC Apache Pig Language

Accelerating apache spark with rdma

Distributed Clouds and Software Defined Networking

More from OpenNebula Project

We've made our way into the world of open cloud — where each organization can find the right cloud for its unique needs. A single cloud management platform cannot be all things to all people. There will be a cloud space with several offerings focused on different environments and/or industries. The OpenNebula commitment to the open cloud is at the very base of its mission — to become the simplest cloud enabling platform — and its purpose — to bring simplicity to the private and hybrid enterprise cloud. OpenNebula exists to help companies build simple, cost-effective, reliable, open enterprise clouds on existing IT infrastructure. The OpenNebula Conference will be a great opportunity to communicate and share our vision and commitment, to look back at how the project has grown in the last 9 years, and to shed some insight into what to expect from the project in the near future.

OpenNebulaConf2019 - Welcome and Project Update - Ignacio M. Llorente, Rubén ...

OpenNebula Project

Computer networks are undergoing a phenomenal growth, driven by the rapidly increasing number of nodes constituting the networks. At the same time, the number of security threats on Internet and intranet networks is constantly increasing, and the testing and experimentation of cyber defense solutions require the availability of separate, test environments that best reflect the complexity of a real system. Such environments support the deployment and monitoring of complex mission-driven network scenarios, and cyber security training activities, thus enabling enterprises to study cyber defense strategies and allowing security researchers to evaluate their algorithms at scale. The main objective is delivering to researchers and practitioners an overview of the technological means and the practical steps to setup a private cloud platform based on OpenNebula for the creation and management of virtual environments that support cyber-security activities of training and testing, as well as an overview of its possible applications in the cyber security domain. In particular: 1. We describe our infrastructure based on OpenNebula 2. We overview our application, sitting on top of OpenNebula, as well as the technological tools involved in the management of its lifecycle (e.g., Ansible) . 3. We show how the platform can support various examples of security research activities  [References] Building an emulation environment for cyber security analyses of complex networked systems, Tanasache, Florin Dragos and Sorella, Mara and Bonomi, Silvia and Rapone, Raniero and Meacci, Davide, ICDCN '19, ACM, 2019

OpenNebulaConf2019 - Building Virtual Environments for Security Analyses of C...

OpenNebula Project

OpenNebulaConf2019 - CORD and Edge computing with OpenNebula - Alfonso Aureli...

OpenNebula Project

OpenNebulaConf2019 - 6 years (+) OpenNebula - Lessons learned - Sebastian Man...

OpenNebula Project

OpenNebula users have a range of storage options available to them, including proprietary appliances, proprietary software and Open Source software projects. This session will present a fully Open Source approach, that tightly integrates with Linux, and makes full use of the mature building blocks within the Linux kernel (LVM, Software RAID, DM-crypt, NVMe-oF Target, DRBD, etc...), and delivers one of the highest performance open source storage stacks currently available. The core goal is to expose the improved performance of NVMe storage devices to VMs and containers. The solution covers both local NVMe drives and NVMe-oF. For interacting with NVMe-oF targets it supports the Swordfish-API and LVM & Linux’s software NVMe-oF target. The solution contains a storage addon for OpenNebula.

OpenNebulaConf2019 - Performant and Resilient Storage the Open Source & Linux...

OpenNebula Project

OpenNebulaConf2019 - Image Backups in OpenNebula - Momčilo Medić - ITAF

OpenNebula Project

At Iguane Solutions, a lot of our "DevOps" tools are developed in Golang, and we have a good amount of experience in contributing to the Goca. I'll review just what contributions we make, as well as how we use Goca with different tools, on a daily basis, to manage and monitor our OpenNebula cloud. I will delve into the concept of Infrastructure as Code - deployment of VM instances on cloud, as well as, also address the metrics collection of deployed VMs. Finally, I will present how we can abstract VM management with automation tools thanks to GOCA.

OpenNebulaConf2019 - How We Use GOCA to Manage our OpenNebula Cloud - Jean-Ph...

OpenNebula Project

OpenNebulaConf2019 - Crytek: A Video gaming Edge Implementation "on the shoul...

OpenNebula Project

Replacing vCloud with OpenNebula

OpenNebula Project

NTS: What We Do With OpenNebula - and Why We Do It

OpenNebula Project

OpenNebula from the Perspective of an ISP

OpenNebula Project

NTS CAPTAIN / OpenNebula at Julius Blum GmbH

OpenNebula Project

Performant and Resilient Storage: The Open Source & Linux Way

OpenNebula Project

NetApp Hybrid Cloud with OpenNebula

OpenNebula Project

NSX with OpenNebula - upcoming 5.10

OpenNebula Project

Security for Private Cloud Environments

OpenNebula Project

CheckPoint R80.30 Installation on OpenNebula

OpenNebula Project

DE-CIX: CloudConnectivity

OpenNebula Project

DDC Demo

OpenNebula Project

Cloud Disaggregation with OpenNebula

OpenNebula Project

More from OpenNebula Project (20)