SlideShare une entreprise Scribd logo
1  sur  17
Télécharger pour lire hors ligne
THE
NEW
KIDS
ON
THE
BLOCK

presented by mike perez
MIKE
PEREZ
senior developer for DreamHost
•Maintain Cinder setup.	

•Maintain interactions between
Nova and Cinder.	

•Working with 900 Ceph OSD
setup comes out to around 4
petabytes.	

•Contribute fixes upstream.
MIKE
PEREZ
cinder core developer
•Wrote the start of Cinder

V2 API	

•Cinder API documentation	

•Cinder API references	

•Compatibility hammer	

•More code reviews than I
know what to do with
http://www.flickr.com/photos/nooccar/5844185400
WHAT
• project exists since Folsom release,
spun off Nova-volume	

• cinder manages block storage	

• not an object storage	

• not a file level storage	

• volumes attach to VM Instances	

• boot from volume	

• volumes have a lifecycle
independent of VM instance
http://www.flickr.com/photos/neilhinchley/294337822/
VOLUME
TYPES
•

Admin can create tiers of storage. e.g. two LVM
backends, one with SSD’s and the other with HDD’s.	

•Users can specify a tier they want when creating a
volume.
ARCHITECTURAL
OVERVIEW
Cinder Client

Cinder API

SQL DB

AMPQ

Cinder Scheduler

AMPQ

Cinder Volume

AMPQ

Cinder Backup
CINDER
API

•Volume create/delete/list/show	

•Create from image, snapshot	

•Snapshot create/delete/list/show	

•Backups create/restore/list/delete/show	

•Volume attach/detach (called by Nova)	

•Manage volume types	

•Manage quotas	

•Volume extend	

•Volume migrate	

•Transfer volumes from tenant to tenant
CINDER
SCHEDULER
•Chooses which back-end to place a new volume on	

•Configurable plugins for schedulers	

•Filter scheduler has filters and weighers	

•Filter scheduler Flow Example:	

•Starts with list of all back-ends	

•Filters according to capabilities	

•Drivers report capabilities and state (e.g., free space)	

•Default filters	

•Volume types	

•Sorts according to weights e.g., available free space	

•Returns best candidate
CINDER
VOLUME

•Drivers: Called by Manager, contains back-end-specific code

to communicate with various storage types (e.g., Linux LVM,
storage controllers from various vendors, distributed file
systems, etc.)	

•Admin can run multiple cinder-volume instances, each with
its own configuration file describing settings and the storage
back-end	

•One cinder-volume instance can manage multiple back-ends	

•Each back-end driver is generally configured to interact with
one storage pool	

•“Multi-threading”
CINDER
BACKUP
•

A backup is an archived copy of a Volume stored in a
object store.	

•A backup is just the data that was written, unlike a
snapshot which is the entire block.	

•Use Swift, Ceph, or IBM Tivoli Storage Manager
ATTACH
THAT
VOLUME
•

Nova calls Cinder via its API, passing connection information.

e.g., host name, iSCSI initiator name, FC WWNNs

•

Cinder API passes message to Cinder Volume.

•

Manager does initial error checking and calls volume driver.

•

Volume driver does any necessary preparation to allow the connection.

e.g., give the nova host permissions to access the volume.

•

Volume driver returns connection information, which is passed to Nova.

e.g., iSCSI iqn and portal, FC WWNN.

•

Nova creates the connection to the storage using the returned information.

•

Nova passes the volume device/file to the hypervisor.
HIGH
LEVEL
Nova
VM Instance
/dev/vda

Legend
Persistent Volume Data
Persistent Volume Control

Cinder
Linux Volume
Manager

KVM
ISCSI
Initiator

Target

/dev/hda
THE

GRID
DRIVER

REQUIREMENTS
• Volume Create/Delete	

• Volume Attach/Detach	

• Snapshot Create/Delete	

• Create Volume from Snapshot	

• Get Volume Stats	

• Copy Image to Volume	

• Copy Volume to Image	

• Clone Volume	

• Extend Volume
CURRENT
DRIVERS
•Coraid (AoE)	

•EMC VMAX/VNX (iSCSI)	

•GlusterFS (GlusterFS)	

•HP 3PAR (iSCSI/FC)	

•HP LeftHand (iSCSI)	

•Huawei T-series/Dorado (iSCSI)	

•IBM Storwize family/SVC (iSCSI/FC)	

•IBM XIV (iSCSI), LVM (iSCSI)	

•NetApp (iSCSI/NFS)

•Nexenta (iSCSI)	

•NFS (NFS)	

•RBD (Ceph)	

•Scality SOFS (scality)	

•Sheepdog (sheepdog)	

•Solaris (iSCSI)	

•SolidFire (iSCSI)	

•Windows Server 2012 (iSCSI)	

•Zadara (iSCSI)	

•Dell EqualLogic	

•VMware VMDK	

•IBM General Parallel File System (GPFS)
ICEHOUSE
BOUND
General Features	


•FC SAN Zone / Access Control
management	


•State machine	

•Volume retype	

•Volume Replication	

•Multiprocess API	

•Disaster recovery

New Drivers:	


•Federator Storage	

•ProphetStor	

•Generic ZFS ISCSI	

•HP Lefthand array iSCSI	

•HP MSA 2040
THANK
YOU!

Web: http://thing.ee	

Github: thingee	

Twitter: @thingee	

IRC: thingee	

Email: thingee@gmail.com

•Get started with Cinder:	

•https://wiki.openstack.org/wiki/Cinder	

•Source Code:	

•http://github.com/openstack/cinder	

•REST API Docs:	

•http://docs.openstack.org/api/openstack-blockstorage/2.0	

•Thanks Avishay Traeger from IBM for letting me
copy things out of his slides.

Contenu connexe

Tendances

Docker swarm-mike-goelzer-mv-meetup-45min-workshop 02242016 (1)
Docker swarm-mike-goelzer-mv-meetup-45min-workshop 02242016 (1)Docker swarm-mike-goelzer-mv-meetup-45min-workshop 02242016 (1)
Docker swarm-mike-goelzer-mv-meetup-45min-workshop 02242016 (1)Michelle Antebi
 
Breaking the RpiDocker challenge
Breaking the RpiDocker challenge Breaking the RpiDocker challenge
Breaking the RpiDocker challenge Nicolas De Loof
 
Docker Meetup: Docker Networking 1.11, by Madhu Venugopal
Docker Meetup: Docker Networking 1.11, by Madhu VenugopalDocker Meetup: Docker Networking 1.11, by Madhu Venugopal
Docker Meetup: Docker Networking 1.11, by Madhu VenugopalMichelle Antebi
 
Xen Project CI for OpenStack Overview
Xen Project CI for OpenStack OverviewXen Project CI for OpenStack Overview
Xen Project CI for OpenStack OverviewThe Linux Foundation
 
Container Runtimes and Tooling
Container Runtimes and ToolingContainer Runtimes and Tooling
Container Runtimes and ToolingKublr
 
ViFX Tech Connect: Containers & VMs
ViFX Tech Connect: Containers & VMsViFX Tech Connect: Containers & VMs
ViFX Tech Connect: Containers & VMsViFX
 
Service Discovery & Load-Balancing under Docker 1.12.0 @ Docker Meetup #22
Service Discovery & Load-Balancing under Docker 1.12.0 @ Docker Meetup #22Service Discovery & Load-Balancing under Docker 1.12.0 @ Docker Meetup #22
Service Discovery & Load-Balancing under Docker 1.12.0 @ Docker Meetup #22Ajeet Singh Raina
 
What's New in Docker 1.12 (June 20, 2016) by Mike Goelzer & Andrea Luzzardi
What's New in Docker 1.12 (June 20, 2016) by Mike Goelzer & Andrea LuzzardiWhat's New in Docker 1.12 (June 20, 2016) by Mike Goelzer & Andrea Luzzardi
What's New in Docker 1.12 (June 20, 2016) by Mike Goelzer & Andrea LuzzardiMike Goelzer
 
Unikernels: the rise of the library hypervisor in MirageOS
Unikernels: the rise of the library hypervisor in MirageOSUnikernels: the rise of the library hypervisor in MirageOS
Unikernels: the rise of the library hypervisor in MirageOSDocker, Inc.
 
Introduction to CNI (Container Network Interface)
Introduction to CNI (Container Network Interface)Introduction to CNI (Container Network Interface)
Introduction to CNI (Container Network Interface)HungWei Chiu
 
OSv – The OS designed for the Cloud
OSv – The OS designed for the CloudOSv – The OS designed for the Cloud
OSv – The OS designed for the CloudYandex
 
FreeSWITCH Cluster by K8s
FreeSWITCH Cluster by K8sFreeSWITCH Cluster by K8s
FreeSWITCH Cluster by K8sChien Cheng Wu
 
OpenStack Boston Summit: Kuryr project updates
OpenStack Boston Summit: Kuryr project updatesOpenStack Boston Summit: Kuryr project updates
OpenStack Boston Summit: Kuryr project updatesAntoni Segura Puimedon
 
Introduction to OpenNetwork and SDN
Introduction to OpenNetwork and SDNIntroduction to OpenNetwork and SDN
Introduction to OpenNetwork and SDNHungWei Chiu
 
IITCC15: The Bare-Metal Hypervisor as a Platform for Innovation
IITCC15: The Bare-Metal Hypervisor as a Platform for InnovationIITCC15: The Bare-Metal Hypervisor as a Platform for Innovation
IITCC15: The Bare-Metal Hypervisor as a Platform for InnovationThe Linux Foundation
 
Writing the Container Network Interface(CNI) plugin in golang
Writing the Container Network Interface(CNI) plugin in golangWriting the Container Network Interface(CNI) plugin in golang
Writing the Container Network Interface(CNI) plugin in golangHungWei Chiu
 
Docker Orchestration at Production Scale
Docker Orchestration at Production Scale Docker Orchestration at Production Scale
Docker Orchestration at Production Scale Docker, Inc.
 
DockerCon EU 2015: Docker Networking Deep Dive
DockerCon EU 2015: Docker Networking Deep DiveDockerCon EU 2015: Docker Networking Deep Dive
DockerCon EU 2015: Docker Networking Deep DiveDocker, Inc.
 
Kubernetes networking
Kubernetes networkingKubernetes networking
Kubernetes networkingSim Janghoon
 

Tendances (20)

Docker swarm-mike-goelzer-mv-meetup-45min-workshop 02242016 (1)
Docker swarm-mike-goelzer-mv-meetup-45min-workshop 02242016 (1)Docker swarm-mike-goelzer-mv-meetup-45min-workshop 02242016 (1)
Docker swarm-mike-goelzer-mv-meetup-45min-workshop 02242016 (1)
 
Breaking the RpiDocker challenge
Breaking the RpiDocker challenge Breaking the RpiDocker challenge
Breaking the RpiDocker challenge
 
Docker Meetup: Docker Networking 1.11, by Madhu Venugopal
Docker Meetup: Docker Networking 1.11, by Madhu VenugopalDocker Meetup: Docker Networking 1.11, by Madhu Venugopal
Docker Meetup: Docker Networking 1.11, by Madhu Venugopal
 
Xen Project CI for OpenStack Overview
Xen Project CI for OpenStack OverviewXen Project CI for OpenStack Overview
Xen Project CI for OpenStack Overview
 
Container Runtimes and Tooling
Container Runtimes and ToolingContainer Runtimes and Tooling
Container Runtimes and Tooling
 
ViFX Tech Connect: Containers & VMs
ViFX Tech Connect: Containers & VMsViFX Tech Connect: Containers & VMs
ViFX Tech Connect: Containers & VMs
 
Service Discovery & Load-Balancing under Docker 1.12.0 @ Docker Meetup #22
Service Discovery & Load-Balancing under Docker 1.12.0 @ Docker Meetup #22Service Discovery & Load-Balancing under Docker 1.12.0 @ Docker Meetup #22
Service Discovery & Load-Balancing under Docker 1.12.0 @ Docker Meetup #22
 
What's New in Docker 1.12 (June 20, 2016) by Mike Goelzer & Andrea Luzzardi
What's New in Docker 1.12 (June 20, 2016) by Mike Goelzer & Andrea LuzzardiWhat's New in Docker 1.12 (June 20, 2016) by Mike Goelzer & Andrea Luzzardi
What's New in Docker 1.12 (June 20, 2016) by Mike Goelzer & Andrea Luzzardi
 
Unikernels: the rise of the library hypervisor in MirageOS
Unikernels: the rise of the library hypervisor in MirageOSUnikernels: the rise of the library hypervisor in MirageOS
Unikernels: the rise of the library hypervisor in MirageOS
 
Introduction to CNI (Container Network Interface)
Introduction to CNI (Container Network Interface)Introduction to CNI (Container Network Interface)
Introduction to CNI (Container Network Interface)
 
OSv – The OS designed for the Cloud
OSv – The OS designed for the CloudOSv – The OS designed for the Cloud
OSv – The OS designed for the Cloud
 
FreeSWITCH Cluster by K8s
FreeSWITCH Cluster by K8sFreeSWITCH Cluster by K8s
FreeSWITCH Cluster by K8s
 
What's New in Docker 1.12?
What's New in Docker 1.12?What's New in Docker 1.12?
What's New in Docker 1.12?
 
OpenStack Boston Summit: Kuryr project updates
OpenStack Boston Summit: Kuryr project updatesOpenStack Boston Summit: Kuryr project updates
OpenStack Boston Summit: Kuryr project updates
 
Introduction to OpenNetwork and SDN
Introduction to OpenNetwork and SDNIntroduction to OpenNetwork and SDN
Introduction to OpenNetwork and SDN
 
IITCC15: The Bare-Metal Hypervisor as a Platform for Innovation
IITCC15: The Bare-Metal Hypervisor as a Platform for InnovationIITCC15: The Bare-Metal Hypervisor as a Platform for Innovation
IITCC15: The Bare-Metal Hypervisor as a Platform for Innovation
 
Writing the Container Network Interface(CNI) plugin in golang
Writing the Container Network Interface(CNI) plugin in golangWriting the Container Network Interface(CNI) plugin in golang
Writing the Container Network Interface(CNI) plugin in golang
 
Docker Orchestration at Production Scale
Docker Orchestration at Production Scale Docker Orchestration at Production Scale
Docker Orchestration at Production Scale
 
DockerCon EU 2015: Docker Networking Deep Dive
DockerCon EU 2015: Docker Networking Deep DiveDockerCon EU 2015: Docker Networking Deep Dive
DockerCon EU 2015: Docker Networking Deep Dive
 
Kubernetes networking
Kubernetes networkingKubernetes networking
Kubernetes networking
 

Similaire à Intro to OpenStack Cinder and IceHouse Bound!

Cinder: The new kids on the block
Cinder: The new kids on the blockCinder: The new kids on the block
Cinder: The new kids on the blockthingee
 
Open stack cinder
Open stack cinderOpen stack cinder
Open stack cinderYong Luo
 
Introduction to docker
Introduction to dockerIntroduction to docker
Introduction to dockerInstruqt
 
Encrypt your volumes with barbican open stack 2018
Encrypt your volumes with barbican open stack 2018Encrypt your volumes with barbican open stack 2018
Encrypt your volumes with barbican open stack 2018Duncan Wannamaker
 
Kubernetes automation in production
Kubernetes automation in productionKubernetes automation in production
Kubernetes automation in productionPaul Bakker
 
SCUGBE_Lowlands_Unite_2017_Managing Windows Containers with Docker
SCUGBE_Lowlands_Unite_2017_Managing Windows Containers with DockerSCUGBE_Lowlands_Unite_2017_Managing Windows Containers with Docker
SCUGBE_Lowlands_Unite_2017_Managing Windows Containers with DockerKenny Buntinx
 
vSphere Integrated Containers 101 and End-User Workflow
vSphere Integrated Containers 101 and End-User WorkflowvSphere Integrated Containers 101 and End-User Workflow
vSphere Integrated Containers 101 and End-User WorkflowSimone Morellato
 
Container and Cloud Native Application: What is VMware doing in this space? -...
Container and Cloud Native Application: What is VMware doing in this space? -...Container and Cloud Native Application: What is VMware doing in this space? -...
Container and Cloud Native Application: What is VMware doing in this space? -...gguglie
 
Deploying to Ubuntu on Linode
Deploying to Ubuntu on LinodeDeploying to Ubuntu on Linode
Deploying to Ubuntu on LinodeWO Community
 
XenServer Virtualization In Cloud Environments
XenServer Virtualization In Cloud EnvironmentsXenServer Virtualization In Cloud Environments
XenServer Virtualization In Cloud EnvironmentsTim Mackey
 
Butter bei die Fische - Ein Jahr Entwicklung und Produktion mit Docker
Butter bei die Fische - Ein Jahr Entwicklung und Produktion mit DockerButter bei die Fische - Ein Jahr Entwicklung und Produktion mit Docker
Butter bei die Fische - Ein Jahr Entwicklung und Produktion mit Dockerjohannesunterstein
 
Gordonh0945deepdive openstackcompute-140417174059-phpapp02
Gordonh0945deepdive openstackcompute-140417174059-phpapp02Gordonh0945deepdive openstackcompute-140417174059-phpapp02
Gordonh0945deepdive openstackcompute-140417174059-phpapp02Công TÔ
 
Advanced Docker Developer Workflows on MacOS X and Windows
Advanced Docker Developer Workflows on MacOS X and WindowsAdvanced Docker Developer Workflows on MacOS X and Windows
Advanced Docker Developer Workflows on MacOS X and WindowsAnil Madhavapeddy
 
OSCON: Advanced Docker developer workflows on Mac OS and Windows
OSCON: Advanced Docker developer workflows on Mac OS and WindowsOSCON: Advanced Docker developer workflows on Mac OS and Windows
OSCON: Advanced Docker developer workflows on Mac OS and WindowsDocker, Inc.
 
My complicated WordPress site
My complicated WordPress siteMy complicated WordPress site
My complicated WordPress siteMarko Heijnen
 
DockerCon EU 2015 Barcelona
DockerCon EU 2015 BarcelonaDockerCon EU 2015 Barcelona
DockerCon EU 2015 BarcelonaRoman Dembitsky
 

Similaire à Intro to OpenStack Cinder and IceHouse Bound! (20)

Cinder: The new kids on the block
Cinder: The new kids on the blockCinder: The new kids on the block
Cinder: The new kids on the block
 
Open stack cinder
Open stack cinderOpen stack cinder
Open stack cinder
 
Introduction to docker
Introduction to dockerIntroduction to docker
Introduction to docker
 
Encrypt your volumes with barbican open stack 2018
Encrypt your volumes with barbican open stack 2018Encrypt your volumes with barbican open stack 2018
Encrypt your volumes with barbican open stack 2018
 
Cinder havana-131111230629-phpapp02
Cinder havana-131111230629-phpapp02Cinder havana-131111230629-phpapp02
Cinder havana-131111230629-phpapp02
 
Instant ColdFusion with Vagrant
Instant ColdFusion with VagrantInstant ColdFusion with Vagrant
Instant ColdFusion with Vagrant
 
OpenStack and Windows
OpenStack and WindowsOpenStack and Windows
OpenStack and Windows
 
Kubernetes automation in production
Kubernetes automation in productionKubernetes automation in production
Kubernetes automation in production
 
SCUGBE_Lowlands_Unite_2017_Managing Windows Containers with Docker
SCUGBE_Lowlands_Unite_2017_Managing Windows Containers with DockerSCUGBE_Lowlands_Unite_2017_Managing Windows Containers with Docker
SCUGBE_Lowlands_Unite_2017_Managing Windows Containers with Docker
 
vSphere Integrated Containers 101 and End-User Workflow
vSphere Integrated Containers 101 and End-User WorkflowvSphere Integrated Containers 101 and End-User Workflow
vSphere Integrated Containers 101 and End-User Workflow
 
Container and Cloud Native Application: What is VMware doing in this space? -...
Container and Cloud Native Application: What is VMware doing in this space? -...Container and Cloud Native Application: What is VMware doing in this space? -...
Container and Cloud Native Application: What is VMware doing in this space? -...
 
Deploying to Ubuntu on Linode
Deploying to Ubuntu on LinodeDeploying to Ubuntu on Linode
Deploying to Ubuntu on Linode
 
XenServer Virtualization In Cloud Environments
XenServer Virtualization In Cloud EnvironmentsXenServer Virtualization In Cloud Environments
XenServer Virtualization In Cloud Environments
 
Butter bei die Fische - Ein Jahr Entwicklung und Produktion mit Docker
Butter bei die Fische - Ein Jahr Entwicklung und Produktion mit DockerButter bei die Fische - Ein Jahr Entwicklung und Produktion mit Docker
Butter bei die Fische - Ein Jahr Entwicklung und Produktion mit Docker
 
Instant ColdFusion with Vagrant
Instant ColdFusion with VagrantInstant ColdFusion with Vagrant
Instant ColdFusion with Vagrant
 
Gordonh0945deepdive openstackcompute-140417174059-phpapp02
Gordonh0945deepdive openstackcompute-140417174059-phpapp02Gordonh0945deepdive openstackcompute-140417174059-phpapp02
Gordonh0945deepdive openstackcompute-140417174059-phpapp02
 
Advanced Docker Developer Workflows on MacOS X and Windows
Advanced Docker Developer Workflows on MacOS X and WindowsAdvanced Docker Developer Workflows on MacOS X and Windows
Advanced Docker Developer Workflows on MacOS X and Windows
 
OSCON: Advanced Docker developer workflows on Mac OS and Windows
OSCON: Advanced Docker developer workflows on Mac OS and WindowsOSCON: Advanced Docker developer workflows on Mac OS and Windows
OSCON: Advanced Docker developer workflows on Mac OS and Windows
 
My complicated WordPress site
My complicated WordPress siteMy complicated WordPress site
My complicated WordPress site
 
DockerCon EU 2015 Barcelona
DockerCon EU 2015 BarcelonaDockerCon EU 2015 Barcelona
DockerCon EU 2015 Barcelona
 

Dernier

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsNanddeep Nachan
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Jeffrey Haguewood
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxRustici Software
 
A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusA Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusZilliz
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024The Digital Insurer
 
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelNavi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelDeepika Singh
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Zilliz
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native ApplicationsWSO2
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWERMadyBayot
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024The Digital Insurer
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businesspanagenda
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?Igalia
 

Dernier (20)

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusA Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source Milvus
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelNavi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 

Intro to OpenStack Cinder and IceHouse Bound!

  • 2. MIKE PEREZ senior developer for DreamHost •Maintain Cinder setup. •Maintain interactions between Nova and Cinder. •Working with 900 Ceph OSD setup comes out to around 4 petabytes. •Contribute fixes upstream.
  • 3. MIKE PEREZ cinder core developer •Wrote the start of Cinder V2 API •Cinder API documentation •Cinder API references •Compatibility hammer •More code reviews than I know what to do with http://www.flickr.com/photos/nooccar/5844185400
  • 4. WHAT • project exists since Folsom release, spun off Nova-volume • cinder manages block storage • not an object storage • not a file level storage • volumes attach to VM Instances • boot from volume • volumes have a lifecycle independent of VM instance http://www.flickr.com/photos/neilhinchley/294337822/
  • 5. VOLUME TYPES • Admin can create tiers of storage. e.g. two LVM backends, one with SSD’s and the other with HDD’s. •Users can specify a tier they want when creating a volume.
  • 6. ARCHITECTURAL OVERVIEW Cinder Client Cinder API SQL DB AMPQ Cinder Scheduler AMPQ Cinder Volume AMPQ Cinder Backup
  • 7. CINDER API •Volume create/delete/list/show •Create from image, snapshot •Snapshot create/delete/list/show •Backups create/restore/list/delete/show •Volume attach/detach (called by Nova) •Manage volume types •Manage quotas •Volume extend •Volume migrate •Transfer volumes from tenant to tenant
  • 8. CINDER SCHEDULER •Chooses which back-end to place a new volume on •Configurable plugins for schedulers •Filter scheduler has filters and weighers •Filter scheduler Flow Example: •Starts with list of all back-ends •Filters according to capabilities •Drivers report capabilities and state (e.g., free space) •Default filters •Volume types •Sorts according to weights e.g., available free space •Returns best candidate
  • 9. CINDER VOLUME •Drivers: Called by Manager, contains back-end-specific code to communicate with various storage types (e.g., Linux LVM, storage controllers from various vendors, distributed file systems, etc.) •Admin can run multiple cinder-volume instances, each with its own configuration file describing settings and the storage back-end •One cinder-volume instance can manage multiple back-ends •Each back-end driver is generally configured to interact with one storage pool •“Multi-threading”
  • 10. CINDER BACKUP • A backup is an archived copy of a Volume stored in a object store. •A backup is just the data that was written, unlike a snapshot which is the entire block. •Use Swift, Ceph, or IBM Tivoli Storage Manager
  • 11. ATTACH THAT VOLUME • Nova calls Cinder via its API, passing connection information.
 e.g., host name, iSCSI initiator name, FC WWNNs • Cinder API passes message to Cinder Volume. • Manager does initial error checking and calls volume driver. • Volume driver does any necessary preparation to allow the connection.
 e.g., give the nova host permissions to access the volume. • Volume driver returns connection information, which is passed to Nova.
 e.g., iSCSI iqn and portal, FC WWNN. • Nova creates the connection to the storage using the returned information. • Nova passes the volume device/file to the hypervisor.
  • 12. HIGH LEVEL Nova VM Instance /dev/vda Legend Persistent Volume Data Persistent Volume Control Cinder Linux Volume Manager KVM ISCSI Initiator Target /dev/hda
  • 14. DRIVER REQUIREMENTS • Volume Create/Delete • Volume Attach/Detach • Snapshot Create/Delete • Create Volume from Snapshot • Get Volume Stats • Copy Image to Volume • Copy Volume to Image • Clone Volume • Extend Volume
  • 15. CURRENT DRIVERS •Coraid (AoE) •EMC VMAX/VNX (iSCSI) •GlusterFS (GlusterFS) •HP 3PAR (iSCSI/FC) •HP LeftHand (iSCSI) •Huawei T-series/Dorado (iSCSI) •IBM Storwize family/SVC (iSCSI/FC) •IBM XIV (iSCSI), LVM (iSCSI) •NetApp (iSCSI/NFS) •Nexenta (iSCSI) •NFS (NFS) •RBD (Ceph) •Scality SOFS (scality) •Sheepdog (sheepdog) •Solaris (iSCSI) •SolidFire (iSCSI) •Windows Server 2012 (iSCSI) •Zadara (iSCSI) •Dell EqualLogic •VMware VMDK •IBM General Parallel File System (GPFS)
  • 16. ICEHOUSE BOUND General Features •FC SAN Zone / Access Control management •State machine •Volume retype •Volume Replication •Multiprocess API •Disaster recovery New Drivers: •Federator Storage •ProphetStor •Generic ZFS ISCSI •HP Lefthand array iSCSI •HP MSA 2040
  • 17. THANK YOU! Web: http://thing.ee Github: thingee Twitter: @thingee IRC: thingee Email: thingee@gmail.com •Get started with Cinder: •https://wiki.openstack.org/wiki/Cinder •Source Code: •http://github.com/openstack/cinder •REST API Docs: •http://docs.openstack.org/api/openstack-blockstorage/2.0 •Thanks Avishay Traeger from IBM for letting me copy things out of his slides.