SlideShare une entreprise Scribd logo
1  sur  9
Télécharger pour lire hors ligne
Eoghan Glynn1
Ceilometer:
Juno at the halfway point
Eoghan Glynn
eglynn@redhat.com
Eoghan Glynn2
Agenda
● Top-level themes for Juno
● Changes in “how we do things” upstream
● Detailed work items
Eoghan Glynn3
Top-level themes for Juno
● Address TC-mandated requirements from gap analysis
● Pay-down known architectural debt
● Adopt some new processes upstream
● Stretch goal: figure out relationship with Monasca &
Stacktach
Eoghan Glynn4
TC-mandated requirements from gap analysis
● Word-smith the project mission statement
● https://review.openstack.org/87526
● Viable sql-alchemy driver in the gate
● required by distro issues and mongo licensing concerns
● Land stalled Tempest coverage
● complicated by branchless Tempest
● Enhance user & ops oriented documentation
● re-purpose RDO Getting Started guide
● Participate in grenade upgrade test harness
● stretch: extend Javelin resource survivability assertions
Eoghan Glynn5
Pay-down architectural debt
● Snapshot'ing of resource-metadata per datapoint now
recognized as a major early misstep
● Leads to write & query inefficiencies in the metering
store for little benefit
● Solution is to re-imagine ceilometer as more like a
Time-Series-Data-as-a-Service
● prototyped in stackforge/gnocchi project
● sample data shorn of resource metadata
● eager pre-aggregation & rollup
● resource state timeline reconstructed from events
● Gnarly migration issues remain to be worked out
Eoghan Glynn6
Changes in upstream team dynamic
● Collaborative decision-making within core team
● Adoption of ceilometer-specs repo for BP review
● FPF for juno-3 versus down-to-the-wire
● Mid-cycle meetup to ensure momentum
● Direct engagement with QA team
● More proactive BP-to-resource matchmaking
Eoghan Glynn7
Detailed work items
● TSDaaS
● canonical implementation against pandas+swift
● additional drivers e.g. using InfluxDB
● integration with metrics pipeline and alarm evaluation
● work of OPW intern re-based on this
● Sql-alchemy viability
● removal of v1 API support
● rationalization of schema, selective denormalization
● simplification of upsert/retry-on-rollback logic
● input from sqlalchemy author Mike Bayer
Eoghan Glynn8
Detailed work items
● SNMP improvements
● declarative pollsters
● reduce chattiness with snmpd
● Central agent SpoF
● tooz for coordination, possibly taskflow for workload
partitioning
● similarly for partitioned alarm evaluator
● Events completion
● support in mongo and hbase drivers
● assumes additional importance with advent of TSDaaS
Eoghan Glynn9
Detailed work items
● QA
● beef up Tempest & Grenade coverage
● backporting conumdrum with branchless Tempest
● IPMI sensor data
● agreed at summit that Ironic will “own the polling cycle”,
emitting notifications for ceilometer to consume
● Miscellaneous
● network services metering: (LB|FW|VPN)aaS
● arithmetic transformer to combine samples across
multiple meters
● eventlet deprecation, replacement by asyncio/trollius?

Contenu connexe

Tendances

XHR Web APps F2F at San Jose
XHR Web APps F2F at San JoseXHR Web APps F2F at San Jose
XHR Web APps F2F at San Jose
jungkees
 
Flink Forward San Francisco 2019: Massive Scale Data Processing at Netflix us...
Flink Forward San Francisco 2019: Massive Scale Data Processing at Netflix us...Flink Forward San Francisco 2019: Massive Scale Data Processing at Netflix us...
Flink Forward San Francisco 2019: Massive Scale Data Processing at Netflix us...
Flink Forward
 
pipeline_structure_overview
pipeline_structure_overviewpipeline_structure_overview
pipeline_structure_overview
setitesuk
 
Tuning the HotSpot JVM Garbage Collectors
Tuning the HotSpot JVM Garbage CollectorsTuning the HotSpot JVM Garbage Collectors
Tuning the HotSpot JVM Garbage Collectors
langer4711
 

Tendances (20)

XHR Web APps F2F at San Jose
XHR Web APps F2F at San JoseXHR Web APps F2F at San Jose
XHR Web APps F2F at San Jose
 
Flink Forward San Francisco 2019: Massive Scale Data Processing at Netflix us...
Flink Forward San Francisco 2019: Massive Scale Data Processing at Netflix us...Flink Forward San Francisco 2019: Massive Scale Data Processing at Netflix us...
Flink Forward San Francisco 2019: Massive Scale Data Processing at Netflix us...
 
Gc Easy
Gc EasyGc Easy
Gc Easy
 
Monitoring Kubernetes with Prometheus
Monitoring Kubernetes with PrometheusMonitoring Kubernetes with Prometheus
Monitoring Kubernetes with Prometheus
 
Python and trending_data_ops
Python and trending_data_opsPython and trending_data_ops
Python and trending_data_ops
 
Kong ingress controller kubernetes ingress on steroids
Kong ingress controller   kubernetes ingress on steroidsKong ingress controller   kubernetes ingress on steroids
Kong ingress controller kubernetes ingress on steroids
 
Pywps
PywpsPywps
Pywps
 
Flink Connector Development Tips & Tricks
Flink Connector Development Tips & TricksFlink Connector Development Tips & Tricks
Flink Connector Development Tips & Tricks
 
Monitoring on Kubernetes using prometheus
Monitoring on Kubernetes using prometheusMonitoring on Kubernetes using prometheus
Monitoring on Kubernetes using prometheus
 
Nova Updates - Kilo Edition
Nova Updates - Kilo EditionNova Updates - Kilo Edition
Nova Updates - Kilo Edition
 
How to jSparrow Jenkins?
How to jSparrow Jenkins?How to jSparrow Jenkins?
How to jSparrow Jenkins?
 
pipeline_structure_overview
pipeline_structure_overviewpipeline_structure_overview
pipeline_structure_overview
 
Tuning the HotSpot JVM Garbage Collectors
Tuning the HotSpot JVM Garbage CollectorsTuning the HotSpot JVM Garbage Collectors
Tuning the HotSpot JVM Garbage Collectors
 
Sprint 59
Sprint 59Sprint 59
Sprint 59
 
KubeOne
KubeOne KubeOne
KubeOne
 
Kubermatic How to Migrate 100 Clusters from On-Prem to Google Cloud Without D...
Kubermatic How to Migrate 100 Clusters from On-Prem to Google Cloud Without D...Kubermatic How to Migrate 100 Clusters from On-Prem to Google Cloud Without D...
Kubermatic How to Migrate 100 Clusters from On-Prem to Google Cloud Without D...
 
OpenStack reliability metrics
OpenStack reliability metricsOpenStack reliability metrics
OpenStack reliability metrics
 
Intro to os-faults library
Intro to os-faults libraryIntro to os-faults library
Intro to os-faults library
 
Connect at Twitter-scale | Jordan Bull and Ryanne Dolan, Twitter
Connect at Twitter-scale | Jordan Bull and Ryanne Dolan, TwitterConnect at Twitter-scale | Jordan Bull and Ryanne Dolan, Twitter
Connect at Twitter-scale | Jordan Bull and Ryanne Dolan, Twitter
 
A Tale of Two Data Centers: Kafka Streams Resiliency (Anna McDonald, Confluen...
A Tale of Two Data Centers: Kafka Streams Resiliency (Anna McDonald, Confluen...A Tale of Two Data Centers: Kafka Streams Resiliency (Anna McDonald, Confluen...
A Tale of Two Data Centers: Kafka Streams Resiliency (Anna McDonald, Confluen...
 

En vedette

Mega ilk 90 gün - kopya
Mega ilk 90 gün - kopyaMega ilk 90 gün - kopya
Mega ilk 90 gün - kopya
cosacos2
 
Prospecting
ProspectingProspecting
Prospecting
cosacos2
 
Mega sunum
Mega sunumMega sunum
Mega sunum
cosacos2
 
Mega ilk 90gün
Mega ilk 90günMega ilk 90gün
Mega ilk 90gün
cosacos2
 
Duygusalzekaegitimi
DuygusalzekaegitimiDuygusalzekaegitimi
Duygusalzekaegitimi
cosacos2
 
Namelistandfollowup
NamelistandfollowupNamelistandfollowup
Namelistandfollowup
cosacos2
 

En vedette (13)

忠孝酒造ブラストプレビューシステム ガイド
忠孝酒造ブラストプレビューシステム ガイド忠孝酒造ブラストプレビューシステム ガイド
忠孝酒造ブラストプレビューシステム ガイド
 
Mega ilk 90 gün - kopya
Mega ilk 90 gün - kopyaMega ilk 90 gün - kopya
Mega ilk 90 gün - kopya
 
忠孝酒造ブラストプレビューシステム
忠孝酒造ブラストプレビューシステム忠孝酒造ブラストプレビューシステム
忠孝酒造ブラストプレビューシステム
 
Prospecting
ProspectingProspecting
Prospecting
 
School of Scholars,Amravati
School of Scholars,AmravatiSchool of Scholars,Amravati
School of Scholars,Amravati
 
MegaSunum
MegaSunumMegaSunum
MegaSunum
 
Is It Working - And How Would You Know?
Is It Working - And How Would You Know?Is It Working - And How Would You Know?
Is It Working - And How Would You Know?
 
Mega sunum
Mega sunumMega sunum
Mega sunum
 
Mega ilk 90gün
Mega ilk 90günMega ilk 90gün
Mega ilk 90gün
 
Duygusalzekaegitimi
DuygusalzekaegitimiDuygusalzekaegitimi
Duygusalzekaegitimi
 
Affordable Business Intelligence (BI) Tool
Affordable Business Intelligence (BI) ToolAffordable Business Intelligence (BI) Tool
Affordable Business Intelligence (BI) Tool
 
Namelistandfollowup
NamelistandfollowupNamelistandfollowup
Namelistandfollowup
 
Measuring Social Media & Better Understanding Audiences
Measuring Social Media & Better Understanding AudiencesMeasuring Social Media & Better Understanding Audiences
Measuring Social Media & Better Understanding Audiences
 

Similaire à Ceilometer juno-midpoint

Similaire à Ceilometer juno-midpoint (20)

Create a One Click Migration (OCM) process to Automate Repeatable Infrastruct...
Create a One Click Migration (OCM) process to Automate Repeatable Infrastruct...Create a One Click Migration (OCM) process to Automate Repeatable Infrastruct...
Create a One Click Migration (OCM) process to Automate Repeatable Infrastruct...
 
Startup safari 2020 making s3 more resilient using lambda@edge
Startup safari 2020 making s3 more resilient using lambda@edgeStartup safari 2020 making s3 more resilient using lambda@edge
Startup safari 2020 making s3 more resilient using lambda@edge
 
Reliability Pipelines With Keptn Quality Gates
Reliability Pipelines With Keptn Quality GatesReliability Pipelines With Keptn Quality Gates
Reliability Pipelines With Keptn Quality Gates
 
Ceilometer Updates - Kilo Edition
Ceilometer Updates - Kilo EditionCeilometer Updates - Kilo Edition
Ceilometer Updates - Kilo Edition
 
PTG recap
PTG recapPTG recap
PTG recap
 
Scaling Monitoring At Databricks From Prometheus to M3
Scaling Monitoring At Databricks From Prometheus to M3Scaling Monitoring At Databricks From Prometheus to M3
Scaling Monitoring At Databricks From Prometheus to M3
 
Task migration using CRIU
Task migration using CRIUTask migration using CRIU
Task migration using CRIU
 
Telemetry Updates - Juno Edition
Telemetry Updates - Juno Edition Telemetry Updates - Juno Edition
Telemetry Updates - Juno Edition
 
Bootstrapping a ML platform at Bluevine [Airflow Summit 2020]
Bootstrapping a ML platform at Bluevine [Airflow Summit 2020]Bootstrapping a ML platform at Bluevine [Airflow Summit 2020]
Bootstrapping a ML platform at Bluevine [Airflow Summit 2020]
 
Upcoming features in Airflow 2
Upcoming features in Airflow 2Upcoming features in Airflow 2
Upcoming features in Airflow 2
 
Parallel Batch Performance Considerations
Parallel Batch Performance ConsiderationsParallel Batch Performance Considerations
Parallel Batch Performance Considerations
 
Airflow Intro-1.pdf
Airflow Intro-1.pdfAirflow Intro-1.pdf
Airflow Intro-1.pdf
 
Clearing Airflow Obstructions
Clearing Airflow ObstructionsClearing Airflow Obstructions
Clearing Airflow Obstructions
 
Flink powered stream processing platform at Pinterest
Flink powered stream processing platform at PinterestFlink powered stream processing platform at Pinterest
Flink powered stream processing platform at Pinterest
 
Running Agile on a non-Agile Environment, by Nuno Caneco
Running Agile on a non-Agile Environment, by Nuno CanecoRunning Agile on a non-Agile Environment, by Nuno Caneco
Running Agile on a non-Agile Environment, by Nuno Caneco
 
Running Scrum on a non-Agile environment - Tales from a past experience" By N...
Running Scrum on a non-Agile environment - Tales from a past experience" By N...Running Scrum on a non-Agile environment - Tales from a past experience" By N...
Running Scrum on a non-Agile environment - Tales from a past experience" By N...
 
Building real time Data Pipeline using Spark Streaming
Building real time Data Pipeline using Spark StreamingBuilding real time Data Pipeline using Spark Streaming
Building real time Data Pipeline using Spark Streaming
 
So you want to write a cloud function
So you want to write a cloud functionSo you want to write a cloud function
So you want to write a cloud function
 
DevOps Braga #15: Agentless monitoring with icinga and prometheus
DevOps Braga #15: Agentless monitoring with icinga and prometheusDevOps Braga #15: Agentless monitoring with icinga and prometheus
DevOps Braga #15: Agentless monitoring with icinga and prometheus
 
Rego University: Integrating MSP with CA PPM (CA Clarity PPM)
Rego University: Integrating MSP with CA PPM (CA Clarity PPM)Rego University: Integrating MSP with CA PPM (CA Clarity PPM)
Rego University: Integrating MSP with CA PPM (CA Clarity PPM)
 

Dernier

Call Girls In Bangalore ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bangalore ☎ 7737669865 🥵 Book Your One night StandCall Girls In Bangalore ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bangalore ☎ 7737669865 🥵 Book Your One night Stand
amitlee9823
 
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
Christo Ananth
 
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...
Christo Ananth
 

Dernier (20)

Booking open Available Pune Call Girls Pargaon 6297143586 Call Hot Indian Gi...
Booking open Available Pune Call Girls Pargaon  6297143586 Call Hot Indian Gi...Booking open Available Pune Call Girls Pargaon  6297143586 Call Hot Indian Gi...
Booking open Available Pune Call Girls Pargaon 6297143586 Call Hot Indian Gi...
 
Roadmap to Membership of RICS - Pathways and Routes
Roadmap to Membership of RICS - Pathways and RoutesRoadmap to Membership of RICS - Pathways and Routes
Roadmap to Membership of RICS - Pathways and Routes
 
(INDIRA) Call Girl Meerut Call Now 8617697112 Meerut Escorts 24x7
(INDIRA) Call Girl Meerut Call Now 8617697112 Meerut Escorts 24x7(INDIRA) Call Girl Meerut Call Now 8617697112 Meerut Escorts 24x7
(INDIRA) Call Girl Meerut Call Now 8617697112 Meerut Escorts 24x7
 
VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...
VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...
VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...
 
Call Girls In Bangalore ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bangalore ☎ 7737669865 🥵 Book Your One night StandCall Girls In Bangalore ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bangalore ☎ 7737669865 🥵 Book Your One night Stand
 
Call Girls Wakad Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Wakad Call Me 7737669865 Budget Friendly No Advance BookingCall Girls Wakad Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Wakad Call Me 7737669865 Budget Friendly No Advance Booking
 
KubeKraft presentation @CloudNativeHooghly
KubeKraft presentation @CloudNativeHooghlyKubeKraft presentation @CloudNativeHooghly
KubeKraft presentation @CloudNativeHooghly
 
Thermal Engineering Unit - I & II . ppt
Thermal Engineering  Unit - I & II . pptThermal Engineering  Unit - I & II . ppt
Thermal Engineering Unit - I & II . ppt
 
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptxBSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx
 
Generative AI or GenAI technology based PPT
Generative AI or GenAI technology based PPTGenerative AI or GenAI technology based PPT
Generative AI or GenAI technology based PPT
 
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
 
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
 
Double rodded leveling 1 pdf activity 01
Double rodded leveling 1 pdf activity 01Double rodded leveling 1 pdf activity 01
Double rodded leveling 1 pdf activity 01
 
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
 
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
 
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...
 
Bhosari ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready For ...
Bhosari ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready For ...Bhosari ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready For ...
Bhosari ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready For ...
 
Unit 1 - Soil Classification and Compaction.pdf
Unit 1 - Soil Classification and Compaction.pdfUnit 1 - Soil Classification and Compaction.pdf
Unit 1 - Soil Classification and Compaction.pdf
 
NFPA 5000 2024 standard .
NFPA 5000 2024 standard                                  .NFPA 5000 2024 standard                                  .
NFPA 5000 2024 standard .
 
The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...
The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...
The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...
 

Ceilometer juno-midpoint

  • 1. Eoghan Glynn1 Ceilometer: Juno at the halfway point Eoghan Glynn eglynn@redhat.com
  • 2. Eoghan Glynn2 Agenda ● Top-level themes for Juno ● Changes in “how we do things” upstream ● Detailed work items
  • 3. Eoghan Glynn3 Top-level themes for Juno ● Address TC-mandated requirements from gap analysis ● Pay-down known architectural debt ● Adopt some new processes upstream ● Stretch goal: figure out relationship with Monasca & Stacktach
  • 4. Eoghan Glynn4 TC-mandated requirements from gap analysis ● Word-smith the project mission statement ● https://review.openstack.org/87526 ● Viable sql-alchemy driver in the gate ● required by distro issues and mongo licensing concerns ● Land stalled Tempest coverage ● complicated by branchless Tempest ● Enhance user & ops oriented documentation ● re-purpose RDO Getting Started guide ● Participate in grenade upgrade test harness ● stretch: extend Javelin resource survivability assertions
  • 5. Eoghan Glynn5 Pay-down architectural debt ● Snapshot'ing of resource-metadata per datapoint now recognized as a major early misstep ● Leads to write & query inefficiencies in the metering store for little benefit ● Solution is to re-imagine ceilometer as more like a Time-Series-Data-as-a-Service ● prototyped in stackforge/gnocchi project ● sample data shorn of resource metadata ● eager pre-aggregation & rollup ● resource state timeline reconstructed from events ● Gnarly migration issues remain to be worked out
  • 6. Eoghan Glynn6 Changes in upstream team dynamic ● Collaborative decision-making within core team ● Adoption of ceilometer-specs repo for BP review ● FPF for juno-3 versus down-to-the-wire ● Mid-cycle meetup to ensure momentum ● Direct engagement with QA team ● More proactive BP-to-resource matchmaking
  • 7. Eoghan Glynn7 Detailed work items ● TSDaaS ● canonical implementation against pandas+swift ● additional drivers e.g. using InfluxDB ● integration with metrics pipeline and alarm evaluation ● work of OPW intern re-based on this ● Sql-alchemy viability ● removal of v1 API support ● rationalization of schema, selective denormalization ● simplification of upsert/retry-on-rollback logic ● input from sqlalchemy author Mike Bayer
  • 8. Eoghan Glynn8 Detailed work items ● SNMP improvements ● declarative pollsters ● reduce chattiness with snmpd ● Central agent SpoF ● tooz for coordination, possibly taskflow for workload partitioning ● similarly for partitioned alarm evaluator ● Events completion ● support in mongo and hbase drivers ● assumes additional importance with advent of TSDaaS
  • 9. Eoghan Glynn9 Detailed work items ● QA ● beef up Tempest & Grenade coverage ● backporting conumdrum with branchless Tempest ● IPMI sensor data ● agreed at summit that Ironic will “own the polling cycle”, emitting notifications for ceilometer to consume ● Miscellaneous ● network services metering: (LB|FW|VPN)aaS ● arithmetic transformer to combine samples across multiple meters ● eventlet deprecation, replacement by asyncio/trollius?