SlideShare a Scribd company logo
1 of 8
Download to read offline
Searching	
  pa,erns	
  in	
  SNMP	
  data	
  

           Mehmet	
  Balman	
  and	
  Doron	
  Rotem	
  
Searching	
  pa,erns	
  in	
  SNMP	
  data	
  
•    Looked	
  at	
  two	
  busy	
  links:	
  	
  
      –  star-­‐sdn1/interface/xe-­‐7_3_0	
  
      –  denv-­‐cr2/interface/xe-­‐1_1_0	
  
      	
  
      	
  
      	
  
      	
  
      -­‐Generated	
  graphs	
  for	
  the	
  last	
  6	
  
      months	
  (including	
  graphs	
  per	
  month,	
  
      per	
  week	
  )	
  
      	
  
      -­‐	
  Visually	
  inspected	
  whether	
  there	
  is	
  
      any	
  Ime	
  related	
  specific	
  pa,ern	
  in	
  
      bandwidth	
  usage	
  
Searching	
  pa,erns	
  in	
  SNMP	
  data	
  
–  star-­‐sdn1/interface/xe-­‐7_3_0	
  
	
  star-­‐>wash	
  
	
  h6ps://sdm.lbl.gov/~balman/temp/1-­‐a/	
  
	
  
–  denv-­‐cr2/interface/xe-­‐1_1_0	
  
	
  
sunn-­‐>denv	
  
	
  
h6ps://sdm.lbl.gov/~balman/temp/1/	
  
	
  
Searching	
  pa,erns	
  in	
  SNMP	
  data	
  
•    Collected	
  data	
  for	
  those	
  two	
  links	
  (one	
  year	
  long)	
  and	
  tried	
  to	
  analyze	
  the	
  data	
  
     with	
  a	
  machine	
  learning	
  soMware	
  
•    Converted	
  data	
  into	
  arff	
  format	
  
•    Used	
  Weka	
  
•    Evaluated	
  the	
  bandwidth	
  vs.	
  Ime	
  data	
  (Ime	
  series	
  analysis)	
  to	
  see	
  whether	
  day	
  of	
  
     the	
  week,	
  PM	
  or	
  AM,	
  day	
  of	
  the	
  year,	
  etc.	
  have	
  any	
  visible	
  effect	
  on	
  bandwidth	
  
     usage	
  
Sunn-­‐>denv	
  
Star-­‐>wash	
  
Searching	
  pa,erns	
  in	
  SNMP	
  data	
  
•  Our	
  iniIal	
  results	
  on	
  Ime	
  series	
  predicIon	
  gave	
  	
  40-­‐50%	
  error	
  rate.	
  	
  	
  
•  By	
  using	
  some	
  other	
  techniques,	
  we	
  were	
  able	
  to	
  achieve	
  30-­‐40	
  %	
  
   error	
  rate.	
  

•  At	
  this	
  moment,	
  	
  taking	
  average	
  link	
  usage	
  may	
  be	
  a	
  reasonable	
  
   way	
  to	
  start	
  with.	
  

•  Further	
  study	
  is	
  required	
  to	
  make	
  useful	
  predicIons	
  
    –  Gretl	
  is	
  also	
  another	
  alternaIve	
  
    –  Using	
  R	
  instead	
  of	
  Weka	
  

More Related Content

What's hot

A New Bi-level Program Based on Unblocked Reliability for a Continuous Road N...
A New Bi-level Program Based on Unblocked Reliability for a Continuous Road N...A New Bi-level Program Based on Unblocked Reliability for a Continuous Road N...
A New Bi-level Program Based on Unblocked Reliability for a Continuous Road N...IJMER
 
AN INFORMATION THEORY-BASED FEATURE SELECTIONFRAMEWORK FOR BIG DATA UNDER APA...
AN INFORMATION THEORY-BASED FEATURE SELECTIONFRAMEWORK FOR BIG DATA UNDER APA...AN INFORMATION THEORY-BASED FEATURE SELECTIONFRAMEWORK FOR BIG DATA UNDER APA...
AN INFORMATION THEORY-BASED FEATURE SELECTIONFRAMEWORK FOR BIG DATA UNDER APA...Nexgen Technology
 
A Study on Hardware and Software Link Quality Metrics for Wireless Multimedia...
A Study on Hardware and Software Link Quality Metrics for Wireless Multimedia...A Study on Hardware and Software Link Quality Metrics for Wireless Multimedia...
A Study on Hardware and Software Link Quality Metrics for Wireless Multimedia...Eswar Publications
 
Data Retrieval Scheduling For Unsynchronized Channel in Wireless Broadcast Sy...
Data Retrieval Scheduling For Unsynchronized Channel in Wireless Broadcast Sy...Data Retrieval Scheduling For Unsynchronized Channel in Wireless Broadcast Sy...
Data Retrieval Scheduling For Unsynchronized Channel in Wireless Broadcast Sy...IJERA Editor
 
EXPLOITING EFFICIENT AND SCALABLE SHUFFLE TRANSFERS IN FUTURE DATA CENTER NET...
EXPLOITING EFFICIENT AND SCALABLE SHUFFLE TRANSFERS IN FUTURE DATA CENTER NET...EXPLOITING EFFICIENT AND SCALABLE SHUFFLE TRANSFERS IN FUTURE DATA CENTER NET...
EXPLOITING EFFICIENT AND SCALABLE SHUFFLE TRANSFERS IN FUTURE DATA CENTER NET...I3E Technologies
 
MetOp Satellites Data Processing for Air Pollution Monitoring in Morocco
MetOp Satellites Data Processing for Air Pollution Monitoring in Morocco MetOp Satellites Data Processing for Air Pollution Monitoring in Morocco
MetOp Satellites Data Processing for Air Pollution Monitoring in Morocco IJECEIAES
 

What's hot (9)

Pregel - Paper Review
Pregel - Paper ReviewPregel - Paper Review
Pregel - Paper Review
 
A New Bi-level Program Based on Unblocked Reliability for a Continuous Road N...
A New Bi-level Program Based on Unblocked Reliability for a Continuous Road N...A New Bi-level Program Based on Unblocked Reliability for a Continuous Road N...
A New Bi-level Program Based on Unblocked Reliability for a Continuous Road N...
 
AN INFORMATION THEORY-BASED FEATURE SELECTIONFRAMEWORK FOR BIG DATA UNDER APA...
AN INFORMATION THEORY-BASED FEATURE SELECTIONFRAMEWORK FOR BIG DATA UNDER APA...AN INFORMATION THEORY-BASED FEATURE SELECTIONFRAMEWORK FOR BIG DATA UNDER APA...
AN INFORMATION THEORY-BASED FEATURE SELECTIONFRAMEWORK FOR BIG DATA UNDER APA...
 
Lect12
Lect12Lect12
Lect12
 
Domain research presentation Final
Domain research presentation FinalDomain research presentation Final
Domain research presentation Final
 
A Study on Hardware and Software Link Quality Metrics for Wireless Multimedia...
A Study on Hardware and Software Link Quality Metrics for Wireless Multimedia...A Study on Hardware and Software Link Quality Metrics for Wireless Multimedia...
A Study on Hardware and Software Link Quality Metrics for Wireless Multimedia...
 
Data Retrieval Scheduling For Unsynchronized Channel in Wireless Broadcast Sy...
Data Retrieval Scheduling For Unsynchronized Channel in Wireless Broadcast Sy...Data Retrieval Scheduling For Unsynchronized Channel in Wireless Broadcast Sy...
Data Retrieval Scheduling For Unsynchronized Channel in Wireless Broadcast Sy...
 
EXPLOITING EFFICIENT AND SCALABLE SHUFFLE TRANSFERS IN FUTURE DATA CENTER NET...
EXPLOITING EFFICIENT AND SCALABLE SHUFFLE TRANSFERS IN FUTURE DATA CENTER NET...EXPLOITING EFFICIENT AND SCALABLE SHUFFLE TRANSFERS IN FUTURE DATA CENTER NET...
EXPLOITING EFFICIENT AND SCALABLE SHUFFLE TRANSFERS IN FUTURE DATA CENTER NET...
 
MetOp Satellites Data Processing for Air Pollution Monitoring in Morocco
MetOp Satellites Data Processing for Air Pollution Monitoring in Morocco MetOp Satellites Data Processing for Air Pollution Monitoring in Morocco
MetOp Satellites Data Processing for Air Pollution Monitoring in Morocco
 

Viewers also liked

Navidad Y Belenes Hortaleza 2009
Navidad Y Belenes Hortaleza 2009Navidad Y Belenes Hortaleza 2009
Navidad Y Belenes Hortaleza 2009megustamibarrio09
 
Uniformity PITCH: DOES IT REALLY MATTER?
Uniformity PITCH: DOES IT REALLY MATTER?Uniformity PITCH: DOES IT REALLY MATTER?
Uniformity PITCH: DOES IT REALLY MATTER?lula_ali
 
Jeremiah leaves and trees
Jeremiah leaves and treesJeremiah leaves and trees
Jeremiah leaves and treesjwarcher
 
2004 Metro Dortmund Bahnazubis Neu
2004  Metro  Dortmund  Bahnazubis Neu2004  Metro  Dortmund  Bahnazubis Neu
2004 Metro Dortmund Bahnazubis Neuschnobias
 
生命教育(洪蘭)
生命教育(洪蘭)生命教育(洪蘭)
生命教育(洪蘭)AMY peng
 
Sintesis informativa 01 08 2012
Sintesis informativa 01 08 2012Sintesis informativa 01 08 2012
Sintesis informativa 01 08 2012megaradioexpress
 
Cartelloni e loghi
Cartelloni e loghiCartelloni e loghi
Cartelloni e loghifrancescarpa
 

Viewers also liked (9)

Navidad Y Belenes Hortaleza 2009
Navidad Y Belenes Hortaleza 2009Navidad Y Belenes Hortaleza 2009
Navidad Y Belenes Hortaleza 2009
 
Mumiy troll
Mumiy trollMumiy troll
Mumiy troll
 
Uniformity PITCH: DOES IT REALLY MATTER?
Uniformity PITCH: DOES IT REALLY MATTER?Uniformity PITCH: DOES IT REALLY MATTER?
Uniformity PITCH: DOES IT REALLY MATTER?
 
Jeremiah leaves and trees
Jeremiah leaves and treesJeremiah leaves and trees
Jeremiah leaves and trees
 
2004 Metro Dortmund Bahnazubis Neu
2004  Metro  Dortmund  Bahnazubis Neu2004  Metro  Dortmund  Bahnazubis Neu
2004 Metro Dortmund Bahnazubis Neu
 
生命教育(洪蘭)
生命教育(洪蘭)生命教育(洪蘭)
生命教育(洪蘭)
 
Sintesis informativa 01 08 2012
Sintesis informativa 01 08 2012Sintesis informativa 01 08 2012
Sintesis informativa 01 08 2012
 
Cartelloni e loghi
Cartelloni e loghiCartelloni e loghi
Cartelloni e loghi
 
Avda+escoles
Avda+escolesAvda+escoles
Avda+escoles
 

Similar to APM project meeting - June 13, 2012 - LBNL, Berkeley, CA

Large scale social networks analysis joclad 2013
Large scale social networks analysis   joclad 2013Large scale social networks analysis   joclad 2013
Large scale social networks analysis joclad 2013Rui Sarmento
 
Hadoop for High-Performance Climate Analytics - Use Cases and Lessons Learned
Hadoop for High-Performance Climate Analytics - Use Cases and Lessons LearnedHadoop for High-Performance Climate Analytics - Use Cases and Lessons Learned
Hadoop for High-Performance Climate Analytics - Use Cases and Lessons LearnedDataWorks Summit
 
TAO Refresh - Automation of Data Spike Flagging Quality
TAO Refresh - Automation of Data Spike Flagging Quality TAO Refresh - Automation of Data Spike Flagging Quality
TAO Refresh - Automation of Data Spike Flagging Quality Sathishkumar Samiappan
 
Building Electricity Demand Forecasting
Building Electricity Demand ForecastingBuilding Electricity Demand Forecasting
Building Electricity Demand ForecastingShubham Saini
 
Data mining projects topics for java and dot net
Data mining projects topics for java and dot netData mining projects topics for java and dot net
Data mining projects topics for java and dot netredpel dot com
 
Aug2013 bioinformatics working group
Aug2013 bioinformatics working groupAug2013 bioinformatics working group
Aug2013 bioinformatics working groupGenomeInABottle
 
IRJET- Univariate Time Series Prediction of Reservoir Inflow using Artifi...
IRJET-  	  Univariate Time Series Prediction of Reservoir Inflow using Artifi...IRJET-  	  Univariate Time Series Prediction of Reservoir Inflow using Artifi...
IRJET- Univariate Time Series Prediction of Reservoir Inflow using Artifi...IRJET Journal
 
EFFICIENT DATA EXTRACTION USING ARTIFICIAL INTELLIGENCE
EFFICIENT DATA EXTRACTION USING  ARTIFICIAL INTELLIGENCEEFFICIENT DATA EXTRACTION USING  ARTIFICIAL INTELLIGENCE
EFFICIENT DATA EXTRACTION USING ARTIFICIAL INTELLIGENCEDeepak Upadhyay
 
Common Design Elements for Data Movement Eli Dart
Common Design Elements for Data Movement Eli DartCommon Design Elements for Data Movement Eli Dart
Common Design Elements for Data Movement Eli DartEd Dodds
 
YAPC2007 Remote System Monitoring (w. Notes)
YAPC2007 Remote System Monitoring (w. Notes)YAPC2007 Remote System Monitoring (w. Notes)
YAPC2007 Remote System Monitoring (w. Notes)rgiersig
 
Cross Domain Data Fusion
Cross Domain Data FusionCross Domain Data Fusion
Cross Domain Data FusionIRJET Journal
 
Moving Towards a Streaming Architecture
Moving Towards a Streaming ArchitectureMoving Towards a Streaming Architecture
Moving Towards a Streaming ArchitectureGabriele Modena
 
Internet ttraffic monitering anomalous behiviour detection
Internet ttraffic monitering anomalous behiviour detectionInternet ttraffic monitering anomalous behiviour detection
Internet ttraffic monitering anomalous behiviour detectionGyan Prakash
 
FME-Enabled Address Management Ecosystem in Arizona - A Technical Introductio...
FME-Enabled Address Management Ecosystem in Arizona - A Technical Introductio...FME-Enabled Address Management Ecosystem in Arizona - A Technical Introductio...
FME-Enabled Address Management Ecosystem in Arizona - A Technical Introductio...Safe Software
 
A brief introduction to 'R' statistical package
A brief introduction to 'R' statistical packageA brief introduction to 'R' statistical package
A brief introduction to 'R' statistical packageShanmukha S. Potti
 
How to do accurate RE forecasting & scheduling
How to do accurate RE forecasting & scheduling How to do accurate RE forecasting & scheduling
How to do accurate RE forecasting & scheduling Das A. K.
 
CROP YIELD PREDICTION USING ARTIFICIAL NEURAL NETWORK
CROP YIELD PREDICTION USING ARTIFICIAL NEURAL NETWORKCROP YIELD PREDICTION USING ARTIFICIAL NEURAL NETWORK
CROP YIELD PREDICTION USING ARTIFICIAL NEURAL NETWORKIRJET Journal
 
Use of Spark MLib for Predicting the Offlining of Digital Media-(Christopher ...
Use of Spark MLib for Predicting the Offlining of Digital Media-(Christopher ...Use of Spark MLib for Predicting the Offlining of Digital Media-(Christopher ...
Use of Spark MLib for Predicting the Offlining of Digital Media-(Christopher ...Spark Summit
 

Similar to APM project meeting - June 13, 2012 - LBNL, Berkeley, CA (20)

Large scale social networks analysis joclad 2013
Large scale social networks analysis   joclad 2013Large scale social networks analysis   joclad 2013
Large scale social networks analysis joclad 2013
 
Hadoop for High-Performance Climate Analytics - Use Cases and Lessons Learned
Hadoop for High-Performance Climate Analytics - Use Cases and Lessons LearnedHadoop for High-Performance Climate Analytics - Use Cases and Lessons Learned
Hadoop for High-Performance Climate Analytics - Use Cases and Lessons Learned
 
TAO Refresh - Automation of Data Spike Flagging Quality
TAO Refresh - Automation of Data Spike Flagging Quality TAO Refresh - Automation of Data Spike Flagging Quality
TAO Refresh - Automation of Data Spike Flagging Quality
 
Building Electricity Demand Forecasting
Building Electricity Demand ForecastingBuilding Electricity Demand Forecasting
Building Electricity Demand Forecasting
 
Data mining projects topics for java and dot net
Data mining projects topics for java and dot netData mining projects topics for java and dot net
Data mining projects topics for java and dot net
 
Aug2013 bioinformatics working group
Aug2013 bioinformatics working groupAug2013 bioinformatics working group
Aug2013 bioinformatics working group
 
IRJET- Univariate Time Series Prediction of Reservoir Inflow using Artifi...
IRJET-  	  Univariate Time Series Prediction of Reservoir Inflow using Artifi...IRJET-  	  Univariate Time Series Prediction of Reservoir Inflow using Artifi...
IRJET- Univariate Time Series Prediction of Reservoir Inflow using Artifi...
 
EFFICIENT DATA EXTRACTION USING ARTIFICIAL INTELLIGENCE
EFFICIENT DATA EXTRACTION USING  ARTIFICIAL INTELLIGENCEEFFICIENT DATA EXTRACTION USING  ARTIFICIAL INTELLIGENCE
EFFICIENT DATA EXTRACTION USING ARTIFICIAL INTELLIGENCE
 
Common Design Elements for Data Movement Eli Dart
Common Design Elements for Data Movement Eli DartCommon Design Elements for Data Movement Eli Dart
Common Design Elements for Data Movement Eli Dart
 
YAPC2007 Remote System Monitoring (w. Notes)
YAPC2007 Remote System Monitoring (w. Notes)YAPC2007 Remote System Monitoring (w. Notes)
YAPC2007 Remote System Monitoring (w. Notes)
 
Cross Domain Data Fusion
Cross Domain Data FusionCross Domain Data Fusion
Cross Domain Data Fusion
 
Moving Towards a Streaming Architecture
Moving Towards a Streaming ArchitectureMoving Towards a Streaming Architecture
Moving Towards a Streaming Architecture
 
Internet ttraffic monitering anomalous behiviour detection
Internet ttraffic monitering anomalous behiviour detectionInternet ttraffic monitering anomalous behiviour detection
Internet ttraffic monitering anomalous behiviour detection
 
FME-Enabled Address Management Ecosystem in Arizona - A Technical Introductio...
FME-Enabled Address Management Ecosystem in Arizona - A Technical Introductio...FME-Enabled Address Management Ecosystem in Arizona - A Technical Introductio...
FME-Enabled Address Management Ecosystem in Arizona - A Technical Introductio...
 
TransPAC2 Workplan - Measurement (v9)
TransPAC2 Workplan - Measurement (v9)TransPAC2 Workplan - Measurement (v9)
TransPAC2 Workplan - Measurement (v9)
 
A brief introduction to 'R' statistical package
A brief introduction to 'R' statistical packageA brief introduction to 'R' statistical package
A brief introduction to 'R' statistical package
 
How to do accurate RE forecasting & scheduling
How to do accurate RE forecasting & scheduling How to do accurate RE forecasting & scheduling
How to do accurate RE forecasting & scheduling
 
CROP YIELD PREDICTION USING ARTIFICIAL NEURAL NETWORK
CROP YIELD PREDICTION USING ARTIFICIAL NEURAL NETWORKCROP YIELD PREDICTION USING ARTIFICIAL NEURAL NETWORK
CROP YIELD PREDICTION USING ARTIFICIAL NEURAL NETWORK
 
Use of Spark MLib for Predicting the Offlining of Digital Media-(Christopher ...
Use of Spark MLib for Predicting the Offlining of Digital Media-(Christopher ...Use of Spark MLib for Predicting the Offlining of Digital Media-(Christopher ...
Use of Spark MLib for Predicting the Offlining of Digital Media-(Christopher ...
 
The Earth System Modeling Framework
The Earth System Modeling FrameworkThe Earth System Modeling Framework
The Earth System Modeling Framework
 

More from balmanme

Network-aware Data Management for Large Scale Distributed Applications, IBM R...
Network-aware Data Management for Large Scale Distributed Applications, IBM R...Network-aware Data Management for Large Scale Distributed Applications, IBM R...
Network-aware Data Management for Large Scale Distributed Applications, IBM R...balmanme
 
Network-aware Data Management for High Throughput Flows Akamai, Cambridge, ...
Network-aware Data Management for High Throughput Flows   Akamai, Cambridge, ...Network-aware Data Management for High Throughput Flows   Akamai, Cambridge, ...
Network-aware Data Management for High Throughput Flows Akamai, Cambridge, ...balmanme
 
Hpcwire100gnetworktosupportbigscience 130725203822-phpapp01-1
Hpcwire100gnetworktosupportbigscience 130725203822-phpapp01-1Hpcwire100gnetworktosupportbigscience 130725203822-phpapp01-1
Hpcwire100gnetworktosupportbigscience 130725203822-phpapp01-1balmanme
 
Experiences with High-bandwidth Networks
Experiences with High-bandwidth NetworksExperiences with High-bandwidth Networks
Experiences with High-bandwidth Networksbalmanme
 
A 100 gigabit highway for science: researchers take a 'test drive' on ani tes...
A 100 gigabit highway for science: researchers take a 'test drive' on ani tes...A 100 gigabit highway for science: researchers take a 'test drive' on ani tes...
A 100 gigabit highway for science: researchers take a 'test drive' on ani tes...balmanme
 
Balman stork cw09
Balman stork cw09Balman stork cw09
Balman stork cw09balmanme
 
Available technologies: algorithm for flexible bandwidth reservations for dat...
Available technologies: algorithm for flexible bandwidth reservations for dat...Available technologies: algorithm for flexible bandwidth reservations for dat...
Available technologies: algorithm for flexible bandwidth reservations for dat...balmanme
 
Berkeley lab team develops flexible reservation algorithm for advance network...
Berkeley lab team develops flexible reservation algorithm for advance network...Berkeley lab team develops flexible reservation algorithm for advance network...
Berkeley lab team develops flexible reservation algorithm for advance network...balmanme
 
Dynamic adaptation balman
Dynamic adaptation balmanDynamic adaptation balman
Dynamic adaptation balmanbalmanme
 
Nersc dtn-perf-100121.test_results-nercmeeting-jan21-2010
Nersc dtn-perf-100121.test_results-nercmeeting-jan21-2010Nersc dtn-perf-100121.test_results-nercmeeting-jan21-2010
Nersc dtn-perf-100121.test_results-nercmeeting-jan21-2010balmanme
 
Cybertools stork-2009-cybertools allhandmeeting-poster
Cybertools stork-2009-cybertools allhandmeeting-posterCybertools stork-2009-cybertools allhandmeeting-poster
Cybertools stork-2009-cybertools allhandmeeting-posterbalmanme
 
Presentation summerstudent 2009-aug09-lbl-summer
Presentation summerstudent 2009-aug09-lbl-summerPresentation summerstudent 2009-aug09-lbl-summer
Presentation summerstudent 2009-aug09-lbl-summerbalmanme
 
Lblc sseminar jun09-2009-jun09-lblcsseminar
Lblc sseminar jun09-2009-jun09-lblcsseminarLblc sseminar jun09-2009-jun09-lblcsseminar
Lblc sseminar jun09-2009-jun09-lblcsseminarbalmanme
 
Presentation southernstork 2009-nov-southernworkshop
Presentation southernstork 2009-nov-southernworkshopPresentation southernstork 2009-nov-southernworkshop
Presentation southernstork 2009-nov-southernworkshopbalmanme
 
Balman dissertation Copyright @ 2010 Mehmet Balman
Balman dissertation Copyright @ 2010 Mehmet BalmanBalman dissertation Copyright @ 2010 Mehmet Balman
Balman dissertation Copyright @ 2010 Mehmet Balmanbalmanme
 
Aug17presentation.v2 2009-aug09-lblc sseminar
Aug17presentation.v2 2009-aug09-lblc sseminarAug17presentation.v2 2009-aug09-lblc sseminar
Aug17presentation.v2 2009-aug09-lblc sseminarbalmanme
 
Pdcs2010 balman-presentation
Pdcs2010 balman-presentationPdcs2010 balman-presentation
Pdcs2010 balman-presentationbalmanme
 
Analyzing Data Movements and Identifying Techniques for Next-generation Networks
Analyzing Data Movements and Identifying Techniques for Next-generation NetworksAnalyzing Data Movements and Identifying Techniques for Next-generation Networks
Analyzing Data Movements and Identifying Techniques for Next-generation Networksbalmanme
 
MemzNet: Memory-Mapped Zero-copy Network Channel -- Streaming exascala data o...
MemzNet: Memory-Mapped Zero-copy Network Channel -- Streaming exascala data o...MemzNet: Memory-Mapped Zero-copy Network Channel -- Streaming exascala data o...
MemzNet: Memory-Mapped Zero-copy Network Channel -- Streaming exascala data o...balmanme
 
Opening ndm2012 sc12
Opening ndm2012 sc12Opening ndm2012 sc12
Opening ndm2012 sc12balmanme
 

More from balmanme (20)

Network-aware Data Management for Large Scale Distributed Applications, IBM R...
Network-aware Data Management for Large Scale Distributed Applications, IBM R...Network-aware Data Management for Large Scale Distributed Applications, IBM R...
Network-aware Data Management for Large Scale Distributed Applications, IBM R...
 
Network-aware Data Management for High Throughput Flows Akamai, Cambridge, ...
Network-aware Data Management for High Throughput Flows   Akamai, Cambridge, ...Network-aware Data Management for High Throughput Flows   Akamai, Cambridge, ...
Network-aware Data Management for High Throughput Flows Akamai, Cambridge, ...
 
Hpcwire100gnetworktosupportbigscience 130725203822-phpapp01-1
Hpcwire100gnetworktosupportbigscience 130725203822-phpapp01-1Hpcwire100gnetworktosupportbigscience 130725203822-phpapp01-1
Hpcwire100gnetworktosupportbigscience 130725203822-phpapp01-1
 
Experiences with High-bandwidth Networks
Experiences with High-bandwidth NetworksExperiences with High-bandwidth Networks
Experiences with High-bandwidth Networks
 
A 100 gigabit highway for science: researchers take a 'test drive' on ani tes...
A 100 gigabit highway for science: researchers take a 'test drive' on ani tes...A 100 gigabit highway for science: researchers take a 'test drive' on ani tes...
A 100 gigabit highway for science: researchers take a 'test drive' on ani tes...
 
Balman stork cw09
Balman stork cw09Balman stork cw09
Balman stork cw09
 
Available technologies: algorithm for flexible bandwidth reservations for dat...
Available technologies: algorithm for flexible bandwidth reservations for dat...Available technologies: algorithm for flexible bandwidth reservations for dat...
Available technologies: algorithm for flexible bandwidth reservations for dat...
 
Berkeley lab team develops flexible reservation algorithm for advance network...
Berkeley lab team develops flexible reservation algorithm for advance network...Berkeley lab team develops flexible reservation algorithm for advance network...
Berkeley lab team develops flexible reservation algorithm for advance network...
 
Dynamic adaptation balman
Dynamic adaptation balmanDynamic adaptation balman
Dynamic adaptation balman
 
Nersc dtn-perf-100121.test_results-nercmeeting-jan21-2010
Nersc dtn-perf-100121.test_results-nercmeeting-jan21-2010Nersc dtn-perf-100121.test_results-nercmeeting-jan21-2010
Nersc dtn-perf-100121.test_results-nercmeeting-jan21-2010
 
Cybertools stork-2009-cybertools allhandmeeting-poster
Cybertools stork-2009-cybertools allhandmeeting-posterCybertools stork-2009-cybertools allhandmeeting-poster
Cybertools stork-2009-cybertools allhandmeeting-poster
 
Presentation summerstudent 2009-aug09-lbl-summer
Presentation summerstudent 2009-aug09-lbl-summerPresentation summerstudent 2009-aug09-lbl-summer
Presentation summerstudent 2009-aug09-lbl-summer
 
Lblc sseminar jun09-2009-jun09-lblcsseminar
Lblc sseminar jun09-2009-jun09-lblcsseminarLblc sseminar jun09-2009-jun09-lblcsseminar
Lblc sseminar jun09-2009-jun09-lblcsseminar
 
Presentation southernstork 2009-nov-southernworkshop
Presentation southernstork 2009-nov-southernworkshopPresentation southernstork 2009-nov-southernworkshop
Presentation southernstork 2009-nov-southernworkshop
 
Balman dissertation Copyright @ 2010 Mehmet Balman
Balman dissertation Copyright @ 2010 Mehmet BalmanBalman dissertation Copyright @ 2010 Mehmet Balman
Balman dissertation Copyright @ 2010 Mehmet Balman
 
Aug17presentation.v2 2009-aug09-lblc sseminar
Aug17presentation.v2 2009-aug09-lblc sseminarAug17presentation.v2 2009-aug09-lblc sseminar
Aug17presentation.v2 2009-aug09-lblc sseminar
 
Pdcs2010 balman-presentation
Pdcs2010 balman-presentationPdcs2010 balman-presentation
Pdcs2010 balman-presentation
 
Analyzing Data Movements and Identifying Techniques for Next-generation Networks
Analyzing Data Movements and Identifying Techniques for Next-generation NetworksAnalyzing Data Movements and Identifying Techniques for Next-generation Networks
Analyzing Data Movements and Identifying Techniques for Next-generation Networks
 
MemzNet: Memory-Mapped Zero-copy Network Channel -- Streaming exascala data o...
MemzNet: Memory-Mapped Zero-copy Network Channel -- Streaming exascala data o...MemzNet: Memory-Mapped Zero-copy Network Channel -- Streaming exascala data o...
MemzNet: Memory-Mapped Zero-copy Network Channel -- Streaming exascala data o...
 
Opening ndm2012 sc12
Opening ndm2012 sc12Opening ndm2012 sc12
Opening ndm2012 sc12
 

Recently uploaded

How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...itnewsafrica
 
Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Kaya Weers
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Nikki Chapple
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integrationmarketing932765
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Strongerpanagenda
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentPim van der Noll
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPathCommunity
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxfnnc6jmgwh
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Mark Goldstein
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Farhan Tariq
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI AgeCprime
 
React Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkReact Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkPixlogix Infotech
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructureitnewsafrica
 

Recently uploaded (20)

How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
 
Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI Age
 
React Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkReact Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App Framework
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
 

APM project meeting - June 13, 2012 - LBNL, Berkeley, CA

  • 1. Searching  pa,erns  in  SNMP  data   Mehmet  Balman  and  Doron  Rotem  
  • 2. Searching  pa,erns  in  SNMP  data   •  Looked  at  two  busy  links:     –  star-­‐sdn1/interface/xe-­‐7_3_0   –  denv-­‐cr2/interface/xe-­‐1_1_0           -­‐Generated  graphs  for  the  last  6   months  (including  graphs  per  month,   per  week  )     -­‐  Visually  inspected  whether  there  is   any  Ime  related  specific  pa,ern  in   bandwidth  usage  
  • 3. Searching  pa,erns  in  SNMP  data   –  star-­‐sdn1/interface/xe-­‐7_3_0    star-­‐>wash    h6ps://sdm.lbl.gov/~balman/temp/1-­‐a/     –  denv-­‐cr2/interface/xe-­‐1_1_0     sunn-­‐>denv     h6ps://sdm.lbl.gov/~balman/temp/1/    
  • 4. Searching  pa,erns  in  SNMP  data   •  Collected  data  for  those  two  links  (one  year  long)  and  tried  to  analyze  the  data   with  a  machine  learning  soMware   •  Converted  data  into  arff  format   •  Used  Weka   •  Evaluated  the  bandwidth  vs.  Ime  data  (Ime  series  analysis)  to  see  whether  day  of   the  week,  PM  or  AM,  day  of  the  year,  etc.  have  any  visible  effect  on  bandwidth   usage  
  • 7.
  • 8. Searching  pa,erns  in  SNMP  data   •  Our  iniIal  results  on  Ime  series  predicIon  gave    40-­‐50%  error  rate.       •  By  using  some  other  techniques,  we  were  able  to  achieve  30-­‐40  %   error  rate.   •  At  this  moment,    taking  average  link  usage  may  be  a  reasonable   way  to  start  with.   •  Further  study  is  required  to  make  useful  predicIons   –  Gretl  is  also  another  alternaIve   –  Using  R  instead  of  Weka