SlideShare a Scribd company logo
1 of 27
Download to read offline
Advanced Automated Analytics
Using OSS Tools
Fred Elmendorf
Grid Protection Alliance
2016 Georgia Tech FDA Conference
http://gridprotectionalliance.org
Presentation Overview
• Open Source Software (OSS) Approach
• Building Blocks of an Automated System
• Examples and Use Cases
• Food for Thought
• Questions
Open Source Software (OSS) Approach
• Stimulates innovation
• Encourages and facilitates collaboration
• Reduces time to deployment
• Reduces cycle time for improvements
• Lowers total cost of ownership
• Accelerates development
• Avoids vendor lock-in
• Lowers on-going software maintenance costs
• Improves code quality
• Improves security through community review
OSS in Electric Utilities
• EPRI OSS survey published June 2015 (conducted by GPA)
• 16 utility company participants
• 80% large companies – gross annual revenue >$1B
• Nearly a third use OSS in production systems
• About three quarters aren’t sure where to find OSS
• Education, examples, support, and ‘were to find it’ would advance
utility use
EPRI Product 3002006348
http://www.epri.com/abstracts/Pages/ProductAbstract.aspx?ProductId=000000003002006348
The Open Source PQ Tool Suite
Building Blocks of an Automated System
• Get the data
• Analyze the data
• Visualize the data
Get the Data
• Physical transport of data from field device to a central repository
• Can be anything from disk copy to fiber network
• Determines the periodicity of data processing
• An OSS project called openMIC can be used to fully automate this
step
• https://github.com/GridProtectionAlliance/openMIC
openMIC – Meter Information Collector
• Schedules device
interrogation and
manages the data
returned from DFRs
• Via IP
• Via Modem (RAS &
FTP)
• Logs and reports
meter problems
• Includes a mobile-
ready web app to
configure openMIC
and view DFR
interrogation
statistics
Version 0.9
GPA’s Web Solutions Framework
• Allows browser-based interaction
with GPA services
• A web server is not required --
but can be used to provide
content in different security
zones via reverse proxy
• Includes bootstrap which makes
content responsive to take the
format of the user’s platform
(mobile, tablet)
• Uses a collection of standard
components imbedded in GPA’s
core code libraries to enable full
CRUD interaction with relational
data systems. Used in openMIC, openSPM, MiPlan, and SOETools
Version 2.0
PQDIF Explorer
• Allows discovery of all
information within the binary
format of PQDIF (IEEE 1159.3) --
including information hidden by
higher-level PQDIF parsing tools
• Good validator for
vendors developing
PQDIF writers
• Valuable
implementation
example of GPA’s
open source PQDIF
parser
Version 1.0
Analyze the Data
• Process the data as quickly as it is available
• No manual interaction to complete the task
• Send appropriate notifications immediately
• Build a database for visualization and analysis
• An OSS project: openXDA can be used to accomplish this step
• The Electric Power Research Institute is a significant contributor
• https://github.com/GridProtectionAlliance/openXDA
openXDA – eXtensible Disturbance Analytics
• Automatically processes and analyzes event
files from disturbance monitoring equipment
such
as DFRs and PQ monitors
• Loads this file-based
data into an enterprise
grade relational database
• Enables on-the-fly analytics
such as single and double
ended fault location, voltage
sag and swell analysis,
breaker timing evaluation,
among others.
• Supports both open source and proprietary
analytics
• The data layer for Open PQ Dashboard and
openSEE
Version 1.51
openXDA Major Components
1. Installer for the openXDA service
2. DataLoader Service (includes File Watcher, logging and notification components)
3. Administrator’s remote console to DataLoader
4. Logging Systems
5. E-Mail Alerts
6. Database (MS SQL Server)
• Dashboard & Service Configuration Data
• Meter Configuration Data
• Power System Engineering Data
• Event Data
• Data Quality Information
• Daily Trending Summary Data (for speed)
7. Trending Data Historian (openHistorian)
8. System Configuration Manager
openXDA Inputs
• Power System Configuration Data
• Meter name and location
• Meter channel definitions
• Line parameters
• Waveform Data
• COMTRADE
• PQDIF
• EMAX (native format)
• SEL .eve (SEL-251, SEL-351, Sel-421 relays)
openXDA – Recent Community Activities
• Breaker Timing at GTC
• Ability to apply fault determination logic executed externally to
openXDA
• Geographic data display R&D with GTC
• TVA Cap Bank monitoring research at TVA
openXDA – Community Activities for 2016
• Configuration manager
• Extract trending data from ION StruxureWare
• Consume real-time MODBUS data
• Event reclassification and tagging.
• Identification of “Device out of Service”.
• Integration of fault indicator data
• Advanced breaker timing analysis such as phase comparisons and
identifying restrikes
Visualize the Data
• Web based dashboard available company wide
• Secured by user credentials
• Visualize entire fleet of devices regardless of brand or type
• Intuitive displays:
• Geographic
• Annunciation panel
• Historical performance
• Details by day, site, device, channel
• Work is underway to overlay related weather data
• An OSS project: Open PQ Dashboard can be used to accomplish this step
• Open PQ Dashboard was initiated by the Electric Power Research Institute
• https://github.com/GridProtectionAlliance/PQDashboard
EPRI Open PQ Dashboard
• A web-based enterprise dashboard that nicely complements traditional vendor-
provided waveform analysis tools
• Displays the results of the analytics rise that run automatically in openXDA
• Provides drill-down from wide-area displays to full resolution waveforms
Version 1.0.3
Examples and Use Cases
Automated Analytics in Production
• Fault presence, and type
• Single and double ended fault distance
• Standard Power Quality parameters such as sag, swell, etc.
• Breaker timing assessment
• Historical trend performance
• Data quality:
• Completeness
• Correctness
• Reasonableness
Examples and Use Cases
External Analytic Integration
• Incipient cable fault analysis
• Capacitor switching transient analysis
Automated Analytics in Development
• Advanced breaker operation analysis
• Capacitor health assessment
Automated Lightning Correlation
• A number of utilities have expressed need
• Once the time and location are determined, the automated analytic
process can easily interrogate a lightning source such as the TXD-100
and include the results in the database for use in visualizations
• Prerequisites include:
• Geospatial information for power system structures
• Access to lightning data source
Example Lightning Integration at TVA
Food for Thought – OSS Building Blocks
• Functional and deployed in operational systems
• Facilitate fully automated advanced analytic systems to perform any
analysis appropriate for the type of data available.
• Provide dramatically improved access to information compared to
manual methods.
• What we see today, it is only the tip of the iceberg.
• Other functions such as data quality, device availability, and device
performance are also being applied in this environment.
Food for Thought – OSS Building Blocks
• Each of these OSS building blocks is freely available for enhancement,
extension, and adaption.
• Through the collaboration and innovation afforded by the OSS
approach, the functions of these blocks continue to grow rapidly.
• Anyone can use them ‘as is’ or become a part of the community to
enhance and extend them.
• See links below for information regarding OSS licenses, and the OSS
code repositories where the projects are managed.
Food for Thought – References
• BSD License https://en.wikipedia.org/wiki/BSD_licenses
• MIT License https://en.wikipedia.org/wiki/MIT_License
• openMIC https://github.com/GridProtectionAlliance/openMIC
• openXDA http://gridprotectionalliance.org/products.asp#XDA
• PQDashboard
https://github.com/GridProtectionAlliance/PQDashboard
• OSI https://opensource.com/resources/what-open-source
Food for Thought - Conclusions
• OSS is a good environment to
accelerate power system
tools
• Building blocks exist to build
a fully automated end-to-end
system
• Any appropriate analytic can
be added
• Automated lightning and
weather correlation can be
included
Thank You
Fred Elmendorf
Phone: 423-702-8136
Grid Protection Alliance
1206 Broad St, Chattanooga, TN

More Related Content

What's hot

Advanced Splunk Administration
Advanced Splunk AdministrationAdvanced Splunk Administration
Advanced Splunk AdministrationGreg Hanchin
 
New Splunk Management Solutions Update: Splunk MINT and Splunk App for Stream
New Splunk Management Solutions Update: Splunk MINT and Splunk App for Stream New Splunk Management Solutions Update: Splunk MINT and Splunk App for Stream
New Splunk Management Solutions Update: Splunk MINT and Splunk App for Stream Splunk
 
Cisco UCS and Splunk Workshop
Cisco UCS and Splunk WorkshopCisco UCS and Splunk Workshop
Cisco UCS and Splunk WorkshopRobb Boyd
 
SplunkLive! Warsaw 2016 - Cisco
SplunkLive! Warsaw 2016 - Cisco SplunkLive! Warsaw 2016 - Cisco
SplunkLive! Warsaw 2016 - Cisco Splunk
 
SplunkLive! Austin Customer Presentation - Dell
SplunkLive! Austin Customer Presentation - DellSplunkLive! Austin Customer Presentation - Dell
SplunkLive! Austin Customer Presentation - DellSplunk
 
Make Streaming IoT Analytics Work for You
Make Streaming IoT Analytics Work for YouMake Streaming IoT Analytics Work for You
Make Streaming IoT Analytics Work for YouHortonworks
 
Build Applications without Pipelines: Shortest path from complex data to live...
Build Applications without Pipelines: Shortest path from complex data to live...Build Applications without Pipelines: Shortest path from complex data to live...
Build Applications without Pipelines: Shortest path from complex data to live...Anirudh Ramanathan
 
ORADIEX : A Big Data driven smart framework for real-time surveillance and an...
ORADIEX : A Big Data driven smart framework for real-time surveillance and an...ORADIEX : A Big Data driven smart framework for real-time surveillance and an...
ORADIEX : A Big Data driven smart framework for real-time surveillance and an...Hadi Fadlallah
 
Motor vehicle emission checker danu-lap
Motor vehicle emission checker danu-lapMotor vehicle emission checker danu-lap
Motor vehicle emission checker danu-lapaidsdatahub
 
Splunk App for Stream for Enhanced Operational Intelligence from Wire Data
Splunk App for Stream for Enhanced Operational Intelligence from Wire DataSplunk App for Stream for Enhanced Operational Intelligence from Wire Data
Splunk App for Stream for Enhanced Operational Intelligence from Wire DataSplunk
 
What’s New: Splunk App for Stream and Splunk MINT
What’s New: Splunk App for Stream and Splunk MINTWhat’s New: Splunk App for Stream and Splunk MINT
What’s New: Splunk App for Stream and Splunk MINTSplunk
 
ICPSR Data Managment
ICPSR Data ManagmentICPSR Data Managment
ICPSR Data ManagmentICPSR
 
Splunk and Cisco UCS Breakout Session
Splunk and Cisco UCS Breakout SessionSplunk and Cisco UCS Breakout Session
Splunk and Cisco UCS Breakout SessionSplunk
 
Tulinx introduction 20130622 detailed
Tulinx introduction 20130622   detailedTulinx introduction 20130622   detailed
Tulinx introduction 20130622 detailedarjen1970
 
Splunk App for Stream
Splunk App for StreamSplunk App for Stream
Splunk App for StreamSplunk
 
Rich Feeds for RESCUE and PALMS
Rich Feeds for RESCUE and PALMSRich Feeds for RESCUE and PALMS
Rich Feeds for RESCUE and PALMSbdemchak
 
Data Onboarding Breakout Session
Data Onboarding Breakout SessionData Onboarding Breakout Session
Data Onboarding Breakout SessionSplunk
 

What's hot (19)

Advanced Splunk Administration
Advanced Splunk AdministrationAdvanced Splunk Administration
Advanced Splunk Administration
 
New Splunk Management Solutions Update: Splunk MINT and Splunk App for Stream
New Splunk Management Solutions Update: Splunk MINT and Splunk App for Stream New Splunk Management Solutions Update: Splunk MINT and Splunk App for Stream
New Splunk Management Solutions Update: Splunk MINT and Splunk App for Stream
 
Cisco UCS and Splunk Workshop
Cisco UCS and Splunk WorkshopCisco UCS and Splunk Workshop
Cisco UCS and Splunk Workshop
 
SplunkLive! Warsaw 2016 - Cisco
SplunkLive! Warsaw 2016 - Cisco SplunkLive! Warsaw 2016 - Cisco
SplunkLive! Warsaw 2016 - Cisco
 
LEFTERIS_PROJECT_FINAL
LEFTERIS_PROJECT_FINALLEFTERIS_PROJECT_FINAL
LEFTERIS_PROJECT_FINAL
 
SplunkLive! Austin Customer Presentation - Dell
SplunkLive! Austin Customer Presentation - DellSplunkLive! Austin Customer Presentation - Dell
SplunkLive! Austin Customer Presentation - Dell
 
Developing Digital Twins
Developing Digital TwinsDeveloping Digital Twins
Developing Digital Twins
 
Make Streaming IoT Analytics Work for You
Make Streaming IoT Analytics Work for YouMake Streaming IoT Analytics Work for You
Make Streaming IoT Analytics Work for You
 
Build Applications without Pipelines: Shortest path from complex data to live...
Build Applications without Pipelines: Shortest path from complex data to live...Build Applications without Pipelines: Shortest path from complex data to live...
Build Applications without Pipelines: Shortest path from complex data to live...
 
ORADIEX : A Big Data driven smart framework for real-time surveillance and an...
ORADIEX : A Big Data driven smart framework for real-time surveillance and an...ORADIEX : A Big Data driven smart framework for real-time surveillance and an...
ORADIEX : A Big Data driven smart framework for real-time surveillance and an...
 
Motor vehicle emission checker danu-lap
Motor vehicle emission checker danu-lapMotor vehicle emission checker danu-lap
Motor vehicle emission checker danu-lap
 
Splunk App for Stream for Enhanced Operational Intelligence from Wire Data
Splunk App for Stream for Enhanced Operational Intelligence from Wire DataSplunk App for Stream for Enhanced Operational Intelligence from Wire Data
Splunk App for Stream for Enhanced Operational Intelligence from Wire Data
 
What’s New: Splunk App for Stream and Splunk MINT
What’s New: Splunk App for Stream and Splunk MINTWhat’s New: Splunk App for Stream and Splunk MINT
What’s New: Splunk App for Stream and Splunk MINT
 
ICPSR Data Managment
ICPSR Data ManagmentICPSR Data Managment
ICPSR Data Managment
 
Splunk and Cisco UCS Breakout Session
Splunk and Cisco UCS Breakout SessionSplunk and Cisco UCS Breakout Session
Splunk and Cisco UCS Breakout Session
 
Tulinx introduction 20130622 detailed
Tulinx introduction 20130622   detailedTulinx introduction 20130622   detailed
Tulinx introduction 20130622 detailed
 
Splunk App for Stream
Splunk App for StreamSplunk App for Stream
Splunk App for Stream
 
Rich Feeds for RESCUE and PALMS
Rich Feeds for RESCUE and PALMSRich Feeds for RESCUE and PALMS
Rich Feeds for RESCUE and PALMS
 
Data Onboarding Breakout Session
Data Onboarding Breakout SessionData Onboarding Breakout Session
Data Onboarding Breakout Session
 

Similar to Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016

Advanced Automated Analytics Using OSS Tools
Advanced Automated Analytics Using OSS ToolsAdvanced Automated Analytics Using OSS Tools
Advanced Automated Analytics Using OSS ToolsGrid Protection Alliance
 
David Henthorn [Rose-Hulman Institute of Technology] | Illuminating the Dark ...
David Henthorn [Rose-Hulman Institute of Technology] | Illuminating the Dark ...David Henthorn [Rose-Hulman Institute of Technology] | Illuminating the Dark ...
David Henthorn [Rose-Hulman Institute of Technology] | Illuminating the Dark ...InfluxData
 
Decision Matrix for IoT Product Development
Decision Matrix for IoT Product DevelopmentDecision Matrix for IoT Product Development
Decision Matrix for IoT Product DevelopmentAlexey Pyshkin
 
Emerging standards and support organizations within engineering simulation
Emerging standards and support organizations within engineering simulation Emerging standards and support organizations within engineering simulation
Emerging standards and support organizations within engineering simulation Modelon
 
Utilising Cloud Computing for Research through Infrastructure, Software and D...
Utilising Cloud Computing for Research through Infrastructure, Software and D...Utilising Cloud Computing for Research through Infrastructure, Software and D...
Utilising Cloud Computing for Research through Infrastructure, Software and D...David Wallom
 
Federated Cloud Computing
Federated Cloud ComputingFederated Cloud Computing
Federated Cloud ComputingDavid Wallom
 
Creating a Climate for Innovation on Internet2 - Eric Boyd Senior Director, S...
Creating a Climate for Innovation on Internet2 - Eric Boyd Senior Director, S...Creating a Climate for Innovation on Internet2 - Eric Boyd Senior Director, S...
Creating a Climate for Innovation on Internet2 - Eric Boyd Senior Director, S...Ed Dodds
 
Architect’s Open-Source Guide for a Data Mesh Architecture
Architect’s Open-Source Guide for a Data Mesh ArchitectureArchitect’s Open-Source Guide for a Data Mesh Architecture
Architect’s Open-Source Guide for a Data Mesh ArchitectureDatabricks
 
ADDO Open Source Observability Tools
ADDO Open Source Observability Tools ADDO Open Source Observability Tools
ADDO Open Source Observability Tools Mickey Boxell
 
WSO2 Data Analytics Server - Product Overview
WSO2 Data Analytics Server - Product OverviewWSO2 Data Analytics Server - Product Overview
WSO2 Data Analytics Server - Product OverviewWSO2
 
Advanced Analytics and Machine Learning with Data Virtualization
Advanced Analytics and Machine Learning with Data VirtualizationAdvanced Analytics and Machine Learning with Data Virtualization
Advanced Analytics and Machine Learning with Data VirtualizationDenodo
 
ThroughTheLookingGlass_EffectiveObservability.pptx
ThroughTheLookingGlass_EffectiveObservability.pptxThroughTheLookingGlass_EffectiveObservability.pptx
ThroughTheLookingGlass_EffectiveObservability.pptxGrace Jansen
 
Historic Opportunities: Discover the Power of Ignition's Historian
Historic Opportunities: Discover the Power of Ignition's HistorianHistoric Opportunities: Discover the Power of Ignition's Historian
Historic Opportunities: Discover the Power of Ignition's HistorianInductive Automation
 
Cloudera federal summit
Cloudera federal summitCloudera federal summit
Cloudera federal summitMatt Carroll
 
Building a Real-Time Security Application Using Log Data and Machine Learning...
Building a Real-Time Security Application Using Log Data and Machine Learning...Building a Real-Time Security Application Using Log Data and Machine Learning...
Building a Real-Time Security Application Using Log Data and Machine Learning...Sri Ambati
 
UI Dev in Big data world using open source
UI Dev in Big data world using open sourceUI Dev in Big data world using open source
UI Dev in Big data world using open sourceTech Triveni
 

Similar to Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016 (20)

Advanced Automated Analytics Using OSS Tools
Advanced Automated Analytics Using OSS ToolsAdvanced Automated Analytics Using OSS Tools
Advanced Automated Analytics Using OSS Tools
 
David Henthorn [Rose-Hulman Institute of Technology] | Illuminating the Dark ...
David Henthorn [Rose-Hulman Institute of Technology] | Illuminating the Dark ...David Henthorn [Rose-Hulman Institute of Technology] | Illuminating the Dark ...
David Henthorn [Rose-Hulman Institute of Technology] | Illuminating the Dark ...
 
Decision Matrix for IoT Product Development
Decision Matrix for IoT Product DevelopmentDecision Matrix for IoT Product Development
Decision Matrix for IoT Product Development
 
Grid computing
Grid computingGrid computing
Grid computing
 
Emerging standards and support organizations within engineering simulation
Emerging standards and support organizations within engineering simulation Emerging standards and support organizations within engineering simulation
Emerging standards and support organizations within engineering simulation
 
Utilising Cloud Computing for Research through Infrastructure, Software and D...
Utilising Cloud Computing for Research through Infrastructure, Software and D...Utilising Cloud Computing for Research through Infrastructure, Software and D...
Utilising Cloud Computing for Research through Infrastructure, Software and D...
 
Federated Cloud Computing
Federated Cloud ComputingFederated Cloud Computing
Federated Cloud Computing
 
inmation Presentation_2017
inmation Presentation_2017inmation Presentation_2017
inmation Presentation_2017
 
iot_basic_1.pptx
iot_basic_1.pptxiot_basic_1.pptx
iot_basic_1.pptx
 
Creating a Climate for Innovation on Internet2 - Eric Boyd Senior Director, S...
Creating a Climate for Innovation on Internet2 - Eric Boyd Senior Director, S...Creating a Climate for Innovation on Internet2 - Eric Boyd Senior Director, S...
Creating a Climate for Innovation on Internet2 - Eric Boyd Senior Director, S...
 
Architect’s Open-Source Guide for a Data Mesh Architecture
Architect’s Open-Source Guide for a Data Mesh ArchitectureArchitect’s Open-Source Guide for a Data Mesh Architecture
Architect’s Open-Source Guide for a Data Mesh Architecture
 
ADDO Open Source Observability Tools
ADDO Open Source Observability Tools ADDO Open Source Observability Tools
ADDO Open Source Observability Tools
 
WSO2 Data Analytics Server - Product Overview
WSO2 Data Analytics Server - Product OverviewWSO2 Data Analytics Server - Product Overview
WSO2 Data Analytics Server - Product Overview
 
Advanced Analytics and Machine Learning with Data Virtualization
Advanced Analytics and Machine Learning with Data VirtualizationAdvanced Analytics and Machine Learning with Data Virtualization
Advanced Analytics and Machine Learning with Data Virtualization
 
ThroughTheLookingGlass_EffectiveObservability.pptx
ThroughTheLookingGlass_EffectiveObservability.pptxThroughTheLookingGlass_EffectiveObservability.pptx
ThroughTheLookingGlass_EffectiveObservability.pptx
 
Historic Opportunities: Discover the Power of Ignition's Historian
Historic Opportunities: Discover the Power of Ignition's HistorianHistoric Opportunities: Discover the Power of Ignition's Historian
Historic Opportunities: Discover the Power of Ignition's Historian
 
Cloudera federal summit
Cloudera federal summitCloudera federal summit
Cloudera federal summit
 
Building a Real-Time Security Application Using Log Data and Machine Learning...
Building a Real-Time Security Application Using Log Data and Machine Learning...Building a Real-Time Security Application Using Log Data and Machine Learning...
Building a Real-Time Security Application Using Log Data and Machine Learning...
 
GPA Software Overview R3
GPA Software Overview R3GPA Software Overview R3
GPA Software Overview R3
 
UI Dev in Big data world using open source
UI Dev in Big data world using open sourceUI Dev in Big data world using open source
UI Dev in Big data world using open source
 

Recently uploaded

Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...amitlee9823
 
Carero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptxCarero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptxolyaivanovalion
 
100-Concepts-of-AI by Anupama Kate .pptx
100-Concepts-of-AI by Anupama Kate .pptx100-Concepts-of-AI by Anupama Kate .pptx
100-Concepts-of-AI by Anupama Kate .pptxAnupama Kate
 
Invezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signalsInvezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signalsInvezz1
 
Log Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxLog Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxJohnnyPlasten
 
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...amitlee9823
 
Mature dropshipping via API with DroFx.pptx
Mature dropshipping via API with DroFx.pptxMature dropshipping via API with DroFx.pptx
Mature dropshipping via API with DroFx.pptxolyaivanovalion
 
Best VIP Call Girls Noida Sector 39 Call Me: 8448380779
Best VIP Call Girls Noida Sector 39 Call Me: 8448380779Best VIP Call Girls Noida Sector 39 Call Me: 8448380779
Best VIP Call Girls Noida Sector 39 Call Me: 8448380779Delhi Call girls
 
BabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptxBabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptxolyaivanovalion
 
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...amitlee9823
 
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...SUHANI PANDEY
 
Zuja dropshipping via API with DroFx.pptx
Zuja dropshipping via API with DroFx.pptxZuja dropshipping via API with DroFx.pptx
Zuja dropshipping via API with DroFx.pptxolyaivanovalion
 
BigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxBigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxolyaivanovalion
 
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Valters Lauzums
 
CebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptxCebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptxolyaivanovalion
 
Best VIP Call Girls Noida Sector 22 Call Me: 8448380779
Best VIP Call Girls Noida Sector 22 Call Me: 8448380779Best VIP Call Girls Noida Sector 22 Call Me: 8448380779
Best VIP Call Girls Noida Sector 22 Call Me: 8448380779Delhi Call girls
 
Week-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interactionWeek-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interactionfulawalesam
 
Accredited-Transport-Cooperatives-Jan-2021-Web.pdf
Accredited-Transport-Cooperatives-Jan-2021-Web.pdfAccredited-Transport-Cooperatives-Jan-2021-Web.pdf
Accredited-Transport-Cooperatives-Jan-2021-Web.pdfadriantubila
 

Recently uploaded (20)

Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
 
Carero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptxCarero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptx
 
100-Concepts-of-AI by Anupama Kate .pptx
100-Concepts-of-AI by Anupama Kate .pptx100-Concepts-of-AI by Anupama Kate .pptx
100-Concepts-of-AI by Anupama Kate .pptx
 
Invezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signalsInvezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signals
 
Log Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxLog Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptx
 
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
 
Mature dropshipping via API with DroFx.pptx
Mature dropshipping via API with DroFx.pptxMature dropshipping via API with DroFx.pptx
Mature dropshipping via API with DroFx.pptx
 
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get CytotecAbortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
 
Best VIP Call Girls Noida Sector 39 Call Me: 8448380779
Best VIP Call Girls Noida Sector 39 Call Me: 8448380779Best VIP Call Girls Noida Sector 39 Call Me: 8448380779
Best VIP Call Girls Noida Sector 39 Call Me: 8448380779
 
BabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptxBabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptx
 
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
 
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
 
Zuja dropshipping via API with DroFx.pptx
Zuja dropshipping via API with DroFx.pptxZuja dropshipping via API with DroFx.pptx
Zuja dropshipping via API with DroFx.pptx
 
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 
BigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxBigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptx
 
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
 
CebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptxCebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptx
 
Best VIP Call Girls Noida Sector 22 Call Me: 8448380779
Best VIP Call Girls Noida Sector 22 Call Me: 8448380779Best VIP Call Girls Noida Sector 22 Call Me: 8448380779
Best VIP Call Girls Noida Sector 22 Call Me: 8448380779
 
Week-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interactionWeek-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interaction
 
Accredited-Transport-Cooperatives-Jan-2021-Web.pdf
Accredited-Transport-Cooperatives-Jan-2021-Web.pdfAccredited-Transport-Cooperatives-Jan-2021-Web.pdf
Accredited-Transport-Cooperatives-Jan-2021-Web.pdf
 

Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016

  • 1. Advanced Automated Analytics Using OSS Tools Fred Elmendorf Grid Protection Alliance 2016 Georgia Tech FDA Conference http://gridprotectionalliance.org
  • 2. Presentation Overview • Open Source Software (OSS) Approach • Building Blocks of an Automated System • Examples and Use Cases • Food for Thought • Questions
  • 3. Open Source Software (OSS) Approach • Stimulates innovation • Encourages and facilitates collaboration • Reduces time to deployment • Reduces cycle time for improvements • Lowers total cost of ownership • Accelerates development • Avoids vendor lock-in • Lowers on-going software maintenance costs • Improves code quality • Improves security through community review
  • 4. OSS in Electric Utilities • EPRI OSS survey published June 2015 (conducted by GPA) • 16 utility company participants • 80% large companies – gross annual revenue >$1B • Nearly a third use OSS in production systems • About three quarters aren’t sure where to find OSS • Education, examples, support, and ‘were to find it’ would advance utility use EPRI Product 3002006348 http://www.epri.com/abstracts/Pages/ProductAbstract.aspx?ProductId=000000003002006348
  • 5. The Open Source PQ Tool Suite
  • 6. Building Blocks of an Automated System • Get the data • Analyze the data • Visualize the data
  • 7. Get the Data • Physical transport of data from field device to a central repository • Can be anything from disk copy to fiber network • Determines the periodicity of data processing • An OSS project called openMIC can be used to fully automate this step • https://github.com/GridProtectionAlliance/openMIC
  • 8. openMIC – Meter Information Collector • Schedules device interrogation and manages the data returned from DFRs • Via IP • Via Modem (RAS & FTP) • Logs and reports meter problems • Includes a mobile- ready web app to configure openMIC and view DFR interrogation statistics Version 0.9
  • 9. GPA’s Web Solutions Framework • Allows browser-based interaction with GPA services • A web server is not required -- but can be used to provide content in different security zones via reverse proxy • Includes bootstrap which makes content responsive to take the format of the user’s platform (mobile, tablet) • Uses a collection of standard components imbedded in GPA’s core code libraries to enable full CRUD interaction with relational data systems. Used in openMIC, openSPM, MiPlan, and SOETools Version 2.0
  • 10. PQDIF Explorer • Allows discovery of all information within the binary format of PQDIF (IEEE 1159.3) -- including information hidden by higher-level PQDIF parsing tools • Good validator for vendors developing PQDIF writers • Valuable implementation example of GPA’s open source PQDIF parser Version 1.0
  • 11. Analyze the Data • Process the data as quickly as it is available • No manual interaction to complete the task • Send appropriate notifications immediately • Build a database for visualization and analysis • An OSS project: openXDA can be used to accomplish this step • The Electric Power Research Institute is a significant contributor • https://github.com/GridProtectionAlliance/openXDA
  • 12. openXDA – eXtensible Disturbance Analytics • Automatically processes and analyzes event files from disturbance monitoring equipment such as DFRs and PQ monitors • Loads this file-based data into an enterprise grade relational database • Enables on-the-fly analytics such as single and double ended fault location, voltage sag and swell analysis, breaker timing evaluation, among others. • Supports both open source and proprietary analytics • The data layer for Open PQ Dashboard and openSEE Version 1.51
  • 13. openXDA Major Components 1. Installer for the openXDA service 2. DataLoader Service (includes File Watcher, logging and notification components) 3. Administrator’s remote console to DataLoader 4. Logging Systems 5. E-Mail Alerts 6. Database (MS SQL Server) • Dashboard & Service Configuration Data • Meter Configuration Data • Power System Engineering Data • Event Data • Data Quality Information • Daily Trending Summary Data (for speed) 7. Trending Data Historian (openHistorian) 8. System Configuration Manager
  • 14. openXDA Inputs • Power System Configuration Data • Meter name and location • Meter channel definitions • Line parameters • Waveform Data • COMTRADE • PQDIF • EMAX (native format) • SEL .eve (SEL-251, SEL-351, Sel-421 relays)
  • 15. openXDA – Recent Community Activities • Breaker Timing at GTC • Ability to apply fault determination logic executed externally to openXDA • Geographic data display R&D with GTC • TVA Cap Bank monitoring research at TVA
  • 16. openXDA – Community Activities for 2016 • Configuration manager • Extract trending data from ION StruxureWare • Consume real-time MODBUS data • Event reclassification and tagging. • Identification of “Device out of Service”. • Integration of fault indicator data • Advanced breaker timing analysis such as phase comparisons and identifying restrikes
  • 17. Visualize the Data • Web based dashboard available company wide • Secured by user credentials • Visualize entire fleet of devices regardless of brand or type • Intuitive displays: • Geographic • Annunciation panel • Historical performance • Details by day, site, device, channel • Work is underway to overlay related weather data • An OSS project: Open PQ Dashboard can be used to accomplish this step • Open PQ Dashboard was initiated by the Electric Power Research Institute • https://github.com/GridProtectionAlliance/PQDashboard
  • 18. EPRI Open PQ Dashboard • A web-based enterprise dashboard that nicely complements traditional vendor- provided waveform analysis tools • Displays the results of the analytics rise that run automatically in openXDA • Provides drill-down from wide-area displays to full resolution waveforms Version 1.0.3
  • 19. Examples and Use Cases Automated Analytics in Production • Fault presence, and type • Single and double ended fault distance • Standard Power Quality parameters such as sag, swell, etc. • Breaker timing assessment • Historical trend performance • Data quality: • Completeness • Correctness • Reasonableness
  • 20. Examples and Use Cases External Analytic Integration • Incipient cable fault analysis • Capacitor switching transient analysis Automated Analytics in Development • Advanced breaker operation analysis • Capacitor health assessment
  • 21. Automated Lightning Correlation • A number of utilities have expressed need • Once the time and location are determined, the automated analytic process can easily interrogate a lightning source such as the TXD-100 and include the results in the database for use in visualizations • Prerequisites include: • Geospatial information for power system structures • Access to lightning data source
  • 23. Food for Thought – OSS Building Blocks • Functional and deployed in operational systems • Facilitate fully automated advanced analytic systems to perform any analysis appropriate for the type of data available. • Provide dramatically improved access to information compared to manual methods. • What we see today, it is only the tip of the iceberg. • Other functions such as data quality, device availability, and device performance are also being applied in this environment.
  • 24. Food for Thought – OSS Building Blocks • Each of these OSS building blocks is freely available for enhancement, extension, and adaption. • Through the collaboration and innovation afforded by the OSS approach, the functions of these blocks continue to grow rapidly. • Anyone can use them ‘as is’ or become a part of the community to enhance and extend them. • See links below for information regarding OSS licenses, and the OSS code repositories where the projects are managed.
  • 25. Food for Thought – References • BSD License https://en.wikipedia.org/wiki/BSD_licenses • MIT License https://en.wikipedia.org/wiki/MIT_License • openMIC https://github.com/GridProtectionAlliance/openMIC • openXDA http://gridprotectionalliance.org/products.asp#XDA • PQDashboard https://github.com/GridProtectionAlliance/PQDashboard • OSI https://opensource.com/resources/what-open-source
  • 26. Food for Thought - Conclusions • OSS is a good environment to accelerate power system tools • Building blocks exist to build a fully automated end-to-end system • Any appropriate analytic can be added • Automated lightning and weather correlation can be included
  • 27. Thank You Fred Elmendorf Phone: 423-702-8136 Grid Protection Alliance 1206 Broad St, Chattanooga, TN