SlideShare une entreprise Scribd logo
Tagging with AI to Enable
Data-Driven Applications at Scale
Jason Koh, PhD
Chief Data Scientist at Mapped
1
2
3
Potential of Building Data
Air Quality Estimation
Occupancy-driven
Energy Optimization
Customizable
Thermal Comfort
On-demand space booking
Automated Fault Detection
HVAC
Electricity
Security
Lightning
Elevator
Water
4
Mapped, the Unified API
Air Quality Estimation
Occupancy-driven
Energy Optimization
Customizable
Thermal Comfort
On-demand space booking
Automated Fault Detection
HVAC
Electricity
Security
Lightning
Elevator
Water
5
State of Building Data
- Open up your building management/automation system, look at the point names
- 3 different buildings/BMS/subsystems → 3 (or more) different labeling/naming schemes
Slide source: Gabe Fierro
6
Mapped Ontology Extending Brick
Point
Equipment Location
feeds,
hasPart isPartOf
feeds
hasPoint
hasPoint
controls
- Introduce People on top of Brick
- Extend more Classes
(e.g., security, conference)
- Identities management
- Community-driven open-source
- Rigorously validated
- Extensible and expressive
7
An Example Building Graph
AHU-1
VAV-101 VAV-102 Zone-102
Room-102-1 Room-102-2
ZNT101 SAF101
feeds
hasPoint
feeds
hasPart
Variable Air
Volume Box
Variable Air
Volume Box
Air Handling
Unit
type
HVAC Zone
Zone Air Temp
Sensor
Supply Air Flow
Sensor Room Room
HVAC & Structural Data
Jane Doe
Access Card
Reader 1
Security & People Data
Person
Jane’s
Corp Badge
Badge
hasLocation
Access
History 1
owns
hasObserved
hasPoint
Access History
Status
Access Card
Reader
8
Unified Access
via GraphQL
{
building(id:"175A7C19") {
floors(level: "3") {
spaces {
id
name
geoshape
points {
type
timestamp
aggregate
}
}
}
}
}
Visualize &
Control Data
Data Flow
Fine-grained
Control
Mapped Data Pipeline
Mapping
with AI
Data Experts
9
Cloud hosted via
site-to-site VPN
Discover &
Extract
Or
Or
The Metadata Mapping Problem
RM-101.VMA-101.ZN_T
type
HVAC_Zone VAV
type
feeds
AHU-1
RM-101.VMA-101.OCC
Zone Air
Temperature
Sensor
type
hasPoint
feeds
hasPoint
Occupancy
Command
type
AHU
type
1. Finding Entities / Types
2. Finding Relationships
Various AI Methods
- Point name analysis
- Timeseries clustering
- Causality / correlation learning
Goals
10
Technical Challenges in Auto-Mapping
Heterogeneous
Buildings
Complex
Relationships
Expensive
Labeling Effort
Lack of
Labeled Data
11
Active
Learning
Transfer
Learning
Ensemble
Learning
Mapped Approach
A New Building
Known Buildings
Machine Learning
Ensemble DAG
Domain Experts
Mapped Graph
12
Active Learning
1. Train a model with given labeled data
Machine Learning
Models
Domain
Experts
What is the most efficient way of
acquiring labels?
1.
2.
3.
At Mapped:
1. Various statistical metrics
2. Highly optimized labeling tool
13
2. Infer unlabeled data with the model
3. Ask labels for less confident inference
4. Repeat
Transfer Learning
1. Shift data distribution
2. Cherry-pick common features
3. Ask uncommon patterns to
domain experts
A New
Building
Known
Buildings
How to utilize
different buildings’ data?
At Mapped:
1. Domain adaptation models
2. Similarity analysis for co-training
14
Machine Learning
Models
Ensemble Learning
1. Voting, decision tree, boosting, etc.
2. Directed Acyclic Graph (DAG) for
complementing different ML models
Machine Learning
Ensemble DAG
How to ensemble various ML models?
At Mapped:
1. Flexible DAG based on customer requirements
2. Learned priorities over different ML models
15
Mapped Approach
A New Building
Known Buildings
Machine Learning
Ensemble DAG
Domain Experts
Mapped Graph
16
Active
Learning
Transfer
Learning
Ensemble
Learning
Mapped in a Slide
17
Mapped solves the complicated ML problem with
active, transfer, and ensemble learning
Applications need a single API with
a common view of the world
The automated data pipeline from discovery to
mapping, control, and usage.
Air Quality Estimation
Occupancy-driven
Energy Optimization
On-demand space
booking
HVAC
Electricity
Security
Lightning
Jason Koh jason@mapped.com
18
Some Numbers from Mapped
1. Scrabble++
a. 97% accuracy with 1-2 % labeled data for a new building
b. 20% increased accuracy with transfer learning (when there are not many examples)
c. 30 seconds to manually label an entity (or a BACnet object)
2. Equipment correlation learning
a. 93% accuracy without labels but with ground-truth point labels
19
© 2021 MAPPED. ALL RIGHTS RESERVED 20
Scrabble: Transferable Active Learning [Koh et al. 2018]
R M 3 - Z N T
Sentence
BIO Tags
Conditional
Random
Fields (CRF)
Robust to
variations
Room
id ⦰
Zone
Temp
Tags
(IR)
Entity Class Room ZoneTempSensor
Multi-Label
MLP
common layer
across buildings
RM-3 RM3-ZNT
Mapped
Graph
hasLocation
Inference
from Schema
static rules
20

Contenu connexe

Tendances

Brochure BIM
Brochure BIM Brochure BIM
Brochure BIM UTHM
 
iviva Smart BIM and Lucy Workflow - UK Launch
iviva Smart BIM and Lucy Workflow - UK Launchiviva Smart BIM and Lucy Workflow - UK Launch
iviva Smart BIM and Lucy Workflow - UK LaunchGeoEnable Limited
 
Building information modeling BIM
Building information modeling BIMBuilding information modeling BIM
Building information modeling BIMfitsum yonas
 
BIM & Coordination Work Process Presentation
BIM & Coordination Work Process PresentationBIM & Coordination Work Process Presentation
BIM & Coordination Work Process PresentationIndranath Sinha
 
How to Create a Rock Star BIM Execution Plan (BEP) and MPDT* (Responsibility ...
How to Create a Rock Star BIM Execution Plan (BEP) and MPDT* (Responsibility ...How to Create a Rock Star BIM Execution Plan (BEP) and MPDT* (Responsibility ...
How to Create a Rock Star BIM Execution Plan (BEP) and MPDT* (Responsibility ...Fabio Roberti
 
ACMV SYSTEM
ACMV SYSTEM ACMV SYSTEM
ACMV SYSTEM YE MYO
 
Integrating BIM & GIS - Closing the Data Loop, September 2019
Integrating BIM & GIS - Closing the Data Loop, September 2019Integrating BIM & GIS - Closing the Data Loop, September 2019
Integrating BIM & GIS - Closing the Data Loop, September 2019Esri Ireland
 
CodeBook BIM Data Workflow
CodeBook BIM Data Workflow CodeBook BIM Data Workflow
CodeBook BIM Data Workflow Andy Hamer
 
Building Information Modeling (BIM)
Building Information Modeling (BIM)Building Information Modeling (BIM)
Building Information Modeling (BIM)Farid Ghori
 
HVAC, Heating Ventilation Air Conditioning BMS
HVAC, Heating Ventilation Air Conditioning BMSHVAC, Heating Ventilation Air Conditioning BMS
HVAC, Heating Ventilation Air Conditioning BMSMohammad Azam Khan
 
Modernize Core Technology to Accelerate Digital Transformation
Modernize Core Technology to Accelerate Digital TransformationModernize Core Technology to Accelerate Digital Transformation
Modernize Core Technology to Accelerate Digital TransformationPerficient, Inc.
 
Siemens and MES (Manufacturing Execution System)
Siemens and MES (Manufacturing Execution System)Siemens and MES (Manufacturing Execution System)
Siemens and MES (Manufacturing Execution System)Vera Leonik-Shilyaeva
 

Tendances (20)

Bms system
Bms  systemBms  system
Bms system
 
SIMPLE ISO 19650 TEMPLATES (BILT VIRTUAL PRESENTATION)
SIMPLE ISO 19650 TEMPLATES (BILT VIRTUAL PRESENTATION)SIMPLE ISO 19650 TEMPLATES (BILT VIRTUAL PRESENTATION)
SIMPLE ISO 19650 TEMPLATES (BILT VIRTUAL PRESENTATION)
 
Brochure BIM
Brochure BIM Brochure BIM
Brochure BIM
 
BMS-System
BMS-SystemBMS-System
BMS-System
 
What is BIM?
What is BIM?What is BIM?
What is BIM?
 
iviva Smart BIM and Lucy Workflow - UK Launch
iviva Smart BIM and Lucy Workflow - UK Launchiviva Smart BIM and Lucy Workflow - UK Launch
iviva Smart BIM and Lucy Workflow - UK Launch
 
Building information modeling BIM
Building information modeling BIMBuilding information modeling BIM
Building information modeling BIM
 
BIM & Coordination Work Process Presentation
BIM & Coordination Work Process PresentationBIM & Coordination Work Process Presentation
BIM & Coordination Work Process Presentation
 
How to Create a Rock Star BIM Execution Plan (BEP) and MPDT* (Responsibility ...
How to Create a Rock Star BIM Execution Plan (BEP) and MPDT* (Responsibility ...How to Create a Rock Star BIM Execution Plan (BEP) and MPDT* (Responsibility ...
How to Create a Rock Star BIM Execution Plan (BEP) and MPDT* (Responsibility ...
 
ACMV SYSTEM
ACMV SYSTEM ACMV SYSTEM
ACMV SYSTEM
 
Revit Mep ppt.pdf
Revit Mep ppt.pdfRevit Mep ppt.pdf
Revit Mep ppt.pdf
 
Integrating BIM & GIS - Closing the Data Loop, September 2019
Integrating BIM & GIS - Closing the Data Loop, September 2019Integrating BIM & GIS - Closing the Data Loop, September 2019
Integrating BIM & GIS - Closing the Data Loop, September 2019
 
CodeBook BIM Data Workflow
CodeBook BIM Data Workflow CodeBook BIM Data Workflow
CodeBook BIM Data Workflow
 
Information Delivery Manual
Information Delivery ManualInformation Delivery Manual
Information Delivery Manual
 
Building Information Modeling (BIM)
Building Information Modeling (BIM)Building Information Modeling (BIM)
Building Information Modeling (BIM)
 
BIM & Sustainability
BIM & SustainabilityBIM & Sustainability
BIM & Sustainability
 
HVAC, Heating Ventilation Air Conditioning BMS
HVAC, Heating Ventilation Air Conditioning BMSHVAC, Heating Ventilation Air Conditioning BMS
HVAC, Heating Ventilation Air Conditioning BMS
 
Bim
BimBim
Bim
 
Modernize Core Technology to Accelerate Digital Transformation
Modernize Core Technology to Accelerate Digital TransformationModernize Core Technology to Accelerate Digital Transformation
Modernize Core Technology to Accelerate Digital Transformation
 
Siemens and MES (Manufacturing Execution System)
Siemens and MES (Manufacturing Execution System)Siemens and MES (Manufacturing Execution System)
Siemens and MES (Manufacturing Execution System)
 

Similaire à Tagging with AI to Enable Data-Driven Smart Building Applications at Scale!

L'architettura di classe enterprise di nuova generazione - Massimo Brignoli
L'architettura di classe enterprise di nuova generazione - Massimo BrignoliL'architettura di classe enterprise di nuova generazione - Massimo Brignoli
L'architettura di classe enterprise di nuova generazione - Massimo BrignoliData Driven Innovation
 
BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...
BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...
BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...Alex Liu
 
Modernize Your Data Platform for Analytics and AI
Modernize Your Data Platform for Analytics and AIModernize Your Data Platform for Analytics and AI
Modernize Your Data Platform for Analytics and AIAlluxio, Inc.
 
Achieve big data analytic platform with lambda architecture on cloud
Achieve big data analytic platform with lambda architecture on cloudAchieve big data analytic platform with lambda architecture on cloud
Achieve big data analytic platform with lambda architecture on cloudScott Miao
 
Deep Learning for Autonomous Driving
Deep Learning for Autonomous DrivingDeep Learning for Autonomous Driving
Deep Learning for Autonomous DrivingJan Wiegelmann
 
Mastering MapReduce: MapReduce for Big Data Management and Analysis
Mastering MapReduce: MapReduce for Big Data Management and AnalysisMastering MapReduce: MapReduce for Big Data Management and Analysis
Mastering MapReduce: MapReduce for Big Data Management and AnalysisTeradata Aster
 
Using Grid Technologies in the Cloud for High Scalability
Using Grid Technologies in the Cloud for High ScalabilityUsing Grid Technologies in the Cloud for High Scalability
Using Grid Technologies in the Cloud for High Scalabilitymabuhr
 
A Big-Data Process Consigned Geographically by Employing Mapreduce Frame Work
A Big-Data Process Consigned Geographically by Employing Mapreduce Frame WorkA Big-Data Process Consigned Geographically by Employing Mapreduce Frame Work
A Big-Data Process Consigned Geographically by Employing Mapreduce Frame WorkIRJET Journal
 
Hw09 Hadoop Based Data Mining Platform For The Telecom Industry
Hw09   Hadoop Based Data Mining Platform For The Telecom IndustryHw09   Hadoop Based Data Mining Platform For The Telecom Industry
Hw09 Hadoop Based Data Mining Platform For The Telecom IndustryCloudera, Inc.
 
Serhii Kholodniuk: What you need to know, before migrating data platform to G...
Serhii Kholodniuk: What you need to know, before migrating data platform to G...Serhii Kholodniuk: What you need to know, before migrating data platform to G...
Serhii Kholodniuk: What you need to know, before migrating data platform to G...Lviv Startup Club
 
Enterprise guide to building a Data Mesh
Enterprise guide to building a Data MeshEnterprise guide to building a Data Mesh
Enterprise guide to building a Data MeshSion Smith
 
Porting Spring PetClinic to GigaSpaces
Porting Spring PetClinic to GigaSpacesPorting Spring PetClinic to GigaSpaces
Porting Spring PetClinic to GigaSpacesUri Cohen
 
The Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
The Enterprise Guide to Building a Data Mesh - Introducing SpecMeshThe Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
The Enterprise Guide to Building a Data Mesh - Introducing SpecMeshIanFurlong4
 
Computer aided design, computer aided manufacturing, computer aided engineering
Computer aided design, computer aided manufacturing, computer aided engineeringComputer aided design, computer aided manufacturing, computer aided engineering
Computer aided design, computer aided manufacturing, computer aided engineeringuniversity of sust.
 
Key-Key-Value Stores for Efficiently Processing Graph Data in the Cloud
Key-Key-Value Stores for Efficiently Processing Graph Data in the CloudKey-Key-Value Stores for Efficiently Processing Graph Data in the Cloud
Key-Key-Value Stores for Efficiently Processing Graph Data in the CloudUniversity of New South Wales
 
Applying Cloud Techniques to Address Complexity in HPC System Integrations
Applying Cloud Techniques to Address Complexity in HPC System IntegrationsApplying Cloud Techniques to Address Complexity in HPC System Integrations
Applying Cloud Techniques to Address Complexity in HPC System Integrationsinside-BigData.com
 
Data Intensive Grid Service Model
Data Intensive Grid Service ModelData Intensive Grid Service Model
Data Intensive Grid Service Modelgomathynayagam
 
ArangoML Pipeline Cloud - Managed Machine Learning Metadata
ArangoML Pipeline Cloud - Managed Machine Learning MetadataArangoML Pipeline Cloud - Managed Machine Learning Metadata
ArangoML Pipeline Cloud - Managed Machine Learning MetadataArangoDB Database
 
Building ML Pipelines with DCOS
Building ML Pipelines with DCOSBuilding ML Pipelines with DCOS
Building ML Pipelines with DCOSQAware GmbH
 
Planet lab : cloud vs grid computing
Planet lab : cloud vs grid computingPlanet lab : cloud vs grid computing
Planet lab : cloud vs grid computingGaurav Singh
 

Similaire à Tagging with AI to Enable Data-Driven Smart Building Applications at Scale! (20)

L'architettura di classe enterprise di nuova generazione - Massimo Brignoli
L'architettura di classe enterprise di nuova generazione - Massimo BrignoliL'architettura di classe enterprise di nuova generazione - Massimo Brignoli
L'architettura di classe enterprise di nuova generazione - Massimo Brignoli
 
BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...
BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...
BUILDING BETTER PREDICTIVE MODELS WITH COGNITIVE ASSISTANCE IN A DATA SCIENCE...
 
Modernize Your Data Platform for Analytics and AI
Modernize Your Data Platform for Analytics and AIModernize Your Data Platform for Analytics and AI
Modernize Your Data Platform for Analytics and AI
 
Achieve big data analytic platform with lambda architecture on cloud
Achieve big data analytic platform with lambda architecture on cloudAchieve big data analytic platform with lambda architecture on cloud
Achieve big data analytic platform with lambda architecture on cloud
 
Deep Learning for Autonomous Driving
Deep Learning for Autonomous DrivingDeep Learning for Autonomous Driving
Deep Learning for Autonomous Driving
 
Mastering MapReduce: MapReduce for Big Data Management and Analysis
Mastering MapReduce: MapReduce for Big Data Management and AnalysisMastering MapReduce: MapReduce for Big Data Management and Analysis
Mastering MapReduce: MapReduce for Big Data Management and Analysis
 
Using Grid Technologies in the Cloud for High Scalability
Using Grid Technologies in the Cloud for High ScalabilityUsing Grid Technologies in the Cloud for High Scalability
Using Grid Technologies in the Cloud for High Scalability
 
A Big-Data Process Consigned Geographically by Employing Mapreduce Frame Work
A Big-Data Process Consigned Geographically by Employing Mapreduce Frame WorkA Big-Data Process Consigned Geographically by Employing Mapreduce Frame Work
A Big-Data Process Consigned Geographically by Employing Mapreduce Frame Work
 
Hw09 Hadoop Based Data Mining Platform For The Telecom Industry
Hw09   Hadoop Based Data Mining Platform For The Telecom IndustryHw09   Hadoop Based Data Mining Platform For The Telecom Industry
Hw09 Hadoop Based Data Mining Platform For The Telecom Industry
 
Serhii Kholodniuk: What you need to know, before migrating data platform to G...
Serhii Kholodniuk: What you need to know, before migrating data platform to G...Serhii Kholodniuk: What you need to know, before migrating data platform to G...
Serhii Kholodniuk: What you need to know, before migrating data platform to G...
 
Enterprise guide to building a Data Mesh
Enterprise guide to building a Data MeshEnterprise guide to building a Data Mesh
Enterprise guide to building a Data Mesh
 
Porting Spring PetClinic to GigaSpaces
Porting Spring PetClinic to GigaSpacesPorting Spring PetClinic to GigaSpaces
Porting Spring PetClinic to GigaSpaces
 
The Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
The Enterprise Guide to Building a Data Mesh - Introducing SpecMeshThe Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
The Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
 
Computer aided design, computer aided manufacturing, computer aided engineering
Computer aided design, computer aided manufacturing, computer aided engineeringComputer aided design, computer aided manufacturing, computer aided engineering
Computer aided design, computer aided manufacturing, computer aided engineering
 
Key-Key-Value Stores for Efficiently Processing Graph Data in the Cloud
Key-Key-Value Stores for Efficiently Processing Graph Data in the CloudKey-Key-Value Stores for Efficiently Processing Graph Data in the Cloud
Key-Key-Value Stores for Efficiently Processing Graph Data in the Cloud
 
Applying Cloud Techniques to Address Complexity in HPC System Integrations
Applying Cloud Techniques to Address Complexity in HPC System IntegrationsApplying Cloud Techniques to Address Complexity in HPC System Integrations
Applying Cloud Techniques to Address Complexity in HPC System Integrations
 
Data Intensive Grid Service Model
Data Intensive Grid Service ModelData Intensive Grid Service Model
Data Intensive Grid Service Model
 
ArangoML Pipeline Cloud - Managed Machine Learning Metadata
ArangoML Pipeline Cloud - Managed Machine Learning MetadataArangoML Pipeline Cloud - Managed Machine Learning Metadata
ArangoML Pipeline Cloud - Managed Machine Learning Metadata
 
Building ML Pipelines with DCOS
Building ML Pipelines with DCOSBuilding ML Pipelines with DCOS
Building ML Pipelines with DCOS
 
Planet lab : cloud vs grid computing
Planet lab : cloud vs grid computingPlanet lab : cloud vs grid computing
Planet lab : cloud vs grid computing
 

Plus de Memoori

State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!Memoori
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Laying the Data Foundations for Artificial Intelligence!
Laying the Data Foundations for Artificial Intelligence!Laying the Data Foundations for Artificial Intelligence!
Laying the Data Foundations for Artificial Intelligence!Memoori
 
The Market for AI in Commercial Buildings 2024.pdf
The Market for AI in Commercial Buildings 2024.pdfThe Market for AI in Commercial Buildings 2024.pdf
The Market for AI in Commercial Buildings 2024.pdfMemoori
 
A BluePrint for the Future of Smart Building Retrofits
A BluePrint for the Future of Smart Building RetrofitsA BluePrint for the Future of Smart Building Retrofits
A BluePrint for the Future of Smart Building RetrofitsMemoori
 
AI + Memoori = AIM
AI + Memoori = AIMAI + Memoori = AIM
AI + Memoori = AIMMemoori
 
How Tenants & Landlords Can Work Together to Reduce Energy Consumption!
How Tenants & Landlords Can Work Together to Reduce Energy Consumption!How Tenants & Landlords Can Work Together to Reduce Energy Consumption!
How Tenants & Landlords Can Work Together to Reduce Energy Consumption!Memoori
 
How Can Smart Building Technology Become Mainstream?
How Can Smart Building Technology Become Mainstream?How Can Smart Building Technology Become Mainstream?
How Can Smart Building Technology Become Mainstream?Memoori
 
The Carbon Lifestyle - Not a Fad
The Carbon Lifestyle - Not a FadThe Carbon Lifestyle - Not a Fad
The Carbon Lifestyle - Not a FadMemoori
 
Hybrid Work: Driving the Workplace Tech Market!
Hybrid Work: Driving the Workplace Tech Market!Hybrid Work: Driving the Workplace Tech Market!
Hybrid Work: Driving the Workplace Tech Market!Memoori
 
AI IoT Edge Applications Insights and Trends
AI IoT Edge Applications Insights and TrendsAI IoT Edge Applications Insights and Trends
AI IoT Edge Applications Insights and TrendsMemoori
 
What Building Owners Need to Know About Cyber Security Insurance!
What Building Owners Need to Know About Cyber Security Insurance!What Building Owners Need to Know About Cyber Security Insurance!
What Building Owners Need to Know About Cyber Security Insurance!Memoori
 
3 Step Guide to Your Holistic Building Experience Journey
3 Step Guide to Your Holistic Building Experience Journey3 Step Guide to Your Holistic Building Experience Journey
3 Step Guide to Your Holistic Building Experience JourneyMemoori
 
The Developers Smart Building Project Canvas
The Developers Smart Building Project CanvasThe Developers Smart Building Project Canvas
The Developers Smart Building Project CanvasMemoori
 
Smart, Connected Restrooms. A Cornerstone of Today's Smart Healthy Buildings
Smart, Connected Restrooms. A Cornerstone of Today's Smart Healthy BuildingsSmart, Connected Restrooms. A Cornerstone of Today's Smart Healthy Buildings
Smart, Connected Restrooms. A Cornerstone of Today's Smart Healthy BuildingsMemoori
 
Using Software Robots to Unlock Energy Efficiency in Aging Buildings
Using Software Robots to Unlock Energy Efficiency in Aging BuildingsUsing Software Robots to Unlock Energy Efficiency in Aging Buildings
Using Software Robots to Unlock Energy Efficiency in Aging BuildingsMemoori
 
The Case for an Open IoT ‘Data Fabric’ for Smart Buildings Integration
The Case for an Open IoT ‘Data Fabric’ for Smart Buildings IntegrationThe Case for an Open IoT ‘Data Fabric’ for Smart Buildings Integration
The Case for an Open IoT ‘Data Fabric’ for Smart Buildings IntegrationMemoori
 
Why Should I Adopt a Digital Twin?
Why Should I Adopt a Digital Twin?Why Should I Adopt a Digital Twin?
Why Should I Adopt a Digital Twin?Memoori
 
Project Haystack - 10 Years of Bringing Data Semantics to the Built Environment!
Project Haystack - 10 Years of Bringing Data Semantics to the Built Environment!Project Haystack - 10 Years of Bringing Data Semantics to the Built Environment!
Project Haystack - 10 Years of Bringing Data Semantics to the Built Environment!Memoori
 
Overcoming Tech Obsolescence in Smart Buildings
Overcoming Tech Obsolescence in Smart BuildingsOvercoming Tech Obsolescence in Smart Buildings
Overcoming Tech Obsolescence in Smart BuildingsMemoori
 

Plus de Memoori (20)

State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Laying the Data Foundations for Artificial Intelligence!
Laying the Data Foundations for Artificial Intelligence!Laying the Data Foundations for Artificial Intelligence!
Laying the Data Foundations for Artificial Intelligence!
 
The Market for AI in Commercial Buildings 2024.pdf
The Market for AI in Commercial Buildings 2024.pdfThe Market for AI in Commercial Buildings 2024.pdf
The Market for AI in Commercial Buildings 2024.pdf
 
A BluePrint for the Future of Smart Building Retrofits
A BluePrint for the Future of Smart Building RetrofitsA BluePrint for the Future of Smart Building Retrofits
A BluePrint for the Future of Smart Building Retrofits
 
AI + Memoori = AIM
AI + Memoori = AIMAI + Memoori = AIM
AI + Memoori = AIM
 
How Tenants & Landlords Can Work Together to Reduce Energy Consumption!
How Tenants & Landlords Can Work Together to Reduce Energy Consumption!How Tenants & Landlords Can Work Together to Reduce Energy Consumption!
How Tenants & Landlords Can Work Together to Reduce Energy Consumption!
 
How Can Smart Building Technology Become Mainstream?
How Can Smart Building Technology Become Mainstream?How Can Smart Building Technology Become Mainstream?
How Can Smart Building Technology Become Mainstream?
 
The Carbon Lifestyle - Not a Fad
The Carbon Lifestyle - Not a FadThe Carbon Lifestyle - Not a Fad
The Carbon Lifestyle - Not a Fad
 
Hybrid Work: Driving the Workplace Tech Market!
Hybrid Work: Driving the Workplace Tech Market!Hybrid Work: Driving the Workplace Tech Market!
Hybrid Work: Driving the Workplace Tech Market!
 
AI IoT Edge Applications Insights and Trends
AI IoT Edge Applications Insights and TrendsAI IoT Edge Applications Insights and Trends
AI IoT Edge Applications Insights and Trends
 
What Building Owners Need to Know About Cyber Security Insurance!
What Building Owners Need to Know About Cyber Security Insurance!What Building Owners Need to Know About Cyber Security Insurance!
What Building Owners Need to Know About Cyber Security Insurance!
 
3 Step Guide to Your Holistic Building Experience Journey
3 Step Guide to Your Holistic Building Experience Journey3 Step Guide to Your Holistic Building Experience Journey
3 Step Guide to Your Holistic Building Experience Journey
 
The Developers Smart Building Project Canvas
The Developers Smart Building Project CanvasThe Developers Smart Building Project Canvas
The Developers Smart Building Project Canvas
 
Smart, Connected Restrooms. A Cornerstone of Today's Smart Healthy Buildings
Smart, Connected Restrooms. A Cornerstone of Today's Smart Healthy BuildingsSmart, Connected Restrooms. A Cornerstone of Today's Smart Healthy Buildings
Smart, Connected Restrooms. A Cornerstone of Today's Smart Healthy Buildings
 
Using Software Robots to Unlock Energy Efficiency in Aging Buildings
Using Software Robots to Unlock Energy Efficiency in Aging BuildingsUsing Software Robots to Unlock Energy Efficiency in Aging Buildings
Using Software Robots to Unlock Energy Efficiency in Aging Buildings
 
The Case for an Open IoT ‘Data Fabric’ for Smart Buildings Integration
The Case for an Open IoT ‘Data Fabric’ for Smart Buildings IntegrationThe Case for an Open IoT ‘Data Fabric’ for Smart Buildings Integration
The Case for an Open IoT ‘Data Fabric’ for Smart Buildings Integration
 
Why Should I Adopt a Digital Twin?
Why Should I Adopt a Digital Twin?Why Should I Adopt a Digital Twin?
Why Should I Adopt a Digital Twin?
 
Project Haystack - 10 Years of Bringing Data Semantics to the Built Environment!
Project Haystack - 10 Years of Bringing Data Semantics to the Built Environment!Project Haystack - 10 Years of Bringing Data Semantics to the Built Environment!
Project Haystack - 10 Years of Bringing Data Semantics to the Built Environment!
 
Overcoming Tech Obsolescence in Smart Buildings
Overcoming Tech Obsolescence in Smart BuildingsOvercoming Tech Obsolescence in Smart Buildings
Overcoming Tech Obsolescence in Smart Buildings
 

Dernier

Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀DianaGray10
 
Intelligent Gimbal FINAL PAPER Engineering.pdf
Intelligent Gimbal FINAL PAPER Engineering.pdfIntelligent Gimbal FINAL PAPER Engineering.pdf
Intelligent Gimbal FINAL PAPER Engineering.pdfAnthony Lucente
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaRTTS
 
10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka Doktorová10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka DoktorováCzechDreamin
 
AI presentation and introduction - Retrieval Augmented Generation RAG 101
AI presentation and introduction - Retrieval Augmented Generation RAG 101AI presentation and introduction - Retrieval Augmented Generation RAG 101
AI presentation and introduction - Retrieval Augmented Generation RAG 101vincent683379
 
Intro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджераIntro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджераMark Opanasiuk
 
Server-Driven User Interface (SDUI) at Priceline
Server-Driven User Interface (SDUI) at PricelineServer-Driven User Interface (SDUI) at Priceline
Server-Driven User Interface (SDUI) at PricelineUXDXConf
 
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)Julian Hyde
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
 
Agentic RAG What it is its types applications and implementation.pdf
Agentic RAG What it is its types applications and implementation.pdfAgentic RAG What it is its types applications and implementation.pdf
Agentic RAG What it is its types applications and implementation.pdfChristopherTHyatt
 
PLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. StartupsPLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. StartupsStefano
 
Demystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyDemystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyJohn Staveley
 
Connecting the Dots in Product Design at KAYAK
Connecting the Dots in Product Design at KAYAKConnecting the Dots in Product Design at KAYAK
Connecting the Dots in Product Design at KAYAKUXDXConf
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backElena Simperl
 
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...CzechDreamin
 
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya HalderCustom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya HalderCzechDreamin
 
UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2DianaGray10
 
WSO2CONMay2024OpenSourceConferenceDebrief.pptx
WSO2CONMay2024OpenSourceConferenceDebrief.pptxWSO2CONMay2024OpenSourceConferenceDebrief.pptx
WSO2CONMay2024OpenSourceConferenceDebrief.pptxJennifer Lim
 
Enterprise Security Monitoring, And Log Management.
Enterprise Security Monitoring, And Log Management.Enterprise Security Monitoring, And Log Management.
Enterprise Security Monitoring, And Log Management.Boni Yeamin
 
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlPeter Udo Diehl
 

Dernier (20)

Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
Exploring UiPath Orchestrator API: updates and limits in 2024 🚀
 
Intelligent Gimbal FINAL PAPER Engineering.pdf
Intelligent Gimbal FINAL PAPER Engineering.pdfIntelligent Gimbal FINAL PAPER Engineering.pdf
Intelligent Gimbal FINAL PAPER Engineering.pdf
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka Doktorová10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka Doktorová
 
AI presentation and introduction - Retrieval Augmented Generation RAG 101
AI presentation and introduction - Retrieval Augmented Generation RAG 101AI presentation and introduction - Retrieval Augmented Generation RAG 101
AI presentation and introduction - Retrieval Augmented Generation RAG 101
 
Intro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджераIntro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджера
 
Server-Driven User Interface (SDUI) at Priceline
Server-Driven User Interface (SDUI) at PricelineServer-Driven User Interface (SDUI) at Priceline
Server-Driven User Interface (SDUI) at Priceline
 
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
Agentic RAG What it is its types applications and implementation.pdf
Agentic RAG What it is its types applications and implementation.pdfAgentic RAG What it is its types applications and implementation.pdf
Agentic RAG What it is its types applications and implementation.pdf
 
PLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. StartupsPLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. Startups
 
Demystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyDemystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John Staveley
 
Connecting the Dots in Product Design at KAYAK
Connecting the Dots in Product Design at KAYAKConnecting the Dots in Product Design at KAYAK
Connecting the Dots in Product Design at KAYAK
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
 
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya HalderCustom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
 
UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2
 
WSO2CONMay2024OpenSourceConferenceDebrief.pptx
WSO2CONMay2024OpenSourceConferenceDebrief.pptxWSO2CONMay2024OpenSourceConferenceDebrief.pptx
WSO2CONMay2024OpenSourceConferenceDebrief.pptx
 
Enterprise Security Monitoring, And Log Management.
Enterprise Security Monitoring, And Log Management.Enterprise Security Monitoring, And Log Management.
Enterprise Security Monitoring, And Log Management.
 
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
 

Tagging with AI to Enable Data-Driven Smart Building Applications at Scale!

  • 1. Tagging with AI to Enable Data-Driven Applications at Scale Jason Koh, PhD Chief Data Scientist at Mapped 1
  • 2. 2
  • 3. 3
  • 4. Potential of Building Data Air Quality Estimation Occupancy-driven Energy Optimization Customizable Thermal Comfort On-demand space booking Automated Fault Detection HVAC Electricity Security Lightning Elevator Water 4
  • 5. Mapped, the Unified API Air Quality Estimation Occupancy-driven Energy Optimization Customizable Thermal Comfort On-demand space booking Automated Fault Detection HVAC Electricity Security Lightning Elevator Water 5
  • 6. State of Building Data - Open up your building management/automation system, look at the point names - 3 different buildings/BMS/subsystems → 3 (or more) different labeling/naming schemes Slide source: Gabe Fierro 6
  • 7. Mapped Ontology Extending Brick Point Equipment Location feeds, hasPart isPartOf feeds hasPoint hasPoint controls - Introduce People on top of Brick - Extend more Classes (e.g., security, conference) - Identities management - Community-driven open-source - Rigorously validated - Extensible and expressive 7
  • 8. An Example Building Graph AHU-1 VAV-101 VAV-102 Zone-102 Room-102-1 Room-102-2 ZNT101 SAF101 feeds hasPoint feeds hasPart Variable Air Volume Box Variable Air Volume Box Air Handling Unit type HVAC Zone Zone Air Temp Sensor Supply Air Flow Sensor Room Room HVAC & Structural Data Jane Doe Access Card Reader 1 Security & People Data Person Jane’s Corp Badge Badge hasLocation Access History 1 owns hasObserved hasPoint Access History Status Access Card Reader 8
  • 9. Unified Access via GraphQL { building(id:"175A7C19") { floors(level: "3") { spaces { id name geoshape points { type timestamp aggregate } } } } } Visualize & Control Data Data Flow Fine-grained Control Mapped Data Pipeline Mapping with AI Data Experts 9 Cloud hosted via site-to-site VPN Discover & Extract Or Or
  • 10. The Metadata Mapping Problem RM-101.VMA-101.ZN_T type HVAC_Zone VAV type feeds AHU-1 RM-101.VMA-101.OCC Zone Air Temperature Sensor type hasPoint feeds hasPoint Occupancy Command type AHU type 1. Finding Entities / Types 2. Finding Relationships Various AI Methods - Point name analysis - Timeseries clustering - Causality / correlation learning Goals 10
  • 11. Technical Challenges in Auto-Mapping Heterogeneous Buildings Complex Relationships Expensive Labeling Effort Lack of Labeled Data 11 Active Learning Transfer Learning Ensemble Learning
  • 12. Mapped Approach A New Building Known Buildings Machine Learning Ensemble DAG Domain Experts Mapped Graph 12
  • 13. Active Learning 1. Train a model with given labeled data Machine Learning Models Domain Experts What is the most efficient way of acquiring labels? 1. 2. 3. At Mapped: 1. Various statistical metrics 2. Highly optimized labeling tool 13 2. Infer unlabeled data with the model 3. Ask labels for less confident inference 4. Repeat
  • 14. Transfer Learning 1. Shift data distribution 2. Cherry-pick common features 3. Ask uncommon patterns to domain experts A New Building Known Buildings How to utilize different buildings’ data? At Mapped: 1. Domain adaptation models 2. Similarity analysis for co-training 14 Machine Learning Models
  • 15. Ensemble Learning 1. Voting, decision tree, boosting, etc. 2. Directed Acyclic Graph (DAG) for complementing different ML models Machine Learning Ensemble DAG How to ensemble various ML models? At Mapped: 1. Flexible DAG based on customer requirements 2. Learned priorities over different ML models 15
  • 16. Mapped Approach A New Building Known Buildings Machine Learning Ensemble DAG Domain Experts Mapped Graph 16 Active Learning Transfer Learning Ensemble Learning
  • 17. Mapped in a Slide 17 Mapped solves the complicated ML problem with active, transfer, and ensemble learning Applications need a single API with a common view of the world The automated data pipeline from discovery to mapping, control, and usage. Air Quality Estimation Occupancy-driven Energy Optimization On-demand space booking HVAC Electricity Security Lightning
  • 19. Some Numbers from Mapped 1. Scrabble++ a. 97% accuracy with 1-2 % labeled data for a new building b. 20% increased accuracy with transfer learning (when there are not many examples) c. 30 seconds to manually label an entity (or a BACnet object) 2. Equipment correlation learning a. 93% accuracy without labels but with ground-truth point labels 19
  • 20. © 2021 MAPPED. ALL RIGHTS RESERVED 20 Scrabble: Transferable Active Learning [Koh et al. 2018] R M 3 - Z N T Sentence BIO Tags Conditional Random Fields (CRF) Robust to variations Room id ⦰ Zone Temp Tags (IR) Entity Class Room ZoneTempSensor Multi-Label MLP common layer across buildings RM-3 RM3-ZNT Mapped Graph hasLocation Inference from Schema static rules 20