SlideShare une entreprise Scribd logo
1  sur  34
Télécharger pour lire hors ligne
1© 2016 The MathWorks, Inc.
Trending Now!
Performance Trends and Alerts
with ThingSpeak IoT
By Anoush Najarian • MATLAB Performance Team • MathWorks
Boston CMG • Social Media Chair at #CMGimPACt • CMG Board of Directors
@anoushnajarian
2
Agenda
 The Internet of Things (IoT)
 ThingSpeak
 A few of our favorite IoT applications
 Performance Trends and Alerts on ThingSpeak
3
The Internet of Things is…
The internet of things (IoT) is the internetworking of physical devices, vehicles
(also referred to as "connected devices" and "smart devices"), buildings and
other items—embedded with electronics, software, sensors, actuators, and
network connectivity that enable these objects to collect and exchange data.
https://en.wikipedia.org/wiki/Internet_of_things
4
Things…
 Typical “thing”
– A sensor with connectivity
– An actuator with connectivity
 They are constrained
– Processing
– Memory
– Protocols
– Clock
– Power
 They run code over and over – sometimes they sleep wake up and run
code, and go back to sleep
 There are lots of them
5
What is the Internet of Things?
Edge Nodes Exploratory Analysis
Analytic IoT Platform
Deploy analytics
to aggregator
Deploy algorithms to nodes/devices
6
Agenda
 The Internet of Things (IoT)
 ThingSpeak
 A few of our favorite IoT applications
 Performance Trends and Alerts on ThingSpeak
7
What is ThingSpeak?
 Analytic IoT platform
– Collect data from sensors, “things”
– Visualize data instantly
– Has more than 60,000 users
 Analyze data
– MATLAB integration allows users to run
scheduled code on data coming into
ThingSpeak
 Act on data
– E.g. send a tweet when the temperature in
your backyard reaches 32 degrees
8
Who is ThingSpeak for?
 Makers
 Academics
 Engineers and scientists
https://thingspeak.com/
9
ThingSpeak: Collecting Data using Channels
 For any new data, first login and
create a channel in ThingSpeak
 Channels have read and write API
keys and can be public or private
 A channel is made up of 8 fields and
can store 8 streams of data (Temp,
Humidity, etc.)
 Channels can be updated at a
maximum rate of once every 15
seconds
ThingSpeak Weather Channel
10
Agenda
 The Internet of Things (IoT)
 ThingSpeak
 A few of our favorite IoT applications
 Performance Trends and Alerts on ThingSpeak
11
Objectives
 Measure, explore, discover weather patterns
 Provide niche weather service
Solution
 Arduino station with weather sensors
 Cloud-based aggregation and analysis
 Full example available at
makerzone.mathworks.com
Example 1: Monitoring Weather
12
Fun with Arduino!
 Arduino Serial Monitor
records the data from
the temperature sensor,
the pressure sensor,
and the humitidity
sensor, as transmitted
to ThingSpeak!
 Placing ice on
the Arduino temperature
sensor to cool it off!
13
Fun with Raspberry Pi
 Building a circuit with a
temperature sensor in this
week's
 Posting the temperature
readings from the sensor
to ThingSpeak using
Twitter.
14
Objectives
 Measure, explore, discover traffic patterns
 Provide live local traffic information service
Solution
 RaspberryPi + webcam
 Automated deployment of vision
algorithms on embedded sensor
 Full example available at
makerzone.mathworks.com
Example 2: Monitoring Traffic
15
Smart Agriculture
 Vineyards
 Green Houses
 Golf Courses
 Weather Stations – drought studies, radiation analysis
 Compost – Fungus prevention
16
Agenda
 The Internet of Things (IoT)
 ThingSpeak
 A few of our favorite IoT applications
 Performance Trends and Alerts on ThingSpeak
17
Case Study: Performance Optimization of MATLAB Code
 A customer ran into slow performance issues with her code in MATLAB.
She saw such slow performance in that she decided to recode her
algorithm in another language. We wanted to show her some simple
techniques in MATLAB that could bring her code down to a more
reasonable running time.
18
What is the problem the user was trying to solve?
 The code generates locations on a 2D
grid with dimensions nx1 by nx2
 The code iterates through all possible
combinations of these initial and final
positions
19
The core of the code
20
Measure performance of the original code
21
Set up ThingSpeak channel
22
Post performance data to our ThingSpeak channel
23
Focusing in on the Performance Improvements
February 1 – baseline at 23.8s
 If we hover over the data points in the trend plots, or zoom in, we will spot the key
optimizations that helped performance of Sarah's code. Initial Code measured at around
23.8s:

24
Performance Optimizations We Used
 Preallocation
 Vectorization
 Elimination of repeated calculations
25
Optimization #1: Preallocation
 Listen to Code Analyzer!
26
Focusing in on the Performance Improvements
Optimization #1: February 20 – 22.3s
 On February 20, we switched to Code with Preallocation, speeding up to
around 22.3s, or by 6%:
27
Optimization #2
Vectorize the inner two loops
28
Focusing in on the Performance Improvements
Optimization #2: May 20 - down to 0.2s!
 On May 2, we implemented the optimization to Vectorize the Inner Two loops; this sped up
the code 100+-fold, to 0.2s.
29
Optimization #3
Vectorize the inner three loops
30
Focusing in on the Performance Improvements
Optimization #3: June 9 – dipped down to 0.06s!
 Finally, on June 9, we implemented Vectorize the Inner Three Loops, and the code sped up
to 0.06s, or by 67%.
31
Final Optimization, #4: Eliminate redundant work
32
 In all, our trends capture pretty awesome 400+-fold performance improvement in the past
few months!
The result: 400x as fast overall!
33
What’s Next?
 Use Analysis and Visualization tools on ThingSpeak for more advanced
data analysis like displaying error bars, normalizing performance across a
suite of tests
 Set up email alerts in response to changes in performance
 Use machine learning for anomaly detection and to generate smart alerts
34
Thank you!
 Many thanks to the ThingSpeak team for help with these slides and for
creating and growing ThingSpeak!
 A big thank you to Andy Campbell for helping me publish a MATLAB Central
blog post on this
@anoushnajarian
Anoush.Najarian@mathworks.com
linkedin.com/in/anoushnajarian

Contenu connexe

Tendances

1. Introduction to Embedded Systems & IoT
1. Introduction to Embedded Systems & IoT1. Introduction to Embedded Systems & IoT
1. Introduction to Embedded Systems & IoTIEEE MIU SB
 
Home automation using IoT
Home automation using IoTHome automation using IoT
Home automation using IoTAthira_1993
 
IOT based air quality and monitoring by using arduino
IOT based air quality and monitoring by using arduinoIOT based air quality and monitoring by using arduino
IOT based air quality and monitoring by using arduinoGopikrishnateja Goli
 
Voice Control Home Automation
Voice Control Home AutomationVoice Control Home Automation
Voice Control Home AutomationAbhishek Neb
 
Home Automation System using iot
Home Automation System using iotHome Automation System using iot
Home Automation System using iotKowshik Deb
 
Introduction to IoT Architectures and Protocols
Introduction to IoT Architectures and ProtocolsIntroduction to IoT Architectures and Protocols
Introduction to IoT Architectures and ProtocolsAbdullah Alfadhly
 
IoT Development - Opportunities and Challenges
IoT Development - Opportunities and ChallengesIoT Development - Opportunities and Challenges
IoT Development - Opportunities and ChallengesAsim Rais Siddiqui
 
Cloud of things (IoT + Cloud Computing)
Cloud of things (IoT + Cloud Computing)Cloud of things (IoT + Cloud Computing)
Cloud of things (IoT + Cloud Computing)Zakaria Hossain
 
Home automation using blynk app with fan direction control and displaying sta...
Home automation using blynk app with fan direction control and displaying sta...Home automation using blynk app with fan direction control and displaying sta...
Home automation using blynk app with fan direction control and displaying sta...Diwash Kapil Chettri
 
Internet of things unit-1
Internet of things unit-1Internet of things unit-1
Internet of things unit-1Srimatre K
 

Tendances (20)

IoT sensor devices
IoT sensor devicesIoT sensor devices
IoT sensor devices
 
1. Introduction to Embedded Systems & IoT
1. Introduction to Embedded Systems & IoT1. Introduction to Embedded Systems & IoT
1. Introduction to Embedded Systems & IoT
 
Home automation using IoT
Home automation using IoTHome automation using IoT
Home automation using IoT
 
IoT security (Internet of Things)
IoT security (Internet of Things)IoT security (Internet of Things)
IoT security (Internet of Things)
 
IOT based air quality and monitoring by using arduino
IOT based air quality and monitoring by using arduinoIOT based air quality and monitoring by using arduino
IOT based air quality and monitoring by using arduino
 
Iot based home automation
Iot based home automationIot based home automation
Iot based home automation
 
Voice Control Home Automation
Voice Control Home AutomationVoice Control Home Automation
Voice Control Home Automation
 
IoT Networking
IoT NetworkingIoT Networking
IoT Networking
 
IOT Networks
IOT NetworksIOT Networks
IOT Networks
 
IoT and m2m
IoT and m2mIoT and m2m
IoT and m2m
 
Home Automation System using iot
Home Automation System using iotHome Automation System using iot
Home Automation System using iot
 
basic ppt on IOT
basic ppt on IOTbasic ppt on IOT
basic ppt on IOT
 
Introduction to IoT Architectures and Protocols
Introduction to IoT Architectures and ProtocolsIntroduction to IoT Architectures and Protocols
Introduction to IoT Architectures and Protocols
 
Internet of Things Using Arduino
Internet of Things Using ArduinoInternet of Things Using Arduino
Internet of Things Using Arduino
 
IoT Development - Opportunities and Challenges
IoT Development - Opportunities and ChallengesIoT Development - Opportunities and Challenges
IoT Development - Opportunities and Challenges
 
Introduction to Node MCU
Introduction to Node MCUIntroduction to Node MCU
Introduction to Node MCU
 
Edge Computing
Edge ComputingEdge Computing
Edge Computing
 
Cloud of things (IoT + Cloud Computing)
Cloud of things (IoT + Cloud Computing)Cloud of things (IoT + Cloud Computing)
Cloud of things (IoT + Cloud Computing)
 
Home automation using blynk app with fan direction control and displaying sta...
Home automation using blynk app with fan direction control and displaying sta...Home automation using blynk app with fan direction control and displaying sta...
Home automation using blynk app with fan direction control and displaying sta...
 
Internet of things unit-1
Internet of things unit-1Internet of things unit-1
Internet of things unit-1
 

En vedette

What we learned from #CMGimPACt Performance and Capacity Conference attendee ...
What we learned from #CMGimPACt Performance and Capacity Conference attendee ...What we learned from #CMGimPACt Performance and Capacity Conference attendee ...
What we learned from #CMGimPACt Performance and Capacity Conference attendee ...Anoush Najarian
 
Social Media for #CMG2015
Social Media for #CMG2015Social Media for #CMG2015
Social Media for #CMG2015Anoush Najarian
 
Performance OR Capacity #CMGimPACt2016
Performance OR Capacity #CMGimPACt2016 Performance OR Capacity #CMGimPACt2016
Performance OR Capacity #CMGimPACt2016 Alex Gilgur
 
Arduino seminar report
Arduino seminar reportArduino seminar report
Arduino seminar reportZaka Jutt
 
Arduino 2 Final Report (final)
Arduino 2 Final Report (final)Arduino 2 Final Report (final)
Arduino 2 Final Report (final)Mohammad Molani
 
Queuing model based load testing of large enterprise applications
Queuing model based load testing of large enterprise applicationsQueuing model based load testing of large enterprise applications
Queuing model based load testing of large enterprise applicationsLeonid Grinshpan, Ph.D.
 
Report On Arduino
Report On  ArduinoReport On  Arduino
Report On ArduinoTongXu520
 
Open / Free Cloud platforms and Open Hardware Systems
Open / Free Cloud platforms and Open Hardware SystemsOpen / Free Cloud platforms and Open Hardware Systems
Open / Free Cloud platforms and Open Hardware SystemsCharalampos Doukas
 
25 Examples of Native Analytics in Modern Products
25 Examples of Native Analytics in Modern Products25 Examples of Native Analytics in Modern Products
25 Examples of Native Analytics in Modern ProductsKeen
 
Arduino、Web 到 IoT
Arduino、Web 到 IoTArduino、Web 到 IoT
Arduino、Web 到 IoTJustin Lin
 
Android Control Hardware and Arduino IoT ( 22 Aug 15 )
Android Control Hardware and Arduino IoT ( 22 Aug 15 )Android Control Hardware and Arduino IoT ( 22 Aug 15 )
Android Control Hardware and Arduino IoT ( 22 Aug 15 )Adun Nanthakaew
 
Heart Rate Powerpoint
Heart Rate PowerpointHeart Rate Powerpoint
Heart Rate Powerpointmmoyerhealth
 
Microcontroller based heart rate meter
Microcontroller based heart rate meterMicrocontroller based heart rate meter
Microcontroller based heart rate meterChetana Nair
 
Automatic Wireless Health Monitoring System In Hospitals For Patients
Automatic Wireless Health Monitoring System In Hospitals For PatientsAutomatic Wireless Health Monitoring System In Hospitals For Patients
Automatic Wireless Health Monitoring System In Hospitals For PatientsEdgefxkits & Solutions
 
Wireless human health Monitor
Wireless human health MonitorWireless human health Monitor
Wireless human health MonitorAmarendra K Yadav
 
Heart beat monitor system PPT
Heart beat monitor system PPT Heart beat monitor system PPT
Heart beat monitor system PPT Anand Dwivedi
 
Boston DevOps Days 2016: Implementing Metrics Driven DevOps - Why and How
Boston DevOps Days 2016: Implementing Metrics Driven DevOps - Why and HowBoston DevOps Days 2016: Implementing Metrics Driven DevOps - Why and How
Boston DevOps Days 2016: Implementing Metrics Driven DevOps - Why and HowAndreas Grabner
 
Slideshare Powerpoint presentation
Slideshare Powerpoint presentationSlideshare Powerpoint presentation
Slideshare Powerpoint presentationelliehood
 

En vedette (19)

What we learned from #CMGimPACt Performance and Capacity Conference attendee ...
What we learned from #CMGimPACt Performance and Capacity Conference attendee ...What we learned from #CMGimPACt Performance and Capacity Conference attendee ...
What we learned from #CMGimPACt Performance and Capacity Conference attendee ...
 
Social Media for #CMG2015
Social Media for #CMG2015Social Media for #CMG2015
Social Media for #CMG2015
 
Performance OR Capacity #CMGimPACt2016
Performance OR Capacity #CMGimPACt2016 Performance OR Capacity #CMGimPACt2016
Performance OR Capacity #CMGimPACt2016
 
Arduino seminar report
Arduino seminar reportArduino seminar report
Arduino seminar report
 
Arduino 2 Final Report (final)
Arduino 2 Final Report (final)Arduino 2 Final Report (final)
Arduino 2 Final Report (final)
 
Queuing model based load testing of large enterprise applications
Queuing model based load testing of large enterprise applicationsQueuing model based load testing of large enterprise applications
Queuing model based load testing of large enterprise applications
 
Report On Arduino
Report On  ArduinoReport On  Arduino
Report On Arduino
 
Open / Free Cloud platforms and Open Hardware Systems
Open / Free Cloud platforms and Open Hardware SystemsOpen / Free Cloud platforms and Open Hardware Systems
Open / Free Cloud platforms and Open Hardware Systems
 
25 Examples of Native Analytics in Modern Products
25 Examples of Native Analytics in Modern Products25 Examples of Native Analytics in Modern Products
25 Examples of Native Analytics in Modern Products
 
Arduino、Web 到 IoT
Arduino、Web 到 IoTArduino、Web 到 IoT
Arduino、Web 到 IoT
 
Android Control Hardware and Arduino IoT ( 22 Aug 15 )
Android Control Hardware and Arduino IoT ( 22 Aug 15 )Android Control Hardware and Arduino IoT ( 22 Aug 15 )
Android Control Hardware and Arduino IoT ( 22 Aug 15 )
 
Heart Rate Powerpoint
Heart Rate PowerpointHeart Rate Powerpoint
Heart Rate Powerpoint
 
Microcontroller based heart rate meter
Microcontroller based heart rate meterMicrocontroller based heart rate meter
Microcontroller based heart rate meter
 
Automatic Wireless Health Monitoring System In Hospitals For Patients
Automatic Wireless Health Monitoring System In Hospitals For PatientsAutomatic Wireless Health Monitoring System In Hospitals For Patients
Automatic Wireless Health Monitoring System In Hospitals For Patients
 
Wireless human health Monitor
Wireless human health MonitorWireless human health Monitor
Wireless human health Monitor
 
Presentation on home automation
Presentation on home automationPresentation on home automation
Presentation on home automation
 
Heart beat monitor system PPT
Heart beat monitor system PPT Heart beat monitor system PPT
Heart beat monitor system PPT
 
Boston DevOps Days 2016: Implementing Metrics Driven DevOps - Why and How
Boston DevOps Days 2016: Implementing Metrics Driven DevOps - Why and HowBoston DevOps Days 2016: Implementing Metrics Driven DevOps - Why and How
Boston DevOps Days 2016: Implementing Metrics Driven DevOps - Why and How
 
Slideshare Powerpoint presentation
Slideshare Powerpoint presentationSlideshare Powerpoint presentation
Slideshare Powerpoint presentation
 

Similaire à Performance trends and alerts with ThingSpeak IoT

IBM Bluemix Nice Meetup #1 - CEEI NCA - 20160630 -
IBM Bluemix Nice Meetup #1 - CEEI NCA - 20160630 - IBM Bluemix Nice Meetup #1 - CEEI NCA - 20160630 -
IBM Bluemix Nice Meetup #1 - CEEI NCA - 20160630 - IBM France Lab
 
Final Year Project For Computer Science
Final Year Project For  Computer ScienceFinal Year Project For  Computer Science
Final Year Project For Computer ScienceSimplilearn
 
PPT on Weather Monitoring System-converted (1).pptx
PPT on Weather Monitoring System-converted (1).pptxPPT on Weather Monitoring System-converted (1).pptx
PPT on Weather Monitoring System-converted (1).pptxabhisheksinghcompute
 
Jprofessionals co create the future of your city
Jprofessionals co create the future of your cityJprofessionals co create the future of your city
Jprofessionals co create the future of your cityPance Cavkovski
 
Prototyping the Internet of Things
Prototyping the Internet of ThingsPrototyping the Internet of Things
Prototyping the Internet of ThingsDavid Bliss
 
Using bluemix predictive analytics service in Node-RED
Using bluemix predictive analytics service in Node-REDUsing bluemix predictive analytics service in Node-RED
Using bluemix predictive analytics service in Node-REDLionel Mommeja
 
Data Science for Internet of Things with Ajit Jaokar
Data Science for Internet of Things with Ajit JaokarData Science for Internet of Things with Ajit Jaokar
Data Science for Internet of Things with Ajit JaokarJessica Willis
 
IRJET- Information Logging and Investigation of Control Framework Utilizing D...
IRJET- Information Logging and Investigation of Control Framework Utilizing D...IRJET- Information Logging and Investigation of Control Framework Utilizing D...
IRJET- Information Logging and Investigation of Control Framework Utilizing D...IRJET Journal
 
BigData @ comScore
BigData @ comScoreBigData @ comScore
BigData @ comScoreeaiti
 
Embedded system & IoT Course | certification Program | Learn and Build
Embedded system & IoT Course | certification Program | Learn and BuildEmbedded system & IoT Course | certification Program | Learn and Build
Embedded system & IoT Course | certification Program | Learn and BuildLearn and Build
 
Big Data Analytics for Real Time Systems
Big Data Analytics for Real Time SystemsBig Data Analytics for Real Time Systems
Big Data Analytics for Real Time SystemsKamalika Dutta
 
Splunk All the Things: Our First 3 Months Monitoring Web Service APIs - Splun...
Splunk All the Things: Our First 3 Months Monitoring Web Service APIs - Splun...Splunk All the Things: Our First 3 Months Monitoring Web Service APIs - Splun...
Splunk All the Things: Our First 3 Months Monitoring Web Service APIs - Splun...Dan Cundiff
 
AWS Summit Berlin 2013 - Big Data Analytics
AWS Summit Berlin 2013 - Big Data AnalyticsAWS Summit Berlin 2013 - Big Data Analytics
AWS Summit Berlin 2013 - Big Data AnalyticsAWS Germany
 
SoftElegance Services: Data Science, Data Engineering, Big Data Architecture
SoftElegance Services: Data Science, Data Engineering, Big Data Architecture SoftElegance Services: Data Science, Data Engineering, Big Data Architecture
SoftElegance Services: Data Science, Data Engineering, Big Data Architecture Daryna Dubitska
 
MongoDB.local Atlanta: MongoDB @ Sensus: Xylem IoT and MongoDB
MongoDB.local Atlanta: MongoDB @ Sensus: Xylem IoT and MongoDBMongoDB.local Atlanta: MongoDB @ Sensus: Xylem IoT and MongoDB
MongoDB.local Atlanta: MongoDB @ Sensus: Xylem IoT and MongoDBMongoDB
 
Real-Time Analytics with Confluent and MemSQL
Real-Time Analytics with Confluent and MemSQLReal-Time Analytics with Confluent and MemSQL
Real-Time Analytics with Confluent and MemSQLSingleStore
 

Similaire à Performance trends and alerts with ThingSpeak IoT (20)

IBM Bluemix Nice Meetup #1 - CEEI NCA - 20160630 -
IBM Bluemix Nice Meetup #1 - CEEI NCA - 20160630 - IBM Bluemix Nice Meetup #1 - CEEI NCA - 20160630 -
IBM Bluemix Nice Meetup #1 - CEEI NCA - 20160630 -
 
Final Year Project For Computer Science
Final Year Project For  Computer ScienceFinal Year Project For  Computer Science
Final Year Project For Computer Science
 
PPT on Weather Monitoring System-converted (1).pptx
PPT on Weather Monitoring System-converted (1).pptxPPT on Weather Monitoring System-converted (1).pptx
PPT on Weather Monitoring System-converted (1).pptx
 
Jprofessionals co create the future of your city
Jprofessionals co create the future of your cityJprofessionals co create the future of your city
Jprofessionals co create the future of your city
 
Prototyping the Internet of Things
Prototyping the Internet of ThingsPrototyping the Internet of Things
Prototyping the Internet of Things
 
Using bluemix predictive analytics service in Node-RED
Using bluemix predictive analytics service in Node-REDUsing bluemix predictive analytics service in Node-RED
Using bluemix predictive analytics service in Node-RED
 
Ajit jaokar slides
Ajit jaokar slidesAjit jaokar slides
Ajit jaokar slides
 
Data Science for Internet of Things with Ajit Jaokar
Data Science for Internet of Things with Ajit JaokarData Science for Internet of Things with Ajit Jaokar
Data Science for Internet of Things with Ajit Jaokar
 
IRJET- Information Logging and Investigation of Control Framework Utilizing D...
IRJET- Information Logging and Investigation of Control Framework Utilizing D...IRJET- Information Logging and Investigation of Control Framework Utilizing D...
IRJET- Information Logging and Investigation of Control Framework Utilizing D...
 
SAP Leonardo
SAP LeonardoSAP Leonardo
SAP Leonardo
 
Self-Service Analytics on Hadoop: Lessons Learned
Self-Service Analytics on Hadoop: Lessons LearnedSelf-Service Analytics on Hadoop: Lessons Learned
Self-Service Analytics on Hadoop: Lessons Learned
 
BigData @ comScore
BigData @ comScoreBigData @ comScore
BigData @ comScore
 
Embedded system & IoT Course | certification Program | Learn and Build
Embedded system & IoT Course | certification Program | Learn and BuildEmbedded system & IoT Course | certification Program | Learn and Build
Embedded system & IoT Course | certification Program | Learn and Build
 
Mendix-7-Keynote
Mendix-7-KeynoteMendix-7-Keynote
Mendix-7-Keynote
 
Big Data Analytics for Real Time Systems
Big Data Analytics for Real Time SystemsBig Data Analytics for Real Time Systems
Big Data Analytics for Real Time Systems
 
Splunk All the Things: Our First 3 Months Monitoring Web Service APIs - Splun...
Splunk All the Things: Our First 3 Months Monitoring Web Service APIs - Splun...Splunk All the Things: Our First 3 Months Monitoring Web Service APIs - Splun...
Splunk All the Things: Our First 3 Months Monitoring Web Service APIs - Splun...
 
AWS Summit Berlin 2013 - Big Data Analytics
AWS Summit Berlin 2013 - Big Data AnalyticsAWS Summit Berlin 2013 - Big Data Analytics
AWS Summit Berlin 2013 - Big Data Analytics
 
SoftElegance Services: Data Science, Data Engineering, Big Data Architecture
SoftElegance Services: Data Science, Data Engineering, Big Data Architecture SoftElegance Services: Data Science, Data Engineering, Big Data Architecture
SoftElegance Services: Data Science, Data Engineering, Big Data Architecture
 
MongoDB.local Atlanta: MongoDB @ Sensus: Xylem IoT and MongoDB
MongoDB.local Atlanta: MongoDB @ Sensus: Xylem IoT and MongoDBMongoDB.local Atlanta: MongoDB @ Sensus: Xylem IoT and MongoDB
MongoDB.local Atlanta: MongoDB @ Sensus: Xylem IoT and MongoDB
 
Real-Time Analytics with Confluent and MemSQL
Real-Time Analytics with Confluent and MemSQLReal-Time Analytics with Confluent and MemSQL
Real-Time Analytics with Confluent and MemSQL
 

Dernier

Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Boston Institute of Analytics
 
Role of Consumer Insights in business transformation
Role of Consumer Insights in business transformationRole of Consumer Insights in business transformation
Role of Consumer Insights in business transformationAnnie Melnic
 
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdfEnglish-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdfblazblazml
 
Data Analysis Project : Targeting the Right Customers, Presentation on Bank M...
Data Analysis Project : Targeting the Right Customers, Presentation on Bank M...Data Analysis Project : Targeting the Right Customers, Presentation on Bank M...
Data Analysis Project : Targeting the Right Customers, Presentation on Bank M...Boston Institute of Analytics
 
Decoding Patterns: Customer Churn Prediction Data Analysis Project
Decoding Patterns: Customer Churn Prediction Data Analysis ProjectDecoding Patterns: Customer Churn Prediction Data Analysis Project
Decoding Patterns: Customer Churn Prediction Data Analysis ProjectBoston Institute of Analytics
 
Data Factory in Microsoft Fabric (MsBIP #82)
Data Factory in Microsoft Fabric (MsBIP #82)Data Factory in Microsoft Fabric (MsBIP #82)
Data Factory in Microsoft Fabric (MsBIP #82)Cathrine Wilhelmsen
 
World Economic Forum Metaverse Ecosystem By Utpal Chakraborty.pdf
World Economic Forum Metaverse Ecosystem By Utpal Chakraborty.pdfWorld Economic Forum Metaverse Ecosystem By Utpal Chakraborty.pdf
World Economic Forum Metaverse Ecosystem By Utpal Chakraborty.pdfsimulationsindia
 
Introduction to Mongo DB-open-­‐source, high-­‐performance, document-­‐orient...
Introduction to Mongo DB-open-­‐source, high-­‐performance, document-­‐orient...Introduction to Mongo DB-open-­‐source, high-­‐performance, document-­‐orient...
Introduction to Mongo DB-open-­‐source, high-­‐performance, document-­‐orient...boychatmate1
 
DATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etcDATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etclalithasri22
 
Digital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdfDigital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdfNicoChristianSunaryo
 
Principles and Practices of Data Visualization
Principles and Practices of Data VisualizationPrinciples and Practices of Data Visualization
Principles and Practices of Data VisualizationKianJazayeri1
 
Rithik Kumar Singh codealpha pythohn.pdf
Rithik Kumar Singh codealpha pythohn.pdfRithik Kumar Singh codealpha pythohn.pdf
Rithik Kumar Singh codealpha pythohn.pdfrahulyadav957181
 
Digital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing worksDigital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing worksdeepakthakur548787
 
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...Dr Arash Najmaei ( Phd., MBA, BSc)
 
What To Do For World Nature Conservation Day by Slidesgo.pptx
What To Do For World Nature Conservation Day by Slidesgo.pptxWhat To Do For World Nature Conservation Day by Slidesgo.pptx
What To Do For World Nature Conservation Day by Slidesgo.pptxSimranPal17
 
knowledge representation in artificial intelligence
knowledge representation in artificial intelligenceknowledge representation in artificial intelligence
knowledge representation in artificial intelligencePriyadharshiniG41
 
modul pembelajaran robotic Workshop _ by Slidesgo.pptx
modul pembelajaran robotic Workshop _ by Slidesgo.pptxmodul pembelajaran robotic Workshop _ by Slidesgo.pptx
modul pembelajaran robotic Workshop _ by Slidesgo.pptxaleedritatuxx
 
Non Text Magic Studio Magic Design for Presentations L&P.pdf
Non Text Magic Studio Magic Design for Presentations L&P.pdfNon Text Magic Studio Magic Design for Presentations L&P.pdf
Non Text Magic Studio Magic Design for Presentations L&P.pdfPratikPatil591646
 

Dernier (20)

Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
 
Role of Consumer Insights in business transformation
Role of Consumer Insights in business transformationRole of Consumer Insights in business transformation
Role of Consumer Insights in business transformation
 
Insurance Churn Prediction Data Analysis Project
Insurance Churn Prediction Data Analysis ProjectInsurance Churn Prediction Data Analysis Project
Insurance Churn Prediction Data Analysis Project
 
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdfEnglish-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
 
Data Analysis Project : Targeting the Right Customers, Presentation on Bank M...
Data Analysis Project : Targeting the Right Customers, Presentation on Bank M...Data Analysis Project : Targeting the Right Customers, Presentation on Bank M...
Data Analysis Project : Targeting the Right Customers, Presentation on Bank M...
 
2023 Survey Shows Dip in High School E-Cigarette Use
2023 Survey Shows Dip in High School E-Cigarette Use2023 Survey Shows Dip in High School E-Cigarette Use
2023 Survey Shows Dip in High School E-Cigarette Use
 
Decoding Patterns: Customer Churn Prediction Data Analysis Project
Decoding Patterns: Customer Churn Prediction Data Analysis ProjectDecoding Patterns: Customer Churn Prediction Data Analysis Project
Decoding Patterns: Customer Churn Prediction Data Analysis Project
 
Data Factory in Microsoft Fabric (MsBIP #82)
Data Factory in Microsoft Fabric (MsBIP #82)Data Factory in Microsoft Fabric (MsBIP #82)
Data Factory in Microsoft Fabric (MsBIP #82)
 
World Economic Forum Metaverse Ecosystem By Utpal Chakraborty.pdf
World Economic Forum Metaverse Ecosystem By Utpal Chakraborty.pdfWorld Economic Forum Metaverse Ecosystem By Utpal Chakraborty.pdf
World Economic Forum Metaverse Ecosystem By Utpal Chakraborty.pdf
 
Introduction to Mongo DB-open-­‐source, high-­‐performance, document-­‐orient...
Introduction to Mongo DB-open-­‐source, high-­‐performance, document-­‐orient...Introduction to Mongo DB-open-­‐source, high-­‐performance, document-­‐orient...
Introduction to Mongo DB-open-­‐source, high-­‐performance, document-­‐orient...
 
DATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etcDATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etc
 
Digital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdfDigital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdf
 
Principles and Practices of Data Visualization
Principles and Practices of Data VisualizationPrinciples and Practices of Data Visualization
Principles and Practices of Data Visualization
 
Rithik Kumar Singh codealpha pythohn.pdf
Rithik Kumar Singh codealpha pythohn.pdfRithik Kumar Singh codealpha pythohn.pdf
Rithik Kumar Singh codealpha pythohn.pdf
 
Digital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing worksDigital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing works
 
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
 
What To Do For World Nature Conservation Day by Slidesgo.pptx
What To Do For World Nature Conservation Day by Slidesgo.pptxWhat To Do For World Nature Conservation Day by Slidesgo.pptx
What To Do For World Nature Conservation Day by Slidesgo.pptx
 
knowledge representation in artificial intelligence
knowledge representation in artificial intelligenceknowledge representation in artificial intelligence
knowledge representation in artificial intelligence
 
modul pembelajaran robotic Workshop _ by Slidesgo.pptx
modul pembelajaran robotic Workshop _ by Slidesgo.pptxmodul pembelajaran robotic Workshop _ by Slidesgo.pptx
modul pembelajaran robotic Workshop _ by Slidesgo.pptx
 
Non Text Magic Studio Magic Design for Presentations L&P.pdf
Non Text Magic Studio Magic Design for Presentations L&P.pdfNon Text Magic Studio Magic Design for Presentations L&P.pdf
Non Text Magic Studio Magic Design for Presentations L&P.pdf
 

Performance trends and alerts with ThingSpeak IoT

  • 1. 1© 2016 The MathWorks, Inc. Trending Now! Performance Trends and Alerts with ThingSpeak IoT By Anoush Najarian • MATLAB Performance Team • MathWorks Boston CMG • Social Media Chair at #CMGimPACt • CMG Board of Directors @anoushnajarian
  • 2. 2 Agenda  The Internet of Things (IoT)  ThingSpeak  A few of our favorite IoT applications  Performance Trends and Alerts on ThingSpeak
  • 3. 3 The Internet of Things is… The internet of things (IoT) is the internetworking of physical devices, vehicles (also referred to as "connected devices" and "smart devices"), buildings and other items—embedded with electronics, software, sensors, actuators, and network connectivity that enable these objects to collect and exchange data. https://en.wikipedia.org/wiki/Internet_of_things
  • 4. 4 Things…  Typical “thing” – A sensor with connectivity – An actuator with connectivity  They are constrained – Processing – Memory – Protocols – Clock – Power  They run code over and over – sometimes they sleep wake up and run code, and go back to sleep  There are lots of them
  • 5. 5 What is the Internet of Things? Edge Nodes Exploratory Analysis Analytic IoT Platform Deploy analytics to aggregator Deploy algorithms to nodes/devices
  • 6. 6 Agenda  The Internet of Things (IoT)  ThingSpeak  A few of our favorite IoT applications  Performance Trends and Alerts on ThingSpeak
  • 7. 7 What is ThingSpeak?  Analytic IoT platform – Collect data from sensors, “things” – Visualize data instantly – Has more than 60,000 users  Analyze data – MATLAB integration allows users to run scheduled code on data coming into ThingSpeak  Act on data – E.g. send a tweet when the temperature in your backyard reaches 32 degrees
  • 8. 8 Who is ThingSpeak for?  Makers  Academics  Engineers and scientists https://thingspeak.com/
  • 9. 9 ThingSpeak: Collecting Data using Channels  For any new data, first login and create a channel in ThingSpeak  Channels have read and write API keys and can be public or private  A channel is made up of 8 fields and can store 8 streams of data (Temp, Humidity, etc.)  Channels can be updated at a maximum rate of once every 15 seconds ThingSpeak Weather Channel
  • 10. 10 Agenda  The Internet of Things (IoT)  ThingSpeak  A few of our favorite IoT applications  Performance Trends and Alerts on ThingSpeak
  • 11. 11 Objectives  Measure, explore, discover weather patterns  Provide niche weather service Solution  Arduino station with weather sensors  Cloud-based aggregation and analysis  Full example available at makerzone.mathworks.com Example 1: Monitoring Weather
  • 12. 12 Fun with Arduino!  Arduino Serial Monitor records the data from the temperature sensor, the pressure sensor, and the humitidity sensor, as transmitted to ThingSpeak!  Placing ice on the Arduino temperature sensor to cool it off!
  • 13. 13 Fun with Raspberry Pi  Building a circuit with a temperature sensor in this week's  Posting the temperature readings from the sensor to ThingSpeak using Twitter.
  • 14. 14 Objectives  Measure, explore, discover traffic patterns  Provide live local traffic information service Solution  RaspberryPi + webcam  Automated deployment of vision algorithms on embedded sensor  Full example available at makerzone.mathworks.com Example 2: Monitoring Traffic
  • 15. 15 Smart Agriculture  Vineyards  Green Houses  Golf Courses  Weather Stations – drought studies, radiation analysis  Compost – Fungus prevention
  • 16. 16 Agenda  The Internet of Things (IoT)  ThingSpeak  A few of our favorite IoT applications  Performance Trends and Alerts on ThingSpeak
  • 17. 17 Case Study: Performance Optimization of MATLAB Code  A customer ran into slow performance issues with her code in MATLAB. She saw such slow performance in that she decided to recode her algorithm in another language. We wanted to show her some simple techniques in MATLAB that could bring her code down to a more reasonable running time.
  • 18. 18 What is the problem the user was trying to solve?  The code generates locations on a 2D grid with dimensions nx1 by nx2  The code iterates through all possible combinations of these initial and final positions
  • 19. 19 The core of the code
  • 20. 20 Measure performance of the original code
  • 22. 22 Post performance data to our ThingSpeak channel
  • 23. 23 Focusing in on the Performance Improvements February 1 – baseline at 23.8s  If we hover over the data points in the trend plots, or zoom in, we will spot the key optimizations that helped performance of Sarah's code. Initial Code measured at around 23.8s: 
  • 24. 24 Performance Optimizations We Used  Preallocation  Vectorization  Elimination of repeated calculations
  • 25. 25 Optimization #1: Preallocation  Listen to Code Analyzer!
  • 26. 26 Focusing in on the Performance Improvements Optimization #1: February 20 – 22.3s  On February 20, we switched to Code with Preallocation, speeding up to around 22.3s, or by 6%:
  • 28. 28 Focusing in on the Performance Improvements Optimization #2: May 20 - down to 0.2s!  On May 2, we implemented the optimization to Vectorize the Inner Two loops; this sped up the code 100+-fold, to 0.2s.
  • 29. 29 Optimization #3 Vectorize the inner three loops
  • 30. 30 Focusing in on the Performance Improvements Optimization #3: June 9 – dipped down to 0.06s!  Finally, on June 9, we implemented Vectorize the Inner Three Loops, and the code sped up to 0.06s, or by 67%.
  • 31. 31 Final Optimization, #4: Eliminate redundant work
  • 32. 32  In all, our trends capture pretty awesome 400+-fold performance improvement in the past few months! The result: 400x as fast overall!
  • 33. 33 What’s Next?  Use Analysis and Visualization tools on ThingSpeak for more advanced data analysis like displaying error bars, normalizing performance across a suite of tests  Set up email alerts in response to changes in performance  Use machine learning for anomaly detection and to generate smart alerts
  • 34. 34 Thank you!  Many thanks to the ThingSpeak team for help with these slides and for creating and growing ThingSpeak!  A big thank you to Andy Campbell for helping me publish a MATLAB Central blog post on this @anoushnajarian Anoush.Najarian@mathworks.com linkedin.com/in/anoushnajarian

Notes de l'éditeur

  1. Internet of Things (IoT) describes an emerging trend where a large number of embedded devices (things) are connected to the Internet. These connected devices communicate with people and other things and often provide sensor data to cloud storage and cloud computing resources where the data is processed and analyzed to gain important insights. Cheap cloud computing power and increased device connectivity is enabling this trend. IoT solutions are built for many vertical applications such as environmental monitoring and control, health monitoring, vehicle fleet monitoring, industrial monitoring and control, and home automation. MATLAB® and Simulink® products support IoT systems by helping you develop and test edge node devices, access and aggregate data, and analyze IoT sensor data. At a high level, many IoT systems can be described using the diagram above. The left side of the diagram illustrates edge nodes. Edge nodes are devices that collect data and include devices such as wireless temperatures sensors, heart rate monitors, and hydraulic pressure sensors. The middle of the diagram shows the data aggregator. The aggregator collects, processes and stores data from many edge nodes that are often geographically dispersed, and it may have the capability to analyze and take action on the incoming data. The right side of the diagram depicts the historical analysis of data. In this case, the data is pulled from the aggregator into a software environment to allow researchers to gain insight from the data and to prototype algorithms that may eventually execute on the aggregator or on the edge node device itself.
  2. Show weather station channel
  3. Our channel: https://thingspeak.com/channels/14046
  4. https://thingspeak.com/channels/82845