SlideShare une entreprise Scribd logo
1  sur  19
Télécharger pour lire hors ligne
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland
Mining in the Middle of the City: The
needs of Big Data for Smart Cities
A Real Experience in the SmartSantander Testbed
Antonio J. Jara, Dominique Genoud, Yann Bocchi
HES-SO, Switzerland
Palo Alto, USA
19th June 2014
Problem statement
• Smart Cities are presenting new challenges for Big Data.
• The emerging amount of data needs to be processed to
make feasible its analysis.
• First step, data fusion to avoid noise and apparently
random behaviors.
• Second step, correlation in order to see hidden
behaviors.
• Next steps more focused on insight, and integration into
business models.
• Needs from the market to define the questions that are
expecting to answer for the Smart Cities.
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland
Big Data / Smart Cities ecosystem
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland
SmartSantander Testbed
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland
SmartSantander Testbed
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland
SmartSantander Testbed
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland
SmartSantander Testbed (Traffic)
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland
SmartSantander Testbed (Temperature)
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland
Data Fusion
• Temperature area totally insolated from the traffic
monitoring zones.
• Not required fine-grain analysis of temperature, since
not influenced by traffic.
• Traffic sensors needs to be aggregated by highways and
lanes.
• Data fusion feasible due to the nature of the problem.
• This simplify and makes feasible the correlation between
Temperature and Traffic
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland
Traffic (without data fusion)
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland
Traffic vs Temperature in April (with data fusion)
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland
Traffic vs Temperature in July (with data fusion)
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland
57,4 % Line Correlated
Traffic vs Temperature in December (with data fusion)
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland
Modelling of Temp / Traffic in April
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland
Modelling of Temp / Traffic in July
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland
Modelling of Temp / Traffic in December
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland
KNIME workflow
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland
KNIME workflow for visualization
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland
Conclusions
• Data Fusion is required for Smart Cities analysis.
• Correlation of non-aggregated data is non-feasible.
• Data Fusion has demonstrated the similarity among the
temperature and traffic trends.
• KNIME offers an intuitive tool to works with Data.
• In addition, it offers correlation tools, characterization
tools, and classification tools from Weka and R, and
finally with Hadoop.
• Current works focused on human dynamics analysis
over the data; Burst vs Poisson.
• An extended / advanced version of this work avaiable
under request to jara@ieee.org
Dr. Antonio J. Jara – jara@ieee.org
HES-SO//Valais Switzerland

Contenu connexe

Similaire à Mining in the Middle of the City: The needs of Big Data for Smart Cities

Doing the Numbers: Getting the other 50% of the story
Doing the Numbers: Getting the other 50% of the storyDoing the Numbers: Getting the other 50% of the story
Doing the Numbers: Getting the other 50% of the storyJ T "Tom" Johnson
 
Eduworks kick-off presentation: USAL
Eduworks kick-off presentation: USALEduworks kick-off presentation: USAL
Eduworks kick-off presentation: USALEduworks Network
 
Presentation: How can Plan Ceibal Land into the Age of Big Data?
Presentation: How can Plan Ceibal Land into the Age of Big Data?Presentation: How can Plan Ceibal Land into the Age of Big Data?
Presentation: How can Plan Ceibal Land into the Age of Big Data?@cristobalcobo
 
Overview of Big Data, Data Science and Statistics, along with Digitalisation,...
Overview of Big Data, Data Science and Statistics, along with Digitalisation,...Overview of Big Data, Data Science and Statistics, along with Digitalisation,...
Overview of Big Data, Data Science and Statistics, along with Digitalisation,...Prof. Dr. Diego Kuonen
 
A Statistician's 'Big Tent' View on Big Data and Data Science (Version 9)
A Statistician's 'Big Tent' View on Big Data and Data Science (Version 9)A Statistician's 'Big Tent' View on Big Data and Data Science (Version 9)
A Statistician's 'Big Tent' View on Big Data and Data Science (Version 9)Prof. Dr. Diego Kuonen
 
A Statistician's 'Big Tent' View on Big Data and Data Science (Version 5)
A Statistician's 'Big Tent' View on Big Data and Data Science (Version 5)A Statistician's 'Big Tent' View on Big Data and Data Science (Version 5)
A Statistician's 'Big Tent' View on Big Data and Data Science (Version 5)Prof. Dr. Diego Kuonen
 
Demystifying Big Data, Data Science and Statistics, along with Machine Intell...
Demystifying Big Data, Data Science and Statistics, along with Machine Intell...Demystifying Big Data, Data Science and Statistics, along with Machine Intell...
Demystifying Big Data, Data Science and Statistics, along with Machine Intell...Prof. Dr. Diego Kuonen
 
A Statistician's 'Big Tent' View on Big Data and Data Science (Version 6)
A Statistician's 'Big Tent' View on Big Data and Data Science (Version 6)A Statistician's 'Big Tent' View on Big Data and Data Science (Version 6)
A Statistician's 'Big Tent' View on Big Data and Data Science (Version 6)Prof. Dr. Diego Kuonen
 
Big Data, Data-Driven Decision Making and Statistics Towards Data-Informed Po...
Big Data, Data-Driven Decision Making and Statistics Towards Data-Informed Po...Big Data, Data-Driven Decision Making and Statistics Towards Data-Informed Po...
Big Data, Data-Driven Decision Making and Statistics Towards Data-Informed Po...Prof. Dr. Diego Kuonen
 
Big Data as the Fuel and Analytics as the Engine of the Digital Transformation
Big Data as the Fuel and Analytics as the Engine of the Digital TransformationBig Data as the Fuel and Analytics as the Engine of the Digital Transformation
Big Data as the Fuel and Analytics as the Engine of the Digital TransformationProf. Dr. Diego Kuonen
 
"Data as the Fuel and Analytics as the Engine of the Digital Transformation -...
"Data as the Fuel and Analytics as the Engine of the Digital Transformation -..."Data as the Fuel and Analytics as the Engine of the Digital Transformation -...
"Data as the Fuel and Analytics as the Engine of the Digital Transformation -...Prof. Dr. Diego Kuonen
 
A Swiss Statistician's 'Big Tent' View on Big Data and Data Science (Version 10)
A Swiss Statistician's 'Big Tent' View on Big Data and Data Science (Version 10)A Swiss Statistician's 'Big Tent' View on Big Data and Data Science (Version 10)
A Swiss Statistician's 'Big Tent' View on Big Data and Data Science (Version 10)Prof. Dr. Diego Kuonen
 
Listening to the pulse of our cities with Stream Reasoning (and few more tech...
Listening to the pulse of our cities with Stream Reasoning (and few more tech...Listening to the pulse of our cities with Stream Reasoning (and few more tech...
Listening to the pulse of our cities with Stream Reasoning (and few more tech...Emanuele Della Valle
 
Production Processes of Official Statistics & Data Innovation Processes Augme...
Production Processes of Official Statistics & Data Innovation Processes Augme...Production Processes of Official Statistics & Data Innovation Processes Augme...
Production Processes of Official Statistics & Data Innovation Processes Augme...Prof. Dr. Diego Kuonen
 
A Statistician's `Big Tent' View on Big Data and Data Science in Health Scien...
A Statistician's `Big Tent' View on Big Data and Data Science in Health Scien...A Statistician's `Big Tent' View on Big Data and Data Science in Health Scien...
A Statistician's `Big Tent' View on Big Data and Data Science in Health Scien...Prof. Dr. Diego Kuonen
 
Big Data as the Fuel and Visual Analytics as the Engine Mount of the Digital ...
Big Data as the Fuel and Visual Analytics as the Engine Mount of the Digital ...Big Data as the Fuel and Visual Analytics as the Engine Mount of the Digital ...
Big Data as the Fuel and Visual Analytics as the Engine Mount of the Digital ...Prof. Dr. Diego Kuonen
 
Data as the Fuel and Analytics as the Engine of the Digital Transformation: D...
Data as the Fuel and Analytics as the Engine of the Digital Transformation: D...Data as the Fuel and Analytics as the Engine of the Digital Transformation: D...
Data as the Fuel and Analytics as the Engine of the Digital Transformation: D...Prof. Dr. Diego Kuonen
 
A Statistician's View on Big Data and Data Science in Pharmaceutical Developm...
A Statistician's View on Big Data and Data Science in Pharmaceutical Developm...A Statistician's View on Big Data and Data Science in Pharmaceutical Developm...
A Statistician's View on Big Data and Data Science in Pharmaceutical Developm...Prof. Dr. Diego Kuonen
 
(Big) Data as the Fuel and Analytics as the Engine of the Digital Transformation
(Big) Data as the Fuel and Analytics as the Engine of the Digital Transformation(Big) Data as the Fuel and Analytics as the Engine of the Digital Transformation
(Big) Data as the Fuel and Analytics as the Engine of the Digital TransformationProf. Dr. Diego Kuonen
 

Similaire à Mining in the Middle of the City: The needs of Big Data for Smart Cities (20)

Doing the Numbers: Getting the other 50% of the story
Doing the Numbers: Getting the other 50% of the storyDoing the Numbers: Getting the other 50% of the story
Doing the Numbers: Getting the other 50% of the story
 
Eduworks kick-off presentation: USAL
Eduworks kick-off presentation: USALEduworks kick-off presentation: USAL
Eduworks kick-off presentation: USAL
 
Presentation: How can Plan Ceibal Land into the Age of Big Data?
Presentation: How can Plan Ceibal Land into the Age of Big Data?Presentation: How can Plan Ceibal Land into the Age of Big Data?
Presentation: How can Plan Ceibal Land into the Age of Big Data?
 
Overview of Big Data, Data Science and Statistics, along with Digitalisation,...
Overview of Big Data, Data Science and Statistics, along with Digitalisation,...Overview of Big Data, Data Science and Statistics, along with Digitalisation,...
Overview of Big Data, Data Science and Statistics, along with Digitalisation,...
 
A Statistician's 'Big Tent' View on Big Data and Data Science (Version 9)
A Statistician's 'Big Tent' View on Big Data and Data Science (Version 9)A Statistician's 'Big Tent' View on Big Data and Data Science (Version 9)
A Statistician's 'Big Tent' View on Big Data and Data Science (Version 9)
 
A Statistician's 'Big Tent' View on Big Data and Data Science (Version 5)
A Statistician's 'Big Tent' View on Big Data and Data Science (Version 5)A Statistician's 'Big Tent' View on Big Data and Data Science (Version 5)
A Statistician's 'Big Tent' View on Big Data and Data Science (Version 5)
 
Demystifying Big Data, Data Science and Statistics, along with Machine Intell...
Demystifying Big Data, Data Science and Statistics, along with Machine Intell...Demystifying Big Data, Data Science and Statistics, along with Machine Intell...
Demystifying Big Data, Data Science and Statistics, along with Machine Intell...
 
A Statistician's 'Big Tent' View on Big Data and Data Science (Version 6)
A Statistician's 'Big Tent' View on Big Data and Data Science (Version 6)A Statistician's 'Big Tent' View on Big Data and Data Science (Version 6)
A Statistician's 'Big Tent' View on Big Data and Data Science (Version 6)
 
Big Data, Data-Driven Decision Making and Statistics Towards Data-Informed Po...
Big Data, Data-Driven Decision Making and Statistics Towards Data-Informed Po...Big Data, Data-Driven Decision Making and Statistics Towards Data-Informed Po...
Big Data, Data-Driven Decision Making and Statistics Towards Data-Informed Po...
 
Big Data as the Fuel and Analytics as the Engine of the Digital Transformation
Big Data as the Fuel and Analytics as the Engine of the Digital TransformationBig Data as the Fuel and Analytics as the Engine of the Digital Transformation
Big Data as the Fuel and Analytics as the Engine of the Digital Transformation
 
"Data as the Fuel and Analytics as the Engine of the Digital Transformation -...
"Data as the Fuel and Analytics as the Engine of the Digital Transformation -..."Data as the Fuel and Analytics as the Engine of the Digital Transformation -...
"Data as the Fuel and Analytics as the Engine of the Digital Transformation -...
 
A Swiss Statistician's 'Big Tent' View on Big Data and Data Science (Version 10)
A Swiss Statistician's 'Big Tent' View on Big Data and Data Science (Version 10)A Swiss Statistician's 'Big Tent' View on Big Data and Data Science (Version 10)
A Swiss Statistician's 'Big Tent' View on Big Data and Data Science (Version 10)
 
Listening to the pulse of our cities with Stream Reasoning (and few more tech...
Listening to the pulse of our cities with Stream Reasoning (and few more tech...Listening to the pulse of our cities with Stream Reasoning (and few more tech...
Listening to the pulse of our cities with Stream Reasoning (and few more tech...
 
Production Processes of Official Statistics & Data Innovation Processes Augme...
Production Processes of Official Statistics & Data Innovation Processes Augme...Production Processes of Official Statistics & Data Innovation Processes Augme...
Production Processes of Official Statistics & Data Innovation Processes Augme...
 
Sight, Sound, Numbers & Us: Data Visualization + Data Sonification = Data Acc...
Sight, Sound, Numbers & Us: Data Visualization + Data Sonification = Data Acc...Sight, Sound, Numbers & Us: Data Visualization + Data Sonification = Data Acc...
Sight, Sound, Numbers & Us: Data Visualization + Data Sonification = Data Acc...
 
A Statistician's `Big Tent' View on Big Data and Data Science in Health Scien...
A Statistician's `Big Tent' View on Big Data and Data Science in Health Scien...A Statistician's `Big Tent' View on Big Data and Data Science in Health Scien...
A Statistician's `Big Tent' View on Big Data and Data Science in Health Scien...
 
Big Data as the Fuel and Visual Analytics as the Engine Mount of the Digital ...
Big Data as the Fuel and Visual Analytics as the Engine Mount of the Digital ...Big Data as the Fuel and Visual Analytics as the Engine Mount of the Digital ...
Big Data as the Fuel and Visual Analytics as the Engine Mount of the Digital ...
 
Data as the Fuel and Analytics as the Engine of the Digital Transformation: D...
Data as the Fuel and Analytics as the Engine of the Digital Transformation: D...Data as the Fuel and Analytics as the Engine of the Digital Transformation: D...
Data as the Fuel and Analytics as the Engine of the Digital Transformation: D...
 
A Statistician's View on Big Data and Data Science in Pharmaceutical Developm...
A Statistician's View on Big Data and Data Science in Pharmaceutical Developm...A Statistician's View on Big Data and Data Science in Pharmaceutical Developm...
A Statistician's View on Big Data and Data Science in Pharmaceutical Developm...
 
(Big) Data as the Fuel and Analytics as the Engine of the Digital Transformation
(Big) Data as the Fuel and Analytics as the Engine of the Digital Transformation(Big) Data as the Fuel and Analytics as the Engine of the Digital Transformation
(Big) Data as the Fuel and Analytics as the Engine of the Digital Transformation
 

Plus de Institute of Information Systems (HES-SO)

Classification of noisy free-text prostate cancer pathology reports using nat...
Classification of noisy free-text prostate cancer pathology reports using nat...Classification of noisy free-text prostate cancer pathology reports using nat...
Classification of noisy free-text prostate cancer pathology reports using nat...Institute of Information Systems (HES-SO)
 
Machine learning assisted citation screening for Systematic Reviews - Anjani ...
Machine learning assisted citation screening for Systematic Reviews - Anjani ...Machine learning assisted citation screening for Systematic Reviews - Anjani ...
Machine learning assisted citation screening for Systematic Reviews - Anjani ...Institute of Information Systems (HES-SO)
 
Exploiting biomedical literature to mine out a large multimodal dataset of ra...
Exploiting biomedical literature to mine out a large multimodal dataset of ra...Exploiting biomedical literature to mine out a large multimodal dataset of ra...
Exploiting biomedical literature to mine out a large multimodal dataset of ra...Institute of Information Systems (HES-SO)
 
Studying Public Medical Images from Open Access Literature and Social Network...
Studying Public Medical Images from Open Access Literature and Social Network...Studying Public Medical Images from Open Access Literature and Social Network...
Studying Public Medical Images from Open Access Literature and Social Network...Institute of Information Systems (HES-SO)
 
Risques opérationnels et le système de contrôle interne : les limites d’un te...
Risques opérationnels et le système de contrôle interne : les limites d’un te...Risques opérationnels et le système de contrôle interne : les limites d’un te...
Risques opérationnels et le système de contrôle interne : les limites d’un te...Institute of Information Systems (HES-SO)
 
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...Le contrôle interne dans les administrations publiques tient-il toutes ses pr...
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...Institute of Information Systems (HES-SO)
 
Le système de contrôle interne : Présentation générale, enjeux et méthodes
Le système de contrôle interne : Présentation générale, enjeux et méthodesLe système de contrôle interne : Présentation générale, enjeux et méthodes
Le système de contrôle interne : Présentation générale, enjeux et méthodesInstitute of Information Systems (HES-SO)
 
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...Institute of Information Systems (HES-SO)
 
NOSE: une approche Smart-City pour les zones périphériques et extra-urbaines
NOSE: une approche Smart-City pour les zones périphériques et extra-urbainesNOSE: une approche Smart-City pour les zones périphériques et extra-urbaines
NOSE: une approche Smart-City pour les zones périphériques et extra-urbainesInstitute of Information Systems (HES-SO)
 

Plus de Institute of Information Systems (HES-SO) (20)

MIE20232.pptx
MIE20232.pptxMIE20232.pptx
MIE20232.pptx
 
Classification of noisy free-text prostate cancer pathology reports using nat...
Classification of noisy free-text prostate cancer pathology reports using nat...Classification of noisy free-text prostate cancer pathology reports using nat...
Classification of noisy free-text prostate cancer pathology reports using nat...
 
Machine learning assisted citation screening for Systematic Reviews - Anjani ...
Machine learning assisted citation screening for Systematic Reviews - Anjani ...Machine learning assisted citation screening for Systematic Reviews - Anjani ...
Machine learning assisted citation screening for Systematic Reviews - Anjani ...
 
Exploiting biomedical literature to mine out a large multimodal dataset of ra...
Exploiting biomedical literature to mine out a large multimodal dataset of ra...Exploiting biomedical literature to mine out a large multimodal dataset of ra...
Exploiting biomedical literature to mine out a large multimodal dataset of ra...
 
L'IoT dans les usines. Quels avantages ?
L'IoT dans les usines. Quels avantages ?L'IoT dans les usines. Quels avantages ?
L'IoT dans les usines. Quels avantages ?
 
Studying Public Medical Images from Open Access Literature and Social Network...
Studying Public Medical Images from Open Access Literature and Social Network...Studying Public Medical Images from Open Access Literature and Social Network...
Studying Public Medical Images from Open Access Literature and Social Network...
 
Risques opérationnels et le système de contrôle interne : les limites d’un te...
Risques opérationnels et le système de contrôle interne : les limites d’un te...Risques opérationnels et le système de contrôle interne : les limites d’un te...
Risques opérationnels et le système de contrôle interne : les limites d’un te...
 
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...Le contrôle interne dans les administrations publiques tient-il toutes ses pr...
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...
 
Le système de contrôle interne : Présentation générale, enjeux et méthodes
Le système de contrôle interne : Présentation générale, enjeux et méthodesLe système de contrôle interne : Présentation générale, enjeux et méthodes
Le système de contrôle interne : Présentation générale, enjeux et méthodes
 
Crowdsourcing-based Mobile Application for Wheelchair Accessibility
Crowdsourcing-based Mobile Application for Wheelchair AccessibilityCrowdsourcing-based Mobile Application for Wheelchair Accessibility
Crowdsourcing-based Mobile Application for Wheelchair Accessibility
 
Quelle(s) valeur(s) pour le leadership stratégique ?
Quelle(s) valeur(s) pour le leadership stratégique ?Quelle(s) valeur(s) pour le leadership stratégique ?
Quelle(s) valeur(s) pour le leadership stratégique ?
 
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...
 
Challenges in medical imaging and the VISCERAL model
Challenges in medical imaging and the VISCERAL modelChallenges in medical imaging and the VISCERAL model
Challenges in medical imaging and the VISCERAL model
 
NOSE: une approche Smart-City pour les zones périphériques et extra-urbaines
NOSE: une approche Smart-City pour les zones périphériques et extra-urbainesNOSE: une approche Smart-City pour les zones périphériques et extra-urbaines
NOSE: une approche Smart-City pour les zones périphériques et extra-urbaines
 
Medical image analysis and big data evaluation infrastructures
Medical image analysis and big data evaluation infrastructuresMedical image analysis and big data evaluation infrastructures
Medical image analysis and big data evaluation infrastructures
 
Medical image analysis, retrieval and evaluation infrastructures
Medical image analysis, retrieval and evaluation infrastructuresMedical image analysis, retrieval and evaluation infrastructures
Medical image analysis, retrieval and evaluation infrastructures
 
How to detect soft falls on devices
How to detect soft falls on devicesHow to detect soft falls on devices
How to detect soft falls on devices
 
FUNDAMENTALS OF TEXTURE PROCESSING FOR BIOMEDICAL IMAGE ANALYSIS
FUNDAMENTALS OF TEXTURE PROCESSING FOR BIOMEDICAL IMAGE ANALYSISFUNDAMENTALS OF TEXTURE PROCESSING FOR BIOMEDICAL IMAGE ANALYSIS
FUNDAMENTALS OF TEXTURE PROCESSING FOR BIOMEDICAL IMAGE ANALYSIS
 
MOBILE COLLECTION AND DISSEMINATION OF SENIORS’ SKILLS
MOBILE COLLECTION AND DISSEMINATION OF SENIORS’ SKILLSMOBILE COLLECTION AND DISSEMINATION OF SENIORS’ SKILLS
MOBILE COLLECTION AND DISSEMINATION OF SENIORS’ SKILLS
 
Enhanced Students Laboratory The GET project
Enhanced Students Laboratory The GET projectEnhanced Students Laboratory The GET project
Enhanced Students Laboratory The GET project
 

Dernier

Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 

Dernier (20)

Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 

Mining in the Middle of the City: The needs of Big Data for Smart Cities

  • 1. Dr. Antonio J. Jara – jara@ieee.org HES-SO//Valais Switzerland Mining in the Middle of the City: The needs of Big Data for Smart Cities A Real Experience in the SmartSantander Testbed Antonio J. Jara, Dominique Genoud, Yann Bocchi HES-SO, Switzerland Palo Alto, USA 19th June 2014
  • 2. Problem statement • Smart Cities are presenting new challenges for Big Data. • The emerging amount of data needs to be processed to make feasible its analysis. • First step, data fusion to avoid noise and apparently random behaviors. • Second step, correlation in order to see hidden behaviors. • Next steps more focused on insight, and integration into business models. • Needs from the market to define the questions that are expecting to answer for the Smart Cities. Dr. Antonio J. Jara – jara@ieee.org HES-SO//Valais Switzerland
  • 3. Big Data / Smart Cities ecosystem Dr. Antonio J. Jara – jara@ieee.org HES-SO//Valais Switzerland
  • 4. SmartSantander Testbed Dr. Antonio J. Jara – jara@ieee.org HES-SO//Valais Switzerland
  • 5. SmartSantander Testbed Dr. Antonio J. Jara – jara@ieee.org HES-SO//Valais Switzerland
  • 6. SmartSantander Testbed Dr. Antonio J. Jara – jara@ieee.org HES-SO//Valais Switzerland
  • 7. SmartSantander Testbed (Traffic) Dr. Antonio J. Jara – jara@ieee.org HES-SO//Valais Switzerland
  • 8. SmartSantander Testbed (Temperature) Dr. Antonio J. Jara – jara@ieee.org HES-SO//Valais Switzerland
  • 9. Data Fusion • Temperature area totally insolated from the traffic monitoring zones. • Not required fine-grain analysis of temperature, since not influenced by traffic. • Traffic sensors needs to be aggregated by highways and lanes. • Data fusion feasible due to the nature of the problem. • This simplify and makes feasible the correlation between Temperature and Traffic Dr. Antonio J. Jara – jara@ieee.org HES-SO//Valais Switzerland
  • 10. Traffic (without data fusion) Dr. Antonio J. Jara – jara@ieee.org HES-SO//Valais Switzerland
  • 11. Traffic vs Temperature in April (with data fusion) Dr. Antonio J. Jara – jara@ieee.org HES-SO//Valais Switzerland
  • 12. Traffic vs Temperature in July (with data fusion) Dr. Antonio J. Jara – jara@ieee.org HES-SO//Valais Switzerland 57,4 % Line Correlated
  • 13. Traffic vs Temperature in December (with data fusion) Dr. Antonio J. Jara – jara@ieee.org HES-SO//Valais Switzerland
  • 14. Modelling of Temp / Traffic in April Dr. Antonio J. Jara – jara@ieee.org HES-SO//Valais Switzerland
  • 15. Modelling of Temp / Traffic in July Dr. Antonio J. Jara – jara@ieee.org HES-SO//Valais Switzerland
  • 16. Modelling of Temp / Traffic in December Dr. Antonio J. Jara – jara@ieee.org HES-SO//Valais Switzerland
  • 17. KNIME workflow Dr. Antonio J. Jara – jara@ieee.org HES-SO//Valais Switzerland
  • 18. KNIME workflow for visualization Dr. Antonio J. Jara – jara@ieee.org HES-SO//Valais Switzerland
  • 19. Conclusions • Data Fusion is required for Smart Cities analysis. • Correlation of non-aggregated data is non-feasible. • Data Fusion has demonstrated the similarity among the temperature and traffic trends. • KNIME offers an intuitive tool to works with Data. • In addition, it offers correlation tools, characterization tools, and classification tools from Weka and R, and finally with Hadoop. • Current works focused on human dynamics analysis over the data; Burst vs Poisson. • An extended / advanced version of this work avaiable under request to jara@ieee.org Dr. Antonio J. Jara – jara@ieee.org HES-SO//Valais Switzerland