SlideShare une entreprise Scribd logo
1  sur  29
IoT Middleware for
Precision Agriculture
José Camacho
Alberto Cunha
Miguel L. Pardal
Workforce Monitoring in Olive Fields
Smart Farming Workshop
April 10th 2018
Food
2016 2
2050
7x109 people
7.95x108 without
regular food supply
UN data:
Agricultural challenge
Efficiency
Produce same with less time and
effort
Productivity
Produce more
Agricultural variability
Profitability
Balance costs and benefits
3
Tecnologies
Actuators
(Water pumps, Faucets, …)
Sensor networks
(Communication infrastructures in agricultural field)
Global Positioning System
(location and navigation – people and machines)
Geographic Information System
(terrain maps)
Sensors
(Humidity, Temperature, Atmosferic Pressure, …)
6
Agricultural production model
“Integrated planning model for citrus agribusiness
system using systems dynamics”
por Ferreira, J. et al.
7
Current solutions require
significant investment and are not
suited for manual labor
8
Monitoring the workforce in specialty crops
(Fruits, Flowers, Vegetables)
Case Study: Olive Trees
Case Study
9
Detect location and activities of the
workers with off-the-shelf devices
Smartphone Wearable
10
Challenges
Tree interference
Granularity
Important in specialty crops
Cost
Ergonomics
Minimum disturbance to worker’s movements
Infrastructure
Low communication and power resources
11
Harvest location tracking
13
Seed
Crop
preservation
Harvest
Final
product
GPS
Smartphone
Metrics
Dead
Reckoning
Gyroscope
Machine
Learning
ActivitiesLocation
Process
Accelerometer Magnetometer
Location tracking
• Precise worker location
• GPS is used in large scale,
mechanized agriculture
• Two sources were evaluated:
GPS and Dead Reckoning
14
Global Positioning System
• 4 satellites are needed to
determine receptor location
• Available in most
Smartphones
• Average error of 5 to 10
meters outside, in the field
• Trees cause signal
interference
15
X
YZ
Accelerometer
+
Magnetometer
Detect worker steps Give a direction to the steps
Inertial Navigation technology
Dead Reckoning
16
Dead Reckoning
2. Look for peaks above
12 m/s2
3. Discard other peaks in a
period of 350ms
1. Calculate amplitude of
acceleration applied to
Smartphone sensor
4. Calculate new position with
azimuth angle given by
magnetometer
Amplitude acceleration for 2 steps
17
GPS vs Dead Reckoning
GPS Dead Reckoning
Coordinates system Absolute Relative
Dependency on external
system
Satellites GPS or
GLONASS
No
Influence of trees in signal Yes No
Power consumption High Moderate
Average location error High (5 to 10 meters) Reduced
Error accumulation No Yes
Comparison between navigation technology available in Smartphones
18
Our solution
Correct accumulated error from Dead Reckoning with
absolute coordinates provided by GPS
When GPS precision is better than 8 meters,
the two navigation systems’ coordinates are averaged
19
+
Dead Reckoning GPS
Results
1. Path correction
Real path Dead Reckoning
+ GPS
GPS
Test performed with worker walking in a
traditional olive field
20
Results
2. Energy consumption test
Analyze power consumption using just GPS technology.
Smartphone with a 3000mAh battery (Samsung Galaxy S7)
Two tests were performed:
a – capture location at each 60 seconds
b – capture location at each 10 seconds
Consumption: 2% of battery every 10 minutes
Problem:
May not be enough for a typical work day (8 hours)
21
Related work
“A wearable module for recording worker
position in orchards”
Yannis Ampatzidis et. Al
Monitoring system
• Capture worker locations
• Uses a dedicated
Dead Reckoning device
• GPS installed in
agricultural machine
• Solution capable of capturing
the worker’s paths
22
Dead
Reckoning
Location
GPS
Harvest activity tracking
23
Seed
Crop
preservation
Harvest
Final
product
Gyroscope
Machine
Learning
Metrics
Smartphone
Activities
Process
Accelerometer Magnetometer
Detect activities during the day through
Machine Learning classification algorithms:
BayesNet and MultilayerPerceptron
from Weka library
X
YZ
+ +
Accelerometer Magnetometer Gyroscope
Activity detection
accX
accY
accZ
compX
compY
compZ
gyroX
gyroY
gyroZ
26
Activity detection
27
Activities list:
• Walk forward
• Walk backward
• Run
• Pick fruit
• Dig
Photo of worker wearing smartphone
in sleeve during activity detection
Harvest process
Activity detection
Sliding window solution
1 .. 75 … 150 151
74 75 … 150 .. 225
Initial window
Window advance
3 seconds = 150 points x 20 ms
1,5 seconds intersection
To each window’s data, we compute:
average, minimum, maximum, kurtosis and
standard-deviation
Total of 45 features extracted from each window
(3 sensors x 3 axis x 5 statistics)
Results
CFS Subset Evaluator ➡ 11 features
Most use data from accelerometer
29
Equipment:
• Samsung Galaxy S7
• Battery 3000mAh
• Sensors:
• Accelerometer, Magnetometer, Gyroscope
Learning:
~2 min of captured data for
each activity
Results
1. Classification of activities by 1 worker
Activity BayesNet MultilayerPerceptron
Walk/Forward 75% 87,5%
Run 100% 100%
Walk/Backward 80,7% 82,46%
Pickfruits 91,67% 91,67%
Dig 98,04% 98,04%
Learning period: less than 30 minutes
Total captured data points: 255
Percentage of correctly classified activities
>90%
Good performance at distinguishing specific agriculture activities.
Less effective at distinguishing walking forward and backward.
30
Results - Activities
2. Classification of activities by 2 workers
Learning period: 0 minutes
Activity BayesNet MultilayerPerceptron
Walk/Forward 38,98% 42,37%
Pick Fruits 81,35% 81,35%
Dig 89,83% 91,52%
Activity BayesNet MultilayerPerceptron
Walk/Forward 38,60% 8,77%
Pick Fruits 91,23% 92,98%
Dig 87,5% 87,5%
2nd worker – percentage of correctly classified activities
1st worker – percentage of correctly classified activities
31
Conclusion
• Solution allows monitoring workforce
harvesting specialty crops
• Solution goes beyond existing works by
adding activity detection
• Location monitoring (Dead Reckoning + GPS)
• Able to locate workers in the field
• Limited by power consumption
• Activity detection
• Percentage of correctly classified activities is above 90%
32
Future work
• New sources of location data
• Bluetooth Low Energy beacons
• GSM antennas triangulation
• Terrain layout with satellite images
• Combine work team data
• Address ethical concerns of privacy
• Integrate worker data with crop field data:
• Soil sensors
• Machinery
• Meteorology
33
Thank you
Miguel.Pardal@tecnico.ulisboa.pt
X
YZ
Master work by José Camacho
Co-advised by Alberto Cunha

Contenu connexe

Tendances

Artificial intelligence in agriculture
Artificial intelligence in agricultureArtificial intelligence in agriculture
Artificial intelligence in agricultureSivajyothi paramsivam
 
Ways iot can transform your agriculture business
Ways iot can transform your agriculture businessWays iot can transform your agriculture business
Ways iot can transform your agriculture businessKG2
 
Global IoT in Agriculture Market Analysis Report
Global IoT in Agriculture Market Analysis ReportGlobal IoT in Agriculture Market Analysis Report
Global IoT in Agriculture Market Analysis ReportNarayanSharma67
 
Iot based smart agriculture
Iot based smart agricultureIot based smart agriculture
Iot based smart agricultureBinayakreddy
 
IoT based water saving technique for Green Farming
IoT based water saving technique for Green FarmingIoT based water saving technique for Green Farming
IoT based water saving technique for Green Farmingijtsrd
 
IoT and 5G in Agriculture: opportunities and challenges
IoT and 5G in Agriculture: opportunities and challengesIoT and 5G in Agriculture: opportunities and challenges
IoT and 5G in Agriculture: opportunities and challengesSjaak Wolfert
 
IoT Application in Agriculture
IoT Application in AgricultureIoT Application in Agriculture
IoT Application in AgricultureUTKARSH DWIVEDI
 
IoT for indian agriculture
IoT for indian agricultureIoT for indian agriculture
IoT for indian agricultureRavi Mundada
 
iot based agriculture
 iot based agriculture iot based agriculture
iot based agricultureTanish Khilani
 
Precision Agriculture with Sensors and Technologies from IoT - INForum 2016
Precision Agriculture with Sensors and Technologies from IoT - INForum 2016Precision Agriculture with Sensors and Technologies from IoT - INForum 2016
Precision Agriculture with Sensors and Technologies from IoT - INForum 2016José Camacho
 
IoT applications in agriculture(iot avenue)
IoT applications in agriculture(iot avenue)IoT applications in agriculture(iot avenue)
IoT applications in agriculture(iot avenue)mousumiiot
 
Smart Farming in Germany and Uzbekistan
Smart Farming in Germany and UzbekistanSmart Farming in Germany and Uzbekistan
Smart Farming in Germany and UzbekistanOzodbek Kuchkarov
 
Artificial Intelligence In Agriculture & Its Status in India
Artificial Intelligence In Agriculture & Its Status in IndiaArtificial Intelligence In Agriculture & Its Status in India
Artificial Intelligence In Agriculture & Its Status in IndiaJanhviTripathi
 
Automation in Agriculture and IoT
Automation in Agriculture and IoTAutomation in Agriculture and IoT
Automation in Agriculture and IoTCloudTechnologies
 
IoT (Internet of Things)- Based Smart Farming
IoT (Internet of Things)- Based Smart FarmingIoT (Internet of Things)- Based Smart Farming
IoT (Internet of Things)- Based Smart FarmingChakravarthy Thejesh
 
Agriculture technology trends 2021: Collaborating tech with agriculture
Agriculture technology trends 2021: Collaborating tech with agricultureAgriculture technology trends 2021: Collaborating tech with agriculture
Agriculture technology trends 2021: Collaborating tech with agricultureKaty Slemon
 

Tendances (20)

Artificial intelligence in agriculture
Artificial intelligence in agricultureArtificial intelligence in agriculture
Artificial intelligence in agriculture
 
Ways iot can transform your agriculture business
Ways iot can transform your agriculture businessWays iot can transform your agriculture business
Ways iot can transform your agriculture business
 
Global IoT in Agriculture Market Analysis Report
Global IoT in Agriculture Market Analysis ReportGlobal IoT in Agriculture Market Analysis Report
Global IoT in Agriculture Market Analysis Report
 
Iot based smart agriculture
Iot based smart agricultureIot based smart agriculture
Iot based smart agriculture
 
IoT based water saving technique for Green Farming
IoT based water saving technique for Green FarmingIoT based water saving technique for Green Farming
IoT based water saving technique for Green Farming
 
IoT and 5G in Agriculture: opportunities and challenges
IoT and 5G in Agriculture: opportunities and challengesIoT and 5G in Agriculture: opportunities and challenges
IoT and 5G in Agriculture: opportunities and challenges
 
IoT Application in Agriculture
IoT Application in AgricultureIoT Application in Agriculture
IoT Application in Agriculture
 
IoT for indian agriculture
IoT for indian agricultureIoT for indian agriculture
IoT for indian agriculture
 
iot based agriculture
 iot based agriculture iot based agriculture
iot based agriculture
 
Precision Agriculture with Sensors and Technologies from IoT - INForum 2016
Precision Agriculture with Sensors and Technologies from IoT - INForum 2016Precision Agriculture with Sensors and Technologies from IoT - INForum 2016
Precision Agriculture with Sensors and Technologies from IoT - INForum 2016
 
IoT applications in agriculture(iot avenue)
IoT applications in agriculture(iot avenue)IoT applications in agriculture(iot avenue)
IoT applications in agriculture(iot avenue)
 
Agriculture iot
Agriculture iotAgriculture iot
Agriculture iot
 
IoT in Agriculture
IoT in AgricultureIoT in Agriculture
IoT in Agriculture
 
Smart Farming in Germany and Uzbekistan
Smart Farming in Germany and UzbekistanSmart Farming in Germany and Uzbekistan
Smart Farming in Germany and Uzbekistan
 
Artificial Intelligence In Agriculture & Its Status in India
Artificial Intelligence In Agriculture & Its Status in IndiaArtificial Intelligence In Agriculture & Its Status in India
Artificial Intelligence In Agriculture & Its Status in India
 
Automation in Agriculture and IoT
Automation in Agriculture and IoTAutomation in Agriculture and IoT
Automation in Agriculture and IoT
 
Applications of iot
Applications of iotApplications of iot
Applications of iot
 
Suciu_Blackseacom2016
Suciu_Blackseacom2016Suciu_Blackseacom2016
Suciu_Blackseacom2016
 
IoT (Internet of Things)- Based Smart Farming
IoT (Internet of Things)- Based Smart FarmingIoT (Internet of Things)- Based Smart Farming
IoT (Internet of Things)- Based Smart Farming
 
Agriculture technology trends 2021: Collaborating tech with agriculture
Agriculture technology trends 2021: Collaborating tech with agricultureAgriculture technology trends 2021: Collaborating tech with agriculture
Agriculture technology trends 2021: Collaborating tech with agriculture
 

Similaire à IoT Middleware for Precision Agriculture: workforce monitoring in olive fields

Crop Prediction using IoT & Machine Learning Algorithm
Crop Prediction using IoT & Machine Learning AlgorithmCrop Prediction using IoT & Machine Learning Algorithm
Crop Prediction using IoT & Machine Learning AlgorithmIRJET Journal
 
IRJET- Smart Crop-Field Monitoring and Automation Irrigation System using...
IRJET-  	  Smart Crop-Field Monitoring and Automation Irrigation System using...IRJET-  	  Smart Crop-Field Monitoring and Automation Irrigation System using...
IRJET- Smart Crop-Field Monitoring and Automation Irrigation System using...IRJET Journal
 
IRJET- Iot Based Intelligent Management for Agricultural Process using Ra...
IRJET-  	  Iot Based Intelligent Management for Agricultural Process using Ra...IRJET-  	  Iot Based Intelligent Management for Agricultural Process using Ra...
IRJET- Iot Based Intelligent Management for Agricultural Process using Ra...IRJET Journal
 
IRJET- Smart Green House using IOT and Cloud Computing
IRJET- Smart Green House using IOT and Cloud ComputingIRJET- Smart Green House using IOT and Cloud Computing
IRJET- Smart Green House using IOT and Cloud ComputingIRJET Journal
 
Precision Farming in Fruit Crops presentation
Precision Farming in Fruit Crops presentationPrecision Farming in Fruit Crops presentation
Precision Farming in Fruit Crops presentationscvns2828
 
Artifical intelligence in agriculture
Artifical intelligence in agricultureArtifical intelligence in agriculture
Artifical intelligence in agricultureYogeshDadhich4
 
artificialintelligenceinagriculture-180324135613.pdf
artificialintelligenceinagriculture-180324135613.pdfartificialintelligenceinagriculture-180324135613.pdf
artificialintelligenceinagriculture-180324135613.pdfkdemersal
 
artificialintelligenceinagriculture-180324135613 (1).pptx
artificialintelligenceinagriculture-180324135613 (1).pptxartificialintelligenceinagriculture-180324135613 (1).pptx
artificialintelligenceinagriculture-180324135613 (1).pptxpramodKumarsahani1
 
artificialintelligenceinagriculture-180324135613 (1).pptx
artificialintelligenceinagriculture-180324135613 (1).pptxartificialintelligenceinagriculture-180324135613 (1).pptx
artificialintelligenceinagriculture-180324135613 (1).pptxpramodKumarsahani1
 
artificialintelligenceinagriculture-180324135613 (1).pptx
artificialintelligenceinagriculture-180324135613 (1).pptxartificialintelligenceinagriculture-180324135613 (1).pptx
artificialintelligenceinagriculture-180324135613 (1).pptxpramodKumarsahani1
 
Commercial & research landscape for smart irrigation systems
Commercial & research landscape for smart irrigation systemsCommercial & research landscape for smart irrigation systems
Commercial & research landscape for smart irrigation systemsMuhammad Yaseen Aftab
 
Elderly activity recognition and classification for application in assisted l...
Elderly activity recognition and classification for application in assisted l...Elderly activity recognition and classification for application in assisted l...
Elderly activity recognition and classification for application in assisted l...Sara Egidi
 
artificial intelligence of farming.pptx____
artificial intelligence of farming.pptx____artificial intelligence of farming.pptx____
artificial intelligence of farming.pptx____kdemersal
 
IRJET- IoT Based Crop Growth Detection and Irrigation System using Raspberry PI
IRJET- IoT Based Crop Growth Detection and Irrigation System using Raspberry PIIRJET- IoT Based Crop Growth Detection and Irrigation System using Raspberry PI
IRJET- IoT Based Crop Growth Detection and Irrigation System using Raspberry PIIRJET Journal
 
IRJET- IoT Based Crop Growth Detection and Irrigation System using Raspbe...
IRJET-  	  IoT Based Crop Growth Detection and Irrigation System using Raspbe...IRJET-  	  IoT Based Crop Growth Detection and Irrigation System using Raspbe...
IRJET- IoT Based Crop Growth Detection and Irrigation System using Raspbe...IRJET Journal
 
Innovations in Smart Agriculture
Innovations in Smart AgricultureInnovations in Smart Agriculture
Innovations in Smart AgricultureGeorge Georgiou
 
PROTECTED CULTIVATION 4TH UNIT.pptx
PROTECTED CULTIVATION 4TH UNIT.pptxPROTECTED CULTIVATION 4TH UNIT.pptx
PROTECTED CULTIVATION 4TH UNIT.pptxARUL S
 

Similaire à IoT Middleware for Precision Agriculture: workforce monitoring in olive fields (20)

Crop Prediction using IoT & Machine Learning Algorithm
Crop Prediction using IoT & Machine Learning AlgorithmCrop Prediction using IoT & Machine Learning Algorithm
Crop Prediction using IoT & Machine Learning Algorithm
 
PRECISION AGRICULTURE
PRECISION AGRICULTUREPRECISION AGRICULTURE
PRECISION AGRICULTURE
 
IRJET- Smart Crop-Field Monitoring and Automation Irrigation System using...
IRJET-  	  Smart Crop-Field Monitoring and Automation Irrigation System using...IRJET-  	  Smart Crop-Field Monitoring and Automation Irrigation System using...
IRJET- Smart Crop-Field Monitoring and Automation Irrigation System using...
 
IRJET- Iot Based Intelligent Management for Agricultural Process using Ra...
IRJET-  	  Iot Based Intelligent Management for Agricultural Process using Ra...IRJET-  	  Iot Based Intelligent Management for Agricultural Process using Ra...
IRJET- Iot Based Intelligent Management for Agricultural Process using Ra...
 
IRJET- Smart Green House using IOT and Cloud Computing
IRJET- Smart Green House using IOT and Cloud ComputingIRJET- Smart Green House using IOT and Cloud Computing
IRJET- Smart Green House using IOT and Cloud Computing
 
Precision Farming in Fruit Crops presentation
Precision Farming in Fruit Crops presentationPrecision Farming in Fruit Crops presentation
Precision Farming in Fruit Crops presentation
 
Artifical intelligence in agriculture
Artifical intelligence in agricultureArtifical intelligence in agriculture
Artifical intelligence in agriculture
 
artificialintelligenceinagriculture-180324135613.pdf
artificialintelligenceinagriculture-180324135613.pdfartificialintelligenceinagriculture-180324135613.pdf
artificialintelligenceinagriculture-180324135613.pdf
 
artificialintelligenceinagriculture-180324135613 (1).pptx
artificialintelligenceinagriculture-180324135613 (1).pptxartificialintelligenceinagriculture-180324135613 (1).pptx
artificialintelligenceinagriculture-180324135613 (1).pptx
 
artificialintelligenceinagriculture-180324135613 (1).pptx
artificialintelligenceinagriculture-180324135613 (1).pptxartificialintelligenceinagriculture-180324135613 (1).pptx
artificialintelligenceinagriculture-180324135613 (1).pptx
 
artificialintelligenceinagriculture-180324135613 (1).pptx
artificialintelligenceinagriculture-180324135613 (1).pptxartificialintelligenceinagriculture-180324135613 (1).pptx
artificialintelligenceinagriculture-180324135613 (1).pptx
 
Commercial & research landscape for smart irrigation systems
Commercial & research landscape for smart irrigation systemsCommercial & research landscape for smart irrigation systems
Commercial & research landscape for smart irrigation systems
 
STCppt.pptx
STCppt.pptxSTCppt.pptx
STCppt.pptx
 
Elderly activity recognition and classification for application in assisted l...
Elderly activity recognition and classification for application in assisted l...Elderly activity recognition and classification for application in assisted l...
Elderly activity recognition and classification for application in assisted l...
 
zigbee - Copy.pptx
zigbee - Copy.pptxzigbee - Copy.pptx
zigbee - Copy.pptx
 
artificial intelligence of farming.pptx____
artificial intelligence of farming.pptx____artificial intelligence of farming.pptx____
artificial intelligence of farming.pptx____
 
IRJET- IoT Based Crop Growth Detection and Irrigation System using Raspberry PI
IRJET- IoT Based Crop Growth Detection and Irrigation System using Raspberry PIIRJET- IoT Based Crop Growth Detection and Irrigation System using Raspberry PI
IRJET- IoT Based Crop Growth Detection and Irrigation System using Raspberry PI
 
IRJET- IoT Based Crop Growth Detection and Irrigation System using Raspbe...
IRJET-  	  IoT Based Crop Growth Detection and Irrigation System using Raspbe...IRJET-  	  IoT Based Crop Growth Detection and Irrigation System using Raspbe...
IRJET- IoT Based Crop Growth Detection and Irrigation System using Raspbe...
 
Innovations in Smart Agriculture
Innovations in Smart AgricultureInnovations in Smart Agriculture
Innovations in Smart Agriculture
 
PROTECTED CULTIVATION 4TH UNIT.pptx
PROTECTED CULTIVATION 4TH UNIT.pptxPROTECTED CULTIVATION 4TH UNIT.pptx
PROTECTED CULTIVATION 4TH UNIT.pptx
 

Plus de Miguel Pardal

Master Beginners Workshop - Feb 2023
Master Beginners Workshop - Feb 2023Master Beginners Workshop - Feb 2023
Master Beginners Workshop - Feb 2023Miguel Pardal
 
Master Beginners Workshop - September 2019
Master Beginners Workshop - September 2019Master Beginners Workshop - September 2019
Master Beginners Workshop - September 2019Miguel Pardal
 
SafeCloud Secure Communication solutions (WP1 overview)
SafeCloud Secure Communication solutions (WP1 overview)SafeCloud Secure Communication solutions (WP1 overview)
SafeCloud Secure Communication solutions (WP1 overview)Miguel Pardal
 
Master Beginners' Workshop September 2018
Master Beginners' Workshop September 2018Master Beginners' Workshop September 2018
Master Beginners' Workshop September 2018Miguel Pardal
 
Rastreabilidade na Internet das (muitas) Coisas
Rastreabilidade na Internet das (muitas) CoisasRastreabilidade na Internet das (muitas) Coisas
Rastreabilidade na Internet das (muitas) CoisasMiguel Pardal
 
Vulnerability-tolerant Transport Layer Security
Vulnerability-tolerant Transport Layer SecurityVulnerability-tolerant Transport Layer Security
Vulnerability-tolerant Transport Layer SecurityMiguel Pardal
 
Arranque Seguro de Redes 6LoWPAN para prevenir Ataques Vampiro na Internet da...
Arranque Seguro de Redes 6LoWPAN para prevenir Ataques Vampiro na Internet da...Arranque Seguro de Redes 6LoWPAN para prevenir Ataques Vampiro na Internet da...
Arranque Seguro de Redes 6LoWPAN para prevenir Ataques Vampiro na Internet da...Miguel Pardal
 
Precision Agriculture with Sensors and Technologies from the Internet of Things
Precision Agriculture with Sensors and Technologies from the Internet of ThingsPrecision Agriculture with Sensors and Technologies from the Internet of Things
Precision Agriculture with Sensors and Technologies from the Internet of ThingsMiguel Pardal
 
Smart Places INForum16 presentation
Smart Places INForum16 presentationSmart Places INForum16 presentation
Smart Places INForum16 presentationMiguel Pardal
 
Eclipse workshop presentation (March 2016)
Eclipse workshop presentation (March 2016)Eclipse workshop presentation (March 2016)
Eclipse workshop presentation (March 2016)Miguel Pardal
 
LaTeX workshop (NEB)
LaTeX workshop (NEB)LaTeX workshop (NEB)
LaTeX workshop (NEB)Miguel Pardal
 
Thesis for beginners 2015-10
Thesis for beginners 2015-10Thesis for beginners 2015-10
Thesis for beginners 2015-10Miguel Pardal
 
LaTeX workshop (JEQ)
LaTeX workshop (JEQ)LaTeX workshop (JEQ)
LaTeX workshop (JEQ)Miguel Pardal
 
Thesis for beginners
Thesis for beginnersThesis for beginners
Thesis for beginnersMiguel Pardal
 
Scalable and secure RFID data discovery
Scalable and secure RFID data discoveryScalable and secure RFID data discovery
Scalable and secure RFID data discoveryMiguel Pardal
 
Breve introdução à investigação
Breve introdução à investigaçãoBreve introdução à investigação
Breve introdução à investigaçãoMiguel Pardal
 
Eclipse workshop presentation
Eclipse workshop presentationEclipse workshop presentation
Eclipse workshop presentationMiguel Pardal
 
BEST Lisboa 2013 - The Internet of Things class
BEST Lisboa 2013 - The Internet of Things classBEST Lisboa 2013 - The Internet of Things class
BEST Lisboa 2013 - The Internet of Things classMiguel Pardal
 
Expressive RFID data access policies for the Pharmaceuticals supply chain
Expressive RFID data access policies for the Pharmaceuticals supply chainExpressive RFID data access policies for the Pharmaceuticals supply chain
Expressive RFID data access policies for the Pharmaceuticals supply chainMiguel Pardal
 

Plus de Miguel Pardal (20)

Master Beginners Workshop - Feb 2023
Master Beginners Workshop - Feb 2023Master Beginners Workshop - Feb 2023
Master Beginners Workshop - Feb 2023
 
Master Beginners Workshop - September 2019
Master Beginners Workshop - September 2019Master Beginners Workshop - September 2019
Master Beginners Workshop - September 2019
 
SafeCloud Secure Communication solutions (WP1 overview)
SafeCloud Secure Communication solutions (WP1 overview)SafeCloud Secure Communication solutions (WP1 overview)
SafeCloud Secure Communication solutions (WP1 overview)
 
Master Beginners' Workshop September 2018
Master Beginners' Workshop September 2018Master Beginners' Workshop September 2018
Master Beginners' Workshop September 2018
 
Rastreabilidade na Internet das (muitas) Coisas
Rastreabilidade na Internet das (muitas) CoisasRastreabilidade na Internet das (muitas) Coisas
Rastreabilidade na Internet das (muitas) Coisas
 
Vulnerability-tolerant Transport Layer Security
Vulnerability-tolerant Transport Layer SecurityVulnerability-tolerant Transport Layer Security
Vulnerability-tolerant Transport Layer Security
 
Master Beginners
Master BeginnersMaster Beginners
Master Beginners
 
Arranque Seguro de Redes 6LoWPAN para prevenir Ataques Vampiro na Internet da...
Arranque Seguro de Redes 6LoWPAN para prevenir Ataques Vampiro na Internet da...Arranque Seguro de Redes 6LoWPAN para prevenir Ataques Vampiro na Internet da...
Arranque Seguro de Redes 6LoWPAN para prevenir Ataques Vampiro na Internet da...
 
Precision Agriculture with Sensors and Technologies from the Internet of Things
Precision Agriculture with Sensors and Technologies from the Internet of ThingsPrecision Agriculture with Sensors and Technologies from the Internet of Things
Precision Agriculture with Sensors and Technologies from the Internet of Things
 
Smart Places INForum16 presentation
Smart Places INForum16 presentationSmart Places INForum16 presentation
Smart Places INForum16 presentation
 
Eclipse workshop presentation (March 2016)
Eclipse workshop presentation (March 2016)Eclipse workshop presentation (March 2016)
Eclipse workshop presentation (March 2016)
 
LaTeX workshop (NEB)
LaTeX workshop (NEB)LaTeX workshop (NEB)
LaTeX workshop (NEB)
 
Thesis for beginners 2015-10
Thesis for beginners 2015-10Thesis for beginners 2015-10
Thesis for beginners 2015-10
 
LaTeX workshop (JEQ)
LaTeX workshop (JEQ)LaTeX workshop (JEQ)
LaTeX workshop (JEQ)
 
Thesis for beginners
Thesis for beginnersThesis for beginners
Thesis for beginners
 
Scalable and secure RFID data discovery
Scalable and secure RFID data discoveryScalable and secure RFID data discovery
Scalable and secure RFID data discovery
 
Breve introdução à investigação
Breve introdução à investigaçãoBreve introdução à investigação
Breve introdução à investigação
 
Eclipse workshop presentation
Eclipse workshop presentationEclipse workshop presentation
Eclipse workshop presentation
 
BEST Lisboa 2013 - The Internet of Things class
BEST Lisboa 2013 - The Internet of Things classBEST Lisboa 2013 - The Internet of Things class
BEST Lisboa 2013 - The Internet of Things class
 
Expressive RFID data access policies for the Pharmaceuticals supply chain
Expressive RFID data access policies for the Pharmaceuticals supply chainExpressive RFID data access policies for the Pharmaceuticals supply chain
Expressive RFID data access policies for the Pharmaceuticals supply chain
 

Dernier

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Zilliz
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
AI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAnitaRaj43
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontologyjohnbeverley2021
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistandanishmna97
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...Zilliz
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWERMadyBayot
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Victor Rentea
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusZilliz
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamUiPathCommunity
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxRemote DBA Services
 

Dernier (20)

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
AI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by Anitaraj
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 

IoT Middleware for Precision Agriculture: workforce monitoring in olive fields

  • 1. IoT Middleware for Precision Agriculture José Camacho Alberto Cunha Miguel L. Pardal Workforce Monitoring in Olive Fields Smart Farming Workshop April 10th 2018
  • 2. Food 2016 2 2050 7x109 people 7.95x108 without regular food supply UN data:
  • 3. Agricultural challenge Efficiency Produce same with less time and effort Productivity Produce more Agricultural variability Profitability Balance costs and benefits 3
  • 4. Tecnologies Actuators (Water pumps, Faucets, …) Sensor networks (Communication infrastructures in agricultural field) Global Positioning System (location and navigation – people and machines) Geographic Information System (terrain maps) Sensors (Humidity, Temperature, Atmosferic Pressure, …) 6
  • 5. Agricultural production model “Integrated planning model for citrus agribusiness system using systems dynamics” por Ferreira, J. et al. 7
  • 6. Current solutions require significant investment and are not suited for manual labor 8
  • 7. Monitoring the workforce in specialty crops (Fruits, Flowers, Vegetables) Case Study: Olive Trees Case Study 9
  • 8. Detect location and activities of the workers with off-the-shelf devices Smartphone Wearable 10
  • 9. Challenges Tree interference Granularity Important in specialty crops Cost Ergonomics Minimum disturbance to worker’s movements Infrastructure Low communication and power resources 11
  • 11. Location tracking • Precise worker location • GPS is used in large scale, mechanized agriculture • Two sources were evaluated: GPS and Dead Reckoning 14
  • 12. Global Positioning System • 4 satellites are needed to determine receptor location • Available in most Smartphones • Average error of 5 to 10 meters outside, in the field • Trees cause signal interference 15
  • 13. X YZ Accelerometer + Magnetometer Detect worker steps Give a direction to the steps Inertial Navigation technology Dead Reckoning 16
  • 14. Dead Reckoning 2. Look for peaks above 12 m/s2 3. Discard other peaks in a period of 350ms 1. Calculate amplitude of acceleration applied to Smartphone sensor 4. Calculate new position with azimuth angle given by magnetometer Amplitude acceleration for 2 steps 17
  • 15. GPS vs Dead Reckoning GPS Dead Reckoning Coordinates system Absolute Relative Dependency on external system Satellites GPS or GLONASS No Influence of trees in signal Yes No Power consumption High Moderate Average location error High (5 to 10 meters) Reduced Error accumulation No Yes Comparison between navigation technology available in Smartphones 18
  • 16. Our solution Correct accumulated error from Dead Reckoning with absolute coordinates provided by GPS When GPS precision is better than 8 meters, the two navigation systems’ coordinates are averaged 19 + Dead Reckoning GPS
  • 17. Results 1. Path correction Real path Dead Reckoning + GPS GPS Test performed with worker walking in a traditional olive field 20
  • 18. Results 2. Energy consumption test Analyze power consumption using just GPS technology. Smartphone with a 3000mAh battery (Samsung Galaxy S7) Two tests were performed: a – capture location at each 60 seconds b – capture location at each 10 seconds Consumption: 2% of battery every 10 minutes Problem: May not be enough for a typical work day (8 hours) 21
  • 19. Related work “A wearable module for recording worker position in orchards” Yannis Ampatzidis et. Al Monitoring system • Capture worker locations • Uses a dedicated Dead Reckoning device • GPS installed in agricultural machine • Solution capable of capturing the worker’s paths 22
  • 21. Detect activities during the day through Machine Learning classification algorithms: BayesNet and MultilayerPerceptron from Weka library X YZ + + Accelerometer Magnetometer Gyroscope Activity detection accX accY accZ compX compY compZ gyroX gyroY gyroZ 26
  • 22. Activity detection 27 Activities list: • Walk forward • Walk backward • Run • Pick fruit • Dig Photo of worker wearing smartphone in sleeve during activity detection Harvest process
  • 23. Activity detection Sliding window solution 1 .. 75 … 150 151 74 75 … 150 .. 225 Initial window Window advance 3 seconds = 150 points x 20 ms 1,5 seconds intersection To each window’s data, we compute: average, minimum, maximum, kurtosis and standard-deviation Total of 45 features extracted from each window (3 sensors x 3 axis x 5 statistics)
  • 24. Results CFS Subset Evaluator ➡ 11 features Most use data from accelerometer 29 Equipment: • Samsung Galaxy S7 • Battery 3000mAh • Sensors: • Accelerometer, Magnetometer, Gyroscope Learning: ~2 min of captured data for each activity
  • 25. Results 1. Classification of activities by 1 worker Activity BayesNet MultilayerPerceptron Walk/Forward 75% 87,5% Run 100% 100% Walk/Backward 80,7% 82,46% Pickfruits 91,67% 91,67% Dig 98,04% 98,04% Learning period: less than 30 minutes Total captured data points: 255 Percentage of correctly classified activities >90% Good performance at distinguishing specific agriculture activities. Less effective at distinguishing walking forward and backward. 30
  • 26. Results - Activities 2. Classification of activities by 2 workers Learning period: 0 minutes Activity BayesNet MultilayerPerceptron Walk/Forward 38,98% 42,37% Pick Fruits 81,35% 81,35% Dig 89,83% 91,52% Activity BayesNet MultilayerPerceptron Walk/Forward 38,60% 8,77% Pick Fruits 91,23% 92,98% Dig 87,5% 87,5% 2nd worker – percentage of correctly classified activities 1st worker – percentage of correctly classified activities 31
  • 27. Conclusion • Solution allows monitoring workforce harvesting specialty crops • Solution goes beyond existing works by adding activity detection • Location monitoring (Dead Reckoning + GPS) • Able to locate workers in the field • Limited by power consumption • Activity detection • Percentage of correctly classified activities is above 90% 32
  • 28. Future work • New sources of location data • Bluetooth Low Energy beacons • GSM antennas triangulation • Terrain layout with satellite images • Combine work team data • Address ethical concerns of privacy • Integrate worker data with crop field data: • Soil sensors • Machinery • Meteorology 33
  • 29. Thank you Miguel.Pardal@tecnico.ulisboa.pt X YZ Master work by José Camacho Co-advised by Alberto Cunha