SlideShare a Scribd company logo
1 of 24
Download to read offline
From Science
to Startups
Dr. Daniel Martinho-Corbishley
daniel@auravisionlabs.com
auravisionlabs.com
with Computer Vision,

Tensorflow & People
Video AI platform for retailers
to measure and improve
every shopping experience Daniel Jaime Jonathon
PhD in Computer Vision and Soft Biometrics
Recently published “Super-Fine Attributes with Crowd Prototyping” in IEEE TPAMI
Dr. Daniel Martinho-Corbishley
Boston Marathon Bombing (2013)
Facial Recognition
- Over 3 days to identify suspects

- Extremely hard to spot faces in crowds

- Internet surveillance traffic growing 7x in the next 3 years
Stage 1.
How to find people

without seeing their faces?
Gender [Male]
Age [25-35]
Headwear [Navy Cap]
Accessories [Black Rucksack]
Upper body [Navy coat, White T-shirt]
Lower body [Beige Trousers]
Footwear [Brown Shoes]
Height [Average - Tall]
Weight [Average - Slender]
Build [Slightly Muscular]
Hair Colour [Black]
Skin Colour [Brown]
Hair Length [Short]
Soft Biometrics
- New branch of identity science
- Visual cues to identify people
- Visible at a distance
- Invariant to angel and pose
DNA [✘]
Iris [✘]
Fingerprint [✘]
Face [✘]
SoftHard
- Highly discriminative
- Difficult to capture
Which Gender?
Female Male
Female Male
Which Gender?
Female Male
Which Gender?
Stage 2.
How to precisely label

any image?
- Label images as coordinates in super-fine space.
- Precisely describes multiple, integral concepts.
Male Female
Gender
Uncertainty
ClearObscured
X
X
XX
X
Super-Fine Attributes
- Don’t account for ambiguity or uncertainty.
- Irrelevant and inconsistent labels.
- Poorly generalised classifiers.
Female Female Male Male? ???
Categorical / Binary space
Super-fine space
- Crowdsource pairwise similarities between n = 95 subjects.
- Forms a high-dimensional distance matrix:
- Embed with Metric MDS to discover fewer, more salient concepts:

- Cluster with Agglomerative Hierarchical clustering to discover c = 5 prototypes
,
Embedding
Clustering
Prototype cluster
Crowd Prototyping 0 n
⋱
⋱
⋱
n ⋱
Distance matrix
Male
(0.00, 0.32)
Pos. Female
(0.64, 0.00)
Female
(1.00, 0.29)
Obscured
(0.69, 1.00)
Pos. Male
(0.30, 0.63)
Crowd’s perceptual space &
Visual prototypes.
Matching new images
to visual prototypes.
Efficient, large scale super-fine attributes
Very young
Quite young
Quite Old
Very Old
Obscured / Can’t See
Super-Fine Age Labels PETA dataset
- Large-scale - 19000 image samples
- Most diverse - 8799 unique subjects
- 108 binary attributes
Super-fine +4.02% AUCSuper-fine +8.25% AUC
Ranked Retrieval
Super-Fine vs Conventional
ResNet-152 Gender & Age [Super-fine & Binary]
3 Attributes [Super-fine]
35 Attributes [Binary]
CNN Training
Binary classified
Super-fine regressed
Dataset loading
Image Augmentation Pipeline
Stage 3.

From the lab
to the real-world
Loading Multiple Checkpoints
Stage 4.
Commercialisation for retail.
Deep, anonymous insights
People counting is a
competitive landscape
100% Anonymous
Fully GDPR compliant
No personal data stored.
Shoppers are never identified.
Footfall
counts
Heat
maps
Product
footfall
Peel-off
rates
Product
engagement
Dwell
maps
Gender Age
The Product
1
Your campaign drew
5% more
females aged 16-24
“
2 3
Minimal Installation
Rapidly integrates with
existing CCTV cameras.
Capture unique insights
Intuitive dashboard and API

reports shopper insights
Define impact
Retailers can now measure
their performance and ROI.
”
Many thanks!
Any Questions?
Dr. Daniel Martinho-Corbishley
daniel@auravisionlabs.com
auravisionlabs.com

More Related Content

Similar to TensorFlow London 18: Dr Daniel Martinho-Corbishley, From science to startups with Tensorflow, Computer Vision and people.

Big data to big understanding
Big data to big understandingBig data to big understanding
Big data to big understanding
University of Hertfordshire
 
Yo. big data. understanding data science in the era of big data.
Yo. big data. understanding data science in the era of big data.Yo. big data. understanding data science in the era of big data.
Yo. big data. understanding data science in the era of big data.
Natalino Busa
 
Machine Learning Introduction.pptx
Machine Learning Introduction.pptxMachine Learning Introduction.pptx
Machine Learning Introduction.pptx
Jeeva Nantham
 
Effective Presentation Skills New01
Effective  Presentation  Skills  New01Effective  Presentation  Skills  New01
Effective Presentation Skills New01
Alaa Sadik
 
Big, Open, Data and Semantics for Real-World Application Near You
Big, Open, Data and Semantics for Real-World Application Near YouBig, Open, Data and Semantics for Real-World Application Near You
Big, Open, Data and Semantics for Real-World Application Near You
Biplav Srivastava
 

Similar to TensorFlow London 18: Dr Daniel Martinho-Corbishley, From science to startups with Tensorflow, Computer Vision and people. (20)

Big data to big understanding
Big data to big understandingBig data to big understanding
Big data to big understanding
 
The Science Of Social Networks
The Science Of Social NetworksThe Science Of Social Networks
The Science Of Social Networks
 
Basics of Stats (2).pptx
Basics of Stats (2).pptxBasics of Stats (2).pptx
Basics of Stats (2).pptx
 
Big Data & ML for Clinical Data
Big Data & ML for Clinical DataBig Data & ML for Clinical Data
Big Data & ML for Clinical Data
 
Data mining BY Zubair Yaseen
Data mining BY Zubair YaseenData mining BY Zubair Yaseen
Data mining BY Zubair Yaseen
 
Copy of getting into ai event slides (PDF)
Copy of getting into ai   event slides (PDF)Copy of getting into ai   event slides (PDF)
Copy of getting into ai event slides (PDF)
 
Yo. big data. understanding data science in the era of big data.
Yo. big data. understanding data science in the era of big data.Yo. big data. understanding data science in the era of big data.
Yo. big data. understanding data science in the era of big data.
 
Unleashing innovation & 21st century scale - Palindromic Queries
Unleashing innovation & 21st century scale - Palindromic QueriesUnleashing innovation & 21st century scale - Palindromic Queries
Unleashing innovation & 21st century scale - Palindromic Queries
 
Pattern recognition and Machine Learning.
Pattern recognition and Machine Learning.Pattern recognition and Machine Learning.
Pattern recognition and Machine Learning.
 
machine learning in the age of big data: new approaches and business applicat...
machine learning in the age of big data: new approaches and business applicat...machine learning in the age of big data: new approaches and business applicat...
machine learning in the age of big data: new approaches and business applicat...
 
Machine Learning Introduction.pptx
Machine Learning Introduction.pptxMachine Learning Introduction.pptx
Machine Learning Introduction.pptx
 
An Introduction to Deep Learning (May 2018)
An Introduction to Deep Learning (May 2018)An Introduction to Deep Learning (May 2018)
An Introduction to Deep Learning (May 2018)
 
SLA Nov2009 Public
SLA Nov2009 PublicSLA Nov2009 Public
SLA Nov2009 Public
 
Ep 121: How Artificial Intelligence Creates Discrimination in HR & Recruiting
Ep 121: How Artificial Intelligence Creates Discrimination in HR & RecruitingEp 121: How Artificial Intelligence Creates Discrimination in HR & Recruiting
Ep 121: How Artificial Intelligence Creates Discrimination in HR & Recruiting
 
Effective Presentation Skills New01
Effective  Presentation  Skills  New01Effective  Presentation  Skills  New01
Effective Presentation Skills New01
 
Research
ResearchResearch
Research
 
Ona For Community Roundtable
Ona For Community RoundtableOna For Community Roundtable
Ona For Community Roundtable
 
Crowdstorm CrossCampus
Crowdstorm CrossCampusCrowdstorm CrossCampus
Crowdstorm CrossCampus
 
Big, Open, Data and Semantics for Real-World Application Near You
Big, Open, Data and Semantics for Real-World Application Near YouBig, Open, Data and Semantics for Real-World Application Near You
Big, Open, Data and Semantics for Real-World Application Near You
 
module 6 (1).ppt
module 6 (1).pptmodule 6 (1).ppt
module 6 (1).ppt
 

More from Seldon

TensorFlow London 18: Dr Alastair Moore, Towards the use of Graphical Models ...
TensorFlow London 18: Dr Alastair Moore, Towards the use of Graphical Models ...TensorFlow London 18: Dr Alastair Moore, Towards the use of Graphical Models ...
TensorFlow London 18: Dr Alastair Moore, Towards the use of Graphical Models ...
Seldon
 
TensorFlow London 15: Find bugs in the herd with debuggable TensorFlow code
TensorFlow London 15: Find bugs in the herd with debuggable TensorFlow code TensorFlow London 15: Find bugs in the herd with debuggable TensorFlow code
TensorFlow London 15: Find bugs in the herd with debuggable TensorFlow code
Seldon
 
Tensorflow London 13: Barbara Fusinska 'Hassle Free, Scalable, Machine Learni...
Tensorflow London 13: Barbara Fusinska 'Hassle Free, Scalable, Machine Learni...Tensorflow London 13: Barbara Fusinska 'Hassle Free, Scalable, Machine Learni...
Tensorflow London 13: Barbara Fusinska 'Hassle Free, Scalable, Machine Learni...
Seldon
 
Tensorflow London 13: Zbigniew Wojna 'Deep Learning for Big Scale 2D Imagery'
Tensorflow London 13: Zbigniew Wojna 'Deep Learning for Big Scale 2D Imagery'Tensorflow London 13: Zbigniew Wojna 'Deep Learning for Big Scale 2D Imagery'
Tensorflow London 13: Zbigniew Wojna 'Deep Learning for Big Scale 2D Imagery'
Seldon
 

More from Seldon (20)

CD4ML and the challenges of testing and quality in ML systems
CD4ML and the challenges of testing and quality in ML systemsCD4ML and the challenges of testing and quality in ML systems
CD4ML and the challenges of testing and quality in ML systems
 
TensorFlow London: Cutting edge generative models
TensorFlow London: Cutting edge generative modelsTensorFlow London: Cutting edge generative models
TensorFlow London: Cutting edge generative models
 
Tensorflow London: Tensorflow and Graph Recommender Networks by Yaz Santissi
Tensorflow London: Tensorflow and Graph Recommender Networks by Yaz SantissiTensorflow London: Tensorflow and Graph Recommender Networks by Yaz Santissi
Tensorflow London: Tensorflow and Graph Recommender Networks by Yaz Santissi
 
TensorFlow London: Progressive Growing of GANs for increased stability, quali...
TensorFlow London: Progressive Growing of GANs for increased stability, quali...TensorFlow London: Progressive Growing of GANs for increased stability, quali...
TensorFlow London: Progressive Growing of GANs for increased stability, quali...
 
TensorFlow London 18: Dr Alastair Moore, Towards the use of Graphical Models ...
TensorFlow London 18: Dr Alastair Moore, Towards the use of Graphical Models ...TensorFlow London 18: Dr Alastair Moore, Towards the use of Graphical Models ...
TensorFlow London 18: Dr Alastair Moore, Towards the use of Graphical Models ...
 
Seldon: Deploying Models at Scale
Seldon: Deploying Models at ScaleSeldon: Deploying Models at Scale
Seldon: Deploying Models at Scale
 
TensorFlow London 17: How NASA Frontier Development Lab scientists use AI to ...
TensorFlow London 17: How NASA Frontier Development Lab scientists use AI to ...TensorFlow London 17: How NASA Frontier Development Lab scientists use AI to ...
TensorFlow London 17: How NASA Frontier Development Lab scientists use AI to ...
 
TensorFlow London 17: Practical Reinforcement Learning with OpenAI
TensorFlow London 17: Practical Reinforcement Learning with OpenAITensorFlow London 17: Practical Reinforcement Learning with OpenAI
TensorFlow London 17: Practical Reinforcement Learning with OpenAI
 
TensorFlow 16: Multimodal Sentiment Analysis with TensorFlow
TensorFlow 16: Multimodal Sentiment Analysis with TensorFlow TensorFlow 16: Multimodal Sentiment Analysis with TensorFlow
TensorFlow 16: Multimodal Sentiment Analysis with TensorFlow
 
TensorFlow 16: Building a Data Science Platform
TensorFlow 16: Building a Data Science Platform TensorFlow 16: Building a Data Science Platform
TensorFlow 16: Building a Data Science Platform
 
Ai in financial services
Ai in financial servicesAi in financial services
Ai in financial services
 
TensorFlow London 15: Find bugs in the herd with debuggable TensorFlow code
TensorFlow London 15: Find bugs in the herd with debuggable TensorFlow code TensorFlow London 15: Find bugs in the herd with debuggable TensorFlow code
TensorFlow London 15: Find bugs in the herd with debuggable TensorFlow code
 
TensorFlow London 14: Ben Hall 'Machine Learning Workloads with Kubernetes an...
TensorFlow London 14: Ben Hall 'Machine Learning Workloads with Kubernetes an...TensorFlow London 14: Ben Hall 'Machine Learning Workloads with Kubernetes an...
TensorFlow London 14: Ben Hall 'Machine Learning Workloads with Kubernetes an...
 
Tensorflow London 13: Barbara Fusinska 'Hassle Free, Scalable, Machine Learni...
Tensorflow London 13: Barbara Fusinska 'Hassle Free, Scalable, Machine Learni...Tensorflow London 13: Barbara Fusinska 'Hassle Free, Scalable, Machine Learni...
Tensorflow London 13: Barbara Fusinska 'Hassle Free, Scalable, Machine Learni...
 
Tensorflow London 13: Zbigniew Wojna 'Deep Learning for Big Scale 2D Imagery'
Tensorflow London 13: Zbigniew Wojna 'Deep Learning for Big Scale 2D Imagery'Tensorflow London 13: Zbigniew Wojna 'Deep Learning for Big Scale 2D Imagery'
Tensorflow London 13: Zbigniew Wojna 'Deep Learning for Big Scale 2D Imagery'
 
TensorFlow London 11: Pierre Harvey Richemond 'Trends and Developments in Rei...
TensorFlow London 11: Pierre Harvey Richemond 'Trends and Developments in Rei...TensorFlow London 11: Pierre Harvey Richemond 'Trends and Developments in Rei...
TensorFlow London 11: Pierre Harvey Richemond 'Trends and Developments in Rei...
 
TensorFlow London 11: Gema Parreno 'Use Cases of TensorFlow'
TensorFlow London 11: Gema Parreno 'Use Cases of TensorFlow'TensorFlow London 11: Gema Parreno 'Use Cases of TensorFlow'
TensorFlow London 11: Gema Parreno 'Use Cases of TensorFlow'
 
Tensorflow London 12: Marcel Horstmann and Laurent Decamp 'Using TensorFlow t...
Tensorflow London 12: Marcel Horstmann and Laurent Decamp 'Using TensorFlow t...Tensorflow London 12: Marcel Horstmann and Laurent Decamp 'Using TensorFlow t...
Tensorflow London 12: Marcel Horstmann and Laurent Decamp 'Using TensorFlow t...
 
TensorFlow London 12: Oliver Gindele 'Recommender systems in Tensorflow'
TensorFlow London 12: Oliver Gindele 'Recommender systems in Tensorflow'TensorFlow London 12: Oliver Gindele 'Recommender systems in Tensorflow'
TensorFlow London 12: Oliver Gindele 'Recommender systems in Tensorflow'
 
TensorFlow London 13.09.17 Ilya Dmitrichenko
TensorFlow London 13.09.17 Ilya DmitrichenkoTensorFlow London 13.09.17 Ilya Dmitrichenko
TensorFlow London 13.09.17 Ilya Dmitrichenko
 

Recently uploaded

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Recently uploaded (20)

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Cyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdfCyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdf
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 

TensorFlow London 18: Dr Daniel Martinho-Corbishley, From science to startups with Tensorflow, Computer Vision and people.

  • 1. From Science to Startups Dr. Daniel Martinho-Corbishley daniel@auravisionlabs.com auravisionlabs.com with Computer Vision,
 Tensorflow & People
  • 2. Video AI platform for retailers to measure and improve every shopping experience Daniel Jaime Jonathon PhD in Computer Vision and Soft Biometrics Recently published “Super-Fine Attributes with Crowd Prototyping” in IEEE TPAMI Dr. Daniel Martinho-Corbishley
  • 4. Facial Recognition - Over 3 days to identify suspects - Extremely hard to spot faces in crowds - Internet surveillance traffic growing 7x in the next 3 years
  • 5. Stage 1. How to find people
 without seeing their faces?
  • 6. Gender [Male] Age [25-35] Headwear [Navy Cap] Accessories [Black Rucksack] Upper body [Navy coat, White T-shirt] Lower body [Beige Trousers] Footwear [Brown Shoes] Height [Average - Tall] Weight [Average - Slender] Build [Slightly Muscular] Hair Colour [Black] Skin Colour [Brown] Hair Length [Short] Soft Biometrics - New branch of identity science - Visual cues to identify people - Visible at a distance - Invariant to angel and pose DNA [✘] Iris [✘] Fingerprint [✘] Face [✘] SoftHard - Highly discriminative - Difficult to capture
  • 10. Stage 2. How to precisely label
 any image?
  • 11. - Label images as coordinates in super-fine space. - Precisely describes multiple, integral concepts. Male Female Gender Uncertainty ClearObscured X X XX X Super-Fine Attributes - Don’t account for ambiguity or uncertainty. - Irrelevant and inconsistent labels. - Poorly generalised classifiers. Female Female Male Male? ??? Categorical / Binary space Super-fine space
  • 12. - Crowdsource pairwise similarities between n = 95 subjects. - Forms a high-dimensional distance matrix: - Embed with Metric MDS to discover fewer, more salient concepts:
 - Cluster with Agglomerative Hierarchical clustering to discover c = 5 prototypes , Embedding Clustering Prototype cluster Crowd Prototyping 0 n ⋱ ⋱ ⋱ n ⋱ Distance matrix
  • 13. Male (0.00, 0.32) Pos. Female (0.64, 0.00) Female (1.00, 0.29) Obscured (0.69, 1.00) Pos. Male (0.30, 0.63) Crowd’s perceptual space & Visual prototypes. Matching new images to visual prototypes. Efficient, large scale super-fine attributes
  • 14. Very young Quite young Quite Old Very Old Obscured / Can’t See Super-Fine Age Labels PETA dataset - Large-scale - 19000 image samples - Most diverse - 8799 unique subjects - 108 binary attributes
  • 15. Super-fine +4.02% AUCSuper-fine +8.25% AUC Ranked Retrieval Super-Fine vs Conventional ResNet-152 Gender & Age [Super-fine & Binary] 3 Attributes [Super-fine] 35 Attributes [Binary] CNN Training Binary classified Super-fine regressed
  • 18. Stage 3.
 From the lab to the real-world
  • 19.
  • 22. Deep, anonymous insights People counting is a competitive landscape 100% Anonymous Fully GDPR compliant No personal data stored. Shoppers are never identified. Footfall counts Heat maps Product footfall Peel-off rates Product engagement Dwell maps Gender Age
  • 23. The Product 1 Your campaign drew 5% more females aged 16-24 “ 2 3 Minimal Installation Rapidly integrates with existing CCTV cameras. Capture unique insights Intuitive dashboard and API
 reports shopper insights Define impact Retailers can now measure their performance and ROI. ”
  • 24. Many thanks! Any Questions? Dr. Daniel Martinho-Corbishley daniel@auravisionlabs.com auravisionlabs.com