How AI is DisruptingTraffic Management in Smart City, Trescon Conference Dubai

1. How AI is Disrupting
Traffic Management in Smart City
Jorge Sebastiao, CISSP
CTO Ecosystem
DCSS
Twitter.com/4jorge
Linkedin.com/in/sebastiao

2. Human Society Is Entering the Intelligent Era
Data
Generated
Data
Stored
Data
Processing
Actionable
Insights
Big Data Artificial Intelligence
Structured and unstructured
data
Data is stored in databases
and servers
Process the data using
CPU/GPUs and AI algorithms
to detect patterns
Predictive signals are
generated
ICT infrastructures have become the cornerstone of the smart world.

3. Big Data + AI  EI
Intelligent analysis
AI+ Database +Hadoop
Big data analysis
Hadoop Fusion analysis
Hadoop + Database
2013
2015
2017

4. Evolution towards Enterprise Intelligence
Theoretical Basis Internal Practice
Chip Device Cloud
External Enabler
(EI services)
Noah Ark
Lab
Distributed
Lab
Neumann
Lab
Shannon
Lab
GTS ISC+
Device BP&IT
Heterogeneous computing
General AI
Essential platforms
Domain-specific
solutions

5. Motivation: Connected Intelligence in Enterprises
Collocated
storage
Device-Cloud
collaboration
HW-SW
synergy
Easy to
Use
Converged
decision
Full lifecycle
support
Open &
compatibility
EI Platform Services

6. Easy & Inclusive: Put Enterprise Intelligence Within Reach
Feature ranking
Feature
engineering
Model tuning
AutoFE & Model Optimization
Full-stack AI capability
Big data base
Intelligent Decision
Essential Platforms
Generic AI Services
Rich services ready to use
Full Lifecycle Support
Train
Evaluate
Serving
Deploy
Upgrade

7. Intelligent Computing Platform elements
AI Accelerator Module
AI Appliance
AI Accelerator Card AI Edge Station
Heterogeneous Server Intelligent Video Analytics Server
GPU FPGANPU

8. Pre-integrated solutions for Smart Cities
Intelligent Twins
 TrafficGo: Traffic optimization, safety, trend
analysis
 iWater: Sewage treatment, environmental
monitoring, river safety
City
 Production quality:Flexible quality classification,
predictive maintenance
 Sales forecast: Regional, product, or combined
 Production planning: Material forecast
Manufacturing
 Customer analysis, customer profile, customer
forecast, VIP analysis
 Abnormal event monitoring: Traffic surge
monitoring, illegal behavior (stay/wander)
Campus
 Inventory management, shipping
path planning
 Trunk dispatching, smart entrucking
 Intelligent declaration: OCR,
customs price forecast
Logistics
 Video recommendation: user
profile, video tag, video classification
 Content inspection:
Pornography, terrorism, violence...
Internet
 Fleet management: Electric fence, trajectory
mining, path planning
 Autonomous Driving: MDC, V2X, Scheduling
Vehicle
 Home Safety: Stranger detection
 Family time: Smile moment, pet identification
 Elderly care: Fall detection, cry detection, abnormal
sounds
Home
 Pathological analysis: Cervical cancer analysis, lung
cancer tissue analysis, pathology report generation
 Genetic analysis: Gene sequencing, disease
classification and prediction based on genetics
Health

9. Converged : Crowd Intelligent Decision & Planning
city
district
intersection
Hierarchical & Crowd
Intelligent Decision
lights
truck
camera RLS
MLSGES
Converge
DLS
Smart Transportation
Supply Chain
Computer Vision

10. Urban Transportation Challenges
---Congestion, Violation, Management
• Violation Types: Illegal Parking、
Improper Lane Use、Crossing
Line(Driving) and Wrong Way(Driving)
• Violation Number： ~300k Case per
Day in X city
• Large Volume of Vehicle：~6
Millions Vehicles in X city.
• Congestion：The average speed is
~22km/hour in the rush hour。
Severe Congestion Frequent Traffic Violation Low efficiency Management
• Workload： ~300k image capture
per Day, but only process 30k-50k
due to workload
• Scope： Lots of Blind Spot. Non-
AI camera.

11. Camera Video
Signal Control Policy
AI Based Signal Control
Offline Variant Cycle Online Adaptive
Video Data Analysis
Deep Learning
Traffic Data Fusion
Huawei AI Platform
pedestrian recognition Vehicle recognition
Edge Computing Cloud Computing
Object Tracking
Deep Learning
Signal Control： Integrate signal control theory with
reinforcement learning to support big area signal control.
Edge Computing：Great cost performance with Huawei AI
chip
Video Analysis：Analyze the pedestrian, Vehicle and Road
Structure by deep learning; bird's-eye view video
Concise Traffic Data： Fuse the structured data from
traditional device with video.
Edge Computing
Reducing Congestion by Signal Control &Traffic Situation Perception
Structured Data
from Other
Device
Lane recognition Tiny Object recognition
Image Enhancement
Passenger
Car Unit
Diverging
Ratio
Vehicle
Speed
Queue
Length
Kalman Filtering
Isolated Control
Arterial Coordinated
Control
Regional
Coordinated Control
Reversible Lane
Control

12. LawEnforcementProcess
Checkpoint
Camera
Red Light
Camera
Human Check
data
Violated
Passed
Double Check
ViolationCheckby
AI
Algorithm
Repository
….
AI Platform
Data Input
Law Enforcement with AI
Feature Extraction Violation Check Double Check
Application
LawEnforcementEcosystem
 Workload： ~300k image capture per Day, but only
process 30k-50k due to workload
 Efficiency: ~70-80% images can not pass the check.
 Algorithm： Deep learning based law enforcement.
Algorithm Repository
 Platform： FusionMind AI Platform
Solution：FusionMind AI
Challenges
 Reduced Workload： Reduce 30k case to 6000 case
for human check.
 New Violation： Modeling time( Reduced from two
month to one day), Process time(Reduced from one
day to 5 minutes)
Business Value
Law Enforcement with Artificial Intelligence
Feature
Extraction
Image Record
For Violation
Not Violated
Truck Restriction
Local Vehicle Only
No License Plate
Improper
Lane Use
……….
Truck Restriction
Local Vehicle Only
No License Plate

13. Multimodal Learning
IntrafficIn-traffic
In-traffic

14. AI its all about patterns

15. Comparison before and after global traffic optimization
Travel Time Delay Wait Time # of Stops

16. Smart car powered by Mobile phone

17. SmartCar Smart Transportation
• Autonomous Driving Car:
• Audi Q7 Autonomous Driving Prototype
• Internet of Vehicles
• Based on Huawei OceanConnect
• PSA DS7 Crossback
• PATEO
• 5G LTE-V
• Collaborated with BMW
• V2X: V, I, N, P
• Verified in WuXi, China

18. Integrate to 10+ algorithm vendors with
20+ AI application.
FusionMind Helps Shenzhen Traffic Police Build Smart Traffic Brain
Cluster resource utilization
improved by 100%
Illegal
occupation
Red light
Signal
indicator
optimization
Video event
Check
License plate
recognition
Roll back the
scrap.
Shenzhen Traffic Brain
... ...
5x
Efficiency improvement
10%
Traffic improvement
Urban road network signal light
Control and optimization
Automatically identify traffic
violations
analysis
algorithms
Video/Image
data source
Analysis
Result
Result
convergence
Algorithm
Evaluation
FusionMind
Smart Traffic

19. Jorge Sebastiao, CISSP
CTO Ecosystem
DCSS
Twitter.com/4jorge
Linkedin.com/in/sebastiao
How AI is Disrupting
Traffic Management in Smart City