Bringing the best of AI to Azure and the best of Azure to AI
Microsoft AI Platform
AI Services
AI Infrastructure
AI Tools
PRE-BUILT AI CONVERSATIONAL AI CUSTOM AI
Cognitive Services Bot Framework Azure Machine Learning
AI ON DATA AI COMPUTE
Data
Lake
SQL
Server
Cosmos
DB
Spark DSVM Batch AI AkS
Azure ML
Studio
Azure ML
workbench
VS Tools for
AI/AML
DEEP LEARNING FRAMEWORKS
Cognitive
Toolkit
TensorFlow Chainer
Others (Azure Notebooks, Pycharm…)
Others (Scikit-learn, Keras, PyTorch, MxNet, Caffe…)
CODING AND MANAGEMENT TOOLS
IoT
AI SILICON
F F F
L0
L1
F F F
L0
Pretrained DNN Model
in TensorFlow, CNTK, etc.
Scalable DNN Hardware
Microservice
BrainWave
Soft DPU
Instr Decoder
& Control
Neural FU
A Scalable FPGA-Powered DNN Serving Platform
Fast:
Flexible
Friendly:
Network switches
FPGAs
Azure ML integration
End-to-end deployment and model lifecycle support
Hardware Accelerated
Model Gallery
Brainwave
Compiler & Runtime
“Brainslice” Soft
Neural Processing Unit
Model
Management
Service
Azure ML orchestratorPython and TensorFlow
Featurize images and train classifier
Classifier
(TF/LGBM)
Preprocessing
(TensorFlow, C++
API)
Control Plane
Service
Brain Wave Runtime
FPGA
CPU
Direct3D
GPU VPU NPU
CPU
DirectML API
Model Inference Engine
WinML COM API
WinML RT API
Input
Surface
Output
Surface
Application #1
WinML Runtime
Application #2