Scaling API-first – The story of a global engineering organization
Sustainability & AI Lecture Lorenz Kupfer Thomas Treml HAM 30. Mai 2022.pdf
1. “Our mission is to empower every person and every organization on the planet to achieve more. ”
Microsoft Sustainability & KI
Thomas Treml
Senior Account Technology Strategist
Microsoft Deutschland GmbH
https://aka.ms/nachhaltige-hochschule
https://www.microsoft.com/en-us/corporate-responsibility/sustainability
Lorenz Kupfer
Industry Advisor Higher Education
Microsoft Deutschland GmbH
3. “At a time when many are calling
attention to the role technology plays in
society, our mission remains constant.
It grounds us in the enormous
opportunity and responsibility we have
to ensure that the technology we create
always benefits everyone on the planet,
including the planet itself.”
- Satya Nadella
4. Our approach Employees
Operations
Align with science and
international goals
Products
& Services
Preferred platform
and products for
environmental
solutions
Customers
& Partners
Trusted partner for
customers’
sustainability journeys
Policy
Advocate for policies to
achieve corporate and
societal goals
5. Our Sustainability journey
2009 2012 2013 2016 2017 2018 2019 2020
First carbon
emission
reduction goal
100% carbon neutral
+ carbon tax
First renewable energy PPA
Smart Building
solution deployed
Set first renewable energy
target of 60% by 2020
Zero-waste campus
certification
Launched AI for Earth
LEED Gold certification
for new datacenters
Launched supplier carbon
engagement in China
Advocated to establish an
economy wide carbon fee in
Washington State
$15 carbon tax
Set goal of 70% renewable
energy by 2023
2021
Set goal of being carbon
negative by 2030
Set goal of 100%
renewable energy by
2025 (100/100/0)
Launched Climate
Innovation Fund
Announced building of
Planetary Computer
Set goal to protect more
land than we use by 2025
Set goal to be zero
Released first company-
wide Sustainability Report
Purchased over 1 million
tons of carbon removal
https://aka.ms/MSFTSustainabilityReport
6. How our carbon tax works
The three primary components of our carbon fee model
1 Organizational carbon reduction policy
%
Human resources
Accounting & finance
Legal
Product development
Sales & marketing
Customer service
mtCO2e
emissions
allocated by
group
2 Price on carbon
Energy emissions X carbon price for energy emissions =
Other emissions X carbon price for energy emissions =
Central
fund
3 Carbon fee fund investment strategy
Internal efficiency initiatives
Green energy (PPA)
Carbon offset projects
White Paper: Sustainable Procurement
How Microsoft is using an internal carbon
fee to reach its carbon negative goal -
Microsoft Industry Blogs
7. Carbon scopes, defined
Scope 1
Direct emissions created
by your activities, like
exhaust from company
vehicles or diesel
generators
Scope 2
Indirect emissions from
the production of
electricity or heat you use
to power buildings or
processes
Scope 3
Indirect value chain
emissions from all other
activities in which you’re
engaged, including all parts
of your supply chain, from
materials in buildings,
business travel, and product
lifecycle to the electricity your
customers consume
BURN BUY
BEYOND
9. Transformative
technologies
democratized
Intelligent Cloud
Smartphones
2% of 2007 Cost
Solar
.5% of 1984 Cost
Mixed Reality
1% of 2007 cost
DNA Sequencing
.01% of 2007 Cost
Industrial Robots
3% of 2007 Cost
3D Printers
1% of 2007 Cost
Sensors
.3% of 2007 Cost
Drones
1% of 2007 cost
Intelligent Cloud
Intelligent Cloud
Smartphones
2% of 2007 Cost
Solar
.5% of 1984 Cost
Mixed Reality
1% of 2007 cost
DNA Sequencing
.01% of 2007 Cost
Industrial Robots
3% of 2007 Cost
3D Printers
1% of 2007 Cost
Sensors
.3% of 2007 Cost
Drones
1% of 2007 cost
10.
11. Datenstrategie der Bundesregierung
Die Zukunft der Arbeit in der digitalen Transformation (bmwk.de)
18. Die größte Herausforderung
Was wissen wir über die Daten, die wir haben?
„Dunkle
Daten“
Projektdaten
Kundendaten-
sätze
Aktuelle
Projektdateien
Aktuelle Dokumente
70 % - 80 % der Daten, die an
Unternehmensdatenstandorten
aufbewahrt werden, werden
nicht verwaltet.
Was Sie
verwenden.
Was Sie behalten müssen.
19. Highly distributed
Frameworks
• Open Source frameworks for massive model training
(20x bigger/10x faster)
• DeepSpeed: Distributed framework enabling
massive models training (200B parameters)
• Azure Machine Learning: Orchestrator via new ONNX
distributed training. Azure Machine Learning recipes for training
• The 5th largest supercomputer in the world
• 300,000 CPU cores, 10,000 GPUs
• 1st cloud based, designed for massive AI training
• Built in partnership with OpenAI
AI Supercomputer
21. Out-of-the-box Customized
AI across the
organization
Everyday
employees
Business employees
in core functions
Advanced
business roles
Developers and
data scientists
Machine Learning Operations (MLOps)
+ Common Data Platform
22. MLOps
Engineering + Data Science
Machine learning operations (MLOps) framework to upscale machine learning lifecycle with Azure Machine Learning
- Azure Architecture Center | Microsoft Docs
28. Learnings
True “lights out”
operation
No maintenance for years
Better server environment
Consistently cool, with reduced
thermal cycling for increased
reliability
No oxygen, low moisture nitrogen
atmosphere to reduce corrosion
No risk from external gaseous or
particulate contaminants
29. DATA INGEST STORE AI SERVE
Azure Blob Storage
Live Underwater
Video Stream
Azure
Machine
Learning
AI App
Monitoring
underwater
wildlife
VoTT Tagged
Data
(training)
Machine
Learning
VM
Azure Media Services
AI for Earth pipeline classifies and counts sea life to understand impact
Project Natick Using AI Earth
Real-time streaming from
external cameras to app
Training
Deployed to
Natick VMs
Object Detection
Model
30. Increase access Provide education Fuel innovation
AI for Earth
430+
Grantees
70+
Countries
Monitor | Model | Manage
42. Die größte Herausforderung
Was wissen wir über die Daten, die wir haben?
„Dunkle
Daten“
Projektdaten
Kundendaten-
sätze
Aktuelle
Projektdateien
Aktuelle Dokumente
70 % - 80 % der Daten, die an
Unternehmensdatenstandorten
aufbewahrt werden, werden
nicht verwaltet.
Was Sie
verwenden.
Was Sie behalten müssen.
43.
44. Building planetary insight
Train
models
Curate
datasets
Deploy
APIs +
Host apps
Provide
infrastructure
Conservation
organizations
Data scientists
App developers
Academia, research
environmental scientists
Education
Citizen scientists
Local governments
Policy and advocacy
Consumers
51. Delivering intelligence to
help you accelerate every
stage of your organization’s
sustainability journey
Comprehensive
Integrated
Automated
Microsoft
Cloud for
Sustainability
DATA
Record
INSIGHTS
Report
ACTION
Reduce
52. One platform for integrating and accelerating your journey
Connect your data and
calculate your impact
View data analysis
and insights
Take action to accelerate
your sustainability journey
55. AI Business School
1.9M+ visitors
190+ countries
640% engagement
4.7/5.0 average rating
aka.ms/aibs
In partnership with
56. Innovation Lectures
Inspire Exchange Connect
We at Microsoft are enthusiastic
about new technologies and
innovative ideas.
Our Innovation Lectures are
giving you impulses for future-
oriented trends, services,
software. They also give you an
insight into current and future
economy challenges focusing
on Sustainability, Responsible AI
and Diversity and Inclusion.
Every day, every hour, every
minute we learn from each
other. So, let’s learn together!
We’d like to hear your thoughts,
your ideas and your needs in
order to create a future-proofed
journey together with us.
Be creative, be innovative, be
vocal and give us your feedback.
Our joint journey does not end
here, it just began!
We will join you on your career
path. Focusing on interactive
trainings leading to valued
certifications, hosting
networking events or
connecting you to our or one
of our partner's recruiting team.
57. We need your Feedback!
https://aka.ms/HAM-Feedback
58. More resources
Workforce of the
Future
https://aka.ms/WOF
Microsoft Virtual
Training Days
https://aka.ms/MVTD
Microsoft Learn –
Student Ambassador
Microsoft Learn Student
Ambassadors
A guided journey
into AI
(microsoft.com)