This document summarizes a presentation about applying artificial intelligence in the real estate industry. It discusses the different stages of the real estate process and how AI could be used at each stage, including predicting energy usage, processing text in different languages, and automating workflows. It also covers challenges around regulations like GDPR and strategies for developing and deploying AI models, including using transfer learning and version control systems.
DPS2019 data scientist in the real estate industry
1. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
A data scientist journey in the
real estate industry
Mia Chang
Data Scientist/Microsoft AI MVP
Akelius GmbH
2. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Introduction
3. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
About me
- Data Scientist
- traditional AI
- computer vision/NLP
- Microsoft AI MVP
- Community Builder
- Taipei
- Berlin
4. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Why this topic
Real estate with
AI application
How do we use Azure in our
service?
Which framework/tool do we
use to solve problems?
8. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Receive Offer; Evaluation
House Visiting; Re-Evaluation
Take or Reject the offer
Upgrading Apartment
Leasing the Apartment
10. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Post Lease Advertisement
Apartment Visiting
Lease Out Apartment
Regular Check; Evaluation
Maintain or Sell
12. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
business analysis
13. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
ai applications
14. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
research focused
15. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Scaling Knowledge at Airbnb
Martin Daniel
How does data science result
take part in the business
decision?
I am building my team for
a. product insight
b. experiment project
c. modeling
16. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
team settings
Infra
- DOC2TEXT
- IMAGE
RECOGNITION
Before
- TRANSACTION
- OFFER
After
- ENERGY
- SENTIMENTDAAS
17. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
data scientist workflow
21. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Domain Driven Design
●Build software that
“makes sense to the business”
●DDD is a set of tools that assist you
Using strategic design activities
To build concrete tactical patterns
22. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
https://cdn.lynda.com/course/170778/170778-636190606665464953-16x9.jpg
23. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Receive Offer; Evaluation
House Visiting; Re-Evaluation
Take or Reject the offer
Upgrading Apartment
Leasing the Apartment
25. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
??? ???
Project ManagerProduct Owner
The user create a file, send a
request to our backend, ...
Data Scientist
case 1
26. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
???
The user create a file, send a
request to our backend, ...
offer manager
-----
Project ManagerProduct Owner Data Scientist
case 1
27. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
???
The user create a file, send a
request to our backend, ...
offer manager
-----
Project ManagerProduct Owner Data Scientist
offer
-----
case 1
28. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
:D
The user create a file, send a
request to our backend, ...
offer manager
-----
Project ManagerProduct Owner Data Scientist
upload
-----
offer
-----
case 1
29. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
???
Project Manager
So we would like to have a
60-mins energy prediction for
each meter.
Data Scientist Product Owner
case 2
???
30. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
???
Project Manager
So we would like to have a
15-mins prediction for meter
level and 60-mins prediction for
cost center level.
Data Scientist Product Owner
case 2
???
31. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
???
Project ManagerData Scientist Product Owner
case 2
???
- meter
- cost center level
- property manager
34. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
:D
Product Manager
OK.
We will provide you 15-mins prediction for meter
level and 60-mins prediction for cost center level.
Developers Product Owner
case 2
:D
35. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Domain knowledge
crunching
• Talk to the domain experts!
• What action do you take?
• What makes things changed?
37. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
GDPR
European General
Data Protection Regulation
38. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Why you should care about GDPR?
39. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
About GDPR
# One European regulation
# Applies to everyone who
Has a european citizenship
Is a company with an establishment in the EU
# Can be extended by local laws
40. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
For example, face recognition
41. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Ok,
I don’t see user name and email in my data.
Now can I say “we follow the GDPR”?
42. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Who should take responsibility?
- DBA
- Data Scientist
- Others, …?
49. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
How to choose wisely?
● Use third party APIs?
● Transfer learning?
● Build from scratch?
50. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Labs
An early look at
emerging Cognitive
Services technologies:
discover, try, and give
feedback on new
technologies before
general availability
Knowledge
Map complex
information and data in
order to solve specific
tasks
Language
Process text and
learn how to recognize
what users want
Search
Access billions of web
pages, images, videos,
and news with the
power of Bing
Vision
From faces to feelings,
allow your apps to
understand images and
video
Speech
Hear and speak to your
users by filtering noise,
identifying speakers,
and understanding intent
Microsoft Cognitive Services
Give your apps a human side
51. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Limitation...
53. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Receive Offer; Evaluation
House Visiting; Re-Evaluation
Take or Reject the offer
Upgrading Apartment
Leasing the Apartment
56. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Challenges
● offer price
● Angebotspreis
● prix de l'offre
● tilbudspris
● erbjudande pris
66. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Need Domain Knowledge?
Do you have labelled data?
Back to traditional pattern
recognizer/rule-base
● Use third party APIs?
● Transfer learning?
● Build from scratch?
67. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
DVC (data version control)
https://dvc.org/
68. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
DVC with azure blob storage
70. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Model Interpret
- make the report friendly to the decision maker.
- Balance between big pictures and details
- Balance between statistic/business logic
71. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Customized Metrics
75. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
DEPLOYMENT
76. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Release automation workflow
Azure Container Service
(AKS)
Azure Container
Instances (ACI)
Azure Container Registry
Open Service
Broker API (OSBA)
Release
Automation Tools
77. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Release automation workflow
Create
Have code?
Code
Container
Configuration
No
Yes
New Draft page
Change
• Code
• Container
• Configuration
Git push Pull code
Build container
Push image
Deploy image (AKS) Staged?
Canary deploy to
production
Deploy to staging
Testing good?
Push to production
as canary
Move to
dev cluster
No
Telemetry
successful?
Rollout
Yes
Rollback
No
Yes
No
Yes
DraftcreateorDraft
create-pack(ifspecificartifacts
exist)
Draft create
Actualdevelopment,Draft
up/connectiteration
Code/artifacts ready
Thebuildingprocess:Brigade,Jenkins,VSTS
CD: No staging
Builds image/config. to be
deployed
2 factor authentication
Azure Container Service
(AKS)
Azure Container
Instances (ACI)
Azure Container Registry
Open Service
Broker API (OSBA)
Release
Automation Tools
78. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Release To AKS
79. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
After deploying to Dev...
80. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Release automation workflow
Create
Have code?
Code
Container
Configuration
No
Yes
New Draft page
Change
• Code
• Container
• Configuration
Git push Pull code
Build container
Push image
Deploy image (AKS) Staged?
Canary deploy to
production
Deploy to staging
Testing good?
Push to production
as canary
Move to
dev cluster
No
Telemetry
successful?
Rollout
Yes
Rollback
No
Yes
No
Yes
DraftcreateorDraft
create-pack(ifspecificartifacts
exist)
Draft create
Actualdevelopment,Draft
up/connectiteration
Code/artifacts ready
Thebuildingprocess:Brigade,Jenkins,VSTS
CD: No staging
Builds image/config. to be
deployed
2 factor authentication
Azure Container Service
(AKS)
Azure Container
Instances (ACI)
Azure Container Registry
Open Service
Broker API (OSBA)
Release
Automation Tools
81. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Gather user
feedback
82. Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Questions
83. Data Platform Summit 2019 is a community initiative by DataPlatformGeeksData Platform Summit 2018 is a community initiative by eDominer Systems
A Big Thanks to Our
Knowledge Partners Post your pics with hash tag #DPS10
and win some cool prizes
at the Community Evening
Give Session & Conference Feedback
and win some cool prizes
at the Community Evening
Thank You
Data Platform Summit 2019 is a community initiative by DataPlatformGeeks
Jonas Jurczok;Jonathan Nye; Kai Schlichting