Building & Scaling Data Teams

Data Science
Software Platform
Building
A Data
Team
Outreachdigital.org @outreachdigit

Meet HAL
Hal AlowneBI Manager
Dim’s Private Showroom
2Outreachdigital.org @outreachdigit

Meet Hal’s Boss, DIM
Hey Hal !
We need
a big data platform
like the big guys.
Just do what they’re doing!
‟
”Big Data
Copy Cat
Project

TECHNOLOGY
DisconnectWhat technologies should
I use ?‟
”

Welcome to Technoslavia !
5

TOY PLATFORM ANTI-PATTERN
6
Test and Invest in Infrastructure == Skilled People
or
Go For Cloud / Packaged Infrastructure
Your Brand New Hadoop Cluster
is perceived as slow, not so used
and not reliable

TECHNO MISMATCH ANTI-PATTERN
7
Assume Being Polyglot
or
Be a Dictator
VS
VS
The Python
Clan
The R
Tribe
The Old Elephant
Fraternity
The New Elephant
Club

PREDICTIVE ANALYTICS DEPLOYMENT
STRATEGY
8
Website 2000’ winners
Companies that were able to release fast
"Artificial Intelligence with Data for
Internet of Things" 2010’ winners
Companies able to put intelligence in production
?
Design a way to put “PREDICTIVE MODELS”
IN PRODUCTION

PEOPLE
Disconnect
Who should I hire ?
‟ ”

Classic Business Intelligence Team Organization
Business Leader
Data Consumer
Line-of-business
Data Consumer
Business Project
Sponsor
BI Solution Architect
Model Designer
ETL Developer
Dashboard / Report Designer
Specs
Dim
Big Boss

Data Science Team Organization
Business Leader
Data Consumer
Line-of-business
Data Consumer
Business Project
Sponsor
Data Engineer
Data Analyst
System Engineer /
Data Architect
Business
Needs
Data Scientist
IT
Constraints
I.T.

Manage Expectations
12
Data
Plumberer
Data
Engineer
Data
Scientist
Data
Waiter
Data
Cleaner
Data
Analyst
REAL
JOB
DREAM
JOB

Managing Extreme Personalities
13
Data Scientist
Highly Creative
Passionate
Hard to hire?
Hard to manage?
Want to take
Hal’s job?Ambitious
Hard to retain?

Paired for Data
14
Data Analyst
Discover Patterns
Data Engineer
Make things work
Fight
data
entropy
Fight
tech
entropy

What do you prefer?
15
One Analyst 
One Engineer 
One Data Scientist
Four data scientists
OR

Two Mindsets Can Coexist
CLICKERS CODERS
Outreachdigital.org @outreachdigit 16

DATA
Disconnect
What about data ?
‟ ”

What is the main reason for data project to fail ?
18
> DATA NOT  
AVAILABLE

BUT FOR ONLY INCREMENTAL GAIN
Contribution to the overall project performance
0% 25% 50% 75% 100%
20%30%50%
Business Goal Definition and Data Feature Engineering Algorithm

How to Get Data if you don’t have it
20
THE GRASSHOPER THE SPIDER THE FOX

The Cicada : Optimistic and Opportunistic Data
22
THE CICADA
As a startup
As a group inside a company
- Build a new product using open data
- Benefit from the data sharing initiative within your company
- Wait for data to be available in your data lake

The Spider: Power of the Network
23
THE SPIDER
As a startup
- Create a network of (web trackers | sensors)
- Make it available for free
- Build your service on people’s collected data
- Make a web service available to collect data
- Promote it internally so that people use it

The Fox: Hunt for the Big Money first
24
THE FOX
As a startup
- Hunt for a Business Group within a large company with a problem
- Build a SaaS solution using their data
- Replicate to competitors
- Take in a charge a critical problem as per the CEO’s request
- Build your own integrated tech team to solve it
- Use those ressources to reset data services internally

PRODUCT
Disconnect

What is Big Data about ?

The Age Of Distributed Intelligence
27
Global,
Personalised and
Real Time Data
Driven Services

Data to Visualize or Data to Automate ?
2013 2014 2015 2016 2017 2018
Moving to a world of automated decision making
28
DATA
FOR MORE
INSIGHTS
DATA
FOR AUTOMATED
DECISIONS

Involve Product Team
29
Product Feature
Personalised Item Ranking
Product Feature
Notify User Only when Needed
Product Feature:
Historical Data For Path Optimisation
Have Product Management Deeply Involved
In the Data Team

Focus on your added value
30
Build by the
Data Team
Is the problem at the
Core of my Business Process?
Is it a common
problem / with share data?
Can i solve it on my
own?
Really?
Hire Consultant
and Learn
Build by
the Data Team
Go for Best of
Breed SaaS
Solution
Build by
the Data Team?
YesNo
No Yes
No Yes
No Yes

Create an API culture
Do not share
o Random Piece of Code
o Flat File
o Email
Do share
✓ Reproductible documented workflows
✓ Clean, documented APIs

Did Hal found his solutions ?
Technology
Data
People
Product
Polyglot on top of open source
Find a way to make clickers and coders work together
Create an API culture and involve the product teams
Hunt for Big Problems and Convince the CEOIs this the end ?‟
”
Hal Alowne
BI Manager
Dim’s Private Showroom

DATA OR SLAVERY ?

Objective Alignment
Autonomous Vehicles Need Experimental Ethics: Are We Ready for Utilitarian Cars?
http://arxiv.org/abs/1510.03346

Data-Driven Artificial Sales & Marketing ?
ARTIFICIAL
SUPERVISOR
Please Call
The customers
Please Call
again
Could you add a
JOKE at the end of
this email
I need you to
ATTEND
A physical meeting
Here is the BRIEF
Analyzing continuously prospect behavior on  
social networks, applications and websites

I don’t know the answer but here  
a free software for the data addicts in  
your company
data scientists
and engineers
25
by the numbers
for clickers and coders
3000
lovely
users
80
customers
by the customers

Food for thoughts 
www.dataiku.com/blog
THANK YOU !
FREE (as in Beer) Software
www.dataiku.com/dss

Car Sharing
Worldwide
Leader
Flash Sales
Worldwide
Leader
One Mission :  
Never leave Hal ALONE
3,700
Hotels
Worldwide
2500 lovely
users
by the numbers
70 customers

My nerdy background
Type Systems Automated Proving Abstract Program Interpretation Functional Programming Garbage
Collection and
Vms
Graph Analytics Chess IA Natural Language Processing 80% Emacs / 20% VIM

So to sum it up …
41
I (USED TO)  
HATE 
GUIs

…and our software is
A supercharged Visual IDE for Data Teams
Deployment

Building & Scaling Data Teams

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (7)

Similar to Building & Scaling Data Teams

Similar to Building & Scaling Data Teams (20)

More from Outreach Digital

More from Outreach Digital (20)

Recently uploaded

Recently uploaded (20)

Building & Scaling Data Teams