The Future of Microsoft Data Strategy : OpenSource, IoT, Analytics and Power BI ; Global Azure Bootcamp 2016 - Lyon, Vincent Thavonekham

Global Azure Bootcamp#GlobalAzure #MUGLyon @AZUGFR LYON - FRANCE
Vincent THAVONEKHAM
The Future of Microsoft Data Strategy :
OpenSource, IoT, Analytics and Power BI
1

GAB 2016 LYON ORAGANIZER
LOCAL SPONSORS
www.iot-world.fr
Prochaine édition
21 et 22 mars 2017 à Paris
2
GLOBAL SPONSORS

• Description of the Data, traditional vs. new
• What are the problems ?
• Solutions, with a focus on Power BI
• Conclusion
CONTENT
3

Microsoft Practice Manager @VISEO
MVP Azure, P-Seller ALM/DevOps
www.thavo.com
@vThavo
Microsoft User Group Lyon
Azure User Group France
Author & co-author DevOps et Azure
(France & international)
In 2015 :
- White paper: Zend / Programmez!
- Round table: live streaming
for Electric Cloud, with Gene Kim
(The Phoenix project)
Speaker : Vincent Thavonekham,

CONTENT
• Description of the Data (traditional vs. new)
• What are the problems ?
• Solutions (with a focus on Power BI)
• Conclusion

Credits : http://blogs.technet.com/b/dataplatforminsider/archive/2013/06/03/sql-server-2014-unlocking-real-time-
INTRODUCTION
The Data is an “old” topic addressed by SQL
Server

VALUE
DIFFICULTY 
INTRODUCTION
Key types of analysis in the Big Data
Traditional BI has evolved. Microsoft has grouped them into 2 categories:
Descriptive and Advanced Analytics (part of the « Data platform »
Source :
Gartner
Data Scientists
(Senior Doctor in
Maths, Astrophysics, …)

Data Platform leaps in innovation in 2015 !
2012
SQL Server 2012
2013
HDInsight
“Our industry does not respect tradition –
it only respects innovation.”
– Satya Nadella
2015
Azure
Machine Learning
Azure
Document DB
HDInsight on
Linux, HBase, Storm
Azure SQL DB with
In-memory OLTP
Cortana Analytics
Preview
IoT Services
2014
SQL Server 2014
APS
Azure SQL Database
Power BI
+ BI DataZen
+ Revolution R
Note : OLAP : On Line Analytic Processing
OLTP : On Line Transaction
Processing
Source : Microsoft

INTRODUCTION
Key actors in 2015
2015
2015

Traditional data warehouse approach
+ Sharepoint + Power BI + O365

Breaking points of the traditional
approach
Source : Microsoft Convergence

INTRODUCTION
Key actors in 2016
2015 2016

What are the problems ? And how to address
them ?
• Many innovations in 2015
• Too many data
• Too many data types
• Cold and hot data (i.e. traditional and real-time)
• Need for Agility (don’t know yet how to use data)
• Need really powerful compute to process

(Continued) What are the problems ? And
how to address them ?
• EXCEL is no more the key peace of
Microsoft Agile BI,
• Reporting Service is less and less used,
• OLAP cubes are no more the automatic
solution

Everyone
3rd wave
End user BI
A new generation of BI
Today, BI extends to everyone
Analyst to end user
2nd wave
Self-service BI
IT to end user
1st wave
Technical BI

FRUSTRATIONS :
The old Power BI and its « WOW » effect
• Beyond the “WOW effect”, you’ll find the
« Ouch » effect !
Ouch : EXCEL
250 Mb
limitations!
Ouch : what ?!?
PowerQuery,
PowerPivot,
PowerView,
PowerMap
Ouch :
Sharepoint ?
Ouch : Silverlight
?
Ouch : Excel
Plugins !
Ouch: Office
licences
2010/2013/365 Pro
Ouch : Need
admin rights ?
Ouch : … « and
what else ?? »

Event Hubs
Stream
processin
g
Apache Storm
on
HDInsightKafka /
RabbitMQ /
ActiveMQ
Azure Stream
Analytics
CURRENT BIG DATA ECOSYSTEM !
Source : Microsoft

IoT AS AN INPUT TO THE BIG DATA

SOLUTIONS (some of them!)
• Microsoft is Opening even more to the world,
• Reinventing Microsoft
• Many Open Source solutions supported
• Following standards
• SaaS + VERY quick Onboarding
• Start small with Free offers
• “Suites” to simplify usage: Azure IoT Suites (with pre-packaged solutions),
Cortona Analytics Suites,
• Focus on PowerBI.com and PowerBI Desktop

Robust Architecture : Lambda
Standards + Generic architecture = OPEN to non Microsoft technologies
Storage Cold Path Analysis
Apache Spark
Apache Storm
Hot Path Analysis Presentation
Apache
Kafka
IoT Hub
Apache Storm
on HDInsight
Apache HBASE
on HDInsight
Hybrid : MS + Open Source
“Lambda Architecture”

Azure IoT Suite
 « Think big, start small » : Microsoft referenced architecture
Pre-packaged solutions:
• Asset management
• Remote monitoring
• Preventive maintenance

Cortana Analytics Suite
http://pocavenet-azure-iot-dashboard.azurewebsites.net/

Global Vision of the Microsoft IoT

IoT Hubs
Stream
processin
g
Apache Storm
on
HDInsightKafka /
RabbitMQ /
ActiveMQ
Azure Stream
Analytics
CURRENT BIG DATA ECOSYSTEM !
Source : Microsoft

Tendency with reporting / BI
• Reporting Services are “brittle”
• and needs IT experts to modify
• No more Reporting Services within TFS/VSTS
• Reports not based on OLAP cube anymore
• Replaced by a lightweight real-time reports and Power BI.com (1)
• No more Power BI inside EXCEL,
• Replaced by a lightweight standalone Power BI.com
(1) https://blogs.msdn.microsoft.com/visualstudioalm/2016/01/11/announcing-reporting-capabilities-for-visual-studio-team-services

• The new SQL Server Reporting Services
https://blogs.msdn.microsoft.com/sqlrsteamblog/2016/03/18/sql-server-2016-rc1-whats-new-in-reporting-services
Tendency with reporting / BI

Zoom on Power BI
Starting with a definition
“Power BI is a suite of business analytics tools
to analyze data and share insights.
Monitor your business and get answers quickly
with rich dashboards available on every device.”

Zoom on Power BI
Starting with a new Portal
https://powerbi.com

New and easy prices

IT challenges
Management of Data in the
cloud
Security, private data, refresh and data updates.
Need to ease the usage Need an easy tool for both the IT and the business users, to
decrease time spent to create reports and visuals.
Keep data up to date Complex to refresh data from various sources, and manage
increasing data volumes due to real time.
Integrating with the existing Time and cost.
IT Administration tasks Time spent for high SLA. Cost of the servers and maintenance.
Various Data sources Complex to connect to both On Premise and Cloud (SaaS)
Data.

Power BI – Key benefits and differentiators
Pre-built content packs, consisting of dashboards
and reports, for popular SaaS solutions
Integration with familiar Microsoft products, and
commitment for scale and availability in Azure
Intuitive data exploration by using natural language
query
Real-time dashboard updates
Fast deployment, hybrid configuration, secure, and
integrated with existing IT systems
Secure, live connection to your data sources,
on-premises and in the cloud

How does Power BI addresses both
the IT challenges and the business needs ?

Data connections

Today:
Soon:

Quick start samples

Create reports

Power BI Desktop

Reports
Azure
Stream Analytics
Azure SQL/DW
HDInsight
AS Tabular
PBI Desktop
Excel

New custom visuals: Gallery (subset)

Dashboard
Azure
Stream Analytics
Azure SQL/DW
HDInsight
AS Tabular
PBI Desktop
Excel

« Ready to go » content packs :
to be used against popular SaaS applications

« Ready to go » content packs :
to be used against your data sources

Live data sources
Consume live data sources with full interactivity

Power BI Personnal Gateway
Dataset
Access your on-premise data using the Data Connectivity Gataways
(Personal and Data Management)

Data updates : Refresh strategies
Real time data streaming in your dashboard
- Using Power BI REST API
- Using Azure Stream Analytics
Live connectivity to Microsoft SSAS
- Auto-refresh
- The Data are updated when the user accesses a
dashboard or a report
Planned or automatic refresh
- SaaS connectors (updates every 24h or planned or
on-demand)
- Personal Gateway : planned or on demand refresh
Data refresh architecture
Live query
Popular SaaS
Solutions
Live dashboards and reports
Dynamics
Marketing
Power BI
SQL Server Analysis
Services (SSAS)
Secure
Credential
Store
PRO Version
1 million rows/hour
FREE Version
10 000 rows/hour
PRO Version
Every hour
FREE Version
Every day
https://support.powerbi.com/knowledgebase/articles/474669-refresh-data-in-power-bi

Sharing reports and personal Dashboards
Share dashboards with others within your orgianization.
• Shared dashboards (and related reports) are Read-Only.
• They cannot be saved volontarily
• The users cannot access the underlaying datasource
• The users always have an up to date view

Team working collaboration
Team working with Office 365 groups within
Power BI
Create, publish and display contents packs of the
company
Manage access control and sharing via Active
Directory groupes

Stay connected from any mobile devices

Push data
Integration
Real-
time
{
name":{String},
"tables":[
...
" ]
}
011001010
0001010
“name”:[string],
“columns”:[String]
“daType”:[String]
{
"name":{String},
"columns":[
{
"name":{String},
"dataType":{String}
},
Visuals
Power BI pour
les
developpeurs
Développements spécifiques

Only ONE access point : Powerbi.com
(forbothDesktopandCloudService)
Sign up for a free Preview account
Take the Power BI Tour

EXAMPLE 1 : Integration with Azure services
Use Azure Stream Analytics to push live
‘near-real time’, streaming data to Power BI
– Enables real-time dashboards at scale, over data from
devices and applications
– Can stream millions of events per second
– Can perform aggregation over time windows

EXAMPLE 2 : Integration with Azure services
Advanced analytics
Coalesce Azure services
together to drive
advanced analytics:
– Azure HDInsight:
Big Data processing
– Azure Machine Learning:
Predictive analytics
– Azure Data Factory:
Orchestration at scale

CONCLUSION
• STOP thinking Data the traditional way
• « Mobile First, Cloud First » (Nadella Satya)
• “Microsoft: opening the Windows to the world” ( Edouard Danel, 2016)
From the inside to the outside” & “From the outside to the inside”
• Microsoft is facilitating (again) the adoption
of the new technologies
• The NEW Microsoft Power BI (Power BI .com and Power BI Desktop)
• Azure Machine Learning, Cortona Analytics, …

GAB 2016 LYON ORAGANIZER
LOCAL SPONSORS
www.iot-world.fr
Prochaine édition
21 et 22 mars 2017 à Paris
57
GLOBAL SPONSORS

The Future of Microsoft Data Strategy : OpenSource, IoT, Analytics and Power BI ; Global Azure Bootcamp 2016 - Lyon, Vincent Thavonekham

Recommandé

Recommandé

Contenu connexe

En vedette

En vedette (8)

Plus de AZUG FR

Plus de AZUG FR (20)

Dernier

Dernier (20)

The Future of Microsoft Data Strategy : OpenSource, IoT, Analytics and Power BI ; Global Azure Bootcamp 2016 - Lyon, Vincent Thavonekham

Notes de l'éditeur