Enabling Self Service Business Intelligenceusing Excel
1. Enabling Self Service
Business Intelligence
using Excel
Alan Koo
Senior Consultant | Nagnoi, Inc.
www.alan.koo.com | @alan_koo
2. Alan Koo | www.alankoo.com
Who am I?
• Senior Consultant at Nagnoi, Inc.
• 13+ years in SQL Server
• 8+ years in BI & OLAP
• Member of the Microsoft BI Advisors internal group
• Former Microsoft MVP (2008 – 2011)
• MCT Regional Lead – Puerto Rico
• MCT since 2004 for Business Intelligence / SQL Server / .NET
• Co-Founder of Puerto Rico PASS
• Blogger: www.alankoo.com
3. Alan Koo | www.alankoo.com
Agenda
Intro
Modern Self Service BI tools
Excel and Power BI
Discover and combine data
Visualize
Model & analyze
What is Next?
5. Alan Koo | www.alankoo.com
BigData
Enormous amounts of data
online behavior of Facebook users
tissue samples of cancer patients
purchasing habits of grocery shoppers
crime statistics of cities
“internet of things”
24/7 outpatient monitor
real-time telemetry devices
http://www.nytimes.com/2013/04/14/education/edlife/universities-offer-courses-in-a-hot-new-field-data-science.html?_r=1&
90%
Of data in the world,
has been created in
the last 2 years
6. Alan Koo | www.alankoo.com
The sexiest job in the 21st century
http://www.nytimes.com/2013/04/14/education/edlife/universities-offer-courses-in-a-hot-new-field-data-science.html?_r=1&
http://hbr.org/2012/10/data-scientist-the-sexiest-job-of-the-21st-century/
Data Science
7. Alan Koo | www.alankoo.com
Data Scientists
The magicians of the Big Data era
They crunch the data, use mathematical
models to analyze it and create
narratives or visualizations to explain it,
then suggest how to use the information
to make decisions
http://www.nytimes.com/2013/04/14/education/edlife/universities-offer-courses-in-a-hot-new-field-data-science.html?_r=1&
9. Alan Koo | www.alankoo.com
Book recommendation
The Information:
A History, A Theory, A Flood
10. Alan Koo | www.alankoo.com
Business Intelligence (BI)
A broad category of applications and technologies
for gathering, storing, analyzing,
and providing access
to data to help enterprise users
make better business decisions.
Search Data Management
11. Alan Koo | www.alankoo.com
BI solution scenarios
Operational Reporting
Access to existing data from operational systems
Business Process / Activity Management
Analysis and reporting capabilities for specific business processes or activities
Data Mart / Integrated Reporting and Analytics
Tools and access to business users of an application.
to enhance its value by improving decision making
Enterprise Data Warehousing / Information Management
Comprehensive integration of critical information across the enterprise.
Breaks down the barriers between applications.
Microsoft Developer & Platform Evangelism
12. Traditional BI: Integrated Reporting and Analytics
Data Sources
Staging Area
Manual
Cleansing
Data Marts
Data Warehouse
Client
Access
Client
Access
1: Clients need access to data2: Clients may access data sources directly3: Data sources can be mirrored/replicated to reduce contention4: The data warehouse manages data for analyzing and reporting5: Data warehouse is periodically populated from data sources6: Staging areas may simplify the data warehouse population7: Manual cleansing may be required to cleanse dirty data8: Clients use various tools to query the data warehouse9: Delivering BI enables a process of continuous business improvement
Microsoft Developer & Platform Evangelism
13. Silos of Data
15
Data Warehouse
Call Center
Web Apps
Inventory
ERPHR
Finance
CRM
Microsoft Developer & Platform Evangelism
14. Alan Koo | www.alankoo.com
From Traditional to Self Service BI
15. Alan Koo | www.alankoo.com
Self-Service BI or simply better results?
• Because the organization has insufficient insight into its data
• Because traditional BI is too expensive
• Because traditional BI is too slow
• Because you were told to go get it
http://www.powerpivotpro.com/2013/06/self-serve-bi-tool-scorecard-powerpivot-vs-the-others-and-why-not-all-checkboxes-are-equal/
A self-serve BI tool is a means to an end
You need one to solve some combination of #1-3 above.
16. Alan Koo | www.alankoo.com
Modern Self-Service BI players
17. Alan Koo | www.alankoo.com
Microsoft Excel for BI???
“…self-service BI solutions to everyday business users
through the familiar tool they already use ..”
http://blogs.technet.com/b/dataplatforminsider/archive/2013/07/08/introducing-power-bi-for-office-365.aspx
18. Alan Koo | www.alankoo.com
Microsoft Excel for BI
• It is very likely that Excel is already the lifeblood of your organization
• These people will be the primary power users of any new self-serve tool you adopt
• All of the tools tend to look a lot easier to learn than they are
• Excel is FAR more flexible than ANY of the other tools
• “Export to Excel” exists because of Excel’s flexibility,
not just because of Excel’s popularity
• If Excel isn’t your BI tool, all of that “Export to Excel”
activity leads to fragmented intelligence.
http://www.powerpivotpro.com/2013/06/self-serve-bi-tool-scorecard-powerpivot-vs-the-others-and-why-not-all-checkboxes-are-equal/
19. Alan Koo | www.alankoo.com
Power BI(for Office 365 - Excel)
…bring the power of big data insights to the people
who are closest to the business – not a specialist with
an expensive, specialized tool -- but everyone in the
organization can find deeper insights that will help
them make better decisions..”
http://blogs.technet.com/b/dataplatforminsider/archive/2013/07/08/introducing-power-bi-for-office-365.aspx
20. Alan Koo | www.alankoo.com
Power BI for Excel
Power Query
• Query data
• Clean data
Power Pivot
• Model tables
• View in Pivot Tables /
Charts
Power View / Power
Map
• “Prettier” visualizations
• Can map
21. Alan Koo | www.alankoo.com
Power BI for Office 365 (Excel) Components
• Power Pivot
(embedded in Excel 2013) – need to be enabled
• Power View
(embedded in Excel 2013) need to be enabled
• Power Query (Data Explorer) – need to be downloaded and installed
• Power Map (Geo-Flow) – need to be downloaded and installed
22. Alan Koo | www.alankoo.com
Power BI for Excel components requirements
• The following Office versions are supported:
– Office 2013 Professional Plus
– Office 365 ProPlus
• Supported Operating System
Windows 7, Windows 8, Windows Server 2008 R2, Windows Server 2012, Windows Vista
– Windows Vista (requires .NET 3.5 SP1)
– Windows Server 2008 (requires .NET 3.5 SP1)
– Windows 7
– Windows 8
24. Alan Koo | www.alankoo.com
Power BI: Discover & Combine
Power Query
Help customers easily
discover, access, and
combine their data
25. Alan Koo | www.alankoo.com
What can I do with Power Query?
• Search public data
• Import data into Excel from a
wide variety of data sources
• Shape it:
– Custom columns
– Aggregate data
– Combine
– Advance querys (formula
language)
– Drill down
– Filter
– Group rows
– Remove duplicates
– Replace values
– Sort
– Split
– Unpivot / Pivot
26. Alan Koo | www.alankoo.com
Demo
Power Query in action!
27. Alan Koo | www.alankoo.com
Power Query: more flexibility???
“M”language
28. Alan Koo | www.alankoo.com
Power BI: Visualize
Power View
Help business users discover and
share new insights with
colleagues through interactive
charts and graphs
Power Map
Allows user to create rich 3D
geospatial visualizations
29. Alan Koo | www.alankoo.com
Power View
An interactive data exploration, visualization, and
presentation experience.
Provides intuitive ad-hoc reporting for business users such
as data analysts, business decision makers, and information
workers.
30. Alan Koo | www.alankoo.com
With Power Map you can....
• Map Data: plot up to a million rows of data in 3-
D, visually on Bing maps.
• Discover Insights: gain new understandings by seeing
your data in geographic space and seeing time-stamped
data change over time.
• Share Stories: capture screenshots and build
cinematic, guided video tours that can be shared
broadly, engaging audiences like never before.
31. Alan Koo | www.alankoo.com
Demo
Power Map in action!
Dallas Utilities
32. Alan Koo | www.alankoo.com
Power BI: Model & Analyze
Power Pivot
Create flexible
models, process hundreds of
millions of rows of data in
split second times
33. Alan Koo | www.alankoo.com
Data Analysis Expressions (DAX)
• Programming language for PowerPivot (SSAS 2012
Tabular)
• Simple, clean, powerful, fast, not easy
• Tabular requires simpler data modeling for good result
• Thinking in DAX is a new attitude
35. Alan Koo | www.alankoo.com
Demo
Enriching your data with
a Power Pivot model
36. Alan Koo | www.alankoo.com
Power Pivot features learned today
1. Import from text files (CSV)
2. Excel as linked tables (Calendar)
3. Pivot table Slicers
4. Hierarchies
5. Create relations between tables
6. Model cleansing
7. Calculated Columns
8. Basic DAX functions (IIF, RELATED)
37. Alan Koo | www.alankoo.com
PowerPivot flavors
PowerPivot for Excel Personal Analytics
PowerPivot for Sharepoint Team Analytics
Analysis Services Corporate Analytics
PowerPivot for Excel Personal Analytics
40. Twit analysis tool for Excel
http://social.technet.microsoft.com/wiki/contents/articles/15665.analytics-for-twitter-2013.aspx
41. Alan Koo | www.alankoo.com
Q & A Feature of Power BI (coming soon)
• Natural language based experience for interacting with
data
“Show London clients” “Show number of products”
“Number of songs per year” “Total number of employees for
finance, HR, marketing in Europe
by employee country”
42. Alan Koo | www.alankoo.com
PowerBIVideo
What is the best selling
Song of All Time?
43. Alan Koo | www.alankoo.com
Wrapping up: Self Service BI
Opens a new window of opportunities
Increase productivity while giving visibility
Scalable to an Enterprise BI Solution
Foundation for Business Intelligence (BI) to the Masses
Just play and have fun!
45. Alan Koo | www.alankoo.com
Nestor Figueroa | 787.671.8244
powerpivotworkshop@nagnoi.com
Authorized Training Center
Designed for professionals who want to use PowerPivot’s full
capabilities, the PowerPivot Workshop is a two/three-day
course that covers PowerPivot topics, starting from basic
concepts and moving on up to complex data models and DAX
formulas with the goal to facilitate the use of PowerPivot in
the real world.
46. Puerto Rico PASS Chapter
Our next meeting is on Wednesday 28th
Subscribe to our newsletter
47. Thank You!
Alan Koo Labrín
Senior Consultant | Nagnoi, Inc.
Blog: www.alankoo.com
Twitter: @alan_koo
48. Alan Koo | www.alankoo.com
Resources
• Power BI Home Page
• Gapminder
• Data.gov
• Microsoft Power Query for Excel Help
http://office.microsoft.com/en-us/excel-help/microsoft-power-query-for-excel-help-HA104003813.aspx
• Power Query basics
http://datapigtechnologies.com/blog/index.php/cool-things-you-can-do-with-data-explorer/
• Importing Data From Multiple Log Files
http://cwebbbi.wordpress.com/2013/03/01/importing-data-from-multiple-log-files-using-data-explorer/
Notes de l'éditeur
As we look at the IT industry today, a number of important trends are changing the way software is being purchased, deployed and used in the organization. Data ExplosionThe volume of data in the workplace is exploding. According to IDC, digital data will grow more than 40x over the next decade. As more and more data is created digitally, we expect to see ever greater demands being placed on our data platforms to store, secure, process and manage these large volumes of data.Consumerization of ITToday we see an increasing trend toward the “consumerization” of IT which is creating the demand for highly interactive and easy-to-use experiences in the business environment. As consumers, we are accustomed to powerful user-friendly experiences, whether searching the Internet on a mobile device to find information instantly, or quickly accessing our personal financial data. In the workplace, however, we are often unable to answer even the most basic questions about our business. Increasingly, users demand business experiences that more closely mirror the convenience and ease of use in consumer life.Private and Public CloudCloud computing is changing the way data is accessed and processed, and it is creating whole new models for the way applications are delivered. According to IDC, Cloud services will account for 46% of net-new growth in overall IT spending. With private and public cloud infrastructure, organizations have an opportunity to reduce TCO dramatically as data volume increases. As we see an evolution toward greater use of private and public clouds, we see an increasing need for solutions that support hybrid cloud scenarios.
Since the goal of building a business intelligence solution is to drive better decision making, there is no single solution scenario to describe what a BI Solution looks like.There are however some broad categories of solutions that describe common approaches to BI solutions that are defined on this slide. These solutions range from low complexity / small investment (Operational Reporting) up to high complexity / large investment (Enterprise Data Warehousing)This workshop will focus on the Data Mart / Integrated Reporting and Analytics solution scenario because it covers all of the technology used in the other scenarios, and is very common in the ISV and SI space. Building a data mart means providing improved access and tools to business users of your application data at all levels of the organization (executives, analysts, information workers, front-line workers), allowing your customer to better leverage the data assets contained in your application.By understanding this solution scenario, you can decide how to approach building your first BI solution. Some developers may elect to start small by simply providing improved access to operational data as described in the Operational Reporting scenario. Other developers may decide to tackle the larger problem of providing comprehensive integrated reporting and analytics capabilities to their application as described in the Data Mart scenario. Truly adventurous developers may decide to tackle the larger problem of Enterprise Data Warehousing, and attempt to provide their customer with an Enterprise Information Management solution which solves the larger problem of providing an integrated view of enterprise information across application boundaries.
1. Get list of files2. Search: Puerto Rico – List of radio Stations3. Search: Winners - NBA Most Valuable Player Award4. Search: List of municipalities - Municipalities of Puerto Rico5. Gas Prices: http://www.gasbuddy.com/GB_Price_List.aspx6. Body Mass Index (BMI),Income per person (GDP/capita, PPP# inflation-adjusted), Population, total-- Body mass index (BMI) is a measure of body fat based on height and weight that applies to adult men and womenUnderweight = <18.5Normal weight = 18.5–24.9 Overweight = 25–29.9 Obesity = BMI of 30 or greater OPTIONAL 7. IMDB - http://www.imdb.com/chart/top | http://denglishbi.wordpress.com/category/data-explorer/8. Facebook Graph - https://developers.facebook.com/tools/explorer?method=GET&path=121801836%3Ffields%3DfriendlistsMiWindowsPhone – 157032490990072 = Facebook.Graph("https://graph.facebook.com/157032490990072/posts")9. Which car Brand is more popular - Twitter - http://dwjunkie.wordpress.com/2013/07/29/data-science-labs-analyze-twitter-data-with-excel-and-power-query/ | “Tweet”, “Tweeter”, “Date” and “Brand”