Presentation given at CodeCamp NYC, October 1, 2011.

1. SQL Server Denali BI on Your Terms Code Camp NYC 2011 Andrew J. Brust, Founder/CEO Blue Badge Insights

2. MARQUEE SPONSOR

3. PLATINUM SPONSOR

4. PLATINUM SPONSOR

5. GOLD SPONSOR

6. GOLD SPONSOR

7. GOLD SPONSOR

8. GOLD SPONSOR

9. GOLD SPONSOR

10. GOLD SPONSOR

11. SILVER SPONSORS

12. Who Am I? Founder, CEO, Blue Badge Insights Microsoft Regional Director, MVP Organizing team, Code Camp NYC Co-chair Visual Studio Live!Co-moderator, NYC .NET Developers Group http://www.nycdotnetdev.com Founder, MS BI User Group NYC http://www.msbinyc.com brustblog.com, Twitter: @andrewbrust

13. Column and Blog

14. Book

15. Agenda SQL Server BI – High Level PowerPivot and Excel Services Analysis Services Tabular Mode Project “Crescent” Overview: Master Data Services and Data Quality Services

16. SQL Server BI Overview

17. Microsoft Business Intelligence Business User Experience Familiar User Experience Self-Service access & insight Data exploration & analysis Predictive analysis Data visualization Contextual visualization Business Collaboration Platform Dashboards & Scorecards Excel Services Web based forms & workflow Collaboration Search Content Management LOB data integration Business Collaboration Platform Data Infrastructure and BI Platform Analysis Services Reporting Services Integration Services Master Data Services Data Mining Data Warehousing Information Platform

18. SQLServer2008 BIComponents IT PROFESSIONALS BUSINESS DECISIONMAKERS INFORMATIONWORKERS POWER USERS DEVELOPERS MICROSOFT BI PLATFORM

19. But Wait, There’s More! R2: PowerPivot R2: Report Parts in SSRS Denali: Analysis Services Tabular mode And corresponding improvements in PowerPivot Denali: “Crescent” Denali: Data Quality Services

20. PowerPivot and Excel Services

21. Self-Service BI with PowerPivot Excel + Analysis Services + SharePoint Enables the working in Excel but mitigates the “spreadmart” pitfalls: Use Analysis Services (AS) as a hidden engine Instead of no engine Share via SharePoint, accessible by all AS clients Instead of “deploying” via email Formal data refresh on server So data doesn’t get stale, and users don’t have to make effort at updating Allow IT to monitor So it’s not all rogue Provide path to more rigorous implementations Can be upsized to Analysis Services

23. You have:

24. Perf: values you wish to aggregate are adjacent

25. Efficiency: great compression from identical or nearly-identical values in proximity

29. =FUNCX('table name', <filter expression>)

30. FILTER(Resellers,[ProductLine] = "Mountain")

31. RELATED(Products[EnglishProductName])

33. What’s New? Data and Diagram views KPIs Measures Measuregrid Measureformula

34. Diagram View Perspectives Default Aggregations Special Advanced Mode Reporting Properties Hierarchies Hide specific columns and tables Create relationshipsvisually Measures KPIs

35. PowerPivot Client

38. PowerPivot Server Publish to Excel Services Viewing and interacting Data Refresh Treating as SSAS cube URL to .xlsx as server name Db name is GUID-based; best to discover it Use Excel, Reporting Services as clients And now “Crescent” too…more later

39. The IT Dashboard Increase IT efficiency: Familiar Technologies for Authoring, Sharing, Security, and Compliance Customizable IT Dashboard Visualize usage with animated charts Simplify management of SSBI content usingIT Operations Dashboard for SharePoint

40. PowerPivot Server

41. Analysis Services Tabular Mode

42. Analysis Services Tabular Mode SSAS Tabular Mode is the enterprise/server implementation of PowerPivot You must have a dedicated tabular mode SSAS instance BI Developer Studio (BIDS) does PowerPivot Implements equivalent tooling to PowerPivot Window Can create an SSAS Tabular database project by importing an Excel workbook with PowerPivot model SSAS tabular models support partitions and roles

43. SSAS Tabular Project in BIDS SSAS tabular project menus and toolbar Measure grid and formula bar Reporting properties in Properties window

44. DirectQuery Mode In DQ mode, model defines schema, but is not used for data Queries issued directly against source Similar to ROLAP storage for conventional cubes

45. SSAS Tabular Mode

46. PROJECT “CRESCENT”

47. What is Crescent? Ad hoc reporting. Really! Analysis, data Exploration Data Visualization In Silverlight, in the browser, in SharePoint Feels a little like Excel BI Is actually based on SSRS Crescent makes a special RDL file And wraps it in an RDLX

48. Crescent Data Sources Crescent works only against PowerPivot/SSAS Tabular models DirectQuery mode supported, however For PowerPivot, click “Create Crescent Report” button or option on workbook in SharePoint report gallery For SSAS tabular model, create BISM data source, then click its “Create Crescent Report” button or option BISM data sources can point to PowerPivot workbooks too, if you want.

49. Crescent! In the browser, in Silverlight Ribbon, like Excel Variety of visualizations and data formats Field list, like Excel Data regions pane,like Excel

50. Text and Viewing Text boxes edited asif in Office Maximize one chart, or put whole report in preview or full-screen

51. Crescent Basics

52. Constraining Your Data In Crescent Tiles A filtering mechanism within a visualization Highlighting Selection in one visualization affects the others Slicers Similar to Excel against PowerPivot True Filters Checked drop-down list; very Excel-like Right Hand Filter Pane, similar to SSRS and Excel Services

53. Crescent Filtering

54. Scatter/Bubble Charts Allow for 3 measures by up to 4 dimensions One dimension is “playable” through a slider or animation Excellent way to visualize trends over time

55. Small Multipliers Multiple charts within a chart, in columns, rows, or a matrix Allows for visualizing an additional dimension Think of it like a clustered chart with each series shown individually

56. Advanced Properties Setting the representative column and image tells Crescent how to summarize your data, and show stored images Other properties tell it about key attribute, default aggregation and more For SSAS tabular models, “Direct Query” mode tells Crescent to get data from relational data source instead of columnar cache

57. Crescent Advanced Features

58. Vocabulary MOLAP: Multidimensional OLAP UDM: Unified Dimensional Model Cube: Unit of schema in a dimensional database VertiPaq: PowerPivot/SSAS’ column store engine BISM: BI Semantic Model Tabular: A column store-based model Because it uses tables, not cubes

59. Apollo Implementation of VertiPaq columnar storage engine for SQL Server relational databases Use it by creating a column store index CREATE COLUMNSTORE INDEX index ON table(col1, Col2, …) Can ignore it too: OPTION (IGNORE_NONCLUSTERED_COLUMNSTORE_INDEX) Significantly increases performance of star join queries (i.e. aggregating queries with dimension lookups). Not as good as SSAS, but better than plain old GROUP BY

60. Overview:Master Data ServicesANDData Quality Services

63. v1 was an ASP.NET application; UI is “different”

64. New in v2:

65. Now Silverlight-based; UI is still “different”

66. Excel add-in for data entry; creation of entities and attributes

67. Perform matching with DQS before loading

68. Includes .NET and Web Services APIs for reading/writing data and creating/editing models

69. Does not integrate with Analysis Services tools even though many of its features and concepts mirror those of dimension designer

70. Catalog kept in SQL Server database

72. Data Quality Services Data Cleansing Tool New to Denali Result of Zoomix Acquisition Uses Artificial Intelligence algorithms detect invalid data and perform matching (for de-duplication) Allows manual intervention, too Can integrate with MDS and SSIS Cleaner data = better adoption of your BI project

73. DQS Concepts Knowledge Bases Domains “semantic representation[s] of a type of data in a data field…[contain] a list of trusted values, invalid values, and erroneous data.” Mapping Data Quality Projects Cleansing (i.e. correcting) Validate Using Reference Data Services and Use Azure DataMarket (or 3rd party providers) Matching (i.e. de-duping) Confidence Profiling, Monitoring

74. Questions? Now? Later? Andrew.Brust@BlueBadgeInsights.com @andrewbrust on Twitter www.brustblog.com Want to get the weekly Redmond Roundup Plus dispatch? Just text the word “bluebadge” to 22828