We all know that SharePoint is an excellent tool for gathering information and collaborating. What it is less good at it maintaining large quantities of that information over long periods of time. The good news is that SQL Server is very good at exactly that.  In the spirit of choosing the right tool for the right job, this session will present a methodology for moving your historical SharePoint information from SharePoint and into a SQL Server based data warehouse. From there, we will cover several method for then surfacing data back in SharePoint in context.

3. 3
© DEVintersection. All rights reserved.
http://www.DEVintersection.com
Agenda
 SharePoint Data Storage
 Data Warehousing
 Moving SharePoint Data
 Surfacing Warehoused Data in SharePoint
 Q&A

4. SharePoint Data Storage
The Problem

5. 5
© DEVintersection. All rights reserved.
http://www.DEVintersection.com
Excel Data Storage
 List based data
 Powerful Features
 Massive adoption
 Good usability
 NOT a database
 Not relational
 Capacity limits
 Not authoritative
 Excellent BI Client
 Surface the data.. DON’T store it

6. SharePoint Content Databases

7. 7
© DEVintersection. All rights reserved.
http://www.DEVintersection.com
SharePoint Content Databases

8. 8
© DEVintersection. All rights reserved.
http://www.DEVintersection.com
SharePoint Capacity Boundaries
 Boundaries and Limits - http://technet.microsoft.com/en-us/library/cc262787





9. Demo – WorkflowHistory List

10. Topic
Data Warehousing

11. ONE DOES NOT SIMPLY
RETURN HIS RAW DATA FROM THE DATABASE

12. 12
© DEVintersection. All rights reserved.
http://www.DEVintersection.com
BI Architecture 101
Data Marts
Extract, Transform,
and Load (ETL)
Middleware
Server(s)
Data
Warehouse
Storage Design and Visualization
Data Cubes and
Tabular Models
E
T
L
Reporting
Server(s)
BI and
Designer
Clients
Source data

13. 13
© DEVintersection. All rights reserved.
http://www.DEVintersection.com
EE
Microsoft enterprise (classic) BI
SQL Server DB
SQL Server
Integration
Services (SSIS)
SharePoint (with)
• Excel Services
• PowerPivot for SharePoint
• SSRS SharePoint Mode
• PerformancePoint
SQL Server
DB
Storage Design and Visualization
SQL Server Analysis
Services Multidimensional
and Tabular modes
L
SQL Server
Reporting
Services
(SSRS)
Excel
SQL Data Tools
Report Builder
3rd party tools
ETL
E
T
Source data

14. 14
© DEVintersection. All rights reserved.
http://www.DEVintersection.com
Team BI and SharePoint Dashboards
Power Pivot Worksheets
• Pivot Tables and Charts
• Power View
Data Marts and
other
Data Cubes and
Tabular Models
Standard Worksheets
• Pivot Tables and Charts
PerformancePoint Reports
• Analytic Charts and Grids
• Decomposition trees
SQL Server Reporting Services Reports
• Standard
• Power View
PerformancePoint Scorecards and KPIs

15. 15
© DEVintersection. All rights reserved.
http://www.DEVintersection.com
Why Warehouse?
 Optimize for End Goal

 Usability
 Reduced Load on Source Systems
 Security Requirements
 Licensing Requirements
 SharePoint (Performance)

16. Topic
Moving SharePoint Data

17. 17
© DEVintersection. All rights reserved.
http://www.DEVintersection.com
ETL Tools
 SQL Server Integration Services
 SQL Server Data Tools
 SharePoint List Source and Destination (Codeplex Project)

 OData Source for Microsoft SQL Server 2012 (Official)



18. Moving SharePoint Data
Demo

19. Topic
Accessing Warehoused Data

20. 20
© DEVintersection. All rights reserved.
http://www.DEVintersection.com
Data Consumption
 Business Connectivity Services

 SQL Server Reporting Services


 Excel/Power Pivot


21. Accessing Warehoused Data
Demo

22. 22
© DEVintersection. All rights reserved.
http://www.DEVintersection.com
Considerations
 Transformations
 Mashups
 Scheduling
 Data latency

23. In Conclusion

24. 24
© DEVintersection. All rights reserved.
http://www.DEVintersection.com
Q&A