A recap of Chris McNulty's SharePoint presentation at SharePoint Saturday the Conference in August 2011.

1. SharePoint 2010 - Administration 101 SharePoint Saturday the ConferenceAugust 2011Chris McNulty

2. SharePoint SpeedMetal [Admin 101](S5A-104)Admin – 200 Chris McNulty KMA Welcome to SharePoint Saturday—The Conference

3. Welcome to SharePoint Saturday—The Conference Thank you for being a part of the first SharePoint Saturday conference Please turn off all electronic devices or set them to vibrate. If you must take a phone call, please do so in the hall so as not to disturb others. Open wireless access is available at SSID: SPSTC2011 Feel free to “tweet and blog” during the session Thanks to our Diamond and Platinum Sponsors:

5. Working with SharePoint technologies since 2000/2001

6. 20 years consulting and financial services technology (Santander, John Hancock, GMO, State Street)

7. MBA in Investment Management from Boston College Carroll School of Management

8. Write and speak often on Microsoft IW technologies (blogs & books)

9. Microsoft MCSE/MCTS/MSA/MVTSP

10. Hiking, cooking, playing guitar, colonial history, photography

12. Out Of Scope Deep Dives (e.g. PowerShell, BI, Upgrade, SQL DBA) Development Customization Design & Architecture Power User (e.g. Library Customization, Designer Workflows, etc.) Office 365 Rules Move fast, PowerPoint is shared Questions – time permitting during session Any time after session – email etc. Objectives

13. The dilemma Architecture, Design & Planning Installation and Upgrade Post Installation Best Practices Service/Feature Placement Support Monitoring and Optimization Backup PowerShell Development Functions Optimization Patching SQL Maintenance Best Practices Agenda

15. But…

16. You’re still responsible for:

17. Exchange

18. Active Directory

19. SQL

20. Desktop

21. Help Desk

22. Network/Firewall

23. Cooking & Cleaning

24. Etc.Congratulations!

26. Time and focus are scarce resources!

27. Common pain points include

28. Upgrades are complex and hard to monitor

29. Dispersed workforce, little control of browsers and Office versions

30. Hard to understand and troubleshoot “behind the scenes” performance and capacity planning

31. Best practices not always understood or compared to system health

32. “All or nothing” administration means IT must be engaged for all admin responsibilities, even searchThe Dilemma

33. Microsoft SharePoint Server 2010 … the bright frontier Eastern Long Island, July 4, 2010

34. Microsoft SharePoint 2010 Ribbon UI SharePoint Workspace SharePoint Mobile Office Client and Office Web App Integration Standards Support Business Connectivity Services InfoPath Form Services External Lists Workflow SharePoint Designer Visual Studio API Enhancements REST/ATOM/RSS Sites Tagging, Tag Cloud, Ratings Social Bookmarking Blogs and Wikis My Sites Activity Feeds Profiles and Expertise Org Browser Communities Composites PerformancePoint Services Excel Services Chart Web Part Visio Services Web Analytics SQL Server Integration PowerPivot Content Insights Enterprise Content Types Metadata and Navigation Document Sets Multi-stage Disposition Audio and Video Content Types Remote Blob Storage List Enhancements Search Social Relevance Phonetic Search Navigation FAST Integration Enhanced Pipeline

35. Architecture and Design

37. http services

38. Search query

39. Scaling

40. Add servers to load balanced cluster

41. Performance Optimization

42. RAM

43. Easily virtualizedServer Farm – Web Front End 14

45. Search index/crawl

46. Excel calculation

47. User profiles

48. Managed Metadata

49. Scaling

50. Add search servers and partitions

51. Move shared services to dedicated servers

52. Performance Optimization

53. CPUServer Farm - Application Server 15

55. Data storage

56. SQL Reporting

57. Scaling

58. Add storage capacity

59. Performance Optimization

60. Disk I/OServer Farm - Database 16

62. Small teams

63. Small pools of documents

64. Considerations

65. Performance & fault tolerance less of a concern

66. SQL & Web on same system

67. Search not a core functionSizing - Single Server

69. 100-10,000 users

70. 10,000 – 1MM documents

71. Scenarios

72. Enterprise portal

73. Large scale collaboration

74. Broader applications platform

75. Larger external search pool

76. Mix and match internal external front end servers on common content databasesSizing - Medium Farm

78. Large distributed enterprise users (10000+)

79. Large pools of documents (>1MM)Sizing - Large Farm

81. Web applications

82. Independent top level URLs

83. Run inside IIS pools

84. Consume shared services and admin from the farm or other farms

85. Site collections

86. Security, branding, database frontier

87. Contain single sites or site hierarchies

88. Sites

89. Group related SharePoint elements (lists, libraries, pages, web parts)Top Level Logical Components 20

91. Maximums

92. 250,000 sites per site collection

93. 5,000 site collections per content DB

94. 200GB max content DB (single site collection)

95. >200GB post SP1

96. 300 Content DBs per web application

97. 30MM documents/library

98. 2GB document size22

100. For DBs, don’t forget to consider transaction logs, disk dumps (if used for backup) which can add 1-3X.

102. WFE Load balanced clusters Internal – external isolation 500-1000 simultaneous users Application Indexes Redundant Distribute Queries Database Cluster Mirroring Log Shipping EBS or RBS Server Counts - Redundancy

103. Sidebar on SQL Disk optimization RAID 1: Mirroring (Wastes disk) RAID 5: Parity Bit (write performance hit) RAID 10 Stripes across mirrors (costly) Physical location of data, log, temp and/or backup files. If virtualization or SAN technology doesn’t isolate the disks, not much performance gain, Performance optimization/fault tolerance by: RAID1 on boot disks RAID5 on data disks RAID10 on log disks No RAID, or RAID 5 on backup disks RBS reduces size (and count) of content databases but doesn’t reduce size of total storage IOPS, IOPS, IOPS! Psst…about SQL…

104. Classic Zones mapped Single URL for each authentication method: e.g. Default: Windows Forms (LDAP, SQL, ADAM) Generate an NTToken to represent SPUser Claims Unified URL Multiple sources (Windows, FBA, SSO) combine to generate a single SAML token to represent SPUser Authentication Architecture 27

105. Authentication ScenariosMixed Mode https://extranet.domain.com Extranet Zone Intranet Zone http://intranet FBA claims Windows claims Remote Employees Employees

106. Traditional Inexpensive Simple Only one firewall External traffic comes inside internal network Internet Topology – Edge Firewall

107. More complex Duplicative networks, backup, AD External traffic is reserved Larger server foot print (exposure) in perimeter Internal users need domain trusts Internal users access site across firewall Internet Topology – Perimeter

108. Most complex Intricate firewall rules App, AD and search roles optionally in perimeter Optional internal WFE or internal users always cross a firewall Crawl topologies important to avoid overtaxing the firewall Internet Topology – Split Back to Back

109. Multi-farm SSA farm Content publishing Internet Topology – Enhanced Techniques

111. Mail Relay

112. Indexed search contentOther Systems FAST (Search) Project Server / TFS BizTalk LoB/Dynamics Oracle (BCS) Notes (Search) Wikis and other indexed web sites Common Integration Touchpoints

113. SharePoint Family Platforms

114. SharePoint 2010 is a 64 bit only platform. Direct upgrades from 32 bit to 64 bit requires prep work. Windows Server 2008 or Windows Server 2008 R2 X64 SQL Server 2005 x64 SP3 CU3 Or SQL Server 2008 x64 SP1 CU2 Or SQL Server 2008 R2 Platform Basics

115. 2007 Shared Services Provider has been broken up; each of its elements is now a Shared Service Application Mix and match them singly or in groups, to match farm’s needs. Crawl/index no longer a single server role In 2010, administration can be delegated Key targets: Enterprise search, metadata, user profiles Shared Service Applications

116. Internet Explorer 7/8/9, Firefox and Safari are all supported. Some support for Chrome IE6 is not supported Most other browsers are still supported for Internet configurations Office 2010 includes optimizations for the new platforms Offline Access 2007: used Outlook 2007 and Groove SharePoint Workspace 2010 integrates offline documents and lists Client/Browser Technology

117. SharePoint 2010 provides a server version of Office applications – Office Web Access, or “OWA”. In part, this enables simultaneous multiuser editing of Office documents: Excel in OWA, not client Word/PowerPoint on client only if file opened from a shared document library OneNote client or OWA Office Web Applications

118. Installation and Upgrade

119. Servers: Windows 2008 R2 X64 Enterprise Edition SQL Server 2008 R2 x64 Service Accounts spfarm(Farm acct; local admin on the SharePoint servers and either sa or dbcreate, dbowner and security admin on the SQL server.) svcsql (SQL Server service acct) sppool (IIS pool acct) spcrawl (Search accts) spadmin Interactive admin (install account; local, site collection and farm admin privileges) Install as SPAdmin Install Software Prerequisites - Checks for following elements: Application Server Role, Web Server (IIS) Role, Microsoft SQL Server 2008 Native Client, Hotfix for Microsoft Windows (KB976462), Windows Identity Foundation (KB974405), Microsoft Sync Framework Runtime v1.0 (x64), Microsoft Chart Controls for Microsoft .NET Framework 3.5, Microsoft Filter Pack 2.0, Microsoft SQL Server 2008 Analysis Services ADOMD.NET, Microsoft Server Speech Platform Runtime (x64), Microsoft Server Speech Recognition Language - TELE(en-US), SQL 2008 R2 Reporting Services SharePoint 2010 Add-in Installation - Prerequisites

120. Initial Product Key Type of installation - Always SERVER FARM Installation Type - Complete [Not Single Server] Accept default file locations – index files will stay on C:rogram Filesicrosoft Office Servers4.0ata At end NO Wizard Run OWA Setup Then, WIZARD! The wizard starts, and yes, it’s OK for IIS to reset during the wizard… Create a new farm Set farm account Pick configuration database, Passphrase, CentralAdmin Port (Conventions) Final confirm and let the wizard run Installation

121. Pros Easy All SSAs Configured Saves time and PowerShell hand tooling of SSAs Cons My Sites setup in same app and DB as primary Database Names are default, GUID happy Kills kittens (ask SharePoint 911!) What it does Sets up service acct for SSAs and other services (sppool) Sets up a port 80 web app with a My Sites Host sub-site collection in WSS_Content database Installation – Farm ConfigWizard?

122. Three paths In place Database upgrade Third party tools Process Pre-upgrade checker Visual Upgrade Resumable upgrade Progress reports Parallel DB upgrades Predictable Upgrade

123. Additional Prepwork Content pruning Database alignment stsadm-o mergecontentdbs DB Attach Preinstall Required Features Stsadm –o addcontentdb –databasename DBNAME –url URL –assignnewdatabaseid PowerShell Mount-ContentDatabase Test, test, test! Upgrade Preparation

124. SharePoint 2007 SP2 minimum, October 2009 CU best STSADM.exe –o preupgradecheck Documentation All servers and components in the farm, and whether the servers meet 64-bit hardware/OS requirements Alternate access mapping URLs A list of all site definitions, site templates, features, and language packs that are installed in the farm. Unsupported farm customizations (such as database schema modifications). Database or site orphans Missing or invalid configuration settings in the farm (missing Web.config file, invalid host names, invalid service accts). Whether the databases meet the requirements — for example, databases are set to read/write, and any databases stored in Windows Internal Database and larger than 4 GB. Pre-Upgrade Check

125. Switch-on new UI across site collections in a controlled manner Upgrade servers without changing the user interface Preview new UI Pre-release screenshots, subject to change IT Pro Investments – Visual Upgrade

127. Developer Dashboard Empower developers and users Integrated Health Analyzer Runs when necessary Alerts anomalies Fixes when it can Web Analytics User usage Resource usage Proactive Issue Resolution

128. Logging, Monitoring, and AlertsKnow what is going on ULS Logs Windows Events Unified Logging Out-of-the-box reports Richer Web Analytics Open Schema SCOM Integration PLUS Developer Dashboard Health Analyzer Logging DB Page requests Feature Logging Health data

129. Monitoring SCOM Central Admin Health Analyzer Site Collection Web Analytics Developer Dashboard stsadm –o setproperty –pn developer-dashboard –pv OnDemand (Get-SPFarm).PerformanceMonitor.DeveloperDashboardLevel = "OnDemand" Troubleshooting Correlation ID – One GUID to rule them all! ULS Logs, Event Logs, Performance Monitor OR WSS_Logging DB Monitoring – General

130. Developer Dashboard Improve customized solutions with the Developer Dashboard SQL Queries Performance Memory Usage Data-Request Trace Pre-release screenshots, subject to change

131. Query Database Views Directly Requires Timer Jobs Enabled Diagnostic Data Provider: Trace Log Diagnostic Data Provider: Event Log ULS Configuration Matters Database will GROW! Aggregates from ALL Servers Sample: SELECT * FROM [WSS_Logging].[dbo].[ULSTraceLog] WHERE CorrelationID = '04377DAE-C2FD-4DBE-A57E-101B3005059E' Monitoring – WSS_Logging

132. Third Party Tools Recycle Bin Granular / Site Collection Backup (UI) *.bak file Restore-SPSite Unattached Recovery Browse unattached content database Account needs DB permissions Database need not be on the same server! No more granular than list or library! Browse Content Export Site or List Export as a CMP file PowerShell restore PS: Import-SPWeb http://msshome2010 –Path C:istRecovery.cmp SQL Backup SharePoint Backup (UI or script) Backup/Recovery

133. @echo off echo ================================================== echo Backup the farm echo ================================================== @SET stsadm="C:rogram Filesommon Filesicrosoft Sharedeb Server Extensions2INtsadm" rmdir /S /Q "spsql08pbackuparmold" ren "spsql08pbackuparm" "farmold" md "spsql08pbackuparm" %stsadm% -o backup -directory "spsql08pbackuparm" -backupmethod full echo complete STSADM Backup

134. # NOT NEEDED write-output write-host ================================================== write-host Backup the farm write-host ================================================== Add-PSSnapIn Microsoft.SharePoint.Powershell Remove-Item -Path "C:SBackuparmold“ -recurse Rename-Item -Path "C:SBackuparm" -NewName "farmold" New-Item -type directory -path C:SBackuparm Backup-SPFarm -directory "C:SBackuparm" -backupmethod full –verbose –percentage 5 Write-host Backup complete PowerShell Backup

135. SharePoint Shell vs. Base Shell Add-PSSnapin Microsoft.Sharepoint.Powershell Command -? Get-Help Command Get-Help Command –examples Pipe Get-Command –Noun SP* Get-Command – Noun SP* | Select Name Get-Command – Noun SP* | Select Name | Out-File Commands.txt Get-SPSite –limit all | Get-SPWeb –limit all | Select URL, webtemplate | Out-GridView WindowsPowerShell Integrated Scripting Environment to allow Out-GridView PowerShell

136. Visual Update a range of sites: Site Backup Add MMS Term Some Useful PowerShell Snippets

137. Create and configure a library Some Useful PowerShell Snippets II

138. Visual Studio 2010 Support Import solutions from SharePoint Designer, including Workflow Extensibility for SharePoint artifacts Support for SharePoint Sandboxed Solutions Workflow Designer Web PartDesigner Packaging Explorer Pre-release screenshots, subject to change

139. Project and Item Templates Templates for many SharePoint elements Support for sandboxed solutions Visual Designers Design web parts Build Business Data Connectivity (BDC) models Create Workflows Workflow Enhancements Site level workflows Templates for association & initiation forms Deploy/debug directly from IDE Visual Studio 2010 Support Templates and designers

140. Development Continuum Professional developer Business Analyst/Process Designer Designer/IW/Power User Import Create lists & libs Design Web Pages Web part hook-up Views & forms Declarative Workflows Custom Web Parts Code Workflows Event Receivers List Definitions Application Pages Design skeleton workflow processes View workflow visualizations Design data-backed business diagrams WSP Package Export

142. Event Receivers

143. Feature Activation Receivers

144. Workflow Actions

145. InfoPath Forms

147. SQL Execution Time

149. Scale OutPre-Beta screenshots, subject to change

150. CA | Application Management Manage Quotas and Locks (Also where you can set a site collection read-only) Daily quota is 300 points includes AbnormalProcessTerminationCount, CPUExecutionTime, CriticalExceptionCount, InvocationCount, PercentProcessorTime, ProcessCPUCycles, ProcessHandleCount, ProcessIOBytes, ProcessThreadCount, ProcessVirtualBytes, SharePointDatabaseQueryCount, SharePointDatabaseQueryTime, UnhandledExceptionCount, UnresponsiveprocessCount Reconfigure values via PowerShell (unlikely) Examine them using: [Microsoft.SharePoint.Administration.SPUserCodeService]::Local.ResourceMeasures Development Support –Sandbox

151. Development Support – Three Regions

153. Developer Dashboard

154. Health Analyzer

156. IIS Bit Rate Throttling (Video) Part of IIS Media Services 2.0 or greater Download http://www.iis.net/download/BitRateThrottling Configured through IIS Manager Large File Upload Support: Central Admin: 600MB Upload Size IIS7 Connection Timeout 65536 seconds Web app web.config = change line to <httpRuntime maxRequestLength="2097151" executionTimeout="999999" /> in 14hiveemplateayoutseb.config, change above line to same Finally, as per http://support.microsoft.com/kb/944981/en-us add section to web.config to allow 600MB content length (it’s a new requirements in IIS7). <system.webServer> <security> <requestFiltering> <requestLimits maxAllowedContentLength="629145600"/> </requestFiltering> </security> Optimization

157. Disk-based BLOB Caching Local store for audio/video, PDF other frequent read only files Edit in Web.config (C:netpubwwrootssirtualdirectories..) <BlobCache location="" path="(gif|jpg|jpeg|jpe|jfif|bmp|dib|tif|tiff|ico|png|wdp|hdp|css|js|asf|avi|flv|m4v|mov|mp3|mp4|mpeg|mpg|rm|rmvb|wma|wmv)$" maxSize="10" enabled="false" /> Location = Local Disk Location maxSize = GB Enabled = true Different from RBS/EBS! Find Sean McDonough Optimization

158. Patching – High Level Process

159. Backups Local Disk – easy but storage intensive Agents – remote, requires extra software RBS Maintenance BLOB Orphans Log Sizing Full logged (default) generates huge t-logs Simple doesn’t but prevents point in time restore Maintenance Plans SQL Maintenance

160. Add PDF image support Add pdf16.gif to 14HiveEMPLATEMAGES [spare copy from http://www.adobe.com/misc/linking.html ] Add references to the images in 14HiveEMPLATEMLOCICON.XML <Mapping Key="pdf" Value="pdf16.gif"/> IISRESET Add PDF to file type in Search SSA Add Adobe 64 bit PDF iFilter: http://www.adobe.com/support/downloads/detail.jsp?ftpID=4025 Large File Upload Support: [Defined Later] Activity Feed Timer Job 14Hive = C:rogram Filesommon Filesicrosoft Sharedeb Server Extensions4 14Hivein on Environment Path Disable the loopback check In Registry Editor, locate and then click the following registry key: HKEY_LOCAL_MACHINEYSTEMurrentControlSetontrolsa Right-click Lsa, point to New, and then click DWORD Value. Type DisableLoopbackCheck, and then press ENTER. Set Value = 1, and then click OK. Quit Registry Editor, and then restart your computer. Make search service topology (crawl, index, query) redundant Post Installation Best Practices

161. Best Practices

162. Users Receive “Cannot Connect to Configuration Database” Web Page SharePoint farm account is locked out No one can upload anything but site is up Database disk volume is full – check transaction logs, backups In virtualized environment, host file systems may be full I can’t find a document I think I should see; Someone can’t see a file I just uploaded Security and permission variations Document “movement” (a/k/a ECM) try search by name or Document ID. Check ECM logs/audits Confirm permissions, and make sure document is checked in (Required properties may be missing) Troubleshooting – Top Support Questions

163. Repeated requests to re-enter Windows credentials Add to Local intranet zone, add site, custom level, automatic login with current user name and password (it’s the last thing in the item list) OR Trusted sites My workflow didn’t start Recycle timer service “FixSharePoint.exe” = IISReset & Timer Service Recycle I’m not seeing the right search results Confirm that crawls are running and complete by checking crawl logs; restart a full crawl if crawls finish OK I need a file back that I deleted Recycle Bin Recovery Use Backup & Restore Troubleshooting – More Support Questions

164. Bad web parts on page ?Contents=1 on end of URL HyperV & DiskPart From the run menu type "diskpart.exe" to enter the command line utility to resize disk partitions in Windows Server 2003. The command list volume will show you all the available volumes. Select your volume as shown below. select volume 1 corresponds to the "D" volume. Extend the volume with the extendcommand; the partition will be immediately extended under the Disk Management snap in. User Profile Sync DirSync permissions in AD are essential (Replicating Directory Changes ) PSCONFIG for a stuck wizard psconfig.exe -cmd upgrade -inplace b2b -wait 14HIVEin on PATH How big is that site collection anyway? Site Settings | Site Collection Analytics | Scroll down to Inventory and choose Storage Usage How do I make a bigger template? stsadm -o setproperty -propertyname max-template-document-size -propertyvalue size_in_bytes Save site as template To save any site as a template, just go to Site Actions | Site Settings | Save Site as template. This saves the site as a standard .WSP package in the Site Collection Solutions Gallery (/_catalogs/solutions/Forms/AllItems.aspx) Auditing In Central Admin | Security, configure Information Management Policy (/_admin/Policyfeatures.aspx). Make sure Auditing is Available At the Site Collection Audit Settings screen (in Site Collection Administration) select the events you want to audit Site Setting | Site Collection Administration | Audit Log Reports Service Account Management in Central Admin Security | Managed Service Accounts When all else fails – web.config!!!! Miscellaneous Tips and Tricks

165. Where Governance Begins? Higher Visibility Lighter governance

166. SharePoint 2010 provides more opportunities, and more importance for reengaging users and sponsors about governance issues than before Major tools Sandbox code Query governors SharePoint Designer Now free (since 2008) Allowed or denied or restricted - PlaceholderMain Social tagging and ratings I like it/I hate it Ratings and adverse feedback ECM Records management - In place vs. Record Center Content Organizer etc. Who controls the lifecycle? Quotas Who gets a site? Governance

167. Seven Deadly Sins for the SharePoint Professional

168. No SQL maintenance plans Default names for every database (WSS_CONTENT_12345abc…) No patching One environment for everything One acct for everything Single server install with SQL Express Runaway content database size Seven Deadly Sins

169. Seven Virtues for the SharePoint Professional

170. Security Applied via AD Groups and SharePoint Groups Review System Health Test Restore and Recovery Monthly Web Analytics Review – Usage, Storage, Search PowerShell instead of STSADM Governance Use ECM, MMS, Clients, Archiving and Training to Keep Content in SharePoint, reduce accidental duplication and keep searching and browsing fresh Seven SharePoint Virtues

172. And now

173. You understand:

174. Design and Architecture

175. Installation and Upgrade

176. Support and Maintenance and Optimization

177. PowerShell

178. Customizations

179. Troubleshooting

180. Best Practices

181. People from New York?Congratulations!

183. SharePoint 2010 site: http://sharepoint.microsoft.com

184. SharePoint Team Blog: http://blogs.msdn.com/sharepoint/default.aspx

185. From KMAWebinars, white papers and blogs at www.kma-llc.net From Me: SharePoint Saturday the Conference Saturday 9:30am S1A-101 - A decade of SharePoint Adoption Best Practices Saturday 11:30am S2B-104 - See Beyond The Numbers: Data Visualization & BI in SharePoint 2010 Saturday 3:00pm S4A-101 Playing Tag - Managed Metadata and Taxonomies in SharePoint 2010 New Jersey SharePoint User Group September 14 (Business Intelligence) SharePoint Saturday NH – September 24, 2011 (Business Intelligence) KMWorld DC October 2011 (IT) Resources

187. Evaluations

188. Contact Me

190. Thanks to Our Other Sponsors! Thanks to our Sponsors

191. Session Evaluation Please complete and turn in your Session Evaluation Form so we can improve future events. Survey can be filled out at: http://app.fluidsurveys.com/s/spstc2011-Fri-S5A-104 Presenter: Chris McNulty Session Name: SharePoint SpeedMetal [75 Minute Admin] Session No.: S5A-104