SlideShare une entreprise Scribd logo
1  sur  21
Télécharger pour lire hors ligne
Performing successful
migrations to the
Microsoft Cloud
CD36 • Andries den Haan • @awdhaan
Platinum sponsors
Gold sponsors
Silver sponsors
Community sponsor
Code of Conduct
As event and experience organizers, we seek to provide a respectful, friendly, professional experience for
everyone, regardless of gender, sexual orientation, physical appearance, disability, age, race or religion.
We do not tolerate any behavior that is degrading to any gender, race, sexual orientation, or disability, or any
behavior that would be deemed harassment or discrimination.
Individuals are responsible for knowing and abiding by our standards and we encourage everyone to assist in
creating a welcoming and safe environment. Please report any concerns, suspicious or disruptive activity or
behavior to the organizing team, so that we can address the issue immediately.
More information can be found on the CollabDays Benelux website at
https://www.collabdays.org/2020-benelux-online/about/
A brief personal introduction
• Working in technology since 1999
• Currently as a Cloud Solution Architect at Wortell, which is an awesome
company
• Previously: Pink Elephant, PinkRoccade, Getronics, Ordina, KPN
Consulting & ETTU
• Crazy about technology that connects people
• Focus on Business & IT Alignment:
o Governance & security
o Use of Best practices
• Certified Microsoft Office 365 technology expert
• Proudly addicted to (large-scale) migrations ☺
Andries.den.Haan@wortell.nl
Twitter: @awdhaan
Blog: www.tribework.nl
What you can expect from this session
Focus on technology
opposed to other
project streams
Fuzzy blend of slides
& demos when
you’re neck-deep
into migrations
Inspiration on how to
handle and admin
your large-scale
scenarios
Getting the latest
info on what is
happening around
tools and approaches
(excluding Mover)
Sharing some
experiences from
previous projects
This is not a 101
session
Advice from the
Microsoft and
ShareGate product
teams
Some (PnP)
PowerShell, fun and
interaction! ☺
Session agenda
• Getting the best migration performance
• Gathering metrics from your migrations
• How to proof migrations were done in full
• Automating like a boss
• Tenant-2-tenant migrations for Microsoft Teams.
Some fundamental
recommendations
• Choose the right tool for the job (the list below is based on previous experiences):
• SharePoint Migration Tool (SharePoint, file shares, PowerShell-driven)
• Migration Manager (file shares, scalable, new features coming later)
• Migrate through the SharePoint Online PowerShell module > Walkthrough
• ShareGate:Desktop
• AP Elements Fly
• Register ShareGate:Desktop (if used) as an Azure AD Desktop application
• Also use PnP PowerShell Azure AD App registration (which is now super easy) for improved
performance during pre- or postmigration actions (also to workaround ADFS/MFA-issues) -> Demo
PnP PowerShell Azure AD App registration Demo summary
• Use the latest PnP PowerShell release which includes a bug fix when using PowerShell ISE
• Run Initialize-PnPPowerShellAuthentication as a Global Administrator
• Give consent for the required permissions
• Import the certificate into the local certificate store including the private key
• Store the Client Id and Certificate Thumb in the Windows Credential store
• Authenticate using the new Azure AD App credentials.
Recommendations from the Microsoft & ShareGate:Desktop product
teams:
• Limit to 200-300K files per migration to keep things manageable
during the ‘Azure hop’
• Don’t migrate large amounts to a single site. Sites per organization
(2.000.000) is sufficient, so plenty of room to split up data
• Limit the amount of simultaneous operations
• For typical office file share migrations (~1.5 MB/file), 1 TB/day should
be feasible
• Throttling is less outside of typical business hours. Daytime migration
are still possible, but with a little bit more throttling.
Sizing your migrations is key
Ground rules: keep it simple
• Data needs to be copied from A to B, that’s all!
• Avoid pre- or postmigration script actions to
beautify or tidy the folder structure
(especially with large-scale file shares)
• Don’t migrate (granular) permissions. People work
differently in the target-environment, so that
same applies to authorizations.
Incremental vs. delta-migrations?
• Incremental migrations compares each file in source and destination
which can be really time consuming with large amounts of files
• Delta migrations are faster as these use date filters to only overwrite
files that were added or modified since the last full migration.
Initial full migration “Delta” migration
Register the start time
End-users continue to work in the source environment
Migrate in “Overwrite”-mode using
the date filter
Content freeze in the source
Why should you care about gathering metrics
from your migrations?
• Especially relevant for large-scale migrations
• All activities cost time, but how much by average?
• How much data can be migrated within e.g. a day?
• It can help you to determine a baseline.
Comparing some popular tools on metrics
ShareGate:Desktop
• Summary reporting is limited
to ItemsCopied, Successes,
Warnings and Errors
• Detailed reports can become
difficult to process for large
amounts of data, although
still valuable. Especially,
when exporting to CSV.
SharePoint Migration Tool
• Summary reporting is
surprisingly useful -> Demo
• GB/Hour metric
• GB in source and migrated
• Item-level summaries are
also included -> Demo.
Migration manager
• Similar reporting as SharePoint
Migration Tool
• Currently manual download from
the SharePoint Admin Center
(this will change soon).
Migration
Manager
How to proof that you’re done
• In addition to migration reports, item count comparison
shows if all in scope was copied as expected
• PowerShell to the rescue as always
• Consider UNC path length limitations in scripting logic
• Consider 5.000 item query limit when programmatically
querying the list
• Distinguish between files and folders
• Use a loop and function approach to populate e.g. a csv-
based report
• Demo!
Automating like a boss
• Why? Because the administration
can be time consuming with large
amounts of data
• Stakeholders expect (near) real-time
progress reporting
• It should be one of your goals as a
migration admin to spend the least
amount of time on administration.
• Alternate approach when you are working on large-scale migrations
with 10.000’s of users and multiple Terabytes of data
• Data-model can be easily created using Visual Studio and published
to Azure
• Use common PowerShell functions to execute stored procedures to
Create, Read, Update or Delete data through PowerShell
• Link scripts to scheduled tasks
• Works when using e.g. SPMT or ShareGate as these tools have
sufficient PowerShell support
• Use email as a means of notifying the migration admin about errors
(could also be used to inform data owners on migration start/end)
• Simplified walkthrough and demo of a Data Migration Factory.
Stepping up from CSV’s to databases
Error
notification
using
PowerShell
Data Migration Factory High level architecture
• Inventory clients importing
data for each organizational
entity into the database
• Batches are created and
assigned to file shares and
migration servers to
distribute the load
• Scheduled console apps poll
the database for any batch-
items that needs to be
processed and trigger the
PowerShell scripts using the
record Id as the only
parameter
• Integrated reporting through
database queries.
Migration
database
SharePoint
2013
SharePoint
2010
Filers
Inventory clientInventory client
Migration servers
PS
SharePoint Online
Microsoft Teams
Reporting
Inventory client
Migrating Teams tenant-2-tenant
• Copy Channels (conversations and files), Tabs and Apps
• Some limitations apply (more on support articles):
• Migrations are limited to the last 50 messages including replies. All other messages
are stored in an HTML archive page (tab)
• Meeting URL’s are tenant-specific, so recreate meetings after migration
• Private channel (files, not conversations) can be difficult to migrate
• ShareGate is doing a great job, supports PowerShell (GUI is currently
richer) for this and will extend their capability soon:
• Choosing specific channels to migrate
• Merge into existing Teams.
Let’s wrap-up this session…
• Slides will be shared
• Script examples available upon request
• Check my blog for upcoming posts
• Contact me for any questions or comments ☺
Thank you!

Contenu connexe

Tendances

SPS Chevy Chase Tips on migrating to Office 365
SPS Chevy Chase Tips on migrating to Office 365SPS Chevy Chase Tips on migrating to Office 365
SPS Chevy Chase Tips on migrating to Office 365Mike Maadarani
 
Oracle GoldenGate and Apache Kafka A Deep Dive Into Real-Time Data Streaming
Oracle GoldenGate and Apache Kafka A Deep Dive Into Real-Time Data StreamingOracle GoldenGate and Apache Kafka A Deep Dive Into Real-Time Data Streaming
Oracle GoldenGate and Apache Kafka A Deep Dive Into Real-Time Data StreamingMichael Rainey
 
Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...
Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...
Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...Lucas Jellema
 
SQL to NoSQL: Top 6 Questions
SQL to NoSQL: Top 6 QuestionsSQL to NoSQL: Top 6 Questions
SQL to NoSQL: Top 6 QuestionsMike Broberg
 
ADDO 2021: Why and how to include database changes in the deployment pipeline
ADDO 2021: Why and how to include database changes in the deployment pipelineADDO 2021: Why and how to include database changes in the deployment pipeline
ADDO 2021: Why and how to include database changes in the deployment pipelineEduardo Piairo
 
SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...
SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...
SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...Patrick Guimonet
 
Data Con LA 2018 - Streaming and IoT by Pat Alwell
Data Con LA 2018 - Streaming and IoT by Pat AlwellData Con LA 2018 - Streaming and IoT by Pat Alwell
Data Con LA 2018 - Streaming and IoT by Pat AlwellData Con LA
 
Data Lake and the rise of the microservices
Data Lake and the rise of the microservicesData Lake and the rise of the microservices
Data Lake and the rise of the microservicesBigstep
 
SQL Server 2017 Enhancements You Need To Know
SQL Server 2017 Enhancements You Need To KnowSQL Server 2017 Enhancements You Need To Know
SQL Server 2017 Enhancements You Need To KnowQuest
 
Designing a Real Time Data Ingestion Pipeline
Designing a Real Time Data Ingestion PipelineDesigning a Real Time Data Ingestion Pipeline
Designing a Real Time Data Ingestion PipelineDataScience
 
Share point 2013 enterprise search (public)
Share point 2013 enterprise search (public)Share point 2013 enterprise search (public)
Share point 2013 enterprise search (public)Petter Skodvin-Hvammen
 
VTU 6th Sem Elective CSE - Module 4 cloud computing
VTU 6th Sem Elective CSE - Module 4  cloud computingVTU 6th Sem Elective CSE - Module 4  cloud computing
VTU 6th Sem Elective CSE - Module 4 cloud computingSachin Gowda
 
Cloudant Overview Bluemix Meetup from Lisa Neddam
Cloudant Overview Bluemix Meetup from Lisa NeddamCloudant Overview Bluemix Meetup from Lisa Neddam
Cloudant Overview Bluemix Meetup from Lisa NeddamRomeo Kienzler
 
Apache Kafka and the Data Mesh | Ben Stopford and Michael Noll, Confluent
Apache Kafka and the Data Mesh | Ben Stopford and Michael Noll, ConfluentApache Kafka and the Data Mesh | Ben Stopford and Michael Noll, Confluent
Apache Kafka and the Data Mesh | Ben Stopford and Michael Noll, ConfluentHostedbyConfluent
 
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part20812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2Raul Chong
 
Chicago HUG Presentation Oct 2011
Chicago HUG Presentation Oct 2011Chicago HUG Presentation Oct 2011
Chicago HUG Presentation Oct 2011Abe Taha
 
It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...
It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...
It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...Lucas Jellema
 

Tendances (20)

SPS Chevy Chase Tips on migrating to Office 365
SPS Chevy Chase Tips on migrating to Office 365SPS Chevy Chase Tips on migrating to Office 365
SPS Chevy Chase Tips on migrating to Office 365
 
Oracle GoldenGate and Apache Kafka A Deep Dive Into Real-Time Data Streaming
Oracle GoldenGate and Apache Kafka A Deep Dive Into Real-Time Data StreamingOracle GoldenGate and Apache Kafka A Deep Dive Into Real-Time Data Streaming
Oracle GoldenGate and Apache Kafka A Deep Dive Into Real-Time Data Streaming
 
Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...
Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...
Oracle OpenWorld 2016 Review - High Level Overview of major themes and grand ...
 
SQL to NoSQL: Top 6 Questions
SQL to NoSQL: Top 6 QuestionsSQL to NoSQL: Top 6 Questions
SQL to NoSQL: Top 6 Questions
 
introduction v4
introduction v4introduction v4
introduction v4
 
ADDO 2021: Why and how to include database changes in the deployment pipeline
ADDO 2021: Why and how to include database changes in the deployment pipelineADDO 2021: Why and how to include database changes in the deployment pipeline
ADDO 2021: Why and how to include database changes in the deployment pipeline
 
slides
slidesslides
slides
 
SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...
SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...
SPS Barcelona 2015 - Real world scenarios to migrate to SharePoint 2016 or Of...
 
Data Con LA 2018 - Streaming and IoT by Pat Alwell
Data Con LA 2018 - Streaming and IoT by Pat AlwellData Con LA 2018 - Streaming and IoT by Pat Alwell
Data Con LA 2018 - Streaming and IoT by Pat Alwell
 
Data Lake and the rise of the microservices
Data Lake and the rise of the microservicesData Lake and the rise of the microservices
Data Lake and the rise of the microservices
 
Tableau API
Tableau APITableau API
Tableau API
 
SQL Server 2017 Enhancements You Need To Know
SQL Server 2017 Enhancements You Need To KnowSQL Server 2017 Enhancements You Need To Know
SQL Server 2017 Enhancements You Need To Know
 
Designing a Real Time Data Ingestion Pipeline
Designing a Real Time Data Ingestion PipelineDesigning a Real Time Data Ingestion Pipeline
Designing a Real Time Data Ingestion Pipeline
 
Share point 2013 enterprise search (public)
Share point 2013 enterprise search (public)Share point 2013 enterprise search (public)
Share point 2013 enterprise search (public)
 
VTU 6th Sem Elective CSE - Module 4 cloud computing
VTU 6th Sem Elective CSE - Module 4  cloud computingVTU 6th Sem Elective CSE - Module 4  cloud computing
VTU 6th Sem Elective CSE - Module 4 cloud computing
 
Cloudant Overview Bluemix Meetup from Lisa Neddam
Cloudant Overview Bluemix Meetup from Lisa NeddamCloudant Overview Bluemix Meetup from Lisa Neddam
Cloudant Overview Bluemix Meetup from Lisa Neddam
 
Apache Kafka and the Data Mesh | Ben Stopford and Michael Noll, Confluent
Apache Kafka and the Data Mesh | Ben Stopford and Michael Noll, ConfluentApache Kafka and the Data Mesh | Ben Stopford and Michael Noll, Confluent
Apache Kafka and the Data Mesh | Ben Stopford and Michael Noll, Confluent
 
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part20812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
 
Chicago HUG Presentation Oct 2011
Chicago HUG Presentation Oct 2011Chicago HUG Presentation Oct 2011
Chicago HUG Presentation Oct 2011
 
It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...
It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...
It's a wrap - closing keynote for nlOUG Tech Experience 2017 (16th June, The ...
 

Similaire à Performing successful migrations to the microsoft cloud

O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...NCCOMMS
 
SPTechCon Austin - The Slippery Slope of SharePoint Migrations
SPTechCon Austin - The Slippery Slope of SharePoint MigrationsSPTechCon Austin - The Slippery Slope of SharePoint Migrations
SPTechCon Austin - The Slippery Slope of SharePoint MigrationsJill Hannemann
 
One101 double the trouble double the fun_ migrating to one_drive and sharepoi...
One101 double the trouble double the fun_ migrating to one_drive and sharepoi...One101 double the trouble double the fun_ migrating to one_drive and sharepoi...
One101 double the trouble double the fun_ migrating to one_drive and sharepoi...Craig Jahnke
 
SPUnite17 Migrating to SharePoint Online Fast Track
SPUnite17 Migrating to SharePoint Online Fast TrackSPUnite17 Migrating to SharePoint Online Fast Track
SPUnite17 Migrating to SharePoint Online Fast TrackNCCOMMS
 
Making the Transition from the Suite to the Hub
Making the Transition from the Suite to the HubMaking the Transition from the Suite to the Hub
Making the Transition from the Suite to the HubJerika Phelps
 
Making the Transition from the Suite to the Hub
Making the Transition from the Suite to the HubMaking the Transition from the Suite to the Hub
Making the Transition from the Suite to the HubBlack Duck by Synopsys
 
How to prepare your site for content migration
How to prepare your site for content migrationHow to prepare your site for content migration
How to prepare your site for content migrationBlend Interactive
 
ActiveMigrate - ECM Renovation Roadshow
ActiveMigrate - ECM Renovation RoadshowActiveMigrate - ECM Renovation Roadshow
ActiveMigrate - ECM Renovation RoadshowZia Consulting
 
Data Vault Automation at the Bijenkorf
Data Vault Automation at the BijenkorfData Vault Automation at the Bijenkorf
Data Vault Automation at the BijenkorfRob Winters
 
Migrating on premises and cloud contents to SharePoint Online at no cost with...
Migrating on premises and cloud contents to SharePoint Online at no cost with...Migrating on premises and cloud contents to SharePoint Online at no cost with...
Migrating on premises and cloud contents to SharePoint Online at no cost with...Juan Carlos Gonzalez
 
Making the Transition from Suite to the Hub
Making the Transition from Suite to the HubMaking the Transition from Suite to the Hub
Making the Transition from Suite to the HubBlack Duck by Synopsys
 
Collab 365 - Real world scenarios to migrate to SharePoint 2016 or Office 365
Collab 365 - Real world scenarios to migrate to SharePoint 2016 or Office 365Collab 365 - Real world scenarios to migrate to SharePoint 2016 or Office 365
Collab 365 - Real world scenarios to migrate to SharePoint 2016 or Office 365Patrick Guimonet
 
Automation options with Office 365
Automation options with Office 365Automation options with Office 365
Automation options with Office 365Robert Crane
 
Acceleration Technology: Taking Media File Transfers From Days to Minutes
Acceleration Technology: Taking Media File Transfers From Days to MinutesAcceleration Technology: Taking Media File Transfers From Days to Minutes
Acceleration Technology: Taking Media File Transfers From Days to MinutesFileCatalyst
 
Deliver Best-in-Class HPC Cloud Solutions Without Losing Your Mind
Deliver Best-in-Class HPC Cloud Solutions Without Losing Your MindDeliver Best-in-Class HPC Cloud Solutions Without Losing Your Mind
Deliver Best-in-Class HPC Cloud Solutions Without Losing Your MindAvere Systems
 
How to Build a Compute Cluster
How to Build a Compute ClusterHow to Build a Compute Cluster
How to Build a Compute ClusterRamsay Key
 
ECM Renovation Roadshow - ECM System Migration
ECM Renovation Roadshow - ECM System MigrationECM Renovation Roadshow - ECM System Migration
ECM Renovation Roadshow - ECM System MigrationZia Consulting
 
Plan to Migrate to SharePoint Online
Plan to Migrate to SharePoint OnlinePlan to Migrate to SharePoint Online
Plan to Migrate to SharePoint OnlineErica Toelle
 

Similaire à Performing successful migrations to the microsoft cloud (20)

O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
O365Con19 - Tips and Tricks for Complex Migrations to SharePoint Online - And...
 
SPTechCon Austin - The Slippery Slope of SharePoint Migrations
SPTechCon Austin - The Slippery Slope of SharePoint MigrationsSPTechCon Austin - The Slippery Slope of SharePoint Migrations
SPTechCon Austin - The Slippery Slope of SharePoint Migrations
 
One101 double the trouble double the fun_ migrating to one_drive and sharepoi...
One101 double the trouble double the fun_ migrating to one_drive and sharepoi...One101 double the trouble double the fun_ migrating to one_drive and sharepoi...
One101 double the trouble double the fun_ migrating to one_drive and sharepoi...
 
SPUnite17 Migrating to SharePoint Online Fast Track
SPUnite17 Migrating to SharePoint Online Fast TrackSPUnite17 Migrating to SharePoint Online Fast Track
SPUnite17 Migrating to SharePoint Online Fast Track
 
Making the Transition from the Suite to the Hub
Making the Transition from the Suite to the HubMaking the Transition from the Suite to the Hub
Making the Transition from the Suite to the Hub
 
Making the Transition from the Suite to the Hub
Making the Transition from the Suite to the HubMaking the Transition from the Suite to the Hub
Making the Transition from the Suite to the Hub
 
How to prepare your site for content migration
How to prepare your site for content migrationHow to prepare your site for content migration
How to prepare your site for content migration
 
ActiveMigrate - ECM Renovation Roadshow
ActiveMigrate - ECM Renovation RoadshowActiveMigrate - ECM Renovation Roadshow
ActiveMigrate - ECM Renovation Roadshow
 
Data Vault Automation at the Bijenkorf
Data Vault Automation at the BijenkorfData Vault Automation at the Bijenkorf
Data Vault Automation at the Bijenkorf
 
Migrating on premises and cloud contents to SharePoint Online at no cost with...
Migrating on premises and cloud contents to SharePoint Online at no cost with...Migrating on premises and cloud contents to SharePoint Online at no cost with...
Migrating on premises and cloud contents to SharePoint Online at no cost with...
 
Datastage Introduction To Data Warehousing
Datastage Introduction To Data WarehousingDatastage Introduction To Data Warehousing
Datastage Introduction To Data Warehousing
 
Making the Transition from Suite to the Hub
Making the Transition from Suite to the HubMaking the Transition from Suite to the Hub
Making the Transition from Suite to the Hub
 
Collab 365 - Real world scenarios to migrate to SharePoint 2016 or Office 365
Collab 365 - Real world scenarios to migrate to SharePoint 2016 or Office 365Collab 365 - Real world scenarios to migrate to SharePoint 2016 or Office 365
Collab 365 - Real world scenarios to migrate to SharePoint 2016 or Office 365
 
Automation options with Office 365
Automation options with Office 365Automation options with Office 365
Automation options with Office 365
 
Acceleration Technology: Taking Media File Transfers From Days to Minutes
Acceleration Technology: Taking Media File Transfers From Days to MinutesAcceleration Technology: Taking Media File Transfers From Days to Minutes
Acceleration Technology: Taking Media File Transfers From Days to Minutes
 
Deliver Best-in-Class HPC Cloud Solutions Without Losing Your Mind
Deliver Best-in-Class HPC Cloud Solutions Without Losing Your MindDeliver Best-in-Class HPC Cloud Solutions Without Losing Your Mind
Deliver Best-in-Class HPC Cloud Solutions Without Losing Your Mind
 
To the cloud!
To the cloud!To the cloud!
To the cloud!
 
How to Build a Compute Cluster
How to Build a Compute ClusterHow to Build a Compute Cluster
How to Build a Compute Cluster
 
ECM Renovation Roadshow - ECM System Migration
ECM Renovation Roadshow - ECM System MigrationECM Renovation Roadshow - ECM System Migration
ECM Renovation Roadshow - ECM System Migration
 
Plan to Migrate to SharePoint Online
Plan to Migrate to SharePoint OnlinePlan to Migrate to SharePoint Online
Plan to Migrate to SharePoint Online
 

Plus de Andries den Haan

DIWUG - Automatiseren van document disposition reviews met Power Automate.pdf
DIWUG - Automatiseren van document disposition reviews met Power Automate.pdfDIWUG - Automatiseren van document disposition reviews met Power Automate.pdf
DIWUG - Automatiseren van document disposition reviews met Power Automate.pdfAndries den Haan
 
Embracing the long term view to build a true digital workplace
Embracing the long term view to build a true digital workplaceEmbracing the long term view to build a true digital workplace
Embracing the long term view to build a true digital workplaceAndries den Haan
 
Practical large scale migration guidance
Practical large scale migration guidancePractical large scale migration guidance
Practical large scale migration guidanceAndries den Haan
 
Msol10 extending social features in share point 2010 v0.4
Msol10   extending social features in share point 2010 v0.4Msol10   extending social features in share point 2010 v0.4
Msol10 extending social features in share point 2010 v0.4Andries den Haan
 
Moving beyond service applications to build a social ecosystem v1.1
Moving beyond service applications to build a social ecosystem v1.1Moving beyond service applications to build a social ecosystem v1.1
Moving beyond service applications to build a social ecosystem v1.1Andries den Haan
 
Deploying the share point user profile service
Deploying the share point user profile serviceDeploying the share point user profile service
Deploying the share point user profile serviceAndries den Haan
 

Plus de Andries den Haan (6)

DIWUG - Automatiseren van document disposition reviews met Power Automate.pdf
DIWUG - Automatiseren van document disposition reviews met Power Automate.pdfDIWUG - Automatiseren van document disposition reviews met Power Automate.pdf
DIWUG - Automatiseren van document disposition reviews met Power Automate.pdf
 
Embracing the long term view to build a true digital workplace
Embracing the long term view to build a true digital workplaceEmbracing the long term view to build a true digital workplace
Embracing the long term view to build a true digital workplace
 
Practical large scale migration guidance
Practical large scale migration guidancePractical large scale migration guidance
Practical large scale migration guidance
 
Msol10 extending social features in share point 2010 v0.4
Msol10   extending social features in share point 2010 v0.4Msol10   extending social features in share point 2010 v0.4
Msol10 extending social features in share point 2010 v0.4
 
Moving beyond service applications to build a social ecosystem v1.1
Moving beyond service applications to build a social ecosystem v1.1Moving beyond service applications to build a social ecosystem v1.1
Moving beyond service applications to build a social ecosystem v1.1
 
Deploying the share point user profile service
Deploying the share point user profile serviceDeploying the share point user profile service
Deploying the share point user profile service
 

Dernier

Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfSeasiaInfotech2
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Wonjun Hwang
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clashcharlottematthew16
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embeddingZilliz
 

Dernier (20)

Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdf
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embedding
 

Performing successful migrations to the microsoft cloud

  • 1. Performing successful migrations to the Microsoft Cloud CD36 • Andries den Haan • @awdhaan
  • 2. Platinum sponsors Gold sponsors Silver sponsors Community sponsor
  • 3. Code of Conduct As event and experience organizers, we seek to provide a respectful, friendly, professional experience for everyone, regardless of gender, sexual orientation, physical appearance, disability, age, race or religion. We do not tolerate any behavior that is degrading to any gender, race, sexual orientation, or disability, or any behavior that would be deemed harassment or discrimination. Individuals are responsible for knowing and abiding by our standards and we encourage everyone to assist in creating a welcoming and safe environment. Please report any concerns, suspicious or disruptive activity or behavior to the organizing team, so that we can address the issue immediately. More information can be found on the CollabDays Benelux website at https://www.collabdays.org/2020-benelux-online/about/
  • 4. A brief personal introduction • Working in technology since 1999 • Currently as a Cloud Solution Architect at Wortell, which is an awesome company • Previously: Pink Elephant, PinkRoccade, Getronics, Ordina, KPN Consulting & ETTU • Crazy about technology that connects people • Focus on Business & IT Alignment: o Governance & security o Use of Best practices • Certified Microsoft Office 365 technology expert • Proudly addicted to (large-scale) migrations ☺ Andries.den.Haan@wortell.nl Twitter: @awdhaan Blog: www.tribework.nl
  • 5. What you can expect from this session Focus on technology opposed to other project streams Fuzzy blend of slides & demos when you’re neck-deep into migrations Inspiration on how to handle and admin your large-scale scenarios Getting the latest info on what is happening around tools and approaches (excluding Mover) Sharing some experiences from previous projects This is not a 101 session Advice from the Microsoft and ShareGate product teams Some (PnP) PowerShell, fun and interaction! ☺
  • 6. Session agenda • Getting the best migration performance • Gathering metrics from your migrations • How to proof migrations were done in full • Automating like a boss • Tenant-2-tenant migrations for Microsoft Teams.
  • 7. Some fundamental recommendations • Choose the right tool for the job (the list below is based on previous experiences): • SharePoint Migration Tool (SharePoint, file shares, PowerShell-driven) • Migration Manager (file shares, scalable, new features coming later) • Migrate through the SharePoint Online PowerShell module > Walkthrough • ShareGate:Desktop • AP Elements Fly • Register ShareGate:Desktop (if used) as an Azure AD Desktop application • Also use PnP PowerShell Azure AD App registration (which is now super easy) for improved performance during pre- or postmigration actions (also to workaround ADFS/MFA-issues) -> Demo
  • 8. PnP PowerShell Azure AD App registration Demo summary • Use the latest PnP PowerShell release which includes a bug fix when using PowerShell ISE • Run Initialize-PnPPowerShellAuthentication as a Global Administrator • Give consent for the required permissions • Import the certificate into the local certificate store including the private key • Store the Client Id and Certificate Thumb in the Windows Credential store • Authenticate using the new Azure AD App credentials.
  • 9. Recommendations from the Microsoft & ShareGate:Desktop product teams: • Limit to 200-300K files per migration to keep things manageable during the ‘Azure hop’ • Don’t migrate large amounts to a single site. Sites per organization (2.000.000) is sufficient, so plenty of room to split up data • Limit the amount of simultaneous operations • For typical office file share migrations (~1.5 MB/file), 1 TB/day should be feasible • Throttling is less outside of typical business hours. Daytime migration are still possible, but with a little bit more throttling. Sizing your migrations is key
  • 10. Ground rules: keep it simple • Data needs to be copied from A to B, that’s all! • Avoid pre- or postmigration script actions to beautify or tidy the folder structure (especially with large-scale file shares) • Don’t migrate (granular) permissions. People work differently in the target-environment, so that same applies to authorizations.
  • 11. Incremental vs. delta-migrations? • Incremental migrations compares each file in source and destination which can be really time consuming with large amounts of files • Delta migrations are faster as these use date filters to only overwrite files that were added or modified since the last full migration. Initial full migration “Delta” migration Register the start time End-users continue to work in the source environment Migrate in “Overwrite”-mode using the date filter Content freeze in the source
  • 12. Why should you care about gathering metrics from your migrations? • Especially relevant for large-scale migrations • All activities cost time, but how much by average? • How much data can be migrated within e.g. a day? • It can help you to determine a baseline.
  • 13. Comparing some popular tools on metrics ShareGate:Desktop • Summary reporting is limited to ItemsCopied, Successes, Warnings and Errors • Detailed reports can become difficult to process for large amounts of data, although still valuable. Especially, when exporting to CSV. SharePoint Migration Tool • Summary reporting is surprisingly useful -> Demo • GB/Hour metric • GB in source and migrated • Item-level summaries are also included -> Demo. Migration manager • Similar reporting as SharePoint Migration Tool • Currently manual download from the SharePoint Admin Center (this will change soon). Migration Manager
  • 14. How to proof that you’re done • In addition to migration reports, item count comparison shows if all in scope was copied as expected • PowerShell to the rescue as always • Consider UNC path length limitations in scripting logic • Consider 5.000 item query limit when programmatically querying the list • Distinguish between files and folders • Use a loop and function approach to populate e.g. a csv- based report • Demo!
  • 15. Automating like a boss • Why? Because the administration can be time consuming with large amounts of data • Stakeholders expect (near) real-time progress reporting • It should be one of your goals as a migration admin to spend the least amount of time on administration.
  • 16. • Alternate approach when you are working on large-scale migrations with 10.000’s of users and multiple Terabytes of data • Data-model can be easily created using Visual Studio and published to Azure • Use common PowerShell functions to execute stored procedures to Create, Read, Update or Delete data through PowerShell • Link scripts to scheduled tasks • Works when using e.g. SPMT or ShareGate as these tools have sufficient PowerShell support • Use email as a means of notifying the migration admin about errors (could also be used to inform data owners on migration start/end) • Simplified walkthrough and demo of a Data Migration Factory. Stepping up from CSV’s to databases
  • 18. Data Migration Factory High level architecture • Inventory clients importing data for each organizational entity into the database • Batches are created and assigned to file shares and migration servers to distribute the load • Scheduled console apps poll the database for any batch- items that needs to be processed and trigger the PowerShell scripts using the record Id as the only parameter • Integrated reporting through database queries. Migration database SharePoint 2013 SharePoint 2010 Filers Inventory clientInventory client Migration servers PS SharePoint Online Microsoft Teams Reporting Inventory client
  • 19. Migrating Teams tenant-2-tenant • Copy Channels (conversations and files), Tabs and Apps • Some limitations apply (more on support articles): • Migrations are limited to the last 50 messages including replies. All other messages are stored in an HTML archive page (tab) • Meeting URL’s are tenant-specific, so recreate meetings after migration • Private channel (files, not conversations) can be difficult to migrate • ShareGate is doing a great job, supports PowerShell (GUI is currently richer) for this and will extend their capability soon: • Choosing specific channels to migrate • Merge into existing Teams.
  • 20. Let’s wrap-up this session… • Slides will be shared • Script examples available upon request • Check my blog for upcoming posts • Contact me for any questions or comments ☺