We demo and discuss SSIS, Azure Data Factory, Dataflow, Azure Stream Analytics, Power Query: important features, similarities and differences, pros and cons, pricing and use scenarios. View this on-demand webinar: https://senturus.com/resources/data-integration-options-for-microsoft-power-bi/
Senturus offers a full spectrum of services in business intelligence and training on Power BI, Cognos and Tableau. Our resource library has hundreds of free live and recorded webinars, blog posts, demos and unbiased product reviews available on our website at: http://www.senturus.com/senturus-resources/.
2. 2
Hundreds of resources
Visit the Resource Library
on the Senturus website
to download this presentation
and explore other assets:
senturus.com/resources
2
3. 3
Andy Kinnier
BI Solution Architect
Senturus, Inc.
Michael Weinhauer
Director
Senturus, Inc.
3
John Peterson
Founder & CEO
Senturus, Inc.
Introductions
4. Agenda
• Introductions
• Brief BI/Analytics architecture overview
• Data integration options for Power BI
• Senturus overview
• Additional resources
4
5. Enjoy the full webinar presentation
This slide deck is from the webinar 5 Data Integration
Options for Microsoft Power BI
To view the FREE video recording and download this deck,
go to https://senturus.com/resources/5-data-integration-
options-for-microsoft-power-bi/
5
7. Data
Integration
Tools
Properly Staged Data
BI Tools
7
SourceSystemsofRecord
Conforming
Dimensional Models*
Single Version of the Truth
DataAbstraction/SemanticModel
Information Security
Report
Authoring
Dashboard
Authoring
Slicing &
Dicing
Ad Hoc
Querying
Threshold
Alerting
ERP
Data
External
Data
Other
Sources
Planning
Data
DataIntegration(ETL,PowerQuery)
Standard
Reports
Dashboards/
Scorecards
Self-Service
Reporting &
Analysis
Threshold-
based Alerts
WebPortal
(Data Lake, Hub, etc.)
Direct Connection
BI architecture
8. Basic analytics (BI) system
8
StorePrepare Model Visualize Share
The essential steps
Connect Combine
Today’s topic
9. Integration options for Power BI
• Ingesting data into Power BI - choices
• ETL and ELT defined
• Microsoft platform - right tool for the job
• Cost, complexity, scalability
• Decision matrix
9
10. Microsoft platform tools
• Power Query
• Power BI dataflows
• SSIS (SQL Server Integration Services)
• Stream Analytics (Power BI and data lake)
• Azure Data Factory – mapping dataflows
10
11. Power Query
• Brings data into a Power BI Desktop model – many built in
connectors
• Allows for transformations, appending and merging tables,
create new columns, etc.
• Doesn’t persist the data in storage – transforms as it moves
data into a Power BI model
• Uses the M language – a sequential data transformation
language
11
13. Power Query segue into Power BI dataflows
• Many power users and analysts have become quite
proficient at ETL using Power Query and the M language
• Organizations wanted a way to reuse and share the work
and data from these power users
• Power BI dataflows bridges the gap between enterprise ETL
and self-service analytics
13
14. Bridge the gap between enterprise and self-service Power BI.
14
Data Flows
15. Power BI dataflows
• Uses the Power Query GUI in the cloud
• Allows you to persist (store) data in the cloud to be used by
many Power BI users
• Schedule data refresh
• Linked datasets allow for reusability of existing dataflows to
create new dataflows
15
16. Demo Power BI dataflows
• Access the GUI
• GUI features
• M language
• Scheduled refresh
• Governance added to Power BI service
16
17. SQL Server Integration Services (SSIS)
• Free with SQL Server license – uses visual studio for
development environment
• On-prem Windows App – GUI-based - drag and drop
without coding
• Pipeline architecture, extract transform and load tool
• More robust, but also more complex – ETL developer
• On-prem data warehouse ingestion
• Control Flow – Sequential and Parallel conditional processing of tasks
• Data Flow – In memory, pipeline data transformations
17
19. Azure Stream Analytics
• Works in tandem with Azure Event Hub to stream data into
your data lake and Power BI
• Big data processing for specific report and data warehouse
ingestion
• Real-time data analysis
19
22. Azure Data Factory
• Browser-based Azure (cloud) application for ETL/ELT
• Cost is usage based – pay for the amount of data you load
• Originally a “Lift and Shift” technology for moving large files into the cloud
• Version 2 has recently added a GUI components
• SSIS, data flows, wrangling data flows
• Enterprise level
• DevOps, alerting, scheduling, test/QA/prod environments
• Pipelines can manage multiple technologies
22
23. In summary
• These tools all share the same fundamentals of loading and
transforming data so that Power BI can produce useful
analytics to help your company make better business
decisions
• Decision matrix – how do I decide?
• Continuously evolving stack of technologies
23
24. See all the demos
To view the video recording with demos and download the
slide deck go to https://senturus.com/resources/5-data-
integration-options-for-microsoft-power-bi/
Visit our website to access our library of free BI knowledge
resources including events, blogs, demos, whitepapers, other
on-demand webinars and our dashboard gallery
https://senturus.com/senturus-resources/
24
25. Power BI assistance many ways
Training
• Get and Transforming Data with Power BI on 12/14, 1/19, 2/ 23, 4/13
• https://senturus.com/training/course-schedule/transforming-data-with-power-bi/
From desktop to enterprise
Get on the path to efficient, accurate, shareable dashboard reporting
https://senturus.com/power-bi-desktop-to-enterprise/
Bucket of hours
Support you need, how you need it
https://senturus.com/business-intelligence-staffing-and-support/
25
27. Full spectrum of BI services
• Dashboards, reporting and visualizations
• Data preparation and modern data warehousing
• Hybrid BI environments (migrations, security, etc.)
• Software to enable bimodal BI and platform migrations
• BI support retainer (expertise on demand)
• Training and mentoring
27
28. A long, strong history of success
• 20+ years
• 1500+ clients
• 3000+ projects
28
The first question we usually get is “Can I get a copy of the presentation?” Absolutely! It’s available on Senturus.com. Select the Resources tab and then Resources Library.
Or you can click the link that was just posted in the GoToWebinar Control panel.
Be sure to bookmark the resource library. It has tons of valuable content addressing a wide variety of business analytics topics.
Joining us today is…..Andy Kinnier and John Peterson
John is the company's thought leader and visionary. John directs the delivery of all projects with Senturus, providing the bridge of technical and business understanding.
Andy is a certified Microsoft business intelligence architect and developer with over 20 years of experience in software development, He has made regular appearances at the Power Platform World Tour events over the years. He also serves as Assistant Organizer of the NJ/NY branch of the Power BI User Groups.
I’m an eager analyst in a small company (business unit within a larger company). I have business data sitting in a bunch of flat files and I’m not going to bother IT with any of this yet (e.g. resources, politics, competence).
I have a lot to figure out! How am I going to: Prepare, Store, Model, Visualize, and Share?
On top of all that, how am I going to:
Have this perform super fast (perhaps by storing data in-memory)?
Do it myself (self-service)??
Can one tool do It all?
This used to be a disjointed process, with upstream data prep and modeling handled by multiple people, often in IT.
The 2 keys:
Properly staged data
Good enterprise BI tools
Focus on
1. Conforming Dimensions – shared across facts
2. Clean metadata layers “insulating” business users from the source data
Nirvana state of Self-Service BI is only possible with this type of approach
EXAMPLE: Jamba Juice needed to shift from silos of accurate data to conforming dimensions in order to create and support the desired Executive Dashboard
I’m an eager analyst in a small company (business unit within a larger company). I have business data sitting in a bunch of flat files and I’m not going to bother IT with any of this yet (e.g. resources, politics, competence).
I have a lot to figure out! How am I going to: Prepare, Store, Model, Visualize, and Share?
On top of all that, how am I going to:
Have this perform super fast (perhaps by storing data in-memory)?
Do it myself (self-service)??
Can one tool do It all?
This used to be a disjointed process, with upstream data prep and modeling handled by multiple people, often in IT.
The need to empower Power BI power users to have some ETL (Extract Transform Load) capabilities that can be shared throughout the organization.
The need to empower Power BI power users to have some ETL (Extract Transform Load) capabilities that can be shared throughout the organization.
The need to empower Power BI power users to have some ETL (Extract Transform Load) capabilities that can be shared throughout the organization.
The need to empower Power BI power users to have some ETL (Extract Transform Load) capabilities that can be shared throughout the organization.
The need to empower Power BI power users to have some ETL (Extract Transform Load) capabilities that can be shared throughout the organization.
Training: We have a full selection of courses. We offer corporate and public. In a few weeks we have an instructor-led, online class: Transforming Data in Power BI
POWER BI: FROM DESKTOP TO ENTERPRISE
In about a day, Senturus will put you on the path to efficient, accurate and shareable dashboard reporting.
At Senturus, our clients know us for providing clarity from the chaos of complex business requirements, disparate data sources and constantly moving targets.
We have made a name for ourselves because of our strength at bridging the gap between IT and business users.
We deliver solutions that give you access to reliable, analysis-ready data across the organization so you can quickly and easily get answers at the point of impact: the Decisions you Make and Actions you Take.
Our consultants are leading experts in the field of analytics, with years of pragmatic, real-world expertise and experience advancing the state-of-the-art.
We’re so confident in our team and our methodology that we back our projects with a 100% money back guarantee that is unique in the industry.
We have been focused exclusively on business intelligence for 19 years.
We work across the spectrum from Fortune 500 to mid market, We solve business problems across many industries and function areas including in the office of finance, sales and marketing, manufacturing, operations, HR and IT
Our team is large enough to meet all your business analytics needs yet small enough to provide personal attention.
Senturus has 100s of free resources on our website, from webinars on all things BI, to our fabulous up-to-the-minute, easily consumable blogs.
We provide training in the three top BI platforms. We are ideal for organizations running multiple platforms or those moving from one to another.
We can provide training in many modes and can mix and match to suit your user community.
Senturus provides 100s of free resources on our website. We have been committed to sharing our BI expertise for over a decade.