あらゆるビジネスの過程でデータが発生し、最適なストレージに蓄積され、データサイエンティストが分析し、業務上で次に打つべきベストなアクションを起こす。このようなデジタル フィードバック ループは、一部の限られた企業のみが実現可能なものでしょうか?確かに「データが事業部門(LOB)毎に点在している」「データは溜まっているけど、活用できていない」などのお困り事が良く聞かれます。マイクロソフトのビジネスアプリケーションの基盤である Power Platform では、皆さまの企業において、あらゆるシステムからのデータを集約、統合し、データが分析されるまでの準備を簡単に行うことができます。Power Apps、CDS、ADLS、Power BI などをキーワードに、それらの最新のテクノロジを整理してご紹介します。
6. Azure Data Lake Storage Gen2
(ADLS Gen2)
Digital Feedback Loop を支えるプラットフォーム
• ビッグデータ分析と他の Azure サービスとの統合
に対応したクラウド ストレージ サービス
• 構造化・非構造化を問わず、組織内外から多
種多様なデータを取得
• 大量のデータを安全、確実、かつ安価に蓄積、
管理
Common Data Service
(CDS)
• Power Apps、Automate、Power BI などから
使用可能なパワー ユーザー向けデータ ストア
• Common Data Service 内のデータはエンティ
ティと呼ばれる一連のレコード内に格納
• ブラウザ ベースでのデータ設計が可能で、フィール
ド、リレーションシップ、フォーム、ビューを簡単に操
作することができる
Common Data Model (CDM)
アプリケーション間でデータのセマンティックの一貫性を保つために使用されるデータ スキーマ
7. Common Data Service
Sales
application
Other
applications…
Azure Data Lake
Sales
Insights
Customer
Insights
Other…PowerApps
applications
Common Data Service (CDS) and Power BI Dataflows with schematized Azure Data Lake
store data in conformance with the Common Data Model definition.
Data Integration
Intelligence
Data IntegrationData Integration
Common Data Service と Azure Data Lake の Data Integration
8. Business analysts
Low/no code
Data scientists, Data engineers
Low to high code
CDM folders
Power BI
dataflows
/ Azure
Synapse
Dynamics 365
F&O and CDS
for Apps data
Office
Substrate
Office 365
Adobe
Customer
Experience
Platform
SAP
C/4HANA
S/4HANA
Power BI
Azure Data Services
data cataloging, data prep, AI,
machine learning, data warehousing
Azure IoT
ISV partners
Custom
LOB +
Developer
resources
Common Data Model でスムーズなコラボレーションを可能に
9. Standardized metadata structures and self-
describing data
Model.json
• Metadata description file contains semantic
information about entity records/attributes
and links to underlying data files.
• Existence of this file indicates compliance
with CDM metadata format.
Data Files
• The data files in a CDM folder have a well-
defined structure and format and are
referenced in the model.json file.
• These files must be in .csv format, but we’re
working to support other formats
CDM フォルダー
10. Export to Data Lake:
Continuously push data from Common
Data Service entity data to Azure Data
Lake Storage Gen2
(code name: Athena)
Azure Data Lake
Storage Gen2
Dynamics 365 Finance
and Operations
(ERP)
Dynamics 365 Customer
Engagement
Common Data Service と Data lake 上のビジネス アプリケーション データ
Common
Data Model
folder
Common Data
Service
Export Dynamics 365 Finance and Operations
data to Azure Data Lake Storage Gen2
Dual Write:
Near-real time and bi-directional integration
between Dynamics 365 Finance and
Operations and Dynamics 365 Customer
Engagement (uses Common Data Service)
Power Apps
12. Common Data Service をベースにした Power Platform アプリ
Act
Learn
Automate
Analyze
Know
PowerPlatform
13. 本セッションでご覧いただくデモンストレーション
Export to Data Lake
(code name: Athena)
Azure Data Lake
Storage Gen2
Dynamics 365 Finance
and Operations
(ERP)
Dynamics 365
Customer Engagement
Common
Data Model
folder
Common Data
Service
Export Dynamics 365 Finance and
Operations data to Azure Data Lake
Storage Gen2
Dual Write:
Near-real time and bi-
directional integration
Power Apps Power Automate
Azure Synapse
Analytics
Power BI
B07 DemoB07 Demo
B07 Demo
B07 Demo
15. Dynamics アーキテクチャー概念図
セキュリティモデル
Common Data Service
データ連携
ISV
Apps
External Systems
Power
Automate
PowerApps
ISV
Power App
Power BI
Sales Field Service
Customer
Service
Project
Service
Marketing
Customer
Insight
PowerUser
App
Sales Insight
Marketing
Insight
個別分析
Finance
Supply Chain Management
Data Entity
16. Dual-Write で F&O (ERP) のデータが CDS に入る意味
1. Harmonize common concepts without deviating the natural flow.
2. Minimal/no user training require for native users.
3. Out-of-the-box experience for Administrators.
4. Allow business to experience the richness of Operations data on CDS.
5. Simplify accessibility to Operations data for D365 apps and apps built
on Power Platform.
3. Empower new markets and market demands like project
manufacturing for “engineering to order”.
2
3
1
2
1
“Make F&O play nicely with CDS”, allows business to exchange data seamlessly beyond application boundaries, providing One Dynamics 365
experience.
17. ラウンチ時の Dual-Write 機能
• Provide near real-time experience for interaction scenarios through
CRUD operations. CRUD できます
• Support for initial data synchronization 初期 Sync できます
• Data Live sync and Play/Pause capabilities Sync ポーズできます
• ALM story – includes template versioning, capability to import/export
templates across tenants & environments, backup and restore DW
artifacts.
• Solution awareness
• Dependency graph to view and track related entities 依存関係見え
ます
• Ability to configure alert thresholds
• Extensible and supports custom entities and expansion of OOB maps.
19. なぜリレーショナル データベースですべてを行わないか?
Need to process
multi petabytes of
data
Data may not have
strict schema
Multiple applications and
tools over same data
Data may come from
various external
sources
Never Delete Data.
Elastic scale
Cost of operational
databases for big
data processing
20. すべての F&O データを Data Lake に
Entity
Store
Table
BYOD
Azure Data Lake Gen2
AOS
AXDB
Dynamics 365 Finance and
Operations
Azure Machine
Learning
Power BI Azure Data
Factory
Azure Data
Bricks
T-SQL on-demand
with Azure Synapse
Click-stream data, sensor data,
external data
Azure Data Services
23. What is Common Data Service?
https://docs.microsoft.com/en-us/powerapps/maker/common-data-service/data-platform-intro
Common Data Model
https://docs.microsoft.com/en-us/common-data-model/
How to use Common Data Model
https://docs.microsoft.com/en-us/common-data-model/use
Use the Common Data Model to optimize Azure Data Lake Storage Gen2
https://docs.microsoft.com/en-us/common-data-model/data-lake
Introduction to Azure Data Lake Storage Gen2
https://docs.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-introduction
参考資料
24. Export entity data to Azure Data Lake Storage Gen2
https://docs.microsoft.com/en-us/powerapps/maker/common-data-service/export-to-data-lake
Azure Data Lake overview (Dynamics 365 Finance and Operations)
https://docs.microsoft.com/en-us/dynamics365/fin-ops-core/dev-itpro/data-entities/azure-data-
lake-overview
Dual-write overview
https://docs.microsoft.com/en-us/dynamics365/fin-ops-core/dev-itpro/data-entities/dual-
write/dual-write-overview
参考資料