SlideShare une entreprise Scribd logo
1  sur  64
Télécharger pour lire hors ligne
Getting Your Data Out of HFM
HFM Extended Analytics
Keith Berry
US-Analytics
US-Analytics is an industry leading professional services firm focused
on helping clients successfully establish and maintain long term Business
Intelligence (BI) and Enterprise Performance Management (EPM)
applications and programs.
• BI and EPM Strategy and Processes
• Custom and packaged BI and EPM Applications
• Oracle Infrastructure
• Managed Services and Hosting
For over a decade, market leading companies have trusted US-Analytics
to solve complex business problems, drive managerial excellence, and
deliver operational agility.
Learn more at Booth #107 or
www.us-analytics.com
 12+ Years Hyperion implementation experience
 Certified in HFM and Essbase
 Second year at Kscope
 First EA presentation in 2004
Background
● Tool for exporting HFM data to a relational database in star schema format
● Prior to 11.1.2.2, the only way to export data not in <Entity Currency>
● As of 11.1.2.2, fully integrated with Data Export
Extended Analytics – What it is
● Writes directly to a relational database (system to system)
● Exports metadata and data
● Flexible star schema format supports analysis and transformation
Why use it?
Setup
● Create target database/schema
● Separate from HFM application database
● Can have multiple
Setup Target Databases
● Create UDL (Universal Data Link) file
● File containing target database connection information
● One per target database
● Copy to each HFM server
Setup Target Databases
● Registers UDL with HFM server
● 11.1.2.1 and prior
Start  All Programs  Oracle EPM System  Foundation Services  EPM
System Configurator
● 11.1.2.2
Start  All Programs  Oracle EPM System  Financial Management  Extended
Analytics DSN Configuration
● DSN will now appear on Data Extract screen
Configure DSN
Configure DSN
● 11.1.2.1 and prior
● EA and Data Export separate tasks
● Administration  Extended Analytics
● 11.1.2.2 –
● EA and Data Export fully integrated
● Consolidation  Extract  Data
Create Export
Step #1 – Set POV
Step #2 – Set Extract Destination
● Type
● Database of flat file
● Extract Format
● Standard
● Data Warehouse
● Essbase
● Metadata Only
● Selected Metadata Only
● Template
● Extract Dynamic Accounts
● Calculated Data
● Derived Data
● Values generated by ZeroView settings
● Line Item Detail
● n/a
Step #3 – Set Options
● Schema Actions
● Create, Update or Delete
● Destination Database
● DSN configured earlier
● Table prefix
● ten alphanumeric characters
● must start with character
● no spaces
● no underscore
Step #3 – Set Options
What Happens
• Create Database
● Creates new tables if not already present
● Clears Fact Table and re-exports data if tables already present and metadata has not
changed
● Drops and rebuilds all tables if metadata has changed
• Update Database
● Adds or updates records in Fact Table for existing POV
● Does not affect existing data outside of POV
● Will not execute if metadata has changed or schema does not exist
• Delete Database
● Deletes all tables
● Doesn’t indicate if tables existed in the first place
What is Exported
● Table layout optimized for dimensional data
● Central fact table
● One field for each dimension
● One or more fields for data
● Dimension tables
● Dimension tables = “look-up” tables
● Has corresponding value for each value in the related Fact table field
● Dimension information in parent-child format
● Contains additional information about the dimension field such as description,
user-defined fields, etc.
• Fact table and dimension tables can be joined to manipulate and aggregate the
data along dimension lines
• Database topology looks like a star
Star Schema Format
Star Schema Format
2 2013
43 Actuals
84 Jan
3 USD
88 California
19 Net Income
2 84 88 3 1943 $100
Actuals, 2013, Jan, California, USD, Net Income - $100
Fact Table
Value Dim Table
Period Dim Table
Scenario Dim Table
Year Dim Table Account Dim Table
Entity Dim Table
Table Sets
• Assign table prefix during setup
• HFM creates and populates tables during each export
• All tables created during an export share the same prefix
• Version exports via prefixes
Fact Table
ScenarioID
YearID
PeriodID
ViewID
EntityID
ParentID (for Entity parent)
ValueID
AccountID
ICPID
Custom1ID
Custom2ID, etc.
dData (float)
– Each field contains a numeric ID which corresponds to the ID field of the appropriate
dimension table
– ID numbers are stable across exports for the same set of metadata
– Primary Key for the fact table is the composite of all dimension fields
Dimension Tables
• Standard export format
• Dimension Table (prefix_dimension name)
ID
Label
ParentID
ParentLabel
Description
IsShared
IsLeaf
– The above fields are standard for all dimensions
– Additional fields available based on individual dimension characteristics
– Dimension tables also vary by export type
– Boolean values (IsShared, IsLeaf) stored as Integer (1=True, 0=False)
Additional dimension fields
• Scenario (prefix_SCENARIO)
UserDefined1
UserDefined2
UserDefined3
DefaultView (lookup to ID in View Dimension table)
• Year (prefix_YEAR)
• None
• Period (prefix_PERIOD)
• None
• View (prefix_VIEW)
• None
Additional dimension fields
• Entity (prefix_ENTITY)
UserDefined1
UserDefined2
UserDefined3
IsICP
DefaultCurrency (lookup to ID in Value Dimension table)
• Entity Parent (prefix_PARENT)
UserDefined1
UserDefined2
UserDefined3
IsICP
DefaultCurrency (lookup to ID in Value Dimension table)
• Value (prefix_VALUE)
• None
• ICP (prefix_ICP)
• None
Additional dimension fields
• Account (prefix_ACCOUNT)
UserDefined1
UserDefined2
UserDefined3
IsCalculated
IsConsolidated
IsICP
AccountType
• Custom (prefix_CUSTOMX)
UserDefined1
UserDefined2
UserDefined3
IsCalculated
SwitchSign
SwitchType
AggWeight
SQL View creates data table view from source tables:
Combined View
• Standard SQL provided in appendix
• Change table prefix
• Adjust number of customs
• Recommend all access to data through View
Combined View
Export types
• Metadata Only
• Selected Metadata Only
• Standard
• Data Warehouse
• Essbase
Export types
• Metadata Only
• All metadata
• Fact table empty
• Standard export table format
• Selected Metadata Only
• Same as Metadata Only, but exports only members selected
Standard Export
– One table per dimension
– Separate dimension tables for Entity and Parent
Standard Export
– Child repeated in dimension table each time it appears in under a new parent in the
source hierarchy
– Separate join needed for base data and parent adjustment
• ID and ParentID in Entity table
• ID in Entity table and ID in Parent table
ENTITY Table
Data Warehouse
– ParentID and ParentLabel are dropped from the dimension tables.
– The entity parent table (prefix_PARENT) is also dropped
– A second table is created for each dimension (prefix_dimension_PARENT) which holds
the parent-child information
Data Warehouse
– Can join Fact table to Entity dimension table without duplicating values
– More complex when parent information is required (three-table join)
ENTITY Table ENTITY_PARENT Table
Essbase
Essbase
– A second table for each dimension (prefix_dimension_BASE)
– Parent entity table
Essbase
– BASE table lists the base members under each parent in the dimension
ENTITY Table ENTITY_BASE Table
Understanding Data in HFM
Eliminations/Adjustments
HFM built to support multiple, alternate financial consolidations of the same
base data
• Two levels of data:
– Data and adjustments in base entity
‒ No parent specified
‒ Currency specified in Value Dimension member
– Eliminations/adjustments in specific parent/child combinations
‒ Parent specified
‒ Named Value Dimension member
‒ Currency not stated, but in currency of parent
Example
• France base entity located in two alternate hierarchies
• Europe parent in first hierarchy
• Corp parent in second hierarchy
• Three records loaded to France for 10K, 20K and 5K (total 35K)
• Application consolidated
• Automatic eliminations performed by HFM
• Europe total now 30K
• Corp total now 15K
France
Europe
Europe.France
France
HFM Consolidation
Corp
Data for France under Corp parent
Data for France under Europe parent
France
Corp.France
France
France
Europe
- 5K
35K
HFM Consolidation
Corp
Data for France under Corp parent
Data for France under Europe parent
France
-20K
35K
30K 15K
Translation
• Default currency assigned to each member
• Translation occurs for child member when consolidated to parent with different
currency
• Translation occurs before parent adjustments
- USD
- USD
- CAD
- EUR
- GBP
Example
• Data loaded to base members as follows:
• USA – 50K USD
• Canada – 40K CAD
• France – 15K EUR
• UK – 10K GBP
• Consolidation/translation performed
- - EUR
Translation
- USD
- USD
- CAD
- EUR
- EUR
- GBP
Base data for each entity after consolidation/translation
Designing Your Exports
● Assumptions
● Can aggregate in target system
● Target system needs base data in a single currency
● Export in Data Warehouse format
● Export only base members of Account, ICP, and Custom dimensions
● Separate base data export from adjustment data export
● Translation handled on case-by-case basis
Recommendations
Export in Data Warehouse Format
● Each member present only once in dimension tables
● Simple join with no duplicates
ENTITY Table ENTITY_PARENT Table
Export Base Members for Accounts, ICP
and Customs
● In HFM, parent members in ICP, Account and Custom dimensions calculated
dynamically in RAM as required
● Overhead for processing
● Overhead for virtual data into real
● Base data
- Load to Entity
Split Export
Entity [Base]
Value Named currency, eg. USD, CAD
● Adjustment data
- Load based on Entity Parent (except named currency Adjs)
- Create base members under parent in target system as needed
- Identify currency by Default Currency of the parent
Split Export
Entity [Hierarchy]
Named currency Adjs
Value [Parent Adjs]
[Eliminaton]
[Contribution Adjs]
Transform
● Define all HFM parent members with the same default currency
● Main or alternate hierarchy
● If alternate, additional processing time
● Force Translate
● High overhead
● Will not update during consolidation
● Eliminations cannot be force translated
● Special handling for <Parent Curr Adjs>
● Translate downstream
● SQL
● Target application
Translation - Possible Solutions
Other Good Things to Know
Templates
• Templates can be created to save export parameters
– Cannot be shared between users
– Not part of LCM export
– Copy utility on HFM server
• Start  All Programs  Oracle EPM System  Financial Management 
Utilities
– Recommend Taskflows
Utility tables
— HFM_EA_EXTRACT
Prefix (relational database prefix)
AppName (HFM application name)
Task (aggregation option)
Dimension (ID number)
dTimestamp (1900 date system)
— Tracks the time each table was last updated
— View provided to convert to readable form
— HFM_LOCK_ACCESS
— Tracks when schemas are being written to prevent simultaneous updates
● Task flows
● API Code
● Http Listener (new) – see HFM Developer’s Guide
Automation
Other Considerations
• Correct upper level data depends on HFM being properly consolidated before export
• EA does not trigger consolidation or translation
• Data keeps the same sign it had in HFM
• Revenue, Liabilities positive
• Must accommodate if aggregating downstream
• Dimension IDs in order they have been added to the system
• Member ID
• Not always suitable for dimension builds
Handy things you can do
with EA….
• Approach
● Export all base data for top entities in two HFM applications to be compared
● Compare with database query
• Benefits
● Comprehensive comparison (all dimensions)
● Automated
● No maintenance
● Always captures data present in one application, but not the other
Automated Reconciliation
• Why it Works
● Parent members in Account, ICP and Custom dimensions calculated dynamically in
RAM
● Base data compare
● Assumptions
● Aggregation weights the same in both applications
● Entity value changes are not offset in a higher entity
Automated Reconciliation
• Setup
● Create export template for first data set (prefix = TIE1)
● Execute export
● Create SQL data view
● Repeat steps for second data set (prefix = TIE2)
● Create comparison data view
● Subsequent Steps
● Rerun exports
● Run compare query
Steps
Sample Export Parameters
Recon
Compare Query
Calculated Data Analysis
Tools for Accessing the Data
• Oracle
• Oracle SQL Developer
• http://www.oracle.com/technetwork/developer-tools/sql-
developer/overview/index.html
• SQL Server
● Microsoft SQL Server Management Studio Express
● http://www.microsoft.com/en-us/download/details.aspx?id=8961
● MS Excel
● MS Access

Contenu connexe

Tendances

Deep dive on dynamic member lists
Deep dive on dynamic member listsDeep dive on dynamic member lists
Deep dive on dynamic member listsfinitsolutions
 
Finit solutions getting the most out of hfm - web data forms tips and tricks
Finit solutions   getting the most out of hfm - web data forms tips and tricksFinit solutions   getting the most out of hfm - web data forms tips and tricks
Finit solutions getting the most out of hfm - web data forms tips and tricksfinitsolutions
 
Finit solutions getting the most out of hfm process management and phased sub...
Finit solutions getting the most out of hfm process management and phased sub...Finit solutions getting the most out of hfm process management and phased sub...
Finit solutions getting the most out of hfm process management and phased sub...finitsolutions
 
Hfm rule custom consolidation
Hfm rule custom consolidationHfm rule custom consolidation
Hfm rule custom consolidationAmit Sharma
 
HFM Business Rule Writing Tips and Techniques
HFM Business Rule Writing Tips and TechniquesHFM Business Rule Writing Tips and Techniques
HFM Business Rule Writing Tips and TechniquesAlithya
 
FDMEE script examples
FDMEE script examplesFDMEE script examples
FDMEE script examplesAmit Soni
 
Security and Auditing in HFM
Security and Auditing in HFMSecurity and Auditing in HFM
Security and Auditing in HFMAlithya
 
Become Jythonic in FDMEE (KSCOPE15)
Become Jythonic in FDMEE (KSCOPE15)Become Jythonic in FDMEE (KSCOPE15)
Become Jythonic in FDMEE (KSCOPE15)Francisco Amores
 
Cash flow in hfm – simplified
Cash flow in hfm – simplifiedCash flow in hfm – simplified
Cash flow in hfm – simplifiedAlithya
 
Where Did That Come From? Techniques for Debugging HFM
Where Did That Come From?  Techniques for Debugging HFMWhere Did That Come From?  Techniques for Debugging HFM
Where Did That Come From? Techniques for Debugging HFMfinitsolutions
 
Dimensionality & Dimensions of Hyperion Planning
Dimensionality & Dimensions of Hyperion PlanningDimensionality & Dimensions of Hyperion Planning
Dimensionality & Dimensions of Hyperion Planningepmvirtual.com
 
HFM Zero view settings
HFM Zero view settings HFM Zero view settings
HFM Zero view settings faizan uddin
 
FDMEE Taking Source Filters to the Next Level
FDMEE Taking Source Filters to the Next LevelFDMEE Taking Source Filters to the Next Level
FDMEE Taking Source Filters to the Next LevelFrancisco Amores
 
KSCope 2013 - Balance Sheet Reporting - Design Consideration - KSCope Format
KSCope 2013 - Balance Sheet Reporting - Design Consideration - KSCope FormatKSCope 2013 - Balance Sheet Reporting - Design Consideration - KSCope Format
KSCope 2013 - Balance Sheet Reporting - Design Consideration - KSCope FormatAlexandre SERAN
 
FDMEE Can Do That?
FDMEE Can Do That?FDMEE Can Do That?
FDMEE Can Do That?Alithya
 
Finit solutions getting the most out of hfm - intercompany matching and eli...
Finit solutions   getting the most out of hfm - intercompany matching and eli...Finit solutions   getting the most out of hfm - intercompany matching and eli...
Finit solutions getting the most out of hfm - intercompany matching and eli...finitsolutions
 
FDMEE script examples
FDMEE script examplesFDMEE script examples
FDMEE script examplesAmit Sharma
 
It's Time to Reassess Your FDM Mappings
It's Time to Reassess Your FDM MappingsIt's Time to Reassess Your FDM Mappings
It's Time to Reassess Your FDM MappingsAlithya
 
FDMEE versus Cloud Data Management - The Real Story
FDMEE versus Cloud Data Management - The Real StoryFDMEE versus Cloud Data Management - The Real Story
FDMEE versus Cloud Data Management - The Real StoryJoseph Alaimo Jr
 
Finit one small step - tips and tricks for transitioning from fdm to fdmee
Finit   one small step - tips and tricks for transitioning from fdm to fdmeeFinit   one small step - tips and tricks for transitioning from fdm to fdmee
Finit one small step - tips and tricks for transitioning from fdm to fdmeefinitsolutions
 

Tendances (20)

Deep dive on dynamic member lists
Deep dive on dynamic member listsDeep dive on dynamic member lists
Deep dive on dynamic member lists
 
Finit solutions getting the most out of hfm - web data forms tips and tricks
Finit solutions   getting the most out of hfm - web data forms tips and tricksFinit solutions   getting the most out of hfm - web data forms tips and tricks
Finit solutions getting the most out of hfm - web data forms tips and tricks
 
Finit solutions getting the most out of hfm process management and phased sub...
Finit solutions getting the most out of hfm process management and phased sub...Finit solutions getting the most out of hfm process management and phased sub...
Finit solutions getting the most out of hfm process management and phased sub...
 
Hfm rule custom consolidation
Hfm rule custom consolidationHfm rule custom consolidation
Hfm rule custom consolidation
 
HFM Business Rule Writing Tips and Techniques
HFM Business Rule Writing Tips and TechniquesHFM Business Rule Writing Tips and Techniques
HFM Business Rule Writing Tips and Techniques
 
FDMEE script examples
FDMEE script examplesFDMEE script examples
FDMEE script examples
 
Security and Auditing in HFM
Security and Auditing in HFMSecurity and Auditing in HFM
Security and Auditing in HFM
 
Become Jythonic in FDMEE (KSCOPE15)
Become Jythonic in FDMEE (KSCOPE15)Become Jythonic in FDMEE (KSCOPE15)
Become Jythonic in FDMEE (KSCOPE15)
 
Cash flow in hfm – simplified
Cash flow in hfm – simplifiedCash flow in hfm – simplified
Cash flow in hfm – simplified
 
Where Did That Come From? Techniques for Debugging HFM
Where Did That Come From?  Techniques for Debugging HFMWhere Did That Come From?  Techniques for Debugging HFM
Where Did That Come From? Techniques for Debugging HFM
 
Dimensionality & Dimensions of Hyperion Planning
Dimensionality & Dimensions of Hyperion PlanningDimensionality & Dimensions of Hyperion Planning
Dimensionality & Dimensions of Hyperion Planning
 
HFM Zero view settings
HFM Zero view settings HFM Zero view settings
HFM Zero view settings
 
FDMEE Taking Source Filters to the Next Level
FDMEE Taking Source Filters to the Next LevelFDMEE Taking Source Filters to the Next Level
FDMEE Taking Source Filters to the Next Level
 
KSCope 2013 - Balance Sheet Reporting - Design Consideration - KSCope Format
KSCope 2013 - Balance Sheet Reporting - Design Consideration - KSCope FormatKSCope 2013 - Balance Sheet Reporting - Design Consideration - KSCope Format
KSCope 2013 - Balance Sheet Reporting - Design Consideration - KSCope Format
 
FDMEE Can Do That?
FDMEE Can Do That?FDMEE Can Do That?
FDMEE Can Do That?
 
Finit solutions getting the most out of hfm - intercompany matching and eli...
Finit solutions   getting the most out of hfm - intercompany matching and eli...Finit solutions   getting the most out of hfm - intercompany matching and eli...
Finit solutions getting the most out of hfm - intercompany matching and eli...
 
FDMEE script examples
FDMEE script examplesFDMEE script examples
FDMEE script examples
 
It's Time to Reassess Your FDM Mappings
It's Time to Reassess Your FDM MappingsIt's Time to Reassess Your FDM Mappings
It's Time to Reassess Your FDM Mappings
 
FDMEE versus Cloud Data Management - The Real Story
FDMEE versus Cloud Data Management - The Real StoryFDMEE versus Cloud Data Management - The Real Story
FDMEE versus Cloud Data Management - The Real Story
 
Finit one small step - tips and tricks for transitioning from fdm to fdmee
Finit   one small step - tips and tricks for transitioning from fdm to fdmeeFinit   one small step - tips and tricks for transitioning from fdm to fdmee
Finit one small step - tips and tricks for transitioning from fdm to fdmee
 

Similaire à Getting Your Data Out of HFM

Making It Easy to Connect Kyriba with Other Systems
Making It Easy to Connect Kyriba with Other SystemsMaking It Easy to Connect Kyriba with Other Systems
Making It Easy to Connect Kyriba with Other SystemsKyriba Corporation
 
Team project - Data visualization on Olist company data
Team project - Data visualization on Olist company dataTeam project - Data visualization on Olist company data
Team project - Data visualization on Olist company dataManasa Damera
 
BI Apps Architecture
BI Apps ArchitectureBI Apps Architecture
BI Apps ArchitectureDylan Wan
 
BI Knowledge Sharing Session 2
BI Knowledge Sharing Session 2BI Knowledge Sharing Session 2
BI Knowledge Sharing Session 2Kelvin Chan
 
Designing high performance datawarehouse
Designing high performance datawarehouseDesigning high performance datawarehouse
Designing high performance datawarehouseUday Kothari
 
Why PostgreSQL for Analytics Infrastructure (DW)?
Why PostgreSQL for Analytics Infrastructure (DW)?Why PostgreSQL for Analytics Infrastructure (DW)?
Why PostgreSQL for Analytics Infrastructure (DW)?Huy Nguyen
 
What Would Happen If I...? FDMEE Edition
What Would Happen If I...? FDMEE EditionWhat Would Happen If I...? FDMEE Edition
What Would Happen If I...? FDMEE EditionAlithya
 
RGiampaoli.DynamicIntegrations
RGiampaoli.DynamicIntegrationsRGiampaoli.DynamicIntegrations
RGiampaoli.DynamicIntegrationsRicardo Giampaoli
 
Netvu test slideshow
Netvu test slideshowNetvu test slideshow
Netvu test slideshowRyan Deeds
 
Tuning and Optimizing U-SQL Queries (SQLPASS 2016)
Tuning and Optimizing U-SQL Queries (SQLPASS 2016)Tuning and Optimizing U-SQL Queries (SQLPASS 2016)
Tuning and Optimizing U-SQL Queries (SQLPASS 2016)Michael Rys
 
SQL Reporting service presentation
SQL Reporting service presentationSQL Reporting service presentation
SQL Reporting service presentationAhmed M. Rafik
 
Changing platforms of Oracle database
Changing platforms of Oracle databaseChanging platforms of Oracle database
Changing platforms of Oracle databasePawanbir Singh
 
Supplementing the Close Process at UHS
Supplementing the Close Process at UHSSupplementing the Close Process at UHS
Supplementing the Close Process at UHSJoseph Alaimo Jr
 
Statistics Pillar (Concepts, Definitions and Classifications)
Statistics Pillar (Concepts, Definitions and Classifications)Statistics Pillar (Concepts, Definitions and Classifications)
Statistics Pillar (Concepts, Definitions and Classifications)FAO
 
Dataware house introduction by InformaticaTrainingClasses
Dataware house introduction by InformaticaTrainingClassesDataware house introduction by InformaticaTrainingClasses
Dataware house introduction by InformaticaTrainingClassesInformaticaTrainingClasses
 
Basics of Microsoft Business Intelligence and Data Integration Techniques
Basics of Microsoft Business Intelligence and Data Integration TechniquesBasics of Microsoft Business Intelligence and Data Integration Techniques
Basics of Microsoft Business Intelligence and Data Integration TechniquesValmik Potbhare
 

Similaire à Getting Your Data Out of HFM (20)

Making It Easy to Connect Kyriba with Other Systems
Making It Easy to Connect Kyriba with Other SystemsMaking It Easy to Connect Kyriba with Other Systems
Making It Easy to Connect Kyriba with Other Systems
 
Preprocessing_new.ppt
Preprocessing_new.pptPreprocessing_new.ppt
Preprocessing_new.ppt
 
Team project - Data visualization on Olist company data
Team project - Data visualization on Olist company dataTeam project - Data visualization on Olist company data
Team project - Data visualization on Olist company data
 
Project+team+1 slides (2)
Project+team+1 slides (2)Project+team+1 slides (2)
Project+team+1 slides (2)
 
BI Apps Architecture
BI Apps ArchitectureBI Apps Architecture
BI Apps Architecture
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data Warehousing
 
BI Knowledge Sharing Session 2
BI Knowledge Sharing Session 2BI Knowledge Sharing Session 2
BI Knowledge Sharing Session 2
 
Designing high performance datawarehouse
Designing high performance datawarehouseDesigning high performance datawarehouse
Designing high performance datawarehouse
 
Why PostgreSQL for Analytics Infrastructure (DW)?
Why PostgreSQL for Analytics Infrastructure (DW)?Why PostgreSQL for Analytics Infrastructure (DW)?
Why PostgreSQL for Analytics Infrastructure (DW)?
 
What Would Happen If I...? FDMEE Edition
What Would Happen If I...? FDMEE EditionWhat Would Happen If I...? FDMEE Edition
What Would Happen If I...? FDMEE Edition
 
RGiampaoli.DynamicIntegrations
RGiampaoli.DynamicIntegrationsRGiampaoli.DynamicIntegrations
RGiampaoli.DynamicIntegrations
 
Netvu test slideshow
Netvu test slideshowNetvu test slideshow
Netvu test slideshow
 
Tuning and Optimizing U-SQL Queries (SQLPASS 2016)
Tuning and Optimizing U-SQL Queries (SQLPASS 2016)Tuning and Optimizing U-SQL Queries (SQLPASS 2016)
Tuning and Optimizing U-SQL Queries (SQLPASS 2016)
 
SQL Reporting service presentation
SQL Reporting service presentationSQL Reporting service presentation
SQL Reporting service presentation
 
Changing platforms of Oracle database
Changing platforms of Oracle databaseChanging platforms of Oracle database
Changing platforms of Oracle database
 
Supplementing the Close Process at UHS
Supplementing the Close Process at UHSSupplementing the Close Process at UHS
Supplementing the Close Process at UHS
 
Statistics Pillar (Concepts, Definitions and Classifications)
Statistics Pillar (Concepts, Definitions and Classifications)Statistics Pillar (Concepts, Definitions and Classifications)
Statistics Pillar (Concepts, Definitions and Classifications)
 
Dataware house introduction by InformaticaTrainingClasses
Dataware house introduction by InformaticaTrainingClassesDataware house introduction by InformaticaTrainingClasses
Dataware house introduction by InformaticaTrainingClasses
 
Basics of Microsoft Business Intelligence and Data Integration Techniques
Basics of Microsoft Business Intelligence and Data Integration TechniquesBasics of Microsoft Business Intelligence and Data Integration Techniques
Basics of Microsoft Business Intelligence and Data Integration Techniques
 
FDMEE Custom Reports
FDMEE Custom ReportsFDMEE Custom Reports
FDMEE Custom Reports
 

Dernier

From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfPrecisely
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 

Dernier (20)

From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 

Getting Your Data Out of HFM

  • 1. Getting Your Data Out of HFM HFM Extended Analytics Keith Berry US-Analytics
  • 2. US-Analytics is an industry leading professional services firm focused on helping clients successfully establish and maintain long term Business Intelligence (BI) and Enterprise Performance Management (EPM) applications and programs. • BI and EPM Strategy and Processes • Custom and packaged BI and EPM Applications • Oracle Infrastructure • Managed Services and Hosting For over a decade, market leading companies have trusted US-Analytics to solve complex business problems, drive managerial excellence, and deliver operational agility. Learn more at Booth #107 or www.us-analytics.com
  • 3.  12+ Years Hyperion implementation experience  Certified in HFM and Essbase  Second year at Kscope  First EA presentation in 2004 Background
  • 4. ● Tool for exporting HFM data to a relational database in star schema format ● Prior to 11.1.2.2, the only way to export data not in <Entity Currency> ● As of 11.1.2.2, fully integrated with Data Export Extended Analytics – What it is
  • 5. ● Writes directly to a relational database (system to system) ● Exports metadata and data ● Flexible star schema format supports analysis and transformation Why use it?
  • 7. ● Create target database/schema ● Separate from HFM application database ● Can have multiple Setup Target Databases
  • 8. ● Create UDL (Universal Data Link) file ● File containing target database connection information ● One per target database ● Copy to each HFM server Setup Target Databases
  • 9. ● Registers UDL with HFM server ● 11.1.2.1 and prior Start  All Programs  Oracle EPM System  Foundation Services  EPM System Configurator ● 11.1.2.2 Start  All Programs  Oracle EPM System  Financial Management  Extended Analytics DSN Configuration ● DSN will now appear on Data Extract screen Configure DSN
  • 11. ● 11.1.2.1 and prior ● EA and Data Export separate tasks ● Administration  Extended Analytics ● 11.1.2.2 – ● EA and Data Export fully integrated ● Consolidation  Extract  Data Create Export
  • 12. Step #1 – Set POV
  • 13. Step #2 – Set Extract Destination ● Type ● Database of flat file ● Extract Format ● Standard ● Data Warehouse ● Essbase ● Metadata Only ● Selected Metadata Only ● Template
  • 14. ● Extract Dynamic Accounts ● Calculated Data ● Derived Data ● Values generated by ZeroView settings ● Line Item Detail ● n/a Step #3 – Set Options
  • 15. ● Schema Actions ● Create, Update or Delete ● Destination Database ● DSN configured earlier ● Table prefix ● ten alphanumeric characters ● must start with character ● no spaces ● no underscore Step #3 – Set Options
  • 16. What Happens • Create Database ● Creates new tables if not already present ● Clears Fact Table and re-exports data if tables already present and metadata has not changed ● Drops and rebuilds all tables if metadata has changed • Update Database ● Adds or updates records in Fact Table for existing POV ● Does not affect existing data outside of POV ● Will not execute if metadata has changed or schema does not exist • Delete Database ● Deletes all tables ● Doesn’t indicate if tables existed in the first place
  • 18. ● Table layout optimized for dimensional data ● Central fact table ● One field for each dimension ● One or more fields for data ● Dimension tables ● Dimension tables = “look-up” tables ● Has corresponding value for each value in the related Fact table field ● Dimension information in parent-child format ● Contains additional information about the dimension field such as description, user-defined fields, etc. • Fact table and dimension tables can be joined to manipulate and aggregate the data along dimension lines • Database topology looks like a star Star Schema Format
  • 19. Star Schema Format 2 2013 43 Actuals 84 Jan 3 USD 88 California 19 Net Income 2 84 88 3 1943 $100 Actuals, 2013, Jan, California, USD, Net Income - $100 Fact Table Value Dim Table Period Dim Table Scenario Dim Table Year Dim Table Account Dim Table Entity Dim Table
  • 20. Table Sets • Assign table prefix during setup • HFM creates and populates tables during each export • All tables created during an export share the same prefix • Version exports via prefixes
  • 21. Fact Table ScenarioID YearID PeriodID ViewID EntityID ParentID (for Entity parent) ValueID AccountID ICPID Custom1ID Custom2ID, etc. dData (float) – Each field contains a numeric ID which corresponds to the ID field of the appropriate dimension table – ID numbers are stable across exports for the same set of metadata – Primary Key for the fact table is the composite of all dimension fields
  • 22. Dimension Tables • Standard export format • Dimension Table (prefix_dimension name) ID Label ParentID ParentLabel Description IsShared IsLeaf – The above fields are standard for all dimensions – Additional fields available based on individual dimension characteristics – Dimension tables also vary by export type – Boolean values (IsShared, IsLeaf) stored as Integer (1=True, 0=False)
  • 23. Additional dimension fields • Scenario (prefix_SCENARIO) UserDefined1 UserDefined2 UserDefined3 DefaultView (lookup to ID in View Dimension table) • Year (prefix_YEAR) • None • Period (prefix_PERIOD) • None • View (prefix_VIEW) • None
  • 24. Additional dimension fields • Entity (prefix_ENTITY) UserDefined1 UserDefined2 UserDefined3 IsICP DefaultCurrency (lookup to ID in Value Dimension table) • Entity Parent (prefix_PARENT) UserDefined1 UserDefined2 UserDefined3 IsICP DefaultCurrency (lookup to ID in Value Dimension table) • Value (prefix_VALUE) • None • ICP (prefix_ICP) • None
  • 25. Additional dimension fields • Account (prefix_ACCOUNT) UserDefined1 UserDefined2 UserDefined3 IsCalculated IsConsolidated IsICP AccountType • Custom (prefix_CUSTOMX) UserDefined1 UserDefined2 UserDefined3 IsCalculated SwitchSign SwitchType AggWeight
  • 26. SQL View creates data table view from source tables: Combined View • Standard SQL provided in appendix • Change table prefix • Adjust number of customs • Recommend all access to data through View
  • 28. Export types • Metadata Only • Selected Metadata Only • Standard • Data Warehouse • Essbase
  • 29. Export types • Metadata Only • All metadata • Fact table empty • Standard export table format • Selected Metadata Only • Same as Metadata Only, but exports only members selected
  • 30. Standard Export – One table per dimension – Separate dimension tables for Entity and Parent
  • 31. Standard Export – Child repeated in dimension table each time it appears in under a new parent in the source hierarchy – Separate join needed for base data and parent adjustment • ID and ParentID in Entity table • ID in Entity table and ID in Parent table ENTITY Table
  • 32. Data Warehouse – ParentID and ParentLabel are dropped from the dimension tables. – The entity parent table (prefix_PARENT) is also dropped – A second table is created for each dimension (prefix_dimension_PARENT) which holds the parent-child information
  • 33. Data Warehouse – Can join Fact table to Entity dimension table without duplicating values – More complex when parent information is required (three-table join) ENTITY Table ENTITY_PARENT Table
  • 34. Essbase Essbase – A second table for each dimension (prefix_dimension_BASE) – Parent entity table
  • 35. Essbase – BASE table lists the base members under each parent in the dimension ENTITY Table ENTITY_BASE Table
  • 37. Eliminations/Adjustments HFM built to support multiple, alternate financial consolidations of the same base data • Two levels of data: – Data and adjustments in base entity ‒ No parent specified ‒ Currency specified in Value Dimension member – Eliminations/adjustments in specific parent/child combinations ‒ Parent specified ‒ Named Value Dimension member ‒ Currency not stated, but in currency of parent
  • 38. Example • France base entity located in two alternate hierarchies • Europe parent in first hierarchy • Corp parent in second hierarchy • Three records loaded to France for 10K, 20K and 5K (total 35K) • Application consolidated • Automatic eliminations performed by HFM • Europe total now 30K • Corp total now 15K
  • 39. France Europe Europe.France France HFM Consolidation Corp Data for France under Corp parent Data for France under Europe parent France Corp.France France
  • 40. France Europe - 5K 35K HFM Consolidation Corp Data for France under Corp parent Data for France under Europe parent France -20K 35K 30K 15K
  • 41. Translation • Default currency assigned to each member • Translation occurs for child member when consolidated to parent with different currency • Translation occurs before parent adjustments
  • 42. - USD - USD - CAD - EUR - GBP Example • Data loaded to base members as follows: • USA – 50K USD • Canada – 40K CAD • France – 15K EUR • UK – 10K GBP • Consolidation/translation performed - - EUR
  • 43. Translation - USD - USD - CAD - EUR - EUR - GBP Base data for each entity after consolidation/translation
  • 45. ● Assumptions ● Can aggregate in target system ● Target system needs base data in a single currency ● Export in Data Warehouse format ● Export only base members of Account, ICP, and Custom dimensions ● Separate base data export from adjustment data export ● Translation handled on case-by-case basis Recommendations
  • 46. Export in Data Warehouse Format ● Each member present only once in dimension tables ● Simple join with no duplicates ENTITY Table ENTITY_PARENT Table
  • 47. Export Base Members for Accounts, ICP and Customs ● In HFM, parent members in ICP, Account and Custom dimensions calculated dynamically in RAM as required ● Overhead for processing ● Overhead for virtual data into real
  • 48. ● Base data - Load to Entity Split Export Entity [Base] Value Named currency, eg. USD, CAD
  • 49. ● Adjustment data - Load based on Entity Parent (except named currency Adjs) - Create base members under parent in target system as needed - Identify currency by Default Currency of the parent Split Export Entity [Hierarchy] Named currency Adjs Value [Parent Adjs] [Eliminaton] [Contribution Adjs] Transform
  • 50. ● Define all HFM parent members with the same default currency ● Main or alternate hierarchy ● If alternate, additional processing time ● Force Translate ● High overhead ● Will not update during consolidation ● Eliminations cannot be force translated ● Special handling for <Parent Curr Adjs> ● Translate downstream ● SQL ● Target application Translation - Possible Solutions
  • 51. Other Good Things to Know
  • 52. Templates • Templates can be created to save export parameters – Cannot be shared between users – Not part of LCM export – Copy utility on HFM server • Start  All Programs  Oracle EPM System  Financial Management  Utilities – Recommend Taskflows
  • 53. Utility tables — HFM_EA_EXTRACT Prefix (relational database prefix) AppName (HFM application name) Task (aggregation option) Dimension (ID number) dTimestamp (1900 date system) — Tracks the time each table was last updated — View provided to convert to readable form — HFM_LOCK_ACCESS — Tracks when schemas are being written to prevent simultaneous updates
  • 54. ● Task flows ● API Code ● Http Listener (new) – see HFM Developer’s Guide Automation
  • 55. Other Considerations • Correct upper level data depends on HFM being properly consolidated before export • EA does not trigger consolidation or translation • Data keeps the same sign it had in HFM • Revenue, Liabilities positive • Must accommodate if aggregating downstream • Dimension IDs in order they have been added to the system • Member ID • Not always suitable for dimension builds
  • 56. Handy things you can do with EA….
  • 57. • Approach ● Export all base data for top entities in two HFM applications to be compared ● Compare with database query • Benefits ● Comprehensive comparison (all dimensions) ● Automated ● No maintenance ● Always captures data present in one application, but not the other Automated Reconciliation
  • 58. • Why it Works ● Parent members in Account, ICP and Custom dimensions calculated dynamically in RAM ● Base data compare ● Assumptions ● Aggregation weights the same in both applications ● Entity value changes are not offset in a higher entity Automated Reconciliation
  • 59. • Setup ● Create export template for first data set (prefix = TIE1) ● Execute export ● Create SQL data view ● Repeat steps for second data set (prefix = TIE2) ● Create comparison data view ● Subsequent Steps ● Rerun exports ● Run compare query Steps
  • 61. Recon
  • 64. Tools for Accessing the Data • Oracle • Oracle SQL Developer • http://www.oracle.com/technetwork/developer-tools/sql- developer/overview/index.html • SQL Server ● Microsoft SQL Server Management Studio Express ● http://www.microsoft.com/en-us/download/details.aspx?id=8961 ● MS Excel ● MS Access