SlideShare une entreprise Scribd logo
1  sur  26
Télécharger pour lire hors ligne
How to Load Data More Quickly and Accurately
into Oracle Life Sciences Data Hub
2
ABOUT PERFICIENT
Perficient is a leading information
technology consulting firm serving
clients throughout North America.
We help clients implement digital experience, business
optimization, and industry solutions that cultivate and captivate
customers, drive efficiency and productivity, integrate business
processes, reduce costs, and create a more agile enterprise.
3
Founded in 1997
Public, NASDAQ: PRFT
2014 revenue $456.7 million
Major market locations:
Allentown, Atlanta, Ann Arbor, Boston, Charlotte,
Chattanooga, Chicago, Cincinnati, Columbus,
Dallas, Denver, Detroit, Fairfax, Houston,
Indianapolis, Lafayette, Milwaukee, Minneapolis,
New York City, Northern California, Oxford (UK),
Southern California, St. Louis, Toronto
Global delivery centers in China and India
>2,600 colleagues
Dedicated solution practices
~90% repeat business rate
Alliance partnerships with major technology vendors
Multiple vendor/industry technology and growth awards
PERFICIENT PROFILE
4
Business Process
Management
Customer Relationship
Management
Enterprise Performance
Management
Enterprise Information
Solutions
Enterprise Resource
Planning
Experience Design
Portal / Collaboration
Content Management
Information Management
Mobile
BUSINESSSOLUTIONS
50+PARTNERS
Safety / PV
Clinical Data
Management
Electronic Data Capture
Medical Coding
Data Warehousing
Data Analytics
Clinical Trial
Management
Precision Medicine
CLINICAL/HEALTHCAREIT
Consulting
Implementation
Integration
Migration
Upgrade
Managed Services
Private Cloud Hosting
Validation
Study Setup
Project Management
Application Development
Software Licensing
Application Support
Staff Augmentation
Training
SERVICES
OUR SOLUTIONS PORTFOLIO
5
WELCOME & INTRODUCTION
Extensive clinical trial software implementation experience
• 20 years of experience in the life sciences industry
• Extensive experience with Oracle’s clinical data warehousing, analytics, and
precision medicine applications
• Expertise in improving and standardizing business processes to support best
practices and the ever-changing regulatory requirements
Kathryn Hanson
Solutions Architect, Life Sciences
Perficient
6
WHAT’S TRENDING IN TECHNOLOGY?
• Big Data
• How do we acquire data from other sources?
• How do we manage high volume data?
• Data analytics
• What conclusions can we draw from the raw data?
• Data privacy and security
• How do we control who has access to our data?
7
WHICH ISSUES ARE WE FACING?
The pharmaceutical industry has many of these same technology issues:
• How do we acquire data from external sources?
• How do we manage high volume data?
• How can we present that data for analysis?
• How can we secure our data against unauthorized access?
How can we acquire and manage the data we
receive from many different sources?
8
WHAT WOULD WE LIKE IN A SOLUTION?
 Hands off and automated
– After the initial setup only routine monitoring is needed
 Flexible
• Adapts as data changes over time
• Handles multiple file types
• Can start other jobs as needed when the load is complete
 Reliable and secure
 Efficient and performs well on high-volume data
 Simple to implement
9
THE SOLUTION: AUTOMATED FILE LOAD
Quality
Assurance
Secure
Staging Area
File
Load
Utility
Warehouse
Study
Staged data
Transformed data
Analysis programs
Data file 1 2
3
4
10
WHAT DO I NEED TO GET STARTED?
• A repository to receive and manage the clinical data
(in this presentation that’s the Oracle Life Sciences Warehouse)
• Resources to set up and monitor the system
• Secure directories to receive and process data files
• Utility software to process the files and load the data into the repository
• Scheduling software to control when, where, and how jobs run
• A way to register new data sources to the utility
11
HOW DO I BEGIN LOADING DATA?
• Work with the vendor to
• Understand the file format, data structures, file naming conventions, etc.
• Provide secure access to the download area
• Receive a sample data file
• Register the new data source in the utility
• Set up the storage areas in the repository
• Test the new data source to verify it loads correctly into the repository
• Complete any other setup needed so authorized users can access the
data (for transformations, visualizations, etc.)
12
SETTING UP THE DIRECTORIES
<root directory>
+
+
+
+
stagedir
processdir
rejectdir
scripts
successdir
+
—
The data file is dropped into this watched directory
The pre-processed files are moved here for final
processing and loading into the warehouse
The data file is moved here if the file load fails
The data file is moved here when the job finishes
successfully
Utility software is stored in this directory
13
SETTING UP STUDY REGISTRATION
The first 3 attributes identify the study
and data type
These 3 attributes tell the utility where
to store the data in the repository
There are many options that control
how the data should be loaded
14
NAMING CONVENTIONS FOR THE DATA FILE
File naming conventions ensure that the utility can identify
the registered study
CDISC01 – The study name
FULL – The type of data that will be loaded
DEV – Is this development, test, or production data?
201509211010 – A unique date and time stamp
15
ADDING OTHER PROCESSING OPTIONS
The utility lets you specify how you want to handle the data:
• Running another job after the data loads
• Handling blinded data
• Sending out notifications
• Processing large files
• Managing changes in data structures
• Identifying file formats for text files
16
SETTING UP THE REPOSITORY
The data will be loaded into the work area under which
you registered the study.
Warehouse
Study
Staged data
Transformed data
Analysis programs
17
WHAT THE UTILITY DOES
Your vendor has uploaded a data file; now the utility…
1. Detects the file and runs a set of preprocessing checks
2. Extracts all the datasets (text files, etc.)
3. Extracts the metadata for each dataset
4. Verifies the metadata for each dataset. If the dataset has been
loaded before, either
• The new metadata must match that in the previous load
OR
• The study allows compatible metadata updates
18
WHAT THE UTILITY DOES
The utility continues if everything checks out by …
5. Creating a load set for each dataset in the data file
(if one doesn’t already exist)
6. Updating the repository metadata, if required
7. Starting each of the load sets
8. Monitoring the running jobs for errors
9. Sending notifications to users, as required, when all
the the jobs are done
19
THE RESULTS
For efficiency, the utility processes all the datasets
in the file in parallel…
20
THE RESULTS
…and when all the jobs are done the data is loaded and
available in the repository.
21
WHAT HAPPENS IF THE METADATA CHANGES?
• One of the options you can choose is
whether or not to allow changes to a
table’s metadata
• If that flag is “Y”, the utility will accept
and process compatible changes
• For example, you need to add 2 new
columns to the table…
22
WHAT HAPPENS IF THE METADATA CHANGES?
The table in the repository now has those two additional columns:
23
DOES THE UTILITY MEET OUR GOALS?
 Automated and hands off
 Flexible
 Efficient
 Simple to implement
24
QUESTIONS
Type your question into the
chat box
25
FOLLOW US ONLINE
• Perficient.com/SocialMedia
• Facebook.com/Perficient
• Twitter.com/Perficient_LS
• Blogs.perficient.com/LifeSciences
26
THANK YOU

Contenu connexe

Tendances

Engage Patients, Reduce Manual Processes and Drive Key Insights with Interope...
Engage Patients, Reduce Manual Processes and Drive Key Insights with Interope...Engage Patients, Reduce Manual Processes and Drive Key Insights with Interope...
Engage Patients, Reduce Manual Processes and Drive Key Insights with Interope...Perficient, Inc.
 
How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...
How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...
How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...Perficient
 
How to Make Wise Post-Production Changes to Oracle Clinical/Remote Data Captu...
How to Make Wise Post-Production Changes to Oracle Clinical/Remote Data Captu...How to Make Wise Post-Production Changes to Oracle Clinical/Remote Data Captu...
How to Make Wise Post-Production Changes to Oracle Clinical/Remote Data Captu...Perficient, Inc.
 
Impact 2014: Optimizing a Retail Distribution chain from Cargo Shipment to St...
Impact 2014: Optimizing a Retail Distribution chain from Cargo Shipment to St...Impact 2014: Optimizing a Retail Distribution chain from Cargo Shipment to St...
Impact 2014: Optimizing a Retail Distribution chain from Cargo Shipment to St...Perficient, Inc.
 
How to Drive Value from Operational Risk Data - Part 2
How to Drive Value from Operational Risk Data - Part 2How to Drive Value from Operational Risk Data - Part 2
How to Drive Value from Operational Risk Data - Part 2Perficient, Inc.
 
The ABCs of Clinical Trial Management Systems
The ABCs of Clinical Trial Management SystemsThe ABCs of Clinical Trial Management Systems
The ABCs of Clinical Trial Management SystemsPerficient, Inc.
 
Healthcare Enterprise Data Model: The Buy vs. Build Debate
Healthcare Enterprise Data Model: The Buy vs. Build DebateHealthcare Enterprise Data Model: The Buy vs. Build Debate
Healthcare Enterprise Data Model: The Buy vs. Build DebatePerficient, Inc.
 
Optimizing Siebel CTMS with Electronic Trip Reports
Optimizing Siebel CTMS with Electronic Trip ReportsOptimizing Siebel CTMS with Electronic Trip Reports
Optimizing Siebel CTMS with Electronic Trip ReportsPerficient, Inc.
 
Data Virtualization Modernizes Biobanking
Data Virtualization Modernizes BiobankingData Virtualization Modernizes Biobanking
Data Virtualization Modernizes BiobankingDenodo
 
Drive Compliance and Profit with Oracle Healthcare Analytics
Drive Compliance and Profit with Oracle Healthcare AnalyticsDrive Compliance and Profit with Oracle Healthcare Analytics
Drive Compliance and Profit with Oracle Healthcare AnalyticsPerficient, Inc.
 
Going Beyond the EMR for Data-driven Insights in Healthcare
Going Beyond the EMR for Data-driven Insights in HealthcareGoing Beyond the EMR for Data-driven Insights in Healthcare
Going Beyond the EMR for Data-driven Insights in HealthcarePerficient, Inc.
 
Population Health Colloquium 2015: Mini Summit IV: Who is Your Champion of Cl...
Population Health Colloquium 2015: Mini Summit IV: Who is Your Champion of Cl...Population Health Colloquium 2015: Mini Summit IV: Who is Your Champion of Cl...
Population Health Colloquium 2015: Mini Summit IV: Who is Your Champion of Cl...Perficient, Inc.
 
PeopleSoft Accelerate for Healthcare
PeopleSoft Accelerate for HealthcarePeopleSoft Accelerate for Healthcare
PeopleSoft Accelerate for HealthcareJGIshare
 
HIPAA Compliance and its Relationship to Pharmacovigilance
HIPAA Compliance and its Relationship to PharmacovigilanceHIPAA Compliance and its Relationship to Pharmacovigilance
HIPAA Compliance and its Relationship to PharmacovigilancePerficient, Inc.
 
Tackle healthcare interoperability challenges and improve transitions of care v3
Tackle healthcare interoperability challenges and improve transitions of care v3Tackle healthcare interoperability challenges and improve transitions of care v3
Tackle healthcare interoperability challenges and improve transitions of care v3Perficient, Inc.
 
Seeing Is Believing: How Clinical Trial Data Transparency is Changing How an...
Seeing Is Believing:  How Clinical Trial Data Transparency is Changing How an...Seeing Is Believing:  How Clinical Trial Data Transparency is Changing How an...
Seeing Is Believing: How Clinical Trial Data Transparency is Changing How an...d-Wise Technologies
 
ACO = HIE + Analytics - a Healthcare IT Presentation
ACO = HIE + Analytics - a Healthcare IT PresentationACO = HIE + Analytics - a Healthcare IT Presentation
ACO = HIE + Analytics - a Healthcare IT PresentationPerficient, Inc.
 
Building a Better Healthcare Dashboard
Building a Better Healthcare DashboardBuilding a Better Healthcare Dashboard
Building a Better Healthcare DashboardPerficient, Inc.
 
The 5 Most Significant Changes in Argus Safety 8.1
The 5 Most Significant Changes in Argus Safety 8.1The 5 Most Significant Changes in Argus Safety 8.1
The 5 Most Significant Changes in Argus Safety 8.1Perficient, Inc.
 

Tendances (20)

Engage Patients, Reduce Manual Processes and Drive Key Insights with Interope...
Engage Patients, Reduce Manual Processes and Drive Key Insights with Interope...Engage Patients, Reduce Manual Processes and Drive Key Insights with Interope...
Engage Patients, Reduce Manual Processes and Drive Key Insights with Interope...
 
How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...
How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...
How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...
 
How to Make Wise Post-Production Changes to Oracle Clinical/Remote Data Captu...
How to Make Wise Post-Production Changes to Oracle Clinical/Remote Data Captu...How to Make Wise Post-Production Changes to Oracle Clinical/Remote Data Captu...
How to Make Wise Post-Production Changes to Oracle Clinical/Remote Data Captu...
 
Impact 2014: Optimizing a Retail Distribution chain from Cargo Shipment to St...
Impact 2014: Optimizing a Retail Distribution chain from Cargo Shipment to St...Impact 2014: Optimizing a Retail Distribution chain from Cargo Shipment to St...
Impact 2014: Optimizing a Retail Distribution chain from Cargo Shipment to St...
 
How to Drive Value from Operational Risk Data - Part 2
How to Drive Value from Operational Risk Data - Part 2How to Drive Value from Operational Risk Data - Part 2
How to Drive Value from Operational Risk Data - Part 2
 
The ABCs of Clinical Trial Management Systems
The ABCs of Clinical Trial Management SystemsThe ABCs of Clinical Trial Management Systems
The ABCs of Clinical Trial Management Systems
 
Healthcare Enterprise Data Model: The Buy vs. Build Debate
Healthcare Enterprise Data Model: The Buy vs. Build DebateHealthcare Enterprise Data Model: The Buy vs. Build Debate
Healthcare Enterprise Data Model: The Buy vs. Build Debate
 
Optimizing Siebel CTMS with Electronic Trip Reports
Optimizing Siebel CTMS with Electronic Trip ReportsOptimizing Siebel CTMS with Electronic Trip Reports
Optimizing Siebel CTMS with Electronic Trip Reports
 
Data Virtualization Modernizes Biobanking
Data Virtualization Modernizes BiobankingData Virtualization Modernizes Biobanking
Data Virtualization Modernizes Biobanking
 
Drive Compliance and Profit with Oracle Healthcare Analytics
Drive Compliance and Profit with Oracle Healthcare AnalyticsDrive Compliance and Profit with Oracle Healthcare Analytics
Drive Compliance and Profit with Oracle Healthcare Analytics
 
Going Beyond the EMR for Data-driven Insights in Healthcare
Going Beyond the EMR for Data-driven Insights in HealthcareGoing Beyond the EMR for Data-driven Insights in Healthcare
Going Beyond the EMR for Data-driven Insights in Healthcare
 
Population Health Colloquium 2015: Mini Summit IV: Who is Your Champion of Cl...
Population Health Colloquium 2015: Mini Summit IV: Who is Your Champion of Cl...Population Health Colloquium 2015: Mini Summit IV: Who is Your Champion of Cl...
Population Health Colloquium 2015: Mini Summit IV: Who is Your Champion of Cl...
 
PeopleSoft Accelerate for Healthcare
PeopleSoft Accelerate for HealthcarePeopleSoft Accelerate for Healthcare
PeopleSoft Accelerate for Healthcare
 
HIPAA Compliance and its Relationship to Pharmacovigilance
HIPAA Compliance and its Relationship to PharmacovigilanceHIPAA Compliance and its Relationship to Pharmacovigilance
HIPAA Compliance and its Relationship to Pharmacovigilance
 
IDMP
IDMPIDMP
IDMP
 
Tackle healthcare interoperability challenges and improve transitions of care v3
Tackle healthcare interoperability challenges and improve transitions of care v3Tackle healthcare interoperability challenges and improve transitions of care v3
Tackle healthcare interoperability challenges and improve transitions of care v3
 
Seeing Is Believing: How Clinical Trial Data Transparency is Changing How an...
Seeing Is Believing:  How Clinical Trial Data Transparency is Changing How an...Seeing Is Believing:  How Clinical Trial Data Transparency is Changing How an...
Seeing Is Believing: How Clinical Trial Data Transparency is Changing How an...
 
ACO = HIE + Analytics - a Healthcare IT Presentation
ACO = HIE + Analytics - a Healthcare IT PresentationACO = HIE + Analytics - a Healthcare IT Presentation
ACO = HIE + Analytics - a Healthcare IT Presentation
 
Building a Better Healthcare Dashboard
Building a Better Healthcare DashboardBuilding a Better Healthcare Dashboard
Building a Better Healthcare Dashboard
 
The 5 Most Significant Changes in Argus Safety 8.1
The 5 Most Significant Changes in Argus Safety 8.1The 5 Most Significant Changes in Argus Safety 8.1
The 5 Most Significant Changes in Argus Safety 8.1
 

En vedette (15)

Discount driver
Discount driverDiscount driver
Discount driver
 
Tiny homes4thehomeless (1)
Tiny homes4thehomeless (1)Tiny homes4thehomeless (1)
Tiny homes4thehomeless (1)
 
Health for all
Health for allHealth for all
Health for all
 
Coder keyspres
Coder keyspresCoder keyspres
Coder keyspres
 
Gov gush chasemoore_rivertonhs-ut_v1.2
Gov gush chasemoore_rivertonhs-ut_v1.2Gov gush chasemoore_rivertonhs-ut_v1.2
Gov gush chasemoore_rivertonhs-ut_v1.2
 
The great traffic stop de escalator
The great traffic stop de escalatorThe great traffic stop de escalator
The great traffic stop de escalator
 
Apti tekk
Apti tekkApti tekk
Apti tekk
 
Colo clean hsuec (1)
Colo clean hsuec (1)Colo clean hsuec (1)
Colo clean hsuec (1)
 
Bird scare device air dancer
Bird scare device   air dancerBird scare device   air dancer
Bird scare device air dancer
 
Headshot (1)
Headshot (1)Headshot (1)
Headshot (1)
 
Deflame presentation
Deflame presentationDeflame presentation
Deflame presentation
 
Valle
ValleValle
Valle
 
P raise the pringle
P raise the pringleP raise the pringle
P raise the pringle
 
My lunch
My lunchMy lunch
My lunch
 
How To Embed SlideShare Shows Into WordPress.com
How To Embed SlideShare Shows Into WordPress.comHow To Embed SlideShare Shows Into WordPress.com
How To Embed SlideShare Shows Into WordPress.com
 

Similaire à How to Load Data More Quickly and Accurately into Oracle's Life Sciences Data Hub

Warehouse Planning and Implementation
Warehouse Planning and ImplementationWarehouse Planning and Implementation
Warehouse Planning and ImplementationSHIKHA GAUTAM
 
Allotrope Foundation & OSTHUS at SmartLab Exchange 2015: Update on the Allotr...
Allotrope Foundation & OSTHUS at SmartLab Exchange 2015: Update on the Allotr...Allotrope Foundation & OSTHUS at SmartLab Exchange 2015: Update on the Allotr...
Allotrope Foundation & OSTHUS at SmartLab Exchange 2015: Update on the Allotr...OSTHUS
 
Data Engineering.pdf
Data Engineering.pdfData Engineering.pdf
Data Engineering.pdfDatacademy.ai
 
Starting Your Modern DataOps Journey
Starting Your Modern DataOps JourneyStarting Your Modern DataOps Journey
Starting Your Modern DataOps JourneyCloverDX
 
DATA WRANGLING presentation.pptx
DATA WRANGLING presentation.pptxDATA WRANGLING presentation.pptx
DATA WRANGLING presentation.pptxAbdullahAbbasi55
 
Decoding the Role of a Data Engineer.pdf
Decoding the Role of a Data Engineer.pdfDecoding the Role of a Data Engineer.pdf
Decoding the Role of a Data Engineer.pdfDatavalley.ai
 
Neoaug 2013 critical success factors for data quality management-chain-sys-co...
Neoaug 2013 critical success factors for data quality management-chain-sys-co...Neoaug 2013 critical success factors for data quality management-chain-sys-co...
Neoaug 2013 critical success factors for data quality management-chain-sys-co...Chain Sys Corporation
 
Data Warehouses & Deployment By Ankita dubey
Data Warehouses & Deployment By Ankita dubeyData Warehouses & Deployment By Ankita dubey
Data Warehouses & Deployment By Ankita dubeyAnkita Dubey
 
ETL processes , Datawarehouse and Datamarts.pptx
ETL processes , Datawarehouse and Datamarts.pptxETL processes , Datawarehouse and Datamarts.pptx
ETL processes , Datawarehouse and Datamarts.pptxParnalSatle
 
What is data science ?
What is data science ?What is data science ?
What is data science ?ShahlKv
 
What are the key points to focus on before starting to learn ETL Development....
What are the key points to focus on before starting to learn ETL Development....What are the key points to focus on before starting to learn ETL Development....
What are the key points to focus on before starting to learn ETL Development....kzayra69
 
Using hadoop for enterprise data management
Using hadoop for enterprise data managementUsing hadoop for enterprise data management
Using hadoop for enterprise data managementEstuate, Inc.
 
A Detailed Guide To Test Data Management.pdf
A Detailed Guide To Test Data Management.pdfA Detailed Guide To Test Data Management.pdf
A Detailed Guide To Test Data Management.pdfEnov8
 
BCS DMSG Healthcare Data Management : Transformation through Migration 26-1...
BCS DMSG Healthcare Data Management : Transformation through Migration   26-1...BCS DMSG Healthcare Data Management : Transformation through Migration   26-1...
BCS DMSG Healthcare Data Management : Transformation through Migration 26-1...BCS Data Management Specialist Group
 
TDWI Checklist Report: Active Data Archiving
TDWI Checklist Report:  Active Data ArchivingTDWI Checklist Report:  Active Data Archiving
TDWI Checklist Report: Active Data ArchivingRainStor
 
UCSF Informatics Day 2014 - Jocel Dumlao, "REDCap / MyResearch"
UCSF Informatics Day 2014 - Jocel Dumlao, "REDCap / MyResearch"UCSF Informatics Day 2014 - Jocel Dumlao, "REDCap / MyResearch"
UCSF Informatics Day 2014 - Jocel Dumlao, "REDCap / MyResearch"CTSI at UCSF
 
Data Warehouse Basic Guide
Data Warehouse Basic GuideData Warehouse Basic Guide
Data Warehouse Basic Guidethomasmary607
 

Similaire à How to Load Data More Quickly and Accurately into Oracle's Life Sciences Data Hub (20)

Warehouse Planning and Implementation
Warehouse Planning and ImplementationWarehouse Planning and Implementation
Warehouse Planning and Implementation
 
Allotrope Foundation & OSTHUS at SmartLab Exchange 2015: Update on the Allotr...
Allotrope Foundation & OSTHUS at SmartLab Exchange 2015: Update on the Allotr...Allotrope Foundation & OSTHUS at SmartLab Exchange 2015: Update on the Allotr...
Allotrope Foundation & OSTHUS at SmartLab Exchange 2015: Update on the Allotr...
 
Data Engineering.pdf
Data Engineering.pdfData Engineering.pdf
Data Engineering.pdf
 
Starting Your Modern DataOps Journey
Starting Your Modern DataOps JourneyStarting Your Modern DataOps Journey
Starting Your Modern DataOps Journey
 
Data warehouse testing
Data warehouse testingData warehouse testing
Data warehouse testing
 
Data Mining
Data MiningData Mining
Data Mining
 
DATA WRANGLING presentation.pptx
DATA WRANGLING presentation.pptxDATA WRANGLING presentation.pptx
DATA WRANGLING presentation.pptx
 
Decoding the Role of a Data Engineer.pdf
Decoding the Role of a Data Engineer.pdfDecoding the Role of a Data Engineer.pdf
Decoding the Role of a Data Engineer.pdf
 
Neoaug 2013 critical success factors for data quality management-chain-sys-co...
Neoaug 2013 critical success factors for data quality management-chain-sys-co...Neoaug 2013 critical success factors for data quality management-chain-sys-co...
Neoaug 2013 critical success factors for data quality management-chain-sys-co...
 
Data Warehouses & Deployment By Ankita dubey
Data Warehouses & Deployment By Ankita dubeyData Warehouses & Deployment By Ankita dubey
Data Warehouses & Deployment By Ankita dubey
 
ETL processes , Datawarehouse and Datamarts.pptx
ETL processes , Datawarehouse and Datamarts.pptxETL processes , Datawarehouse and Datamarts.pptx
ETL processes , Datawarehouse and Datamarts.pptx
 
What is data science ?
What is data science ?What is data science ?
What is data science ?
 
What are the key points to focus on before starting to learn ETL Development....
What are the key points to focus on before starting to learn ETL Development....What are the key points to focus on before starting to learn ETL Development....
What are the key points to focus on before starting to learn ETL Development....
 
Using hadoop for enterprise data management
Using hadoop for enterprise data managementUsing hadoop for enterprise data management
Using hadoop for enterprise data management
 
A Detailed Guide To Test Data Management.pdf
A Detailed Guide To Test Data Management.pdfA Detailed Guide To Test Data Management.pdf
A Detailed Guide To Test Data Management.pdf
 
BCS DMSG Healthcare Data Management : Transformation through Migration 26-1...
BCS DMSG Healthcare Data Management : Transformation through Migration   26-1...BCS DMSG Healthcare Data Management : Transformation through Migration   26-1...
BCS DMSG Healthcare Data Management : Transformation through Migration 26-1...
 
TDWI Checklist Report: Active Data Archiving
TDWI Checklist Report:  Active Data ArchivingTDWI Checklist Report:  Active Data Archiving
TDWI Checklist Report: Active Data Archiving
 
File auditing on NetApp Filer
File auditing on NetApp Filer File auditing on NetApp Filer
File auditing on NetApp Filer
 
UCSF Informatics Day 2014 - Jocel Dumlao, "REDCap / MyResearch"
UCSF Informatics Day 2014 - Jocel Dumlao, "REDCap / MyResearch"UCSF Informatics Day 2014 - Jocel Dumlao, "REDCap / MyResearch"
UCSF Informatics Day 2014 - Jocel Dumlao, "REDCap / MyResearch"
 
Data Warehouse Basic Guide
Data Warehouse Basic GuideData Warehouse Basic Guide
Data Warehouse Basic Guide
 

Plus de Perficient, Inc.

Driving Strong 2020 Holiday Season Results
Driving Strong 2020 Holiday Season ResultsDriving Strong 2020 Holiday Season Results
Driving Strong 2020 Holiday Season ResultsPerficient, Inc.
 
Transforming Pharmacovigilance Workflows with AI & Automation
Transforming Pharmacovigilance Workflows with AI & Automation Transforming Pharmacovigilance Workflows with AI & Automation
Transforming Pharmacovigilance Workflows with AI & Automation Perficient, Inc.
 
The Secret to Acquiring and Retaining Customers in Financial Services
The Secret to Acquiring and Retaining Customers in Financial ServicesThe Secret to Acquiring and Retaining Customers in Financial Services
The Secret to Acquiring and Retaining Customers in Financial ServicesPerficient, Inc.
 
Oracle Strategic Modeling Live: Defined. Discussed. Demonstrated.
Oracle Strategic Modeling Live: Defined. Discussed. Demonstrated.Oracle Strategic Modeling Live: Defined. Discussed. Demonstrated.
Oracle Strategic Modeling Live: Defined. Discussed. Demonstrated.Perficient, Inc.
 
Content, Commerce, and... COVID
Content, Commerce, and... COVIDContent, Commerce, and... COVID
Content, Commerce, and... COVIDPerficient, Inc.
 
Centene's Financial Transformation Journey: A OneStream Success Story
Centene's Financial Transformation Journey: A OneStream Success StoryCentene's Financial Transformation Journey: A OneStream Success Story
Centene's Financial Transformation Journey: A OneStream Success StoryPerficient, Inc.
 
Automate Medical Coding With WHODrug Koda
Automate Medical Coding With WHODrug KodaAutomate Medical Coding With WHODrug Koda
Automate Medical Coding With WHODrug KodaPerficient, Inc.
 
Preparing for Your Oracle, Medidata, and Veeva CTMS Migration Project
Preparing for Your Oracle, Medidata, and Veeva CTMS Migration ProjectPreparing for Your Oracle, Medidata, and Veeva CTMS Migration Project
Preparing for Your Oracle, Medidata, and Veeva CTMS Migration ProjectPerficient, Inc.
 
Accelerating Partner Management: How Manufacturers Can Navigate Covid-19
Accelerating Partner Management: How Manufacturers Can Navigate Covid-19Accelerating Partner Management: How Manufacturers Can Navigate Covid-19
Accelerating Partner Management: How Manufacturers Can Navigate Covid-19Perficient, Inc.
 
The Critical Role of Audience Intelligence with Eric Enge and Rand Fishkin
The Critical Role of Audience Intelligence with Eric Enge and Rand FishkinThe Critical Role of Audience Intelligence with Eric Enge and Rand Fishkin
The Critical Role of Audience Intelligence with Eric Enge and Rand FishkinPerficient, Inc.
 
Cardtronics Future Ready with Oracle EPM Cloud
Cardtronics Future Ready with Oracle EPM CloudCardtronics Future Ready with Oracle EPM Cloud
Cardtronics Future Ready with Oracle EPM CloudPerficient, Inc.
 
Teams Summit - What is New and Coming
Teams Summit -  What is New and ComingTeams Summit -  What is New and Coming
Teams Summit - What is New and ComingPerficient, Inc.
 
Empower Your Organization with Teams & Remote Work Crisis Management
Empower Your Organization with Teams & Remote Work Crisis ManagementEmpower Your Organization with Teams & Remote Work Crisis Management
Empower Your Organization with Teams & Remote Work Crisis ManagementPerficient, Inc.
 
Adoption & Change Management Overview
Adoption & Change Management OverviewAdoption & Change Management Overview
Adoption & Change Management OverviewPerficient, Inc.
 
Microsoft Teams: Measuring Activity of Employees Working from Home
Microsoft Teams: Measuring Activity of Employees Working from HomeMicrosoft Teams: Measuring Activity of Employees Working from Home
Microsoft Teams: Measuring Activity of Employees Working from HomePerficient, Inc.
 
Securing Teams with Microsoft 365 Security for Remote Work
Securing Teams with Microsoft 365 Security for Remote WorkSecuring Teams with Microsoft 365 Security for Remote Work
Securing Teams with Microsoft 365 Security for Remote WorkPerficient, Inc.
 
Infrastructure Best Practices for Teams Remote Workers
Infrastructure Best Practices for Teams Remote WorkersInfrastructure Best Practices for Teams Remote Workers
Infrastructure Best Practices for Teams Remote WorkersPerficient, Inc.
 
Accelerate Adoption for Microsoft Teams
Accelerate Adoption for Microsoft TeamsAccelerate Adoption for Microsoft Teams
Accelerate Adoption for Microsoft TeamsPerficient, Inc.
 
Preparing for Project Cortex and the Future of Knowledge Management
Preparing for Project Cortex and the Future of Knowledge ManagementPreparing for Project Cortex and the Future of Knowledge Management
Preparing for Project Cortex and the Future of Knowledge ManagementPerficient, Inc.
 
Utilizing Microsoft 365 Security for Remote Work
Utilizing Microsoft 365 Security for Remote Work Utilizing Microsoft 365 Security for Remote Work
Utilizing Microsoft 365 Security for Remote Work Perficient, Inc.
 

Plus de Perficient, Inc. (20)

Driving Strong 2020 Holiday Season Results
Driving Strong 2020 Holiday Season ResultsDriving Strong 2020 Holiday Season Results
Driving Strong 2020 Holiday Season Results
 
Transforming Pharmacovigilance Workflows with AI & Automation
Transforming Pharmacovigilance Workflows with AI & Automation Transforming Pharmacovigilance Workflows with AI & Automation
Transforming Pharmacovigilance Workflows with AI & Automation
 
The Secret to Acquiring and Retaining Customers in Financial Services
The Secret to Acquiring and Retaining Customers in Financial ServicesThe Secret to Acquiring and Retaining Customers in Financial Services
The Secret to Acquiring and Retaining Customers in Financial Services
 
Oracle Strategic Modeling Live: Defined. Discussed. Demonstrated.
Oracle Strategic Modeling Live: Defined. Discussed. Demonstrated.Oracle Strategic Modeling Live: Defined. Discussed. Demonstrated.
Oracle Strategic Modeling Live: Defined. Discussed. Demonstrated.
 
Content, Commerce, and... COVID
Content, Commerce, and... COVIDContent, Commerce, and... COVID
Content, Commerce, and... COVID
 
Centene's Financial Transformation Journey: A OneStream Success Story
Centene's Financial Transformation Journey: A OneStream Success StoryCentene's Financial Transformation Journey: A OneStream Success Story
Centene's Financial Transformation Journey: A OneStream Success Story
 
Automate Medical Coding With WHODrug Koda
Automate Medical Coding With WHODrug KodaAutomate Medical Coding With WHODrug Koda
Automate Medical Coding With WHODrug Koda
 
Preparing for Your Oracle, Medidata, and Veeva CTMS Migration Project
Preparing for Your Oracle, Medidata, and Veeva CTMS Migration ProjectPreparing for Your Oracle, Medidata, and Veeva CTMS Migration Project
Preparing for Your Oracle, Medidata, and Veeva CTMS Migration Project
 
Accelerating Partner Management: How Manufacturers Can Navigate Covid-19
Accelerating Partner Management: How Manufacturers Can Navigate Covid-19Accelerating Partner Management: How Manufacturers Can Navigate Covid-19
Accelerating Partner Management: How Manufacturers Can Navigate Covid-19
 
The Critical Role of Audience Intelligence with Eric Enge and Rand Fishkin
The Critical Role of Audience Intelligence with Eric Enge and Rand FishkinThe Critical Role of Audience Intelligence with Eric Enge and Rand Fishkin
The Critical Role of Audience Intelligence with Eric Enge and Rand Fishkin
 
Cardtronics Future Ready with Oracle EPM Cloud
Cardtronics Future Ready with Oracle EPM CloudCardtronics Future Ready with Oracle EPM Cloud
Cardtronics Future Ready with Oracle EPM Cloud
 
Teams Summit - What is New and Coming
Teams Summit -  What is New and ComingTeams Summit -  What is New and Coming
Teams Summit - What is New and Coming
 
Empower Your Organization with Teams & Remote Work Crisis Management
Empower Your Organization with Teams & Remote Work Crisis ManagementEmpower Your Organization with Teams & Remote Work Crisis Management
Empower Your Organization with Teams & Remote Work Crisis Management
 
Adoption & Change Management Overview
Adoption & Change Management OverviewAdoption & Change Management Overview
Adoption & Change Management Overview
 
Microsoft Teams: Measuring Activity of Employees Working from Home
Microsoft Teams: Measuring Activity of Employees Working from HomeMicrosoft Teams: Measuring Activity of Employees Working from Home
Microsoft Teams: Measuring Activity of Employees Working from Home
 
Securing Teams with Microsoft 365 Security for Remote Work
Securing Teams with Microsoft 365 Security for Remote WorkSecuring Teams with Microsoft 365 Security for Remote Work
Securing Teams with Microsoft 365 Security for Remote Work
 
Infrastructure Best Practices for Teams Remote Workers
Infrastructure Best Practices for Teams Remote WorkersInfrastructure Best Practices for Teams Remote Workers
Infrastructure Best Practices for Teams Remote Workers
 
Accelerate Adoption for Microsoft Teams
Accelerate Adoption for Microsoft TeamsAccelerate Adoption for Microsoft Teams
Accelerate Adoption for Microsoft Teams
 
Preparing for Project Cortex and the Future of Knowledge Management
Preparing for Project Cortex and the Future of Knowledge ManagementPreparing for Project Cortex and the Future of Knowledge Management
Preparing for Project Cortex and the Future of Knowledge Management
 
Utilizing Microsoft 365 Security for Remote Work
Utilizing Microsoft 365 Security for Remote Work Utilizing Microsoft 365 Security for Remote Work
Utilizing Microsoft 365 Security for Remote Work
 

Dernier

"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embeddingZilliz
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 

Dernier (20)

"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embedding
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 

How to Load Data More Quickly and Accurately into Oracle's Life Sciences Data Hub

  • 1. How to Load Data More Quickly and Accurately into Oracle Life Sciences Data Hub
  • 2. 2 ABOUT PERFICIENT Perficient is a leading information technology consulting firm serving clients throughout North America. We help clients implement digital experience, business optimization, and industry solutions that cultivate and captivate customers, drive efficiency and productivity, integrate business processes, reduce costs, and create a more agile enterprise.
  • 3. 3 Founded in 1997 Public, NASDAQ: PRFT 2014 revenue $456.7 million Major market locations: Allentown, Atlanta, Ann Arbor, Boston, Charlotte, Chattanooga, Chicago, Cincinnati, Columbus, Dallas, Denver, Detroit, Fairfax, Houston, Indianapolis, Lafayette, Milwaukee, Minneapolis, New York City, Northern California, Oxford (UK), Southern California, St. Louis, Toronto Global delivery centers in China and India >2,600 colleagues Dedicated solution practices ~90% repeat business rate Alliance partnerships with major technology vendors Multiple vendor/industry technology and growth awards PERFICIENT PROFILE
  • 4. 4 Business Process Management Customer Relationship Management Enterprise Performance Management Enterprise Information Solutions Enterprise Resource Planning Experience Design Portal / Collaboration Content Management Information Management Mobile BUSINESSSOLUTIONS 50+PARTNERS Safety / PV Clinical Data Management Electronic Data Capture Medical Coding Data Warehousing Data Analytics Clinical Trial Management Precision Medicine CLINICAL/HEALTHCAREIT Consulting Implementation Integration Migration Upgrade Managed Services Private Cloud Hosting Validation Study Setup Project Management Application Development Software Licensing Application Support Staff Augmentation Training SERVICES OUR SOLUTIONS PORTFOLIO
  • 5. 5 WELCOME & INTRODUCTION Extensive clinical trial software implementation experience • 20 years of experience in the life sciences industry • Extensive experience with Oracle’s clinical data warehousing, analytics, and precision medicine applications • Expertise in improving and standardizing business processes to support best practices and the ever-changing regulatory requirements Kathryn Hanson Solutions Architect, Life Sciences Perficient
  • 6. 6 WHAT’S TRENDING IN TECHNOLOGY? • Big Data • How do we acquire data from other sources? • How do we manage high volume data? • Data analytics • What conclusions can we draw from the raw data? • Data privacy and security • How do we control who has access to our data?
  • 7. 7 WHICH ISSUES ARE WE FACING? The pharmaceutical industry has many of these same technology issues: • How do we acquire data from external sources? • How do we manage high volume data? • How can we present that data for analysis? • How can we secure our data against unauthorized access? How can we acquire and manage the data we receive from many different sources?
  • 8. 8 WHAT WOULD WE LIKE IN A SOLUTION?  Hands off and automated – After the initial setup only routine monitoring is needed  Flexible • Adapts as data changes over time • Handles multiple file types • Can start other jobs as needed when the load is complete  Reliable and secure  Efficient and performs well on high-volume data  Simple to implement
  • 9. 9 THE SOLUTION: AUTOMATED FILE LOAD Quality Assurance Secure Staging Area File Load Utility Warehouse Study Staged data Transformed data Analysis programs Data file 1 2 3 4
  • 10. 10 WHAT DO I NEED TO GET STARTED? • A repository to receive and manage the clinical data (in this presentation that’s the Oracle Life Sciences Warehouse) • Resources to set up and monitor the system • Secure directories to receive and process data files • Utility software to process the files and load the data into the repository • Scheduling software to control when, where, and how jobs run • A way to register new data sources to the utility
  • 11. 11 HOW DO I BEGIN LOADING DATA? • Work with the vendor to • Understand the file format, data structures, file naming conventions, etc. • Provide secure access to the download area • Receive a sample data file • Register the new data source in the utility • Set up the storage areas in the repository • Test the new data source to verify it loads correctly into the repository • Complete any other setup needed so authorized users can access the data (for transformations, visualizations, etc.)
  • 12. 12 SETTING UP THE DIRECTORIES <root directory> + + + + stagedir processdir rejectdir scripts successdir + — The data file is dropped into this watched directory The pre-processed files are moved here for final processing and loading into the warehouse The data file is moved here if the file load fails The data file is moved here when the job finishes successfully Utility software is stored in this directory
  • 13. 13 SETTING UP STUDY REGISTRATION The first 3 attributes identify the study and data type These 3 attributes tell the utility where to store the data in the repository There are many options that control how the data should be loaded
  • 14. 14 NAMING CONVENTIONS FOR THE DATA FILE File naming conventions ensure that the utility can identify the registered study CDISC01 – The study name FULL – The type of data that will be loaded DEV – Is this development, test, or production data? 201509211010 – A unique date and time stamp
  • 15. 15 ADDING OTHER PROCESSING OPTIONS The utility lets you specify how you want to handle the data: • Running another job after the data loads • Handling blinded data • Sending out notifications • Processing large files • Managing changes in data structures • Identifying file formats for text files
  • 16. 16 SETTING UP THE REPOSITORY The data will be loaded into the work area under which you registered the study. Warehouse Study Staged data Transformed data Analysis programs
  • 17. 17 WHAT THE UTILITY DOES Your vendor has uploaded a data file; now the utility… 1. Detects the file and runs a set of preprocessing checks 2. Extracts all the datasets (text files, etc.) 3. Extracts the metadata for each dataset 4. Verifies the metadata for each dataset. If the dataset has been loaded before, either • The new metadata must match that in the previous load OR • The study allows compatible metadata updates
  • 18. 18 WHAT THE UTILITY DOES The utility continues if everything checks out by … 5. Creating a load set for each dataset in the data file (if one doesn’t already exist) 6. Updating the repository metadata, if required 7. Starting each of the load sets 8. Monitoring the running jobs for errors 9. Sending notifications to users, as required, when all the the jobs are done
  • 19. 19 THE RESULTS For efficiency, the utility processes all the datasets in the file in parallel…
  • 20. 20 THE RESULTS …and when all the jobs are done the data is loaded and available in the repository.
  • 21. 21 WHAT HAPPENS IF THE METADATA CHANGES? • One of the options you can choose is whether or not to allow changes to a table’s metadata • If that flag is “Y”, the utility will accept and process compatible changes • For example, you need to add 2 new columns to the table…
  • 22. 22 WHAT HAPPENS IF THE METADATA CHANGES? The table in the repository now has those two additional columns:
  • 23. 23 DOES THE UTILITY MEET OUR GOALS?  Automated and hands off  Flexible  Efficient  Simple to implement
  • 24. 24 QUESTIONS Type your question into the chat box
  • 25. 25 FOLLOW US ONLINE • Perficient.com/SocialMedia • Facebook.com/Perficient • Twitter.com/Perficient_LS • Blogs.perficient.com/LifeSciences