Contenu connexe
Similaire à 2009.10.22 S308460 Cloud Data Services (20)
Plus de Jeffrey T. Pollock (12)
2009.10.22 S308460 Cloud Data Services
- 2. Cloud Data Services - S308460
Jeff Pollock
Senior Director, Fusion Middleware Product Management
- 3. The following is intended to outline our general
product direction. It is intended for information
purposes only, and may not be incorporated into any
contract. It is not a commitment to deliver any
material, code, or functionality, and should not be
relied upon in making purchasing decisions.
The development, release, and timing of any
features or functionality described for Oracle’s
products remains at the sole discretion of Oracle.
© 2009 Oracle Corporation – Proprietary and Confidential 3
- 4. “I believe, over time, more and more
software will be delivered as a
service. I totally believe that... We
have to be good at this, or we have a
problem”
- Larry Ellison
© 2009 Oracle Corporation – Proprietary and Confidential 4
- 5. Agenda
• Data Services <Insert Picture Here>
• Cloud Computing
• Data Services in the Private Cloud
• Pragmatic First Steps
– Pre-Built On-Demand Data Integration
– Service-based ETL Architectures
– Canonical Data Access Services
• Lessons Learned
– Unify and Rationalize Tools
– Build Dedicated Competency Centers
© 2009 Oracle Corporation – Proprietary and Confidential 5
- 6. What are Data Services?
© 2009 Oracle Corporation – Proprietary and Confidential 6
- 7. A Bit of Data Services History
• Reality Check About “Data Services”
– This new hype is about an old idea – reusable data is a good thing
– 1968 – formation of EDI document translation standards for banks
– 1986 – Design by Contract: Precondition and Postcondition driven services
– Early 1990’s – tech roots of Informatica, IBM DataStage and Ab Initio
– 1994 – Design Patterns: Factory, Adapter, Façade, Proxy, Mediator…
– Late 1990’s – the application server data services (Kiva, Net Dynamics…)
• Long Before Java (and Before EAI or SOA or Cloud Computing)
– Data interchange among: banks, railways, airlines, militaries, etc.
– Metered software access and computing services from Mainframes
– Enterprise data warehouses for analytic purposes
– Object-oriented design patterns for decoupled data access
• So What’s Different About Data Services Today?
– Modern (new and different) standards & protocols
– Business scale, complexity, and expectations
– Near-infinite elasticity
© 2009 Oracle Corporation – Proprietary and Confidential 7
- 8. Java Programmer’s View of Data Services
Objects & Components in my JEE and JSE infrastructure
JEE BUSINESS SERVICES
• SCA
– Service Component Architecture – Key framework spec for Java Business Services
JEE DATA SERVICES
• DAS, DTO & JDO
– Data Access Service – Java service for accessing RDB’s and other Source Types
– Data Transfer Object – Java object for moving data (w/in container)
– Java Data Object – Java object for data containment (POJO-oriented)
• JPA & SDO
– Java Persistence API – EJB 3.0 spec for accessing external data (typically relational)
– Service Data Object – Entity objects targeted for SOA data use
• ORM
– Object Relational Mapping – A generic term typically applied to some solution approach to handling
“impedance mismatch”
• Oracle Toplink – A proven industrial strength data services layer for managing object persistence
• JAXB / OXM
– Java Architecture for XML Binding – Standard set of APIs for XML
– Object to XML – Toplink extended implementation of JAXB
© 2009 Oracle Corporation – Proprietary and Confidential 8
- 9. A Classification Taxonomy for Data Services
JAVA DATA SERVICE IMPLEMENTATION PATTERNS
• DAS & DTO – Access and in-container data transfer
• JPA, JDO & SDO – Enterprise intra-container data entity transfer
• JAXB & OXM (Toplink) – Access and binding to XML data
INFRASTRUCTURE DATA SERVICE FUNCTIONAL PATTERNS
• Master Data Services – Golden Records, Hierarchies, & Policies
• Bulk Data Services – Bulk Refresh, CDC, Trickle Feeds, SCD…
• Data Access Services – Virtualization, Federated Query, ORM…
– Really Urgent Data Access – Data Grid Cache / Virtualization
– Real Time Data Access – Query Federation & Layered Data Services
– Right Time Data Access – Data Hubs & Warehouses
• Data Event Services – Low Latency CDC, Trigger-Based CDC…
• Data Quality Services – Cleansing, Matching, De-Duplication…
PHYSICAL DATA SERVICE DEPLOYMENT PATTERNS
• Data Hub – Centralized cache (variation of Data Virtualization) or repository
• Data Grid – Distributed RAM-based data partitions with decentralized access
• Data Federation – Late-binding of query-time access to source data
© 2009 Oracle Corporation – Proprietary and Confidential 9
- 11. Example: Service-based Data Integration
Best of Breed Data Integration as a SOA Service
Oracle Data Integration
• Best Performing E-LT Architecture
• Works with any Data Warehouse
• 100% Java & SOA components
Oracle Data Replication
• Changed Data Capture (CDC)
• Query Offloading / DB Tiering
Example Use Cases
• Bulk Data Transformation (any2any)
High Performance • XML/EDI Large File Handling
ETL & Replication
• SOA-driven Business Intelligence
Data Warehouse
• Load DW from SOA
Any Data Source & OLAP
• Unified Data Steward Workflow
(ETL Error Hospital w/BPEL PM)
Oracle Data Integrator EE is the standard for:
• Oracle Fusion Applications • Oracle Business Intelligence
• ERP Migration, Replication / Loading
• Oracle Fusion AIA • Oracle Performance Management • Query Offloading & Zero Downtime
• Oracle Fusion Middleware • Oracle Database, Essbase & Tools
© 2009 Oracle Corporation – Proprietary and Confidential 11
- 12. So What Are Data Services?
Casting a Wide Technical Net…
• A General Software Pattern?
– Using contract-based development patterns for data distribution…
• A Java Software Pattern?
– Pick your favorite TLA: DTO, DAS, SDO, JPA, ORM, JAXB, OXM…
• A Web Services Stereotype?
– Dedicated SOAP services for reusable data manipulation and access…
• Shared Services for Enterprise Class Data Processing
– Shared – common for a group of consumers/clients
– Services – contract-driven interfaces to functional behaviors
– Enterprise Class – exceptionally demanding SLA’s and KPI’s
– Data Processing – the heart-beat for all big businesses
© 2009 Oracle Corporation – Proprietary and Confidential 12
- 13. What is Cloud Computing?
© 2009 Oracle Corporation – Proprietary and Confidential 13
- 14. Everyone Is Talking About Cloud
© 2009 Oracle Corporation – Proprietary and Confidential 14
- 16. What Is Cloud Computing?
*
Cloud Computing is often characterized by:
• Virtualized computing resources • Multi-tenancy
• Seemingly limitless capacity/scalability • Self-service
• Dynamic provisioning • Pay-for-use pricing
* Source: Wikipedia.org
© 2009 Oracle Corporation – Proprietary and Confidential 16
- 17. Haven’t we Heard About this Before?
*
Grid Cloud
Cloud Grid Computing is often characterized by:
• Virtualized computing resources • Multi-tenancy
• Seemingly limitless capacity/scalability • Self-service
• Dynamic/elastic provisioning • Pay-for-use pricing
* Source: Wikipedia.org
© 2009 Oracle Corporation – Proprietary and Confidential 17
- 18. Cloud Computing Benefits are Speed & Cost-Driven
Speed
Cost
© 2009 Oracle Corporation – Proprietary and Confidential 18
- 19. Cloud Layers: SaaS, PaaS, IaaS
Applications delivered as a service
Software as a Service
to end-users over the Internet
App development & deployment
Platform as a Service
platform delivered as a service
Server, storage and network
Infrastructure as a Service hardware and associated software
delivered as a service
© 2009 Oracle Corporation – Proprietary and Confidential 19
- 20. Public Clouds and Private Clouds
Public Clouds Private Cloud
I SaaS
SaaS I N
N T
R PaaS
T A
PaaS E N IaaS
R E
N T
IaaS E
T
Users
Both offer:
Public Clouds: • High efficiency Private Cloud:
• Lower upfront costs • High availability • Lower total costs
• Economies of scale • Elastic capacity • Greater control over security,
• Simpler to manage compliance & quality of service
• OpEx • Easier integration
• CapEx & OpEx
© 2009 Oracle Corporation – Proprietary and Confidential 20
- 21. Private Clouds are Majority of IT Spend on Cloud
Public Cloud
vs.
On-Premise
© 2009 Oracle Corporation – Proprietary and Confidential 21
- 22. Data Services for the Private Cloud
© 2009 Oracle Corporation – Proprietary and Confidential 22
- 23. Cloud Layers: Where’s the Data?
Software as a Service
Platform as a Service
Infrastructure as a Service
© 2009 Oracle Corporation – Proprietary and Confidential 23
- 24. Cloud Layers: Data at Every Strata!
Public Clouds Private Cloud
Corporate
Software as a Service Cloud
Services
Data as a Service
Platform as a Service
Hubs, ETL and Access Services
Infrastructure as a Service
Storage Clusters
© 2009 Oracle Corporation – Proprietary and Confidential 24
- 25. Important Challenges For Data Owners Today
Access and
Distribute Data
with agility
Scale data access
while preserving Do it all
quality of service efficiently
© 2009 Oracle Corporation – Proprietary and Confidential 25
- 26. Technology that Starts to Address the Challenges
Shared Data Services Management/
Automation
Grid/Dynamic Resourcing
Virtualization
© 2009 Oracle Corporation – Proprietary and Confidential 26
- 27. Data Integration: Reusable Data Components
Department
Dept App App Owner
Dept App
IT Dept App build app
Svc Proc
Svc Proc
Svc Svc
Proc Proc include
create Svc Proc data
data services Svc Proc find data
create services
processes
define data
integration
scenarios
Svc Svc Svc Svc Svc Proc Proc Proc Self Svc
Data
Data Data
Oracle Data Integration Suite
Service Oracle SOA Suite
Integrator Quality
Integrator Enterprise
Manager
Oracle WebLogic Suite-based Application Grid
DB Integration Legacy
© 2009 Oracle Corporation – Proprietary and Confidential 27
- 28. Kinds of Enterprise Data Integration Services
Oracle Fusion MDM Business Activity SOA
CLIENTS
Applications Applications Applications Intelligence Monitoring Platforms
FUNCTIONAL
SERVICES
Master ETL Data Data Data Data SOA SOA
Data Data Access Event Quality Grid Registry Metadata
Service Service Service Service Service Service Service Service
Data Movement & Delivery Data Integration Designer
TECHNICAL
PLATFORM
Data Integration Foundation
Data Connectivity
SOURCES
Oracle or 3rd Party: Applications | Analytics | Identity | SOA Platforms | Data Grid | Content Management | Search
DATA
© 2009 Oracle Corporation – Proprietary and Confidential 28
- 29. Oracle Data Integration Suite
Oracle Fusion MDM Business Activity SOA
Applications Applications Applications Intelligence Monitoring Platforms
Data Distribution & Delivery Services
Bulk Data API Data Replication Data Quality API Process-Oriented
Event-Driven (CDC) Data Virtualization Java SDO Message-Oriented
Data Integration Foundation
Bulk Data Core Data Federation Core Data Relationship Core Data Quality Core
Bulk Acquisition Change Data Capture Realtime Query Data Classification Cleanse/Parse
Trickle Feeds Event-Based Data Caching Lifecycle Mgmt Matching/Dedupe’s
Complex Transforms Integrity Constraints Query Federation Data Reconciliation Cluster Analysis
Metadata Services Models Relationships Lineage Object Cache Exchange APIs
Data Connectivity
Relational Databases Non-Relational DBs Various File Formats XML Data
Packaged Applications Standard Msg Formats Message Queues Semi-Structured Data
Oracle or 3rd Party: Applications | Analytics | Identity | SOA Platforms | Data Grid | Content Management | Search
© 2009 Oracle Corporation – Proprietary and Confidential 29
- 30. Data Integration, SOA, BPM & IdM: Putting it Together
Department
Dept App App Owner
IT build app
UI UI
Svc Proc Include
create components
set policies
reusable
DATA register
components components discover
authorized
components
authenticate
Svc Svc Proc Proc UI UI
Svc Svc Proc Proc UI UI
Svc Svc Proc Proc UI UI Self-Service Interface
policies
Oracle Data
Oracle SOA Oracle BPM Oracle Identity
Integration Oracle
Suite Suite Mgt
Suite Enterprise
Manager
Oracle WebLogic Suite-based Application Grid
© 2009 Oracle Corporation – Proprietary and Confidential 30
- 31. Cloud and Fusion Middleware Data Services
Shared Components Self-Service Interface
Oracle Oracle Oracle
ODI Suite Oracle
SOA Suite BPM Suite Identity Mgt
Enterprise
Manager
Oracle WebLogic Suite-based Application Grid
Key Benefits
Cloud Enabling Capabilities
• Development efficiency
• Basis for reusable data service
components • Deployment agility
• Simple and consistent data • Elastic Scale-out
integration framework Why Oracle
• Modular and heterogeneous • Most integrated
• Unified Management • Easiest to use and manage
© 2009 Oracle Corporation – Proprietary and Confidential 31
- 32. Take-Aways
Cloud Data Services is an architecture for centralized,
shared, elastic data resources internal to an enterprise that
allows departments to rapidly deploy and easily manage
application and analytic data.
• Fundamental Enablers:
• Application server • Key Benefits:
• Data Integration • Efficiency
• SOA/BPM • Agility
• Identity Management • Quality of Service
• Enterprise Management
• Oracle:
• Most complete, comprehensive offering
• Easiest to set up, integrate, and operate
• Best performance, automation, and self-service
© 2009 Oracle Corporation – Proprietary and Confidential 32
- 34. Leverage Pre-Packaged Integration Solutions
Direct Pre-Built Integrations”- Data Integration made simple
Oracle CRM On Demand Integration to Siebel CRM
Siebel Life Sciences Integration for Oracle Adverse Event Reporting System
Demantra Integration Pack for Siebel CRM Consumer Goods
Oracle Transportation Management (Glog) Integration to E-Business Suite
Cross Industry Process Integration Packs- Design, Sell, Plan and Execute
►Design to Release Agile Product Lifecycle Management integration Pack for Oracle E-Business Suite
►Opportunity to Quote Oracle CRM On Demand Integration Pack for Oracle E-Business Suite
►Order to Cash Siebel CRM Integration Pack for Oracle EBS Order Management
►Trade Promotion Mgmt Siebel CRM Integration Pack for Trade Promotion Management
Industry Process Integration Packs- Transform key business processes
►Comms Order to Bill Siebel CRM Integration Pack for Oracle Comms Billing and Revenue Management: Order to Bill
►Comms Customer care Siebel CRM Integration Pack for Oracle Comms Billing & Revenue Management: Agent
Assisted Billing Care
►Comms Revenue Accntg Oracle Comms Billing and Revenue Management Integration Pack for Oracle E-Business
Suite: Revenue Accounting
►Banking Acct Originations Siebel CRM Integration Pack for i-flex FLEXCUBE Account Originations
►Banking Acct Originations Siebel CRM Integration Pack for Banking Account Originations
© 2009 Oracle Corporation – Proprietary and Confidential 34
- 35. Commit to a Service-based ETL Architecture
Running Oracle Data Integrator ETL as a managed Java
process enables CONSISTENT management and
monitoring – only Oracle can do this! Sense
demand spike
Dept
Dept App 1 Dept
App 1 App 2
Data Data
Shared
Service Service
Service Enterprise
Elastic ETL Manager
Services
WebLogic
Server Cluser
WebLogic Suite-based Application Grid
of Nodes
Adjust
capacity
© 2009 Oracle Corporation – Proprietary and Confidential 35
- 36. Consider a Canonical Data Services Architecture
Service Clients Canonical Data Services Physical Sources
Data Service Data Service Customer
APIs Addresses Profile
Internal
Java, Web Service, XQuery, SQL, JMS
Mgmt
JDBC Orders
Dashboard
Pending
Customer Payments
Web Srvcs
History
Credited
ESB Order Payments
Adapters
Enterprise Data
Customer Payment
Custom
Portal
Repository
BPM
• Data services layer provides data access capabilities
• Data services modeling organizes services for use and reuse
© 2009 Oracle Corporation – Proprietary and Confidential 36
- 38. Create Data Integration Competency Centers
People Process Technology
Data
Governance
Data Profiling
and Quality
Data Integration Shared Services / SOA
Data Stewards ETL Tools
Data Architects Data Quality Tools
ETL Developers Data Profiling
Data Service Modelers Data Federation
Database Administrators Data Replication
Compliance Officers Data Archiving
Data Masking
End-to-End Lifecycle Governance
© 2009 Oracle Corporation – Proprietary and Confidential 38
- 39. Unify and Rationalize Different Vendor Tools
Solution Areas Key Buying Attributes
Data Modeling Relational, object and service models.
ETL / Bulk Data Integration Apps, DB and Java integration. Flexible
ETL and ELT architectures.
Data Quality, Matching and Rule-based and statistical learning. Fast
Cleansing bulk and realtime match.
Data Profiling In place and out-of-place profiling.
Data Federation Canonical modeling and data redaction.
Data Archiving Data masking, lifecycle management
Data Replication / High Log-based capture with sub-second,
Availability transaction-safe data apply
Data Grid Multi-platform limitless object scale-out.
Management and Monitoring Common metrics, logging, and charts.
© 2009 Oracle Corporation – Proprietary and Confidential 39
- 40. For More Information
Quote Attribution
Title, Company
Get Started Resources
• Visit the Oracle Fusion Middleware 11g • Datasheet:
web site at http://www.oracle.com/products/middlewar
http://www.oracle.com/goto/fmw11g/index. e/odi/docs/odiee-datasheet.pdf
html • Blog:
• Oracle Data Integration on oracle.com http://blogs.oracle.com/dataintegration
www.oracle.com/goto/odi • Technical information available at:
• Oracle Fusion Middleware on OTN http://www.oracle.com/technology/product
http://otn.oracle.com/middleware s/oracle-data-integrator/index.html
• Information on GoldenGate: • Data Integration Events
http://www.oracle.com/goldengate http://www.oracle.com/events
© 2009 Oracle Corporation – Proprietary and Confidential 40
- 41. Developing in the Cloud @ Middleware Lounge
At the Marriott Hotel
• Free Amazon Web Services access
• $35 credit for development time Workshops Daily
• Daily workshops: “Developing in the Cloud” In the Middleware Lounge
• Q&A with Amazon representatives and other experts • Daily, 11:30 AM
Introduction to Amazon Web
Services
• Monday 2:00 PM
• Internet access Developing with WebCenter and
Oracle Content Management in
• Wireless access Amazon Web Services
• SunRay machines also provided • Tuesday 2:00 PM Developing with
WebCenter and Oracle Content
• Recharging stations for your phone or laptop Management in Amazon Web
Services
• Wednesday 2:15 PM Developing
• Free food and beverages with Oracle SOA Suite in Amazon
Web Services
• Live Twitter feeds and blog updates
• Thursday 2:30 PM Developing
• Watch keynotes and featured sessions while relaxing, with Oracle SOA Suite in Amazon
recharging, and checking email Web Services
© 2009 Oracle Corporation – Proprietary and Confidential 41
- 42. OpenWorld Activities for Oracle Data Integration
Monday 10/12
11:30am Introducing Oracle GoldenGate Products Marriott Golden Gate B1 Oracle GoldenGate &
1:00 pm Event-Driven BI with Oracle Data Integrator Marriott Salon 1 Oracle Streams: The
2:30 pm Real-time BI Using Oracle GoldenGate + ODI Marriott Golden Gate B1 Future of Oracle
4:00 pm RIM Case Study: Using Oracle GoldenGate Marriott Golden Gate B1 Replication and Data
5:30 pm Integrate Oracle BI Solutions with ODI Moscone Room 307
Integration
Tuesday 10/13 Panel With Hasan Rizvi and
Juan Loaiza, Sachin
11:30am Oracle GoldenGate for Zero-Downtime Migrations, Marriot Golden Gate B1 Chawla, and Ali Kutay
11:30am Enterprise Data Services in the Cloud Marriott Hotel Salon 7
1:00pm Oracle GoldenGate Deep Dive: Architecture Marriott Hotel Golden Gate B1 Tuesday, 2:30 - 3:30 PM
1:00pm Deep Dive on Real-World Use Cases for ODI Hilton Hotel Golden Gate 3
Moscone South Room 270
4:00 pm Bringing BPM and Data Integration Together Marriott Hotel Nob Hill CD
Wednesday 10/14
11:45am Ensure a Successful Siebel CRM Upgrade Moscone West L2 Room 2001 DemoGrounds
1:00pm ELT, Federation, and Replication: Overstock.com Moscone West L3 Room 3014
Moscone West
Thursday 10/15 ODI, OWB, W-093, W-094
Oracle Information Framework: The Power of the Oracle GoldenGate, 3709
9:00am Combined ODI and MDM Moscone South Room 304
Hands-on Labs Marriott Hotel Golden Gate A2
Monday 11:30am, Wed 1:15pm: Introduction to ODI-EE Tuesday 4:00pm, Thurs 10:30am: BI + ODI-EE
Monday 1:00pm, Wed 5:00pm: Data Services using ODI-EE Tuesday 2:30pm, Thurs 9:00am: Advanced ODI-EE
© 2009 Oracle Corporation – Proprietary and Confidential 42
- 44. The preceding is intended to outline our general
product direction. It is intended for information
purposes only, and may not be incorporated into any
contract. It is not a commitment to deliver any
material, code, or functionality, and should not be
relied upon in making purchasing decisions.
The development, release, and timing of any
features or functionality described for Oracle’s
products remains at the sole discretion of Oracle.
© 2009 Oracle Corporation – Proprietary and Confidential 44
- 46. For More Information
search.oracle.com
or
oracle.com
© 2009 Oracle Corporation – Proprietary and Confidential 46