SlideShare une entreprise Scribd logo
1  sur  26
Télécharger pour lire hors ligne
DATA VIRTUALIZATIONDATA VIRTUALIZATION
PRIMERPRIMER
THE ARCHITECTURETHE ARCHITECTURE
THE ARCHITECTURETHE ARCHITECTURE
MAI N DATAMAI N DATA
VIRTUALIZATION COMPONENTSVIRTUALIZATION COMPONENTS
The Server
Design Tools
Administration Tools
THE SERVERTHE SERVER
The server is positioned between business applications/Consumers
and one or more data sources. An enterprise ready, scalable,
managable, runtime for the Query Engine that runs inside JBoss AS
that provides additional security, fault-tolerance, and administrative
features.
MOVE DOWN TO EXPLORE THE CONCEPT OR RIGHT FOR THE NEXT CONCEPT
SE RVE R COMPONENTSSE RVE R COMPONENTS
Virtual Database
Access Layer
Query Engine
Connector Architecture
VIRTUAL DATABASEVIRTUAL DATABASE
A virtual database (VDB) provides a unified view of data residing in
multiple physical repositories. A VDB is composed of various data
models and configuration information that describes which data
sources are to be integrated and how. In particular, source
models are used to represent the structure and characteristics of the
physical data sources, and view models represent the structure and
characteristics of the integrated data exposed to applications.
ACCESS L AYERACCESS L AYER
The access layer is the interface through which applications submit
queries (relational, XML, XQuery and procedural) to the VDB via
JDBC, ODBC or Web services.
QUERY ENGINEQUERY ENGINE
The heart of DV is a high-performance query engine that processes
relational, XML, XQuery and procedural queries from federated
datasources. Features include support for homogeneous schemas,
heterogeneous schemas, transactions, and user defined functions.
When applications submit queries to a VDB via the access layer, the
query engine produces an optimized query plan to provide efficient
access to the required physical data sources as determined by the
SQL criteria and the mappings between source and view models in
the VDB. This query plan dictates processing order to ensure
physical data sources are accessed in the most efficient manner.
CONNECTOR ARCH ITECTURECONNECTOR ARCH ITECTURE
Translators and resource adapters are used to provide transparent
connectivity between the query engine and the physical data
sources. DV includes a rich set of Translators and Resource Adaptors
that enable access to a variety of sources, including most relational
databases, web services, text files and LDAP. A translator is used to
convert queries into source-specific commands, and a resource
adapter provides communication with the source.
Need data from a different source? A custom translators and
resource adaptors can easily be developed.
DESIGN TOOLSDESIGN TOOLS
Various design tools are available to assist users in seeting up JBoss Data
Virtualization for an integrated solution.
MOVE DOWN TO EXPLORE THE CONCEPT OR RIGHT FOR THE NEXT CONCEPT
DATA VIRTUALIZATION DESIGNERDATA VIRTUALIZATION DESIGNER
The designer is a visual tool that enables rapid, model-driven
definition, integration, management and testing of data services
without programming using the DV runtime framework. With the
designer you can:
create a virtual database (or VDB) containing your models, views,
procedures, dynamic XML documents which you deploy to DV
server and then access your data.
resolve semantic differences
create virtual data structures at a physical or logical level
use declarative interfaces to integrate, aggregate, and transform
the data on its way from source to a target format which is
compatible and optimized for consumption by your applications
Preview your data
DATA VIRTUALIZATION DESIGNERDATA VIRTUALIZATION DESIGNER
(CONTINUED)(CONTINUED)
Part of the JBoss Developer Studio Integration stack
DV WEBUIDV WEBUI
http://www.ossmentor.com/2015/03/data-virtualization-web-ui-now-released.html
Create Data Services through a
WebUI
Create Views and Models
through the WebUI without the
requirements of a local IDE
Currently for more simple data
services
Currently Developer Preview
CONNECTOR DEVELO PMENTCONNECTOR DEVELO PMENT
The process of integrating data from an enterprise information system into
JBoss Data Virtualization requires one to two components:
a translator (mandatory) and
a resource adapter (optional), also known as a connector. Most of the time,
this will be a Java EE Connector Architecture (JCA) Adapter.
A translator is used to:
translate JBoss Data Virtualization commands into commands understood by
the datasource for which the translator is being used,
execute those commands,
return batches of results from the datasource, translated into the formats
that JBoss Data Virtualization is expecting.
https://access.redhat.com/documentation/en-
US/Red_Hat_JBoss_Data_Vir tualization/6.1/html/Development_Guide_Volume_4_Server_Development/Introduction_to_the_JBoss_Data_Serv
ices_Connector_Architecture.html
CONNECTOR DEVELO PMENTCONNECTOR DEVELO PMENT
(CONTINUED)(CONTINUED)
A resource adapter (or connector):
handles all communications with individual enterprise information
systems, (which can include databases, data feeds, flat files and so
forth),
can be a JCA Adapter or any other custom connection provider
(the JCA specification ensures the writing, packaging and
configuration are undertaken in a consistent manner),
removes concerns such as connection information, resource
pooling, and authentication for translators.
CUSTOM ADAPTORS ANDCUSTOM ADAPTORS AND
TRANSL ATORSTRANSL ATORS
Translators - https://access.redhat.com/documentation/en-
US/Red_Hat_JBoss_Data_Virtualization/6.1/html/Development_Guide_Volume_4_Server_Development/chap-
Translator_Development.html#Custom_Translators
Adaptors - https://access.redhat.com/documentation/en-
US/Red_Hat_JBoss_Data_Virtualization/6.1/html/Development_Guide_Volume_4_Server_Development/chap-
Resource_Adapter_Development.html#Developing_JCA_Adapters
Extending Execution Factory Class - https://access.redhat.com/documentation/en-
US/Red_Hat_JBoss_Data_Virtualization/6.1/html/Development_Guide_Volume_4_Server_Development/chap-
Extending_the_Execution_Factory_Class.html
ADDITIONAL CUSTOMIZATIONSADDITIONAL CUSTOMIZATIONS
JBoss Data Virtualization is highly extensible in other ways:
You can add user defined functions.
You can adapt logging to your requirements, which is especially
useful for custom audit or command logging.
A delegating translator can be used to add custom code to all
methods for a given translator.
You can also customize authentication and authorization modules.
See the Red Hat JBoss Data Virtualization Security Guide.
TRANSL ATORSTRANSL ATORS
Apache Cassandra (Technical
Preview Only)
Apache Solr
Cloudera Impala
JDBC Translator
File Translator
Google Spreadsheet Translator
JBoss Data Grid 6.3
LDAP Translator
MongoDB Translator
Object Translator
OData Translator
OLAP Translator
Salesforce Translator
Web Services Translator
RESOURCE ADAPTORSRESOURCE ADAPTORS
With the exception of JDBC data sources, JBoss Data Virtualization provides a
JCA adapter for each supported data source. These are the resource adapter
identifiers, as specified in the server configuration file:
File Adapter - file
Google Spreadsheet Adapter - google
Red Hat JBoss Data Grid (6.1 & 6.2) Adapter - infinispan
LDAP Adapter - ldap
Salesforce Adapter - salesforce
Web Services Adapter - webservice
Mongo DB Adapter (technical preview) - mongodb
A resource adapter for the JDBC translator is provided with JBoss EAP by
default.
ADMINISTRATIVE TOOLSADMINISTRATIVE TOOLS
AdminShell- AdminShell provides a script-based programming environment enabling
users to access, monitor and control JBoss Data Virtualization.
Management Console - The Management Console provided by the Red Hat JBoss
Enterprise Application Platform (EAP) is a web-based tool allowing system administrators
to monitor and configure services deployed within a running JBoss EAP instance,
including JBoss Data Virtualization.
Management CLI - The Management CLI (command-line interface) is provided by JBoss
EAP to manage services deployed within a JBoss EAP instance. Operations can be
performed in batch modes, allowing multiple tasks to be run as a group.
JBoss Operations Network - Red Hat JBoss Operations Network provides a single
interface to deploy, manage, and monitor an entire deployment of Red Hat JBoss
Middleware applications and services, including JBoss Data Virtualization.
Dashboard Builder - The Dashboard builder allows connection to VDBs through the DV
JDBC driver to visualize the data for testing and Business Analytics.
MOVE DOWN TO EXPLORE THE CONCEPT OR RIGHT FOR THE NEXT CONCEPT
THE ADMIN SHELLTHE ADMIN SHELL
AdminShell provides the following features:
Administration - AdminShell can be used to connect to a JBoss Data
Virtualization instance in order to perform various administrative tasks.
Data Access - AdminShell can be used to connect to a virtual database (VDB)
and run SQL commands to query VDB data and view results.
Migration - AdminShell can be used to develop scripts that will move VDBs and
associated components from one development environment to another. (Users
can test and automate migration scripts before executing them in production
deployments.)
Testing -The built-in JUnit Test Framework allows users to write regression tests
to check system health and data integrity. The written tests validate system
functionality automatically, removing the need for manual verification by QA
Personnel.
https://access.redhat.com/documentation/en-
US/Red_Hat_JBoss_Data_Virtualization/6.1/html/Administration_and_Configuration_Guide/sect
-AdminShell.html
THE MANAGEMENT CONSOLETHE MANAGEMENT CONSOLE
The Configuration tab contains general and JBoss Data
Virtualization specific configuration properties.
Runtime tab shows runtime information about JBoss EAP server
and Teiid subsystem. You can view runtime information about Teiid
by clicking Virtual Databases in the left hand navigational tree.
You can configure roles and groups using the Administration tab.
Roles for a user to be included in and excluded from can be
configured in the Management Console. You can also configure
groups to be included or excluded from a role. Only users in the
SuperUser or Administrator roles can perform this configuration.
https://access.redhat.com/documentation/en-
US/Red_Hat_JBoss_Data_Virtualization/6.1/html/Administration_and_Configuratio
n_Guide/sect-Management_Console.html
MANAGE MENT CLIMANAGE MENT CLI
The Management CLI features a help dialog with general and
context-sensitive options.
Easy to launch and connect with the EAP_HOME/bin/jboss-cli.sh -
-connect or jboss-cli.bat
https://access.redhat.com/documentation/en-
US/Red_Hat_JBoss_Data_Virtualization/6.1/html/Administration_and_Configura
tion_Guide/sect-Management_CLI.html
JBOSS OPERATIONS NETWORKJBOSS OPERATIONS NETWORK
JBoss Operations Network has additional agent plug-ins to manage
other JBoss products. Although these are JBoss ON resource plug-
ins, they are included in separate packages and require a separate
subscription to download them.
https://access.redhat.com/documentation/en-
US/Red_Hat_JBoss_Data_Virtualization/6.1/html/Administration_an
d_Configuration_Guide/sect-
JBoss_Operations_Network.html#Installing_JBoss_Agent_Plug-
in_Packs
DASHBOARD BUILDERDASHBOARD BUILDER
Red Hat JBoss Dashboard Builder can be connected to an external database, be it
using JNDI of the container or connecting directly only using the JDBC driver to
access the database. Connections to databases can be configured in
workspace Showcase on page External Connections. After you have established the
connection to the database, you need to create a data provider that will collect the
data from the database and allow you to visualize it as an indicator in the dashboard
area of a page.
Note that Red Hat JBoss Dashboard Builder makes use of its own local internal
database to store its local data. This database is read-only for Dashboard Builder,
but is accessible from outside.
THANK YOU!THANK YOU!

Contenu connexe

Tendances

Introduction to Microsoft’s Master Data Services (MDS)
Introduction to Microsoft’s Master Data Services (MDS)Introduction to Microsoft’s Master Data Services (MDS)
Introduction to Microsoft’s Master Data Services (MDS)James Serra
 
xRM - as an Evolution of CRM
xRM - as an Evolution of CRMxRM - as an Evolution of CRM
xRM - as an Evolution of CRMCatherine Eibner
 
Data virtualization
Data virtualizationData virtualization
Data virtualizationHamed Hatami
 
Red Hat JBoss Data Virtualization
Red Hat JBoss Data VirtualizationRed Hat JBoss Data Virtualization
Red Hat JBoss Data VirtualizationDLT Solutions
 
Open Development
Open DevelopmentOpen Development
Open DevelopmentMedsphere
 
Hadoop World 2011: Big Data Architecture: Integrating Hadoop with Other Enter...
Hadoop World 2011: Big Data Architecture: Integrating Hadoop with Other Enter...Hadoop World 2011: Big Data Architecture: Integrating Hadoop with Other Enter...
Hadoop World 2011: Big Data Architecture: Integrating Hadoop with Other Enter...Cloudera, Inc.
 
A Comparison of EDB Postgres to Self-Supported PostgreSQL
A Comparison of EDB Postgres to Self-Supported PostgreSQLA Comparison of EDB Postgres to Self-Supported PostgreSQL
A Comparison of EDB Postgres to Self-Supported PostgreSQLEDB
 
Why advanced monitoring is key for healthy
Why advanced monitoring is key for healthyWhy advanced monitoring is key for healthy
Why advanced monitoring is key for healthyDenodo
 
SnapLogic corporate presentation
SnapLogic corporate presentationSnapLogic corporate presentation
SnapLogic corporate presentationpbridges
 
Enabling a Data Mesh Architecture with Data Virtualization
Enabling a Data Mesh Architecture with Data VirtualizationEnabling a Data Mesh Architecture with Data Virtualization
Enabling a Data Mesh Architecture with Data VirtualizationDenodo
 
Case Study - Ibotta Builds A Self-Service Data Lake To Enable Business Growth...
Case Study - Ibotta Builds A Self-Service Data Lake To Enable Business Growth...Case Study - Ibotta Builds A Self-Service Data Lake To Enable Business Growth...
Case Study - Ibotta Builds A Self-Service Data Lake To Enable Business Growth...Vasu S
 
Teradata Aster: Big Data Discovery Made Easy
Teradata Aster: Big Data Discovery Made EasyTeradata Aster: Big Data Discovery Made Easy
Teradata Aster: Big Data Discovery Made EasyTIBCO Spotfire
 
IBM - Transformation digitale et le SI des banques
IBM - Transformation digitale et le SI des banquesIBM - Transformation digitale et le SI des banques
IBM - Transformation digitale et le SI des banquesRodolphe Lezennec
 
Big_SQL_3.0_Whitepaper
Big_SQL_3.0_WhitepaperBig_SQL_3.0_Whitepaper
Big_SQL_3.0_WhitepaperScott Gray
 

Tendances (19)

MDS & SQL 2012
MDS & SQL 2012MDS & SQL 2012
MDS & SQL 2012
 
Introduction to Microsoft’s Master Data Services (MDS)
Introduction to Microsoft’s Master Data Services (MDS)Introduction to Microsoft’s Master Data Services (MDS)
Introduction to Microsoft’s Master Data Services (MDS)
 
Crimson 3 - Final case presentation
Crimson 3 - Final case presentationCrimson 3 - Final case presentation
Crimson 3 - Final case presentation
 
EIM Tutorial
EIM TutorialEIM Tutorial
EIM Tutorial
 
xRM - as an Evolution of CRM
xRM - as an Evolution of CRMxRM - as an Evolution of CRM
xRM - as an Evolution of CRM
 
Data virtualization
Data virtualizationData virtualization
Data virtualization
 
Red Hat JBoss Data Virtualization
Red Hat JBoss Data VirtualizationRed Hat JBoss Data Virtualization
Red Hat JBoss Data Virtualization
 
Open Development
Open DevelopmentOpen Development
Open Development
 
Hadoop World 2011: Big Data Architecture: Integrating Hadoop with Other Enter...
Hadoop World 2011: Big Data Architecture: Integrating Hadoop with Other Enter...Hadoop World 2011: Big Data Architecture: Integrating Hadoop with Other Enter...
Hadoop World 2011: Big Data Architecture: Integrating Hadoop with Other Enter...
 
A Comparison of EDB Postgres to Self-Supported PostgreSQL
A Comparison of EDB Postgres to Self-Supported PostgreSQLA Comparison of EDB Postgres to Self-Supported PostgreSQL
A Comparison of EDB Postgres to Self-Supported PostgreSQL
 
Why advanced monitoring is key for healthy
Why advanced monitoring is key for healthyWhy advanced monitoring is key for healthy
Why advanced monitoring is key for healthy
 
SnapLogic corporate presentation
SnapLogic corporate presentationSnapLogic corporate presentation
SnapLogic corporate presentation
 
Enabling a Data Mesh Architecture with Data Virtualization
Enabling a Data Mesh Architecture with Data VirtualizationEnabling a Data Mesh Architecture with Data Virtualization
Enabling a Data Mesh Architecture with Data Virtualization
 
Data Mesh
Data MeshData Mesh
Data Mesh
 
Case Study - Ibotta Builds A Self-Service Data Lake To Enable Business Growth...
Case Study - Ibotta Builds A Self-Service Data Lake To Enable Business Growth...Case Study - Ibotta Builds A Self-Service Data Lake To Enable Business Growth...
Case Study - Ibotta Builds A Self-Service Data Lake To Enable Business Growth...
 
Teradata Aster: Big Data Discovery Made Easy
Teradata Aster: Big Data Discovery Made EasyTeradata Aster: Big Data Discovery Made Easy
Teradata Aster: Big Data Discovery Made Easy
 
IBM - Transformation digitale et le SI des banques
IBM - Transformation digitale et le SI des banquesIBM - Transformation digitale et le SI des banques
IBM - Transformation digitale et le SI des banques
 
EDB Guide
EDB GuideEDB Guide
EDB Guide
 
Big_SQL_3.0_Whitepaper
Big_SQL_3.0_WhitepaperBig_SQL_3.0_Whitepaper
Big_SQL_3.0_Whitepaper
 

En vedette

Presentazione - Progettazione e realizzazione di una piattaforma middleware p...
Presentazione - Progettazione e realizzazione di una piattaforma middleware p...Presentazione - Progettazione e realizzazione di una piattaforma middleware p...
Presentazione - Progettazione e realizzazione di una piattaforma middleware p...LucaGre
 
ESB e Architetture per l'Interoperabilità
ESB e Architetture per l'InteroperabilitàESB e Architetture per l'Interoperabilità
ESB e Architetture per l'InteroperabilitàCommit University
 
JBoss Fuse Service Works
JBoss Fuse Service WorksJBoss Fuse Service Works
JBoss Fuse Service WorksElvis Rocha
 
JBoss Fuse Workshop 101 part 2
JBoss Fuse Workshop 101 part 2JBoss Fuse Workshop 101 part 2
JBoss Fuse Workshop 101 part 2Christina Lin
 
Developing Microservices with Apache Camel
Developing Microservices with Apache CamelDeveloping Microservices with Apache Camel
Developing Microservices with Apache CamelClaus Ibsen
 
Microservices with Apache Camel
Microservices with Apache CamelMicroservices with Apache Camel
Microservices with Apache CamelClaus Ibsen
 
Microservices with Apache Camel, Docker and Fabric8 v2
Microservices with Apache Camel, Docker and Fabric8 v2Microservices with Apache Camel, Docker and Fabric8 v2
Microservices with Apache Camel, Docker and Fabric8 v2Christian Posta
 
Integrating Microservices with Apache Camel
Integrating Microservices with Apache CamelIntegrating Microservices with Apache Camel
Integrating Microservices with Apache CamelChristian Posta
 
Codemotion fuse presentation
Codemotion fuse presentationCodemotion fuse presentation
Codemotion fuse presentationUgo Landini
 
An introduction to data virtualization in business intelligence
An introduction to data virtualization in business intelligenceAn introduction to data virtualization in business intelligence
An introduction to data virtualization in business intelligenceDavid Walker
 

En vedette (14)

Presentazione - Progettazione e realizzazione di una piattaforma middleware p...
Presentazione - Progettazione e realizzazione di una piattaforma middleware p...Presentazione - Progettazione e realizzazione di una piattaforma middleware p...
Presentazione - Progettazione e realizzazione di una piattaforma middleware p...
 
Sensor Node Plugin System
Sensor Node Plugin SystemSensor Node Plugin System
Sensor Node Plugin System
 
EIP with Apache Camel
EIP with Apache CamelEIP with Apache Camel
EIP with Apache Camel
 
ESB e Architetture per l'Interoperabilità
ESB e Architetture per l'InteroperabilitàESB e Architetture per l'Interoperabilità
ESB e Architetture per l'Interoperabilità
 
SOA wonderful World
SOA wonderful WorldSOA wonderful World
SOA wonderful World
 
JBoss Fuse Service Works
JBoss Fuse Service WorksJBoss Fuse Service Works
JBoss Fuse Service Works
 
JBoss Fuse Workshop 101 part 2
JBoss Fuse Workshop 101 part 2JBoss Fuse Workshop 101 part 2
JBoss Fuse Workshop 101 part 2
 
Developing Microservices with Apache Camel
Developing Microservices with Apache CamelDeveloping Microservices with Apache Camel
Developing Microservices with Apache Camel
 
Fuse overview
Fuse overviewFuse overview
Fuse overview
 
Microservices with Apache Camel
Microservices with Apache CamelMicroservices with Apache Camel
Microservices with Apache Camel
 
Microservices with Apache Camel, Docker and Fabric8 v2
Microservices with Apache Camel, Docker and Fabric8 v2Microservices with Apache Camel, Docker and Fabric8 v2
Microservices with Apache Camel, Docker and Fabric8 v2
 
Integrating Microservices with Apache Camel
Integrating Microservices with Apache CamelIntegrating Microservices with Apache Camel
Integrating Microservices with Apache Camel
 
Codemotion fuse presentation
Codemotion fuse presentationCodemotion fuse presentation
Codemotion fuse presentation
 
An introduction to data virtualization in business intelligence
An introduction to data virtualization in business intelligenceAn introduction to data virtualization in business intelligence
An introduction to data virtualization in business intelligence
 

Similaire à dvprimer-architecture

Data Virtualization Primer -
Data Virtualization Primer -Data Virtualization Primer -
Data Virtualization Primer -Kenneth Peeples
 
SQL Azure the database in the cloud
SQL Azure the database in the cloud SQL Azure the database in the cloud
SQL Azure the database in the cloud Eduardo Castro
 
44spotkaniePLSSUGWRO_CoNowegowKrainieChmur
44spotkaniePLSSUGWRO_CoNowegowKrainieChmur44spotkaniePLSSUGWRO_CoNowegowKrainieChmur
44spotkaniePLSSUGWRO_CoNowegowKrainieChmurTobias Koprowski
 
A Guide to Modern BPM Data Integration
A Guide to Modern BPM Data IntegrationA Guide to Modern BPM Data Integration
A Guide to Modern BPM Data IntegrationEric D. Schabell
 
Microsoft SQL Server 2012
Microsoft SQL Server 2012 Microsoft SQL Server 2012
Microsoft SQL Server 2012 Dhiren Gala
 
Microsoft Azure Overview Infographic
Microsoft Azure Overview InfographicMicrosoft Azure Overview Infographic
Microsoft Azure Overview InfographicMicrosoft Azure
 
Eclipse Developement @ Progress Software
Eclipse Developement @ Progress SoftwareEclipse Developement @ Progress Software
Eclipse Developement @ Progress Softwaresriikanthp
 
Mule database-connectors
Mule  database-connectorsMule  database-connectors
Mule database-connectorsD.Rajesh Kumar
 
Mule database-connectors
Mule database-connectorsMule database-connectors
Mule database-connectorsirfan1008
 
Mule database-connectors
Mule database-connectorsMule database-connectors
Mule database-connectorsPhaniu
 
Benefits of the Azure cloud
Benefits of the Azure cloudBenefits of the Azure cloud
Benefits of the Azure cloudJames Serra
 
Netserv Technology Services
Netserv Technology ServicesNetserv Technology Services
Netserv Technology Servicessthicks14
 
Benefits of the Azure Cloud
Benefits of the Azure CloudBenefits of the Azure Cloud
Benefits of the Azure CloudCaserta
 

Similaire à dvprimer-architecture (20)

SOA Summit 2014
SOA Summit 2014SOA Summit 2014
SOA Summit 2014
 
Data Virtualization Primer -
Data Virtualization Primer -Data Virtualization Primer -
Data Virtualization Primer -
 
dvprimer-concepts
dvprimer-conceptsdvprimer-concepts
dvprimer-concepts
 
Microsoft Azure
Microsoft AzureMicrosoft Azure
Microsoft Azure
 
Project seminar
Project seminarProject seminar
Project seminar
 
SQL Azure the database in the cloud
SQL Azure the database in the cloud SQL Azure the database in the cloud
SQL Azure the database in the cloud
 
44spotkaniePLSSUGWRO_CoNowegowKrainieChmur
44spotkaniePLSSUGWRO_CoNowegowKrainieChmur44spotkaniePLSSUGWRO_CoNowegowKrainieChmur
44spotkaniePLSSUGWRO_CoNowegowKrainieChmur
 
A Guide to Modern BPM Data Integration
A Guide to Modern BPM Data IntegrationA Guide to Modern BPM Data Integration
A Guide to Modern BPM Data Integration
 
Microsoft SQL Server 2012
Microsoft SQL Server 2012 Microsoft SQL Server 2012
Microsoft SQL Server 2012
 
Microsoft Azure Overview Infographic
Microsoft Azure Overview InfographicMicrosoft Azure Overview Infographic
Microsoft Azure Overview Infographic
 
Sql Azure Pass
Sql Azure PassSql Azure Pass
Sql Azure Pass
 
Sql Azure Pass
Sql Azure PassSql Azure Pass
Sql Azure Pass
 
Eclipse Developement @ Progress Software
Eclipse Developement @ Progress SoftwareEclipse Developement @ Progress Software
Eclipse Developement @ Progress Software
 
Mule database-connectors
Mule database-connectorsMule database-connectors
Mule database-connectors
 
Mule database-connectors
Mule  database-connectorsMule  database-connectors
Mule database-connectors
 
Mule database-connectors
Mule database-connectorsMule database-connectors
Mule database-connectors
 
Mule database-connectors
Mule database-connectorsMule database-connectors
Mule database-connectors
 
Benefits of the Azure cloud
Benefits of the Azure cloudBenefits of the Azure cloud
Benefits of the Azure cloud
 
Netserv Technology Services
Netserv Technology ServicesNetserv Technology Services
Netserv Technology Services
 
Benefits of the Azure Cloud
Benefits of the Azure CloudBenefits of the Azure Cloud
Benefits of the Azure Cloud
 

Plus de Kenneth Peeples

Connect to the IoT with a lightweight protocol MQTT
Connect to the IoT with a lightweight protocol MQTTConnect to the IoT with a lightweight protocol MQTT
Connect to the IoT with a lightweight protocol MQTTKenneth Peeples
 
Maximize information exchange in your enterprise with AMQP
Maximize information exchange in your enterprise with AMQPMaximize information exchange in your enterprise with AMQP
Maximize information exchange in your enterprise with AMQPKenneth Peeples
 
Integration intervention: Get your apps and data up to speed
Integration intervention: Get your apps and data up to speedIntegration intervention: Get your apps and data up to speed
Integration intervention: Get your apps and data up to speedKenneth Peeples
 
Understanding and Using Client JBoss A-MQ APIs
Understanding and Using Client JBoss A-MQ APIsUnderstanding and Using Client JBoss A-MQ APIs
Understanding and Using Client JBoss A-MQ APIsKenneth Peeples
 
Using Red Hat JBoss Fuse on OpenShift
Using Red Hat JBoss Fuse on OpenShiftUsing Red Hat JBoss Fuse on OpenShift
Using Red Hat JBoss Fuse on OpenShiftKenneth Peeples
 
Service Lifecycle Management with Fuse Service Works
Service Lifecycle Management with Fuse Service WorksService Lifecycle Management with Fuse Service Works
Service Lifecycle Management with Fuse Service WorksKenneth Peeples
 
Big Data and Data Virtualization
Big Data and Data VirtualizationBig Data and Data Virtualization
Big Data and Data VirtualizationKenneth Peeples
 
Simplify your integrations with Apache Camel
Simplify your integrations with Apache CamelSimplify your integrations with Apache Camel
Simplify your integrations with Apache CamelKenneth Peeples
 
Fuse Service Works Design Time Governance and S-RAMP
Fuse Service Works Design Time Governance and S-RAMPFuse Service Works Design Time Governance and S-RAMP
Fuse Service Works Design Time Governance and S-RAMPKenneth Peeples
 
Peeples authentication authorization_services_with_saml_xacml_with_jboss_eap6
Peeples authentication authorization_services_with_saml_xacml_with_jboss_eap6Peeples authentication authorization_services_with_saml_xacml_with_jboss_eap6
Peeples authentication authorization_services_with_saml_xacml_with_jboss_eap6Kenneth Peeples
 
Sap webinar-briefing-sep-2013-final
Sap webinar-briefing-sep-2013-finalSap webinar-briefing-sep-2013-final
Sap webinar-briefing-sep-2013-finalKenneth Peeples
 
CamelOne 2013 Karaf A-MQ Camel CXF Security
CamelOne 2013 Karaf A-MQ Camel CXF SecurityCamelOne 2013 Karaf A-MQ Camel CXF Security
CamelOne 2013 Karaf A-MQ Camel CXF SecurityKenneth Peeples
 

Plus de Kenneth Peeples (13)

Connect to the IoT with a lightweight protocol MQTT
Connect to the IoT with a lightweight protocol MQTTConnect to the IoT with a lightweight protocol MQTT
Connect to the IoT with a lightweight protocol MQTT
 
Maximize information exchange in your enterprise with AMQP
Maximize information exchange in your enterprise with AMQPMaximize information exchange in your enterprise with AMQP
Maximize information exchange in your enterprise with AMQP
 
Integration intervention: Get your apps and data up to speed
Integration intervention: Get your apps and data up to speedIntegration intervention: Get your apps and data up to speed
Integration intervention: Get your apps and data up to speed
 
Understanding and Using Client JBoss A-MQ APIs
Understanding and Using Client JBoss A-MQ APIsUnderstanding and Using Client JBoss A-MQ APIs
Understanding and Using Client JBoss A-MQ APIs
 
Using Red Hat JBoss Fuse on OpenShift
Using Red Hat JBoss Fuse on OpenShiftUsing Red Hat JBoss Fuse on OpenShift
Using Red Hat JBoss Fuse on OpenShift
 
Service Lifecycle Management with Fuse Service Works
Service Lifecycle Management with Fuse Service WorksService Lifecycle Management with Fuse Service Works
Service Lifecycle Management with Fuse Service Works
 
Big Data and Data Virtualization
Big Data and Data VirtualizationBig Data and Data Virtualization
Big Data and Data Virtualization
 
Simplify your integrations with Apache Camel
Simplify your integrations with Apache CamelSimplify your integrations with Apache Camel
Simplify your integrations with Apache Camel
 
Fuse Service Works Design Time Governance and S-RAMP
Fuse Service Works Design Time Governance and S-RAMPFuse Service Works Design Time Governance and S-RAMP
Fuse Service Works Design Time Governance and S-RAMP
 
Peeples authentication authorization_services_with_saml_xacml_with_jboss_eap6
Peeples authentication authorization_services_with_saml_xacml_with_jboss_eap6Peeples authentication authorization_services_with_saml_xacml_with_jboss_eap6
Peeples authentication authorization_services_with_saml_xacml_with_jboss_eap6
 
Sap webinar-briefing-sep-2013-final
Sap webinar-briefing-sep-2013-finalSap webinar-briefing-sep-2013-final
Sap webinar-briefing-sep-2013-final
 
Bitmoney Demonstration
Bitmoney DemonstrationBitmoney Demonstration
Bitmoney Demonstration
 
CamelOne 2013 Karaf A-MQ Camel CXF Security
CamelOne 2013 Karaf A-MQ Camel CXF SecurityCamelOne 2013 Karaf A-MQ Camel CXF Security
CamelOne 2013 Karaf A-MQ Camel CXF Security
 

dvprimer-architecture

  • 3. MAI N DATAMAI N DATA VIRTUALIZATION COMPONENTSVIRTUALIZATION COMPONENTS The Server Design Tools Administration Tools
  • 4. THE SERVERTHE SERVER The server is positioned between business applications/Consumers and one or more data sources. An enterprise ready, scalable, managable, runtime for the Query Engine that runs inside JBoss AS that provides additional security, fault-tolerance, and administrative features. MOVE DOWN TO EXPLORE THE CONCEPT OR RIGHT FOR THE NEXT CONCEPT
  • 5. SE RVE R COMPONENTSSE RVE R COMPONENTS Virtual Database Access Layer Query Engine Connector Architecture
  • 6. VIRTUAL DATABASEVIRTUAL DATABASE A virtual database (VDB) provides a unified view of data residing in multiple physical repositories. A VDB is composed of various data models and configuration information that describes which data sources are to be integrated and how. In particular, source models are used to represent the structure and characteristics of the physical data sources, and view models represent the structure and characteristics of the integrated data exposed to applications.
  • 7. ACCESS L AYERACCESS L AYER The access layer is the interface through which applications submit queries (relational, XML, XQuery and procedural) to the VDB via JDBC, ODBC or Web services.
  • 8. QUERY ENGINEQUERY ENGINE The heart of DV is a high-performance query engine that processes relational, XML, XQuery and procedural queries from federated datasources. Features include support for homogeneous schemas, heterogeneous schemas, transactions, and user defined functions. When applications submit queries to a VDB via the access layer, the query engine produces an optimized query plan to provide efficient access to the required physical data sources as determined by the SQL criteria and the mappings between source and view models in the VDB. This query plan dictates processing order to ensure physical data sources are accessed in the most efficient manner.
  • 9. CONNECTOR ARCH ITECTURECONNECTOR ARCH ITECTURE Translators and resource adapters are used to provide transparent connectivity between the query engine and the physical data sources. DV includes a rich set of Translators and Resource Adaptors that enable access to a variety of sources, including most relational databases, web services, text files and LDAP. A translator is used to convert queries into source-specific commands, and a resource adapter provides communication with the source. Need data from a different source? A custom translators and resource adaptors can easily be developed.
  • 10. DESIGN TOOLSDESIGN TOOLS Various design tools are available to assist users in seeting up JBoss Data Virtualization for an integrated solution. MOVE DOWN TO EXPLORE THE CONCEPT OR RIGHT FOR THE NEXT CONCEPT
  • 11. DATA VIRTUALIZATION DESIGNERDATA VIRTUALIZATION DESIGNER The designer is a visual tool that enables rapid, model-driven definition, integration, management and testing of data services without programming using the DV runtime framework. With the designer you can: create a virtual database (or VDB) containing your models, views, procedures, dynamic XML documents which you deploy to DV server and then access your data. resolve semantic differences create virtual data structures at a physical or logical level use declarative interfaces to integrate, aggregate, and transform the data on its way from source to a target format which is compatible and optimized for consumption by your applications Preview your data
  • 12. DATA VIRTUALIZATION DESIGNERDATA VIRTUALIZATION DESIGNER (CONTINUED)(CONTINUED) Part of the JBoss Developer Studio Integration stack
  • 13. DV WEBUIDV WEBUI http://www.ossmentor.com/2015/03/data-virtualization-web-ui-now-released.html Create Data Services through a WebUI Create Views and Models through the WebUI without the requirements of a local IDE Currently for more simple data services Currently Developer Preview
  • 14. CONNECTOR DEVELO PMENTCONNECTOR DEVELO PMENT The process of integrating data from an enterprise information system into JBoss Data Virtualization requires one to two components: a translator (mandatory) and a resource adapter (optional), also known as a connector. Most of the time, this will be a Java EE Connector Architecture (JCA) Adapter. A translator is used to: translate JBoss Data Virtualization commands into commands understood by the datasource for which the translator is being used, execute those commands, return batches of results from the datasource, translated into the formats that JBoss Data Virtualization is expecting. https://access.redhat.com/documentation/en- US/Red_Hat_JBoss_Data_Vir tualization/6.1/html/Development_Guide_Volume_4_Server_Development/Introduction_to_the_JBoss_Data_Serv ices_Connector_Architecture.html
  • 15. CONNECTOR DEVELO PMENTCONNECTOR DEVELO PMENT (CONTINUED)(CONTINUED) A resource adapter (or connector): handles all communications with individual enterprise information systems, (which can include databases, data feeds, flat files and so forth), can be a JCA Adapter or any other custom connection provider (the JCA specification ensures the writing, packaging and configuration are undertaken in a consistent manner), removes concerns such as connection information, resource pooling, and authentication for translators.
  • 16. CUSTOM ADAPTORS ANDCUSTOM ADAPTORS AND TRANSL ATORSTRANSL ATORS Translators - https://access.redhat.com/documentation/en- US/Red_Hat_JBoss_Data_Virtualization/6.1/html/Development_Guide_Volume_4_Server_Development/chap- Translator_Development.html#Custom_Translators Adaptors - https://access.redhat.com/documentation/en- US/Red_Hat_JBoss_Data_Virtualization/6.1/html/Development_Guide_Volume_4_Server_Development/chap- Resource_Adapter_Development.html#Developing_JCA_Adapters Extending Execution Factory Class - https://access.redhat.com/documentation/en- US/Red_Hat_JBoss_Data_Virtualization/6.1/html/Development_Guide_Volume_4_Server_Development/chap- Extending_the_Execution_Factory_Class.html
  • 17. ADDITIONAL CUSTOMIZATIONSADDITIONAL CUSTOMIZATIONS JBoss Data Virtualization is highly extensible in other ways: You can add user defined functions. You can adapt logging to your requirements, which is especially useful for custom audit or command logging. A delegating translator can be used to add custom code to all methods for a given translator. You can also customize authentication and authorization modules. See the Red Hat JBoss Data Virtualization Security Guide.
  • 18. TRANSL ATORSTRANSL ATORS Apache Cassandra (Technical Preview Only) Apache Solr Cloudera Impala JDBC Translator File Translator Google Spreadsheet Translator JBoss Data Grid 6.3 LDAP Translator MongoDB Translator Object Translator OData Translator OLAP Translator Salesforce Translator Web Services Translator
  • 19. RESOURCE ADAPTORSRESOURCE ADAPTORS With the exception of JDBC data sources, JBoss Data Virtualization provides a JCA adapter for each supported data source. These are the resource adapter identifiers, as specified in the server configuration file: File Adapter - file Google Spreadsheet Adapter - google Red Hat JBoss Data Grid (6.1 & 6.2) Adapter - infinispan LDAP Adapter - ldap Salesforce Adapter - salesforce Web Services Adapter - webservice Mongo DB Adapter (technical preview) - mongodb A resource adapter for the JDBC translator is provided with JBoss EAP by default.
  • 20. ADMINISTRATIVE TOOLSADMINISTRATIVE TOOLS AdminShell- AdminShell provides a script-based programming environment enabling users to access, monitor and control JBoss Data Virtualization. Management Console - The Management Console provided by the Red Hat JBoss Enterprise Application Platform (EAP) is a web-based tool allowing system administrators to monitor and configure services deployed within a running JBoss EAP instance, including JBoss Data Virtualization. Management CLI - The Management CLI (command-line interface) is provided by JBoss EAP to manage services deployed within a JBoss EAP instance. Operations can be performed in batch modes, allowing multiple tasks to be run as a group. JBoss Operations Network - Red Hat JBoss Operations Network provides a single interface to deploy, manage, and monitor an entire deployment of Red Hat JBoss Middleware applications and services, including JBoss Data Virtualization. Dashboard Builder - The Dashboard builder allows connection to VDBs through the DV JDBC driver to visualize the data for testing and Business Analytics. MOVE DOWN TO EXPLORE THE CONCEPT OR RIGHT FOR THE NEXT CONCEPT
  • 21. THE ADMIN SHELLTHE ADMIN SHELL AdminShell provides the following features: Administration - AdminShell can be used to connect to a JBoss Data Virtualization instance in order to perform various administrative tasks. Data Access - AdminShell can be used to connect to a virtual database (VDB) and run SQL commands to query VDB data and view results. Migration - AdminShell can be used to develop scripts that will move VDBs and associated components from one development environment to another. (Users can test and automate migration scripts before executing them in production deployments.) Testing -The built-in JUnit Test Framework allows users to write regression tests to check system health and data integrity. The written tests validate system functionality automatically, removing the need for manual verification by QA Personnel. https://access.redhat.com/documentation/en- US/Red_Hat_JBoss_Data_Virtualization/6.1/html/Administration_and_Configuration_Guide/sect -AdminShell.html
  • 22. THE MANAGEMENT CONSOLETHE MANAGEMENT CONSOLE The Configuration tab contains general and JBoss Data Virtualization specific configuration properties. Runtime tab shows runtime information about JBoss EAP server and Teiid subsystem. You can view runtime information about Teiid by clicking Virtual Databases in the left hand navigational tree. You can configure roles and groups using the Administration tab. Roles for a user to be included in and excluded from can be configured in the Management Console. You can also configure groups to be included or excluded from a role. Only users in the SuperUser or Administrator roles can perform this configuration. https://access.redhat.com/documentation/en- US/Red_Hat_JBoss_Data_Virtualization/6.1/html/Administration_and_Configuratio n_Guide/sect-Management_Console.html
  • 23. MANAGE MENT CLIMANAGE MENT CLI The Management CLI features a help dialog with general and context-sensitive options. Easy to launch and connect with the EAP_HOME/bin/jboss-cli.sh - -connect or jboss-cli.bat https://access.redhat.com/documentation/en- US/Red_Hat_JBoss_Data_Virtualization/6.1/html/Administration_and_Configura tion_Guide/sect-Management_CLI.html
  • 24. JBOSS OPERATIONS NETWORKJBOSS OPERATIONS NETWORK JBoss Operations Network has additional agent plug-ins to manage other JBoss products. Although these are JBoss ON resource plug- ins, they are included in separate packages and require a separate subscription to download them. https://access.redhat.com/documentation/en- US/Red_Hat_JBoss_Data_Virtualization/6.1/html/Administration_an d_Configuration_Guide/sect- JBoss_Operations_Network.html#Installing_JBoss_Agent_Plug- in_Packs
  • 25. DASHBOARD BUILDERDASHBOARD BUILDER Red Hat JBoss Dashboard Builder can be connected to an external database, be it using JNDI of the container or connecting directly only using the JDBC driver to access the database. Connections to databases can be configured in workspace Showcase on page External Connections. After you have established the connection to the database, you need to create a data provider that will collect the data from the database and allow you to visualize it as an indicator in the dashboard area of a page. Note that Red Hat JBoss Dashboard Builder makes use of its own local internal database to store its local data. This database is read-only for Dashboard Builder, but is accessible from outside.