1. TEC1227
Complete Business Analytics with SAP Sybase IQ
and SAP BusinessObjects Software
Courtney Claussen, SAP Sybase IQ Product Management
October 19, 2012
39. Feedback
Please complete your session evaluation for TEC 1227.
courtney.claussen@sap.com
Thanks for attending this SAP TechEd session.
Notes de l'éditeur
Sybase IQ handles big data across many industries worldwide. It is the custodian of very large societal information:All statistical measures in CanadaAll federal tax returns in the USAAll citizen health information in KoreaSybase IQ allows the largest commercial information providers to thrive, including 30 of the largest information providers in the world: Nielsen, Experian, TransUnion, Acxiom, Dun & Bradstreet, Thomson Reuters, TNS Media, …Sybase IQ crunches through the most complex models in the financial world, and is deployed in more than 200 financial institutions : JPMC, HSBC, Goldman Sachs, Alliance Bernstein, Citigroup,CSFB, Etrade, …
Sybase IQ is a recognized leader in analytics – with a growing customer base and high level of customer satisfaction. Our revenue growth curve has been double that of the general data warehouse marketplace during the last 4 hears. Our performance in certified benchmarks, and recognition as a market leader by Gartner and Forrester have earned us our stripes. Sybase has never sat on its laurels, though, and has continuously improved Sybase IQ with a rapid series of innovations. The last 3 years have seen 5 major releases that have introduced significant new features and capabilities.
As you can see, Sybase IQ is a comprehensive big data analytics platform.At the foundation layer, we have the most mature column store, ILM, MPP, Virtual data marts, high speed loads, structured and unstructured data handled together.At the application services layer, we provide a rich dialect of SQL, built-in full text search, Web 2.0 drivers, and UDFs for extending IQ capability and integrating with other computing paradigms such as Hadoop and R.And finally, there is an extensive ecosystem of partner technology that integrates with IQ to provide solutions in the areas of predictive analytics, information lifecycle management, business intelligence and administration tools.
Now let’s look at what kinds of searches I can do against text columns. In the first example, I’m asking to return all the rows and where the term ‘d’ is included in the text column. ‘d’ stands for any word or phrase that you might want to look for.In the second example, I get not only the rows but also a score for how often the term ‘d’ appears in the text column.In the third example, I’m asking to find the text where the term ‘a’ exists in the document when the term ‘b’ does NOT exist.Finally, in the last example, I’m able to find terms within a certain proximity to each other using the NEAR keyword.
SAP Sybase IQ can take an individual query, break it up into independent fragments, and execute those fragments in parallel on multiple machines. The node that a query is initiated on is the “leader”, and other nodes are the “workers”. Leaders and workers can work on multiple queries at the same time. Distribution to workers occurs only if the query optimizer decides that it cannot handle the query most effectively by itself. Note that distribution requires some overhead, and a query will only be distributed if it can be executed more quickly on multiple machines.
These different integration methods give the user a variety of choices when combining the power of IQ with the power of Hadoop.
This whitepaper describes the outcome of an SAP Co-Innovation Lab-enabled project to validate the performance and scalability of a large scale deployment of BI4 capable of sustaining thousands of concurrent users. The SAP BI platform and database technologies were configured to run over a standard enterprise ready open source operating system (RedHat RHEL 6) using commodity hardware (Super micro Twinblades and SuperServers) using an Application Delivery Control system from F5 as well as continuous energy monitoring and management from OsiSoft using its PI server technology. Lastly we generated all of the simulated user traffic with SoastaCloudTest affording the project team the flexibility to dynamically assign load levels and ramp up and yet reveal deep insight into the underlying systems, behaviours and response times based upon the load generated
This whitepaper describes the outcome of an SAP Co-Innovation Lab-enabled project to validate the performance and scalability of a large scale deployment of BI4 capable of sustaining thousands of concurrent users. The SAP BI platform and database technologies were configured to run over a standard enterprise ready open source operating system (RedHat RHEL 6) using commodity hardware (Super micro Twinblades and SuperServers) using an Application Delivery Control system from F5 as well as continuous energy monitoring and management from OsiSoft using its PI server technology. Lastly we generated all of the simulated user traffic with SoastaCloudTest affording the project team the flexibility to dynamically assign load levels and ramp up and yet reveal deep insight into the underlying systems, behaviours and response times based upon the load generated
The internal launch of SAP BusinessObjects BI Analytics Editions, was announced today [August 22, 2012]. The SAP BusinessObjects BI Analytics Editions is a complete analytics solution in one simple package. SAP BusinessObjects BI Analytics Editions combine business intelligence and real-time data management, with runtime licenses of Sybase IQ and Data Integrator, together with access to free best practice business content to deliver high performance analytics tailored to industry and line of business needsThe goal of this play is to take the existing BI Platform to a whole new level and establish it as an end-to-end analytics platform and align it with SAP’s real-time data management strategy by including runtime licenses of Sybase IQ and Data Integrator. SAP BusinessObjects BI Solutions, analytics editions are new solutions this play will help introduce to the market. The bundling of the SAP BusinessObjects BI solutions with SAP Sybase IQ and SAP Data Integrator provide an analytics framework for the customer to gain superior analytic performance on big data and have instand and powerful insight all from one complete out-of-the-box offering. The analytics editions of SAP BusinessObjects BI solutions also include samples of best-practice analytics content and use cases tailored for key industries and/or lines of business (LoB). The new solutions this play will introduce to the market to meet the needs of small, mid-market & enterprise customers are: SAP BusinessObjects BI suite, analytics edition SAP BusinessObjects BI platform, analytics edition SAP BusinessObjects BI, Edge analytics edition SAP Crystal Server, analytics edition
Let us take a look at how we can take a versatile portfolio and improve it significantly.Today, the various modules in the portfolio works very well. In fact, most of them worked very well even before the two companies came together. However, since the acquisition of Sybase by SAP we have moved in to unleash a new wave of innovation to make the complete portfolio even more interesting and valuable.Our direction is very clear. First, we want to ensure that the products and modules within the portfolio continues to work well i.e. they are always certified and supported before they are released thereby providing our customers with a sense of confidence that new releases in any product will always work with other products in the portfolio that may or may not have changed. But this is a given, everyone expects it from us.What we have planned and already commissioned is a series of projects that will provide several cutting edge optimizations at the integration points that will provide customers with tremendous performance, scalability or usability advantages thereby saving time and resourcesWhat’s more, we will go another step further and actually provide seamless integration in various areas that will make the products in the portfolio appear as ‘fused and one’ reducing complexity further.But the benefits are clear as explained earlier – ease of deployment, fantastic performance, scalable to handle lots of users and data, integration to simplify administration, and cutting edge innovations in areas like Text analytics.
Data Preparation activities traditionally consume about 70% of the time and resources for analytics projects and include extracting, transforming, cleansing and loading data, and ensuring adequate data quality processes: SAP Data Integrator rapidly cleans, transforms and loads data from a variety of database sources.Data Management activities consist of designing schemas, determining data storage architecture (i.e. near-line, archival storage), optimizing data access, managing workload performance, and maintaining operational efficiency: SAP Sybase IQ stores, efficiently manages massive volumes of data, no matter the schema, the application needs or the user counts. With compression algorithms reducing volumes of stored data by up to 70% customers have a low startup and long-term TCO — less storage and maintenance resources = more money for the bottom line.Data Analysis relates to decision-making activities, including reporting, data mining, ad hoc analysis, and just-in-time decision-making. Data analysis is completed by various users from a wide range of tools and types of algorithms or queries: SAP BusinessObjects BI solutions enables reporting, dashboarding, discovery and analysis.
Having earned leader status in their respective Gartner Magic Quadrants, each of the SAP products are now integrated into a complete end-to-end business analytics solution. Together they provide a unique and integrated set of best-of-breed tools for data integration, data management and data analysis/business intelligence.
Data warehousing and analytics is not easy. Organizations are willing to go the extra step to string together the various pieces needed starting from data identification to cleansing to loading to managing to reporting/analysis. However, the task is quite daunting when all of these pieces need to be top notch and most often come from different vendors with different levels of integration with each other.Isn’t it great that now between Sybase and SAP BusinessObjects we are able to offer the complete ‘best-of-breed’ stack to our customers without the complications of multivendor acquisition, integration, deployment, and sustenance.With the combination of Sybase IQ and SAP BusinessObjects portfolio we are now able to overcome all of the above issues making it easier to acquire, develop, deploy, and sustain a sophisticated, capable, and valuable Business Analytics solution stack that provides, we would argue, the best ROI in the industry.