Webinar: ‘Secret Sauce’ How Allied Payment Innovates with DataStax Enterprise
•Download as PPTX, PDF•
0 likes•2,842 views
Allied Payment Network is a visionary and innovative company that applies emerging bill pay technologies for the financial industry and its customers. The company makes the bill paying process easier and more convenient for the consumer, and more efficient and cost effective for financial institutions. Faced with “ridiculous scale” a year and a half ago, the IT team at Allied Payment Network knew they needed an alternative to the legacy database system that was locking up much too frequently. They also needed a better way to increase application response times, manage multiple availability zones, and take advantage of the fact that “space is cheap.” Innovators of PicturePay and other cutting edge solutions, Allied Payment turned to DataStax Enterprise, powered by Apache Cassandra™. Join us for this webinar, where you will learn about Allied Payment’s 1. “Painless migration” from Microsoft SQL Server, accomplished after they were in production 2. Discovery of the “paradigm-shifting” query-first data model 3. Use of DataStax’s OpsCenter to easily manage the database layer of their application 4. Experience of 100x faster response times since deploying on DataStax Enterprise You need to find the best database for today’s online applications, and you need to know which one to consider first so you don’t waste valuable time. Allied Payment is a great example of how to get it right: proactively grow your business using the right technology.
Recommended
Recommended
More Related Content
Viewers also liked
Viewers also liked (20)
More from DataStax
More from DataStax (20)
Recently uploaded
Recently uploaded (20)
Webinar: ‘Secret Sauce’ How Allied Payment Innovates with DataStax Enterprise
- 1. ‘Secret Sauce’: How Allied Payment Innovates with DataStax Enterprise Brian Rumschlag, Systems Architect, Allied Payment Kami Nixon, DataStax Enterprise Product Team
- 2. Today’s conversation • Introductions • Today’s online environments • Uptime (continuous availability) • Success Stories • Your Questions
- 3. Today’s Speakers Brian Rumschlag Systems Architect Allied Payment Network Kami Nixon DataStax Enterprise product team
- 5. DataStax • Founded in April 2010 • Drives Apache Cassandra™, the popular open-source big data database • 300+ customers ©2013 DataStax Confidential. Do not distribute without consent. 5
- 6. Allied Chose DataStax for Confidence DataStax Enterprise delivers confidence in using a production-ready version of Cassandra, fully supported by the world’s leading experts, 24x7 We’re there when you need us Get support while you build and during production, with hot-fix support for emergencies Consult with us while you decide what to build and what to change
- 8. Is she buying clothing? vegetables? a mortgage? Your online applications must help customers with… • • • • Fast and tailored product searches Individualized recommendations Customized web pages Good information With no downtime
- 9. Bill pay & banking: slow online adoption?
- 10. Use Cases & Fraud Detection
- 11. Security, Compliance & Fraud Detection
- 12. Success Story: Thomson Reuters “Security is very important to us, so we’re naturally very pleased to see all the new security features in DataStax Enterprise 3. Its scalability and performance are enabling us to develop an exciting financial data analytics platform that will create a better experience for our audience.”
- 13. Using OpsCenter
- 14. Now Available: Fix problems before they happen • DataStax Management Services in DSE 3.2 • Repair Service • Capacity Planning Service • Improved Search & Analytics • DataStax OpsCenter 4.0 • Redesign • Bulk Management
- 15. DataStax Management Services • Automatic management services transparently perform key maintenance tasks and advanced operations without staff involvement. • Choose the command line or OpsCenter. • Repair service automatically keeps a cluster’s data consistent. • Capacity service provides historical trend analysis and forecasting • More services to roll out with upcoming DataStax Enterprise releases. Repair Service Capacity Planning
- 16. ‘3 Days Down would = death of company’ About 1/2 OF ALL SALES will be online BY THE END OF 2013 Localization deployment Global market demands Cloud Datacenter Source: (http://www.datastax.com/resources/whitepapers/bigdata) 24/7 monitoring demands
- 17. Innovate with confidence Apache Cassandra™: massively scalable NoSQL database That offers uptime, all the time (continuous availability) And easy data distribution Cloud Datacenter Source: (http://www.datastax.com/resources/whitepapers/bigdata)
- 18. Scale to meet any demand, without surprises On Demand down 14 13 Major Retailer loses shopping cart inventory 24 Dates systems crashes Rapper joins Social Media and crashes site 5 Power grid failure 2009 Natural disaster Black Friday 24 Holiday shopping season 25 2010 2011 Fluctuating traffic demands 2012
- 19. Cassandra: performance and scale “In terms of scalability, there is a clear winner throughout our experiments. Cassandra achieves the highest throughput for the maximum number of nodes in all experiments with a linear increasing throughput.” Solving Big Data Challenges for Enterprise Application Performance Management, Tilman Rable, et al., August 2013, p. 10. Benchmark paper presented at the Very Large Database Conference, 2013. http://vldb.org/pvldb/vol5/p1724_tilmannrabl_vldb2013.pdf Netflix Cloud Benchmark… End Point Independent NoSQL Benchmark Highest in throughput… Lowest in latency… http://techblog.netflix.com/2011/11/benchmarking-cassandra-scalabilityon.html
- 20. Cassandra: read and write anywhere Read Write Write Cassandra Multi-Data Center Read Write
- 21. DataStax Enterprise – Hot Data in Context Read Analyze Write Write DataStax Enterprise Multi-Data Center Search Search Read Write
- 22. The Security You Need Read Analyze Write Write Search Search Read Write
- 23. Success Story: Datafiniti Datafiniti, which is a search engine for data, needs to consume lots of data in real time and provide fast search on top of the same data.
- 24. Get Strong Payback on IT Investment Constant Contact found that scaling out with NoSQL vs. IBM DB2 saved them 90% in software costs, and was implemented in 1/3 the time... • Better ROI “To do what we need to do today without Cassandra would cost a couple million dollars more and would be significantly harder to manage operationally.” • 80-90% less than a RDBMS • Simpler & faster development • Greater insight • More flexibility and functionality
- 25. DataStax Enterprise for uptime • Cassandra for real time ecommerce transactions. • Hadoop for ecommerce buyer analysis. • Solr for fast ecommerce product searches.
- 26. How can I try DataStax Enterprise? • • • • Go to www.datastax.com/download Download DataStax Enterprise Installs and configures in minutes Completely free for development evaluation (no trial time bombs) • Subscription required for production deployments
- 27. What’s next for your business? Future-proof your modern applications. • Expand capacity when needed without business interruption. • Scale to handle new product lines, new markets, and more.
- 28. DataStax Enterprise – The future-proof platform • Easily increase performance and scale • Add nodes transparently/online • Across multiple data centers and cloud zones Online Search Analyze Online Analyze DataStax Enterprise The Enterprise NoSQL Platform Search DataStax Enterprise Search The Enterprise NoSQL Platform Analyze Online Online Search Analyze
- 29. Thank You – Questions? We power the big data applications that transform business.
- 30. Archive/Supporting ©2013 DataStax Confidential. Do not distribute without consent. 30
- 31. Yesterday’s ecommerce vs. today’s ecommerce Legacy Line-ofBusiness Apps LOB App RDBMS LOB App RDBMS Data Warehouse RDBMS Oracle Today’s Line-ofBusiness Apps LOB App RDBMS MySQL SQL Server Teradata/ Column DB’s LOB App NoSQL C * C * LOB App NoSQL C * C * C * C * C * C * C * C * C * C * C * C * LOB App NoSQL C * C * C * C * C * C * C * C * C * C * C * C * C * C * C * C * Data Warehouse Hadoop
- 32. Previous Generation vs. Modern Applications Legacy Applications Today’s Applications Slow/medium velocity data High velocity data Data coming in from one/few locations Data coming in from many locations Rigid, static structured data Flexible, fluid, multi-type data Low/medium data volumes; purge often High data volumes; retain forever Deploy app central location/ one server Deploy app everywhere / many servers Write data in one location Write data everywhere/anywhere Primary concern: scale reads Scale writes and reads Scale up for more users/data Scale out for more users/data Downtime tolerated Downtime not tolerated
- 34. Success Story - Netflix Netflix systems are run in the cloud across multiple availability zones with Cassandra and sport constant uptime. Over 95% of Netflix’s data is stored in Cassandra (much of it previously on Oracle).
- 35. Success Story - Netflix Commenting on Amazon outage in Oct 2012: “We configure all our clusters to use a replication factor of three, with each replica located in a different Availability Zone. This allowed Cassandra to handle the outage remarkably well. When a single zone became unavailable, we didn't need to do anything. Cassandra routed requests around the unavailable zone and when it recovered, the ring was repaired.” - Netflix Tech Blog http://techblog.netflix.com/2012/10/post-mortem-of-october-222012-aws.html
Editor's Notes
- Welcome to today’s webinar: How much money do you lose when your online application goes down?My name is Kami Nixon and I handle Product Marketing here at DataStax.Joining me is Brian Rumschlag, Systems Architect Allied Payment, and Mike Bulman head of DataStax OpsCenter
- Faced with “ridiculous scale” a year and a half ago, the IT team at Allied Payment Network knew they needed an alternative to the legacy database system that was locking up much too frequently. They also needed a better way to increase application response times, manage multiple availability zones, and take advantage of the fact that “space is cheap.” Innovators of PicturePay and other cutting edge solutions, Allied Payment turned to DataStax Enterprise, powered by Apache Cassandra™.Today we will learn about Allied Payment’s1. “Painless migration” from Microsoft SQL Server, accomplished after they were in production2. Discovery of the “paradigm-shifting” query-first data model3. Use of DataStax’sOpsCenter to easily manage the database layer of their application4. Experience of 100x faster response times since deploying on DataStax EnterpriseYou need to find the best database for today’s online applications, and you need to know which one to consider first so you don’t waste valuable time. Allied Payment is a great example of how to get it right: proactively grow your business using the right technology.
- Brian Rumschlag:A 15-year industry veteran, Brian “grew up side by side with a PC” and has seen many changes, as he puts it: “From Access to Dbase 3 to SQL Server and Oracle, and now Cassandra. You have to have some paradigm-shift every couple of years.”Kami Nixon: I’m on the product team here at DataStax.
- Allied Payment Network is a visionary and innovative company that applies emerging bill pay technologies for the financial industry and its customers. The company makes the bill paying process easier and more convenient for the consumer, and more efficient and cost effective for financial institutions. Allied is breaking the mold and bringing bill payment to financial institutions that doesn't break the bank.Brian, please tell us more about Allied.
- DataStax drives Apache Cassandra, the popular open-source NoSQL database. Founded about 3 ½ years ago, DataStax helps more than 300 businesses achieve the uptime they need so they can provide highly differentiated products and services.
- Brian, you said Allied’s number one reason for choosing DataStax was our expert support. What has our support meant for your business?(notes from conversation)Support: Biggest draw was the support. Helped in sales process, data model. Before we even bought you helps us a lot. Open-source Chef recipes. Plain vanilla server start out. Compare service. I would pay for private chef to reward them for that attitude. Focus of the conversation: talk about how DS helped us out with this, benefits we got from C*. Enabled us to try out something we aren’t totally comfortable with.
- Brian, how important was it to learn the data model?Command query responsibility Read model Write modelRDBMS data model, 3rd order standard, nothing duplicated, joinsApplication will have 9x reads as writes, or even 99 reads to 1 write. Why do we have a data structure that makes it really easy to write to, but makes it difficult/expensive to read from. What our arch lets us do, we write to an event store, project that into whatever shape we want it to be. Allowed us to take a risk on C*. Write everything in C#. Java client was outside of comfort zone. I don’t lose any data. We set up a really small cluster, stored some read models in both places.
- No matter what industry you’re in, this image reflects more and more how your customers experience you: through a computer screen. How you optimize those onscreen interactions, and let your customers know that they are unique, is an important indicator of your ongoing success. The online application has become the employee on the sales floor or behind the desk. A website experiencing downtime is basically a padlocked storefront during business hours. Your potential customers scratch their heads and turn away wondering what’s going on, often never to return, while you lose money every minute. Whether people are buying shoes or a car loan, they expect to find you online and open for business, always.
- Brian, Allied says, and I agree, that the bill pay market is still relatively immature in adoption of online banking customers. I’m showing content from Eric Brewer’s blog here about ACID, BASE, and so on. Is consistency a factor? Why such slow adoption in the bill pay and banking sector?ACID: blog post. Financial transactions in real life are eventually consistent. Controlled with limits and such. So our model is constructed so denormalizers kick off and project that into different shapes. In effect eventually consistent – handful of milliseconds. Misbehaving apps are caught. List of all payments today, for this customer, within 0.5 seconds. Consistent volatile cache. And the fact that you’re not waiting for the next day.
- Fraud detection: using limits. Identification with device. Geo locations and things like that. Can only track all of that information by having a column family by user. Very difficult in a relational database. If brand new device, different set of limits and rules. Use cases: Read models. Logging, time series. List of all logs for the day in one row. Having a bunch of appends to a table, database hates it. Locking pages, tables, etc. This doesn’t happen in C*. What’s the big deal about time series? There are db whose whole purpose in life is for time series or something like C*. sheer volume of what’s going on. Don’t have pull whatever happened to everyone, can get what happened to Alice? Don’t have to filter. She’s all in one row. Fewer rows and more columns.
- Allied’s biggest hurdle is in the cloud. We’re able to replicate into multiple data centers. No shared tenancy. People allergic to cloud PCI.
- Security that satisfies even the toughest requirements, like those of Thomson Reuters.So Allied could solve the challenges they had with DataStax Enterprise.
- Brian, you’ve said that your team uses OpsCenter quite a bit. Could you tell us more about that?
- Conversation between Mike and Brian.
- Getting comfortable with C*: Maintained that scenario in production. 100x faster. Not blowing up. Eventually consistent. Don’t have to worry about locks so much. Big table of payments millions of rows in it.
- Cassandra accomplishes this performance and continuous availability because of its architecture. By design, it is a massively scalable NoSQL database that offers uptime, all the time, and easy data distribution. With physical and cloud deployments.
- Avoiding disaster is one component of uptime. Another is scaling to meet demand for 1 visitor or 1 million. Since your application must be continuously available, it requires elastic scale so you can meet needs as traffic ebbs and flows. You see, sometimes things will go extremely well for your business. Is that during tax time? Black Friday? Summer travel season? How would your business handle it if you experienced a sudden huge spike in demand? If your application crashed, how much business would you lose? We’ve heard estimates in the millions of dollars per day lost to outages. What’s more, how would you ever get those sought-after customers back to your company?
- So, scaling up. Cassandra, which powers DataStax Enterprise, scales without surprises and greatly outperforms other NoSQL databases like Hbase and MongoDB. In independent benchmarks, Cassandra consistently outperforms competition and scales linearly, something no other database technology even claims to do.
- Here’s more about how it works. Cassandra lets you read and write data anywhere, with no single points of failure.
- So, here is how you get to know your customers better, in real time, using search and analytics. In DataStax Enterprise you can do all of this in real time without affecting performance. You’ve still got the active-everywhere architecture letting you read and write at extremely high velocities. Thanks to DataStax Enterprise’s integrated platform, you also have the ability to search and analyze all of that hot data in context. You don’t have to extract it, process it and then import it back into some program. Nope. You leverage it exactly as you need to, all in real time within the context of the online app. Plus, you also offer a much better search experience for your customers, again because everything is happening in real time without slowing anything down.
- DataStax offers the most comprehensive set of data security features offered by any NoSQL provider. Read, write, search and analyze, and do it all with enterprise security. So if you are a health care provider, a mortgage company or an insurance brokerage with a tight regulatory and compliance environment, you can still offer the service that customers demand today.Internal authentication, which makes it easy to manage who can access your database.External authentication, which allows widely trusted security packages like Kerberos and LDAP to be used for security management.Permission management that controls who can perform certain tasks in your database.Transparent data encryption, which encrypts sensitive data so that it can’t be stolen and accessed by data thieves.Data auditing that provides the ability to understand everything that’s taken place in your database, and…Client to node encryption, which protects data as it’s in flight from clients to the database.
- Datafiniti uses the operational simplicity and integration of DataStax so it can provide fast search.
- Constant Contact found that choosing us saved them 90% in software costs, and was implemented in 1/3 the time. Remember at the beginning of the talk, we touched on enablement for your developers. Making things easier for them to shorten implementation times? Our Cassandra Query Language, akin to SQL, flattens the learning curve for the people on your team coming from a relational background. Our drivers and other capabilities make the whole development and implementation process seamless so your lean team can stay that way, and still perform incredibly well.Ease of use. Better manageability. Superior technology. Integration and certified for production. World class support. Lower software costs. Commodity hardware capabilities. Cloud and physical deployments. Nimble operational team functionality.Oh, and unparalleled performance.All of this means you get a better return on investment, not only savings costs to improve the bottom line, but growing the top line in ways you may not have ever imagined. What would this do for your ecommerce environment?
- So, ours is an enterprise NoSQL platform built on Cassandra that lets you scale with no surprises and keep your applications running, no matter what. Plus, its integrated platform gives you operational simplicity for real-time, analytic, and enterprise search data.
- Find out how easy it is to ensure uptime, all the time, for your online transactional applications.Download DataStax Enterprise today. It’s completely free in development, with no trial time bombs or anything like that. Use it in your sandbox. You do need a subscription when you bring it into production so that your mission-critical applications will be supported.
- Where will you be 12 months from now? Are you ready?You’ve got to future-proof your modern applications while still maintaining uptime. Use scalable architecture so you can expand capacity when you need to, without interrupting your revenue-generating online applications. Scale to handle new product lines, new markets and so on.
- Oursis the future-proof platform because it lets you easily increase performance and scale without any surprises. You can add nodes transparently and online, even across multiple data centers and cloud zones.
- Questions?
- Let’s quickly visualize what all of this means in terms of technology change. Online transactional applications rest firmly on the left side of this image. In the past, you would build your online transactional applications on top of a relational database and call it a day. But that simply doesn’t work anymore.That’s because the needs have changed. Now you need tokeep business always online and serving customersserve customers everywhere (i.e. in multiple locations)deliver information fast both internally and externallyhandle increasing customer demandprotect information that runs the businessmake business decisions based on right informationeasily find needed informationandreceive strong payback for IT investments
- In terms of what you used to expect from your applications and what you need to demand from them now, take a look here. The velocities and varieties of data coming in are ever-increasing. You’ve got more and more of it, and you must scale and never experience downtime.(Brian, how have these changes impacted Allied?)
- Ebay uses the continuous availability plus integrated search and analytics capabilities of DataStax Enterprise to serve the personalized pages that customers expect. You might be thinking, “We’re not ebay. We don’t have to do all that.” Not true. Not anymore. Customers simply expect this personalization and if you aren’t offering this level of customization on your page and in your products and services, your competitors almost certainly are.
- Netflix relies on Cassandra’s performance and availability across multiple zones to achieve constant uptime. They couldn’t do that with the legacy solutions.
- They’ve said so.