David Pilato - Advance search for your legacy application - NoSQL matters Paris 2015

•

2 likes•2,035 views

How do you mix SQL and NoSQL worlds without starting a messy revolution?This live coding talk will show you how to add Elasticsearch to your legacy application without changing all your current development habits. Your application will have suddenly have advanced search features, all without the need to write complex SQL code!David will start from a Spring, Hibernate and Postgresql based application and will add a complete integration of Elasticsearch, all live from the stage during his presentation.

Software

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or
distributing without written permission is strictly prohibited
for your legacy app
advanced search
David Pilato
Developer | Evangelist
@dadoonet

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or
distributing without written permission is strictly prohibited
our use case

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or
distributing without written permission is strictly prohibited
our legacy platform
WEB APP
HTTP/REST
JDBC
DATABASE
SQL

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or
distributing without written permission is strictly prohibited
our legacy domain / database

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or
distributing without written permission is strictly prohibited
our legacy app
demo time
$ git clone https://github.com/dadoonet/legacy-search.git
$ git checkout 00-legacy
$ mvn clean install jetty:run

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or
distributing without written permission is strictly prohibited
architecture
connecting with our app

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or
distributing without written permission is strictly prohibited
ETL
using a ETL
DATABASE
SQL
WEB APP
HTTP/REST
JDBC
ELASTICSEARCH
REST/JSON

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or
distributing without written permission is strictly prohibited
JDBC RIVER
JDBC river
DATABASE
SQL
WEB APP
HTTP/REST
JDBC
ELASTICSEARCH
REST/JSON
SQL JSON

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or
distributing without written permission is strictly prohibited
JDBC river
DATABASE
SQL
WEB APP
HTTP/REST
JDBC
ELASTICSEARCH
REST/JSON
SQL

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or
distributing without written permission is strictly prohibited

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or
distributing without written permission is strictly prohibited
direct connection
Do It Yourself

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or
distributing without written permission is strictly prohibited
https://elastic.co/support/
jobs@elastic.co
David Pilato
Developer | Evangelist
@dadoonet

What's hot

When creating a mobile application, organisations have a few options to choose from; mobile web, native or a hybrid application. Where web apps are just websites that can be accessed on the internet via a mobile browser like Chrome or Safari, native apps are applications that are developed for a specific platform such as Android or iOS. Hybrid apps are different because they possess elements from native apps and web apps. When automating web applications, Selenium commands are used. Nine out of ten times the same automation script can be used for mobile web applications as our desktop web applications. With native apps however, we need to look deeper into the differences between Android and iOS apps before we can use Appium commands. But how should you automate hybrid apps, can or do you need to choose one of the two automation strategies or is there also a hybrid approach for automating hybrid apps? That’s what we are going to talk about during this webinar. We will be looking into how to detect a hybrid application for Android and iOS, the do’s and the don’ts when it comes to automating a hybrid application and we will provide you with tips and tricks on how to make this work for both Android and iOS. By the end of this webinar, you’ll be able to create your own Appium scripts to automate Android and iOS hybrid mobile applications. Key Takeaways: - Understand what a hybrid mobile application is - How to detect a hybrid mobile application - Learn how iOS and Android handle hybrid mobile applications - Learn how to automate hybrid mobile applications

Automating Hybrid Applications with Appium

Sauce Labs

Ever kill a bug only to have it resurface later? How about that last intermittent bug you had to trace down? Looking forward to fixing it again when it pops back up? If you hate reanimated bugs then this session is for you. In this session, we will discuss the why and the how of building regression testing into your tests using the Codeception testing framework. Join me, let's hunt some zombie bugs. (Weapons not required)

Put an end to regression with codeception testing

Joe Ferguson

Improving Android app testing with Appium and Sauce Labs

Isaac Murchie

React Native for Web

Sam Lee

As Atlassian Connect is the way forward for building add-ons on Atlassian Cloud, Spring Boot is the way forward for building Spring web applications. Now you can combine the best of both worlds with the new open source library: Atlassian Connect Starter for Spring Boot. This will get you bootstrapped with an Atlassian Connect add-on in just a few minutes. In this talk you will learn: What is Spring Boot What is a Spring Boot Starter and how they benefit you How to use the Atlassian Connect Starter to easily build Atlassian Connect add-ons The Atlassian Connect architecture and how it interacts with your add-ons We will write a simple macro for Confluence and show how much time Spring Boot can save you.

Connecting Connect with Spring Boot

Vincent Kok

(Ignite) DID ANYONE SAY SEMVER? - PHILIPP KRENN, ELASTIC

DevOpsDays Tel Aviv

Are you ready to adopt GraphQL?

Siva Prasad Rao Janapati

DevOps is a large part of a company of any size. In the 9+ years that I have been a professional developer I have always taken an interest in DevOps and have been the "server person" for most of the teams I have been a part of. I would like to teach others how easy it is to implement modern tools to make their everyday development and development processes better. I will cover a range of topics from "Stop using WAMP/MAMP and start using Vagrant", "version control isn't renaming files", "Automate common tasks with shell scripts / command line PHP apps" and "From Vagrant to Production".

Midwest PHP 2017 DevOps For Small team

Joe Ferguson

Rails Plugins 1 Plugin

oscon2007

Selenium and Sauce Labs

hugs

Top 8 Ruby on Rails Gems

Tiago E.M. Martins

Client Side Applications with WP-API WordPress - WCMTL 2015

Roy Sivan

Building an E-commerce Progressive Web App with React and WooCommerce What is a PWA?, PWA E-commerce Showcases (ex. Alibaba), Differences between a PWA and a responsive website, Technologies used to build a PWA, Structuring a PWA with React, Retrieving data from the API and displaying it, UI/UX components, Integrate a PWA in WordPress, Adding advanced features – Web Push Notifications & Offline Mode

WordCamp Bucharest 2017

Alexandra Anghel

In this session, I show how to build a Progressive Web App (PWA) using Ionic, Angular, and Spring Boot. PWAs are being hyped as the next big thing in mobile development. This talk will cut through the hype and get down to the nitty-gritty. Are they really better than native applications? Can you develop PWAs and easily target mobile and desktop with the same application? Tutorial used for demo: http://developer.okta.com/blog/2017/05/17/develop-a-mobile-app-with-ionic-and-spring-boot Source code: https://github.com/oktadeveloper/spring-boot-ionic-example

Building a PWA with Ionic, Angular, and Spring Boot - GeeCON 2017

Matt Raible

The Guardian publishes around 350 articles of content a day. Hardly 'big data'. We deal with barely 150 million users a month. Facebook (with it's 600 million users on mobile alone), we ain't. But we do have to serve the news, and we do have to serve it fast, accurately, and on time, across multiple platforms and devices. For a company that's 192 years old, we like to think we're pretty Agile. So what do our development teams care about? What kind of qualities are we optimising for in our software and processes? How do we make sure that when the news is breaking, our software isn't broken? Or if it is, how do we fix it fast?

Breaking News and Breaking Software by Andy Hume

SyncConf

Serverless application development is fabulous…but if you don’t have a CI/CD pipeline with a strong foundation of test automation, you’ll likely fail. In this session, MongoDB Developer Advocate Lauren Schaefer will walk you through the process of crafting test automation and DevOps pipelines for serverless apps that are built on MongoDB Realm. Then, she’ll jump into the always-terrifying-for-the-presenter live demo so you can see how this all works in a very practical way. She’ll make some changes to her codebase, update her automated tests, and push her code changes. You’ll watch as the various pieces of the pipeline fail and (hopefully) succeed. You’ll walk away from this session equipped to build test automation and DevOps pipelines for your serverless apps.

DevOps + MongoDB Realm Serverless Functions = 🤩

Lauren Hayward Schaefer

One of the largest issues in API architecture development is that the task is often driven by the pragmatic indoctrination of a specification into a product rather than designing around the speed and ease of development, usually due to a separation between the engineering teams and their core developer user base. Extending upon the ideas of API design around developer accelerated development delivered in the PayPal keynote, we will take a deeper look into some of the great techniques delivered to us through the RESTful specification, applying them to developer API consumption practices with the intention of creating efficient best practices for rapid development. Within this talk we will explore what we have learned through reconstructing our API backbone at PayPal for our developer community, including: - API automation practices for code reduction and application longevity - Open security standards that promote developer integration ease and maintain strict security practices - RESTful API architecture best practices for developer centric accelerated development

API Design Principles for Accelerated Development

Jonathan LeBlanc

Q4E and Eclipse IAM, Maven integration for Eclipse

Carlos Sanchez

Performing theme, plugin and core updates on your site can be intimidating and overwhelming, especially for older and more complex sites with many interconnected plugins – WooCommerce, I’m looking at you! The solution is simple: use a staging site – a private copy of your site where you can safely test updates and resolve problems before your users ever experience an issue. I’ll guide you across a number of ways to create a staging site depending on your specific needs, performing these updates, and then applying these updates to your main site. You’ll leave with a concrete plan for how to set up your own staging site, and will fear the update process far less!

Update Smart: Use a Staging Site!

Meagan Hanes

What's hot (19)

Automating Hybrid Applications with Appium

Put an end to regression with codeception testing

Improving Android app testing with Appium and Sauce Labs

React Native for Web

Connecting Connect with Spring Boot

(Ignite) DID ANYONE SAY SEMVER? - PHILIPP KRENN, ELASTIC

Are you ready to adopt GraphQL?

Midwest PHP 2017 DevOps For Small team

Rails Plugins 1 Plugin

Selenium and Sauce Labs

Top 8 Ruby on Rails Gems

Client Side Applications with WP-API WordPress - WCMTL 2015

WordCamp Bucharest 2017

Building a PWA with Ionic, Angular, and Spring Boot - GeeCON 2017

Breaking News and Breaking Software by Andy Hume

DevOps + MongoDB Realm Serverless Functions = 🤩

API Design Principles for Accelerated Development

Q4E and Eclipse IAM, Maven integration for Eclipse

Update Smart: Use a Staging Site!

Similar to David Pilato - Advance search for your legacy application - NoSQL matters Paris 2015

Codemotion Rome 2015 - How do you mix SQL and NoSQL worlds without starting a messy revolution? This live coding talk will show you how to add Elasticsearch to your legacy application without changing all your current development habits. Your application will have suddenly have advanced search features, all without the need to write complex SQL code! David will start from a Spring, Hibernate and Postgresql based application and will add a complete integration of Elasticsearch, all live from the stage during his presentation.

Advanced search for your legacy application - David Pilato - Codemotion Rome ...

Codemotion

Building Rich Applications with Appcelerator

Matt Raible

Microservices architecture has changed how companies develop and deploy applications. This change has affected testing process as well. New techniques have emerged and others have been enhanced. Does your organization wish to achieve unicorn like speed? With N deploys per day? Or a lead time (time to business value from idea to production) measured in days/weeks instead of months/years?In this session, we will not only describe how to use Istio and Kubernetes but actively demonstrate 3 specific techniques that you can use immediately following the session.

Sail In The Cloud

Alex Soto

So you're an Oracle DBA or database developer and you've been hearing about this "REST-thing" and apparently it's way cool for exchanging data. This session for any database folk who missed the trend, covers at a high level what this REST thing is all about, then takes a look at Oracle REST Data Services (ORDS) that allows you to expose your database objects via HTTP, and then walk through how Oracle SQL Developer makes this a breeze to setup.

Oracle REST Data Services

Chris Muir

Enterprise Build And Test In The Cloud ApacheCon EU 2009 Amsterdam http://www.carlossanchez.eu Building and testing software can be a time and resource consuming task. Cloud computing / on demand services like Amazon EC2 allow a cost-effective way to scale applications, and applied to building and testing software can reduce the time needed to find and correct problems, meaning a reduction also in time and costs. Properly configuring your build tools (Maven, Ant,...), continuous integration servers (Continuum, Cruise Control,...), and testing tools (TestNG, Selenium,...) can allow you to run all the build/testing process in a cloud environment, simulating high load environments, distributing long running tests to reduce their execution time, using different environments for client or server applications,... and in the case of on-demand services like Amazon EC2, pay only for the time you use it. In this presentation we will introduce a development process and architecture using popular open source tools for the build and test process such as Apache Maven or Ant for building, Apache Continuum as continuous integration server, TestNG and Selenium for testing, and how to configure them to achieve the best results and performance in several typical use cases (long running testing processes, different client platforms,...) by using he Amazon Elastic Computing Cloud EC2, and therefore reducing time and costs compared to other solutions.

Enterprise Build And Test In The Cloud

Carlos Sanchez

Explore Advanced CA Release Automation Configuration Topics

CA Technologies

REST API Doc Best Practices

Marta Rauch

Seattle StrongLoop Node.js Workshop

Jimmy Guerrero

**** Java Certification Training: https://www.edureka.co/java-j2ee-soa-training **** This Edureka tutorial on “Introduction to Servlets” will talk about the basics of the World Wide Web and its components. It will tell you the fundamental concepts of servlets, its life cycle and various steps to create Servlet. Also, it will talk about Generic Servlet. Through this tutorial you will learn the following topics: Introduction to Web Web & HTTP HTTP Request & Response Introduction to Servlets Servlet Architecture Servlet Life Cycle Steps to create Servlet Generic Servlet Servlet Request & Response Check out our Java Tutorial blog series: https://goo.gl/osrGrS Check out our complete Youtube playlist here: https://goo.gl/gMFLx3 Follow us to never miss an update in the future. Instagram: https://www.instagram.com/edureka_learning/ Facebook: https://www.facebook.com/edurekaIN/ Twitter: https://twitter.com/edurekain LinkedIn: https://www.linkedin.com/company/edureka

Java Servlets Tutorial | Introduction to Servlets | Java Certification Traini...

Edureka!

Writing highly scalable WebSocket using the Atmosphere Framework and Scala

jfarcand

Technical Deep Dive Into Atlassian's New Apps Performance Testing Framework

Atlassian

Gentle App Engine Intro

robinb123

Front End Development for Back End Java Developers - Dublin JUG 2019

Matt Raible

Ce talk s’inscrit dans une lignée de démystification de Drupal 8 et vous introduit comment utiliser pleinement son potentiel (sans uniquement cliquer dans l’interface). La dernière monture de Drupal, le v8 remplaçant émérite d’un vieillissant – néanmoins valeureux – Drupal 7, permet d’ambitieux projet PHP allant d’une plateforme business à un ecommerce en passant par un site de contenu. Kevin Wenger nous présente un rapide overview des nouvelles API de Drupal 8, partage ses retours d’expériences sur des développement de projets intranet, de plateformes communautaires et de business applications. Il illustre ensuite quelques contre exemple D7 vs D8 et termine par les bonnes pratiques appliquées au quotidien sur les projet Drupal chez Antistatique.

Use drupal 8 as a framework the romance recalibration

Kevin Wenger

BEST REST in OpenStack

Vikram G Hosakote

Introduction To REST

rainynovember12

Front End Development for Back End Java Developers - West Midlands Java User ...

Matt Raible

Microservice architectures have generated quite a bit of hype in recent months, and practitioners across our industry have vigorously debated the definition, purpose, and effectiveness of these architectures. In this session, Matt Stine will cut through the Microservices hype and examine some very practical considerations: • Not an End in Themselves: Microservices are really all about helping us achieve continuous delivery • Systems over Services: Microservices are less about the services themselves and more about the systems we can assemble using them. Boilerplate patterns for configuration, integration, and fault tolerance are keys. • Operationalized Architecture: Microservices aren’t a free lunch. You have to pay for them with strong DevOps sauce. • It’s About the Data: Bounded contexts with API’s are great until you need to ask really big questions. How do we effectively wrangle all of the data at once? Along the way, we’ll see how open source technology efforts such as Cloud Foundry, Spring Cloud, Netflix OSS, Spring XD, and Hadoop can help us with many of these considerations.

To Microservices and Beyond

Matt Stine

In this, hands-on, collaborative lab we will discuss the vision of CA App Services Orchestrator (CA ASO) and see the advantages of elegant and resilient RESTful APIs compared to legacy SOAP-based web services. You’ll take pre-built SOAP services and marvel at the beautiful user experience that CA ASO provides to orchestrate them into resource-based APIs. For more information, please visit http://cainc.to/Nv2VOe

Orchestrating Legacy Services Into Contemporary RESTful WEB APIs With CA App ...

CA Technologies

SpringOne Platform 2017 Jonathan Schabowsky, Solace "Microservices may be small in size, but they have huge potential, especially when you pair them with the idea of event-driven architecture (EDA). Today developers are using microservices as the building blocks behind all kinds of cloud and enterprise applications, but most still think microservices = REST, which limits you to polling/reactive interactions. Using a demo featuring Spring and Pivotal Cloud Foundry (and whiskey), this session will explain why a microservices architecture could be further enhanced by becoming event-driven and how using asynchronous messaging allows easy and flexible scaling and independent deployment. After all, life is event-driven. And your microservices should be as well."

Practical Microservices, Practical Whiskey

VMware Tanzu

Similar to David Pilato - Advance search for your legacy application - NoSQL matters Paris 2015 (20)

Advanced search for your legacy application - David Pilato - Codemotion Rome ...

Building Rich Applications with Appcelerator

Sail In The Cloud

Oracle REST Data Services

Enterprise Build And Test In The Cloud

Explore Advanced CA Release Automation Configuration Topics

REST API Doc Best Practices

Seattle StrongLoop Node.js Workshop

Java Servlets Tutorial | Introduction to Servlets | Java Certification Traini...

Writing highly scalable WebSocket using the Atmosphere Framework and Scala

Technical Deep Dive Into Atlassian's New Apps Performance Testing Framework

Gentle App Engine Intro

Front End Development for Back End Java Developers - Dublin JUG 2019

Use drupal 8 as a framework the romance recalibration

BEST REST in OpenStack

Introduction To REST

Front End Development for Back End Java Developers - West Midlands Java User ...

To Microservices and Beyond

Orchestrating Legacy Services Into Contemporary RESTful WEB APIs With CA App ...

Practical Microservices, Practical Whiskey

More from NoSQLmatters

While metrics generated by static code analysis are well established as predictors of possible future defects, there is another untapped source of useful information, namely your source code revision history. This presentation will discuss converting this revision information into a graph representation, various defect prediction models and how to generate their related change metrics through graph traversal, as well as the potential applications and benefits of these graph enabled prediction models.

Nathan Ford- Divination of the Defects (Graph-Based Defect Prediction through...

NoSQLmatters

Stefan Hochdörfer - The NoSQL Store everyone ignores: PostgreSQL - NoSQL matt...

NoSQLmatters

Adrian Colyer - Keynote: NoSQL matters - NoSQL matters Dublin 2015

NoSQLmatters

Peter Bakas - Zero to Insights - Real time analytics with Kafka, C*, and Spar...

NoSQLmatters

Data analysis is an exploratory process that requires a variety of tools and a flexible data store. Data analysis projects are easy to start but quickly become difficult to manage and error prone when depending on file-based data storage. Relational databases are poorly equipped to accommodate the dynamic demands complex analysis. This talk describes best practices for using MongoDB for analytics projects. Examples will be drawn from a large scale text mining project (approximately 25 million documents) that applies machine learning (neural networks and support vector machines) and statistical analysis. Tools discussed include R, Spark, Python scientific stack, and custom pre-processing scripts but the focus is on using these with the document database.

Dan Sullivan - Data Analytics and Text Mining with MongoDB - NoSQL matters Du...

NoSQLmatters

Sometimes we need to step back and take a look at the bigger picture - not just counting huge piles of individual log records, but reasoning about the behaviors of the people who are ultimately generating this firehose of data. While your DevOps folks care deeply about log records from a machine utlization perspective, marketing wants to know what these records tell us about the customers' needs. Elasticsearch Aggregations are a great feature but are not a panacea. We can happily use them to summarise complex things like the number of web requests per day broken down by geography and browser type on a busy website, but we would quickly run out of memory if we tried to calculate something as simple as a single number for the average duration of visitor web sessions when using the very same dataset. Why does this occur? A web session duration is an example of a behavioural attribute not held on any one log record; it has to be derived by finding the first and last records for each session in our weblogs, requiring some complex query expressions and a lot of memory to connect all the data points. We can maintain a more useful joined-up-picture if we run an ongoing background process to fuse related events from one index into ?entity-centric? summaries in another index e.g: • Web log events summarised into ?web session? entities • Road-worthiness test results summarised into ?car? entities • Reviews in a marketplace summarised into a ?reviewer? entity Using real data, this session will demonstrate how to incrementally build entity-centric indexes alongside event-centric indexes by using simple scripts to uncover interesting behaviours that accumulate over time. We'll explore: • Which cars are driven long distances after failing roadworthiness tests? • Which website visitors look to be behaving like ?bots?? • Which seller in my marketplace has employed an army of ?shills? to boost his feedback rating? Attendees will leave this session with all the tools required to begin building entity-centric indexes and using that data to derive richer business insights across every department in their organization.

Mark Harwood - Building Entity Centric Indexes - NoSQL matters Dublin 2015

NoSQLmatters

Relevance and Personalization is crucial to building personalized local commerce experience at Groupon. Talk covers overview of the real time analytics infrastructure that handles over 3 million events/ second and stores and scales to billions of data points. Solution covers how our Kafka -> Storm -> Redis/ HBase pipeline is used to generate real time analytics for hundreds of millions of users of Groupon. Solution includes various architecture design choices and tradeoffs including some interesting algorithmic choices such as Bloom Filters & Hyper Log Log. Attendees can take away learnings from our real-life experience that can help them understand various tuning methods, their tradeoffs and apply them in their solutions

Prassnitha Sampath - Real Time Big Data Analytics with Kafka, Storm & HBase -...

NoSQLmatters

Building applications on streaming data has its challenges. If you are trying to use programs such as Apache Spark or Storm to build applications, this presentation will explain the advantages and disadvantages of each solution and how to choose the right tool for your next streaming data project. Building streaming data applications that can manage the massive quantities of data generated from mobile devices, M2M, sensors and other IoT devices, is a big challenge that many organizations face today. Traditional tools, such as conventional database systems, do not have the capacity to ingest data, analyze it in real-time, and make decisions. New technologies such as Apache Spark and Storm are now coming to the forefront as possible solutions to handing fast data streams. Typical technology choices fall into one of three categories: OLAP, OLTP, and stream-processing systems. Each of these solutions has its benefits, but some choices support streaming data and application development much better than others. Employing a solution that handles streaming data, provides state, ensures durability, and supports transactions and real-time decisions is key to benefitting from fast data. During this presentation you will learn: - The difference between fast OLAP, stream-processing, and OLTP database solutions. - The importance of state, real-time analytics and real-time decisions when building applications on streaming data. - How streaming applications deliver more value when built on a super-fast in-memory, SQL database.

Akmal Chaudhri - How to Build Streaming Data Applications: Evaluating the Top...

NoSQLmatters

Just a few years ago all software systems were designed to be monoliths running on a single big and powerful machine. But nowadays most companies desire to scale out instead of scaling up, because it is much easier to buy or rent a large cluster of commodity hardware then to get a single machine that is powerful enough. In the database area scaling out is realized by utilizing a combination of polyglot persistence and sharding of data. On the application level scaling out is realized by microservices. In this talk I will briefly introduce the concepts and ideas of microservices and discuss their benefits and drawbacks. Afterwards I will focus on the point of intersection of a microservice based application talking to one or many NoSQL databases. We will try and find answers to these questions: Are the differences to a monolithic application? How to scale the whole system properly? What about polyglot persistence? Is there a data-centric way to split microservices?

Michael Hackstein - NoSQL meets Microservices - NoSQL matters Dublin 2015

NoSQLmatters

In this talk we'll focus on the use of Crate alongside Weave in Docker containers, the technical challenges, best practices learned, and getting a big data application running alongside it. You'll learn about the reasons why Crate.IO is building "yet another NoSQL database" and why it's unique and important when running web scale containerized applications. We'll show why the shared-nothing architecture is so important when deploying large clusters in containers and how it addresses the issues and fears of a Docker-based persistence layer. You will learn how to deploy a Crate cluster in the cloud within minutes using Docker, some of the challenges you'll encounter, and how to overcome them in order to scale your backends efficiently. We focused on super simple integration with any cloud provider, striving it to be as turnkey as possible with minimal up-front configuration required to establish a cluster. Once established, we'll show how to scale the cluster horizontally by simply adding more nodes. The session will also give you examples when you should use Crate compared to other similar technologies such as MongoDB, Hadoop, Cassandra or FoundationDB. We'll talk about this approach's strengths and what types of applications are well-suited for this type of data store, as well what is not. Finally we'll outline how to architect an application that is easy to scale using Crate and Docker.

Chris Ward - Understanding databases for distributed docker applications - No...

NoSQLmatters

More than two years ago we faced the decision whether to run our MongoDB database on Amazon's EC2 ourselves or to rely on a Database as a Service provider. Common wisdom told us that a well known provider, focusing all its knowledge and energy on running MongoDB, would be a better choice than us trying it on the side. Well, this talk describes what can go wrong, since we have seen a lot of interesting minor and major hiccups — including stopped instances, broken backups, a major security incident, and more broken backups. Additionally, we discuss some reasons why a hosted solution is not always the better choice and which new challenges arise from it.

Philipp Krenn - Host your database in the cloud, they said... - NoSQL matters...

NoSQLmatters

What if we would try to make Elasticsearch SQL 92 compliant (http://www.contrib.andrew.cmu.edu/~shadow/sql/sql1992.txt)? This wouldn't serve that much nowadays, you would say. Well, we actually tried to do the exercise and we have some interesting conclusions. While we take Elasticsearch as an example for this "side by side", the issues we are addressing also apply to nosql in general. With this unusual exercise, we take the occasion to compare relational databases / sql with Elasticsearch / nosql on all the levels : functionality, semantics, performance and user experience.

Lucian Precup - Back to the Future: SQL 92 for Elasticsearch? - NoSQL matters...

NoSQLmatters

Bruno Guedes - Hadoop real time for dummies - NoSQL matters Paris 2015

NoSQLmatters

Apache Spark is a general data processing framework which allows you perform map-reduce tasks (but not only) in memory. Apache Cassandra is a highly available and massively scalable NoSQL data-store. By combining Spark flexible API and Cassandra performance, we get an interesting alternative to the Hadoop eco-system for both real-time and batch processing. During this talk we will highlight the tight integration between Spark & Cassandra and demonstrate some usages with live code demo.

DuyHai DOAN - Real time analytics with Cassandra and Spark - NoSQL matters Pa...

NoSQLmatters

When deploying your service to Microsoft Azure, you have a number of options in terms of noSQL: you can install databases on Linux or Windows virtual machines by yourself, or via the marketplace, or you can use open source databases available as a service like HBase or proprietary and managed databases like Document DB. After showing these options, we'll show Document DB in more details. This is a noSQL database as a service that stores JSON.

Benjamin Guinebertière - Microsoft Azure: Document DB and other noSQL databas...

NoSQLmatters

During this live-coding session, Tugdual will move an old fashion full SQL application (JavaEE) to the new NoSQL world.Using MongoDB, and REST, he will show the benefits of this new architecture: * Easyness * Flexibility * High availability * Scalability; During this presentation, you will learn more about: * Document Oriented Model * JSON * REST * Iterative development; This demonstration is also a good opportunity to see how you can migrate data from a relational database, and the various schema options.

Tugdual Grall - From SQL to NoSQL in less than 40 min - NoSQL matters Paris 2015

NoSQLmatters

How do you monitor performance for one of your clients on a specific user segmentation when dealing with billions of events a day ? With over 2 billion ads served and 230Tb of data processed a day, we at Criteo have a comprehensive need for an interactive analytics stack. And by interactive, we mean a querying system with dynamic filtering to drill down over multiple dimensions, answering within sub-second latency. This session will take you on our journey with Druid, ""an open-source data store designed for real-time exploratory analytics on large data sets"". We will explore Druid's architecture and noticeable concepts, how relevant they are for some use cases and how it really performs.

Gregorry Letribot - Druid at Criteo - NoSQL matters 2015

NoSQLmatters

In many modern applications the database side is realized using polyglot persistence – store each data format (graphs, documents, etc.) in an appropriate separate database. This approach yields several benefits, databases are optimized for their specific duty, however there are also drawbacks: * keep all databases in sync * queries might require data from several databases * experts needed for all used systems A multi-model database is not restricted to one data format, but can cope with several of them. In this talk i will present how a multi-model database can be used in a polyglot persistence setup and how it will reduce the effort drastically.

Michael Hackstein - Polyglot Persistence & Multi-Model NoSQL Databases - NoSQ...

NoSQLmatters

The impact that NoSQL has had on the technology community cannot be overstated. The proliferation of new and exciting data systems has led to a slew of interesting solutions to problems that were once solved the relational way. In this session we explore all that is great and good about NoSQL: the innovative software, the clever storage paradigms and the reigniting of developer interest in data access. It is unfortunate that NoSQL is not only a force for good in our community. We'll explore some of the darker corners of NoSQL: the disregard for years of proven technology, the overbearing hype, the overblown marketing and the ever present arguments over which technology is best. We close the session by exploring what can be done to extract even more value from the NoSQL movement, where we can improve how the community interacts with the larger technology community and what the future holds for data access technologies.

Rob Harrop- Key Note The God, the Bad and the Ugly - NoSQL matters Paris 2015

NoSQLmatters

Come to this deep dive on how Pivotal's Data Lake Vision is evolving by embracing next generation in-memory data exchange and compute technologies around Spark and Tachyon. Did we say Hadoop, SQL, and what's the shortest path to get from past to future state? The next generation of data lake technology will leverage the availability of in-memory processing, with an architecture that supports multiple data analytics workloads within a single environment: SQL, R, Spark, batch and transactional.

Alexandre Vasseur - Evolution of Data Architectures: From Hadoop to Data Lake...

NoSQLmatters

More from NoSQLmatters (20)