Cassandra & puppet, scaling data at $15 per month

•Télécharger en tant que PPTX, PDF•

9 j'aime•37,300 vues

Constant Contact shares lessons learned from DevOps approach to implementing Cassandra to manage social media data for over 400k small business customers. Puppet is the critical in our tool chain. Single most important factor was the willingness of Development and Operations to stretch beyond traditional roles and responsibilities.

Technologie

Cassandra & Puppet: Scaling data at $15/month Constant Contact March 2011 Dave Connors – VP Operations Jim Ancona – Systems Architect Mark Schena – Manager Systems Automation

Constant Contact Constant Contact 2000 – 2010 Market leader for Small Businesses ,[object Object]

No. 134 on the Deloitte Technology Fast 500 listingBusiness model ,[object Object]

~2 million database transactions per minute,[object Object]

Constant Contact Small Businesses are looking to us for help with Social Media marketing ,[object Object]

Challenge with our business model,[object Object]

Roles & Responsibilities,[object Object]

Apache Cassandra Apache Cassandra ,[object Object]

Became an Apache top-level project in 2010

In use at Digg, Facebook, Twitter, Reddit, Rackspace, Cloudkick, Cisco, …

Largest production cluster has over 100 TB of data in over 150 machines,[object Object]

Consistency LevelONE Consistency Level One Y

Risks and Mitigation Risks and Mitigation ,[object Object]

Contenu connexe

Tendances

Now that teams are increasingly being pressed to cut costs, the database can be a low-hanging fruit for sizable cost reduction – especially if you’re managing terabytes to petabytes of data with millions of read/write operations per second. Join Tzach Livyatan, VP of Product at ScyllaDB, as he shares four ways that teams commonly cut database costs by rethinking their database strategy. We’ll cover topics including: - Cutting admin costs by reducing node sprawl and reducing the need for tuning - ScyllaDB as a better, compatible Amazon DynamoDB - Options to increase price performance through new cloud instances - Ways to safely add more workloads to your cluster without compromising the performance of your latency-sensitive workloads

How Development Teams Cut Costs with ScyllaDB.pdf

ScyllaDB

If you are looking to collect and store time series data, it's probably not going to be small. Don't get caught without a plan! Apache Cassandra has proven itself as a solid choice now you can learn how to do it. We'll look at possible data models and the the choices you have to be successful. Then, let's open the hood and learn about how data is stored in Apache Cassandra. You don't need to be an expert in distributed systems to make this work and I'll show you how. I'll give you real-world examples and work through the steps. Give me an hour and I will upgrade your time series game.

Storing time series data with Apache Cassandra

Patrick McFadin

Kafka Intro With Simple Java Producer Consumers

Jean-Paul Azar

Kafka replication apachecon_2013

Jun Rao

MariaDB MaxScale

MariaDB plc

Galera Cluster Best Practices for DBA's and DevOps Part 1

Codership Oy - Creators of Galera Cluster

Apache Roadshow Chicago Talk on May 14, 2019 In this talk we’ll look at the ways Apache Thrift can solve performance problems commonly facing next generation applications deployed in performance sensitive capital markets and banking environments. The talk will include practical examples illustrating the construction, performance and resource utilization benefits of Apache Thrift. Apache Thrift is a high-performance cross platform RPC and serialization framework designed to make it possible for organizations to specify interfaces and application wide data structures suitable for serialization and transport over a wide variety of schemes. Due to the unparalleled set of languages supported by Apache Thrift, these interfaces and structs have similar interoperability to REST type services with an order of magnitude improvement in performance. Apache Thrift services are also a perfect fit for container technology, using considerably fewer resources than traditional application server style deployments. Decomposing applications into microservices, packaging them into containers and orchestrating them on systems like Kubernetes can bring great value to an organization; however, it can also take a very fast monolithic application and turn it into a high latency web of slow, resource hungry services. Apache Thrift is a perfect solution to the performance and resource ills of many microservice based endeavors.

Building high performance microservices in finance with Apache Thrift

RX-M Enterprises LLC

Apache Cassandra - Einführung

Andreas Finke

Scylla Summit 2022: How to Migrate a Counter Table for 68 Billion Records

ScyllaDB

Migrating an application to Docker creates an opportunity to utilize new networking topologies and features, which can provide new functionality to an existing application. This talk will provide an overview of Docker networking with a focus on the architectural choices when migrating applications. Taking sample applications we will look at the existing networking topology and cover the options available to create a simple migration and provide additional functionality.

Practical Design Patterns in Docker Networking

Docker, Inc.

Netflix viewing data architecture evolution - QCon 2014

Philip Fisher-Ogden

Introduction to Apache ZooKeeper

Saurav Haloi

Should you use traditional REST APIs to bind services together? Or is it better to use a richer, more loosely-coupled protocol? This talk will dig into how we piece services together in event driven systems, how we use a distributed log (event hub) to create a central, persistent history of events and what benefits we achieve from doing so. Apache Kafka is a perfect match for building such an asynchronous, loosely-coupled event-driven backbone. Events trigger processing logic, which can be implemented in a more traditional as well as in a stream processing fashion. The talk will show the difference between a request-driven and event-driven communication and show when to use which. It highlights how the modern stream processing systems can be used to hold state both internally as well as in a database and how this state can be used to further increase independence of other services, the primary goal of a Microservices architecture.

Microservices with Kafka Ecosystem

Guido Schmutz

Kafka 101

Clement Demonchy

Scaling paypal workloads with oracle rac ss

Anil Nair

Apache CloudStack from API to UI

CloudStack - Open Source Cloud Computing Project

RedisConf18 - Redis at LINE - 25 Billion Messages Per Day

Redis Labs

(Sam Obeid, Shopify) Kafka Summit SF 2018 At Shopify we manage multiple Apache Kafka clusters in multiple locations in Google’s cloud platform. We deploy our Kafka clusters as Kubernetes StatefulSets, and we use other K8s workloads to implement different tasks. Automating critical and repetitive operational tasks is one of our top priorities. In this talk we’ll discuss how we leveraged Kubernetes Custom Resources and Controllers to automate some of the key cluster operational tasks, to detect clusters configuration changes and react to these changes with required actions. We will go through actual examples we implemented at Shopify, how we solved the problem of cluster discovery and how we automated topics creation across different clusters with zero human intervention and safety controls.

Automate Your Kafka Cluster with Kubernetes Custom Resources

confluent

Apache Spark is a gift to the big data community, which adds tons of new features on every release. However, it’s difficult to manage petabyte-scale Hadoop clusters with hundreds of edge nodes, multiple Spark releases and demonstrate operational efficiencies and standardization. In order to address these challenges, Paypal has developed and deployed a REST0based Spark platform: Spark Compute as a Service (SCaaS),which provides improved application development, execution, logging, security, workload management and tuning. This session will walk through the top challenges faced by PayPal administrators, developers and operations and describe how Paypal’s SCaaS platform overcomes them by leveraging open source tools and technologies, like Livy, Jupyter, SparkMagic, Zeppelin, SQL Tools, Kafka and Elastic. You’ll also hear about the improvements PayPal has added, which enable it to run greater than 10,000 Spark applications in production effectively.

Spark Compute as a Service at Paypal with Prabhu Kasinathan

Databricks

I don't think it's hyperbole when I say that Facebook, Instagram, Twitter & Netflix now define the dimensions of our social & entertainment universe. But what kind of technology engines purr under the hoods of these social media machines? Here is a tech student's perspective on making the paradigm shift to "Big Data" using innovative models: alphabet blocks, nesting dolls, & LEGOs! Get info on: - What is Cassandra (C*)? - Installing C* Community Version on Amazon Web Services EC2 - Data Modelling & Database Design in C* using CQL3 - Industry Use Cases

Cassandra NoSQL Tutorial

Michelle Darling

Tendances (20)

How Development Teams Cut Costs with ScyllaDB.pdf

Storing time series data with Apache Cassandra

Kafka Intro With Simple Java Producer Consumers

Kafka replication apachecon_2013

MariaDB MaxScale

Galera Cluster Best Practices for DBA's and DevOps Part 1

Building high performance microservices in finance with Apache Thrift

Apache Cassandra - Einführung

Scylla Summit 2022: How to Migrate a Counter Table for 68 Billion Records

Practical Design Patterns in Docker Networking

Netflix viewing data architecture evolution - QCon 2014

Introduction to Apache ZooKeeper

Microservices with Kafka Ecosystem

Kafka 101

Scaling paypal workloads with oracle rac ss

Apache CloudStack from API to UI

RedisConf18 - Redis at LINE - 25 Billion Messages Per Day

Automate Your Kafka Cluster with Kubernetes Custom Resources

Spark Compute as a Service at Paypal with Prabhu Kasinathan

Cassandra NoSQL Tutorial

En vedette

Comcast is developing a highly scalable cloud DVR scheduling system on top of Cassandra. The system is responsible for managing all DVR data and scheduling logic for devices on the X1 platform. This talk will cover the overall architecture of the scheduling system, data model, message queue and notification software that have been developed as part of this ambitious project. We'll take a deep dive into the details of our data model and review the implementation of Comcast's open-source, Cassandra-based clones of Amazon SQS and SNS.

NYC* 2013 — "Using Cassandra for DVR Scheduling at Comcast"

DataStax Academy

Migrating Netflix from Datacenter Oracle to Global Cassandra

Adrian Cockcroft

This session talks about Intuit’s journey of our Consumer Financial Platform that is built to scale to petabytes of data. The original system used a major RDBMS and from there, we redesigned to use the distributed nature of Cassandra. This talk will go through our transition including the data model used for the final product. As with any large system transition, many hard lessons are learned and we will discuss those and share our experiences.

C* Summit 2013: Time for a New Relationship - Intuit's Journey from RDBMS to ...

DataStax Academy

Seattle Scalability - GigaSpaces / Cassandra

clive boulton

Blueflood: Open Source Metrics Processing at CassandraEU 2013

gdusbabek

Best Practices for couchDB developers on Microsoft Azure

Brian Benz

Flash Economics and Lessons learned from operating low latency platforms at h...

Aerospike, Inc.

Getting started with Serverless on AWS

Adrian Hornsby

Cassandra Summit - What's New In Apache TinkerPop?

Stephen Mallette

Kai – An Open Source Implementation of Amazon’s Dynamo

Takeru INOUE

I'm going to cover something which could be seen as essential for Cassandra but which hasn't gotten much attention in the Cassandra community and literature. It's schema migrations--how you go about pushing out and versioning changes to your keyspace and table definitions across environments. This is an area that has established solutions in the relational database world, with tools like Liquibase(http://www.liquibase.org/) and Flyway (http://flywaydb.org/) and in web frameworks like Rails and Grails. I'll explain the different types of migrations but then focus, for most of the talk, on schema migrations. I'll explain how schema migrations have been done in the Cassandra community and the roadblocks teams have faced trying to use Liquibase and Flyway to manage Cassandra migrations. Then I'll share an elegant, lightweight schema migrations system that we at GridPoint built on top of Flyway. I'll use our system as a context for discussing schema migration best practices for Cassandra and the various choices teams have for their migrations and table definitions, including when NOT to use a tool like Flyway. I'll also touch on the other types of migrations besides keyspace and table definitions that can be versioned and driven off source control.

Managing (Schema) Migrations in Cassandra

DataStax Academy

SpringPeople Introduction to Agile and Scrum

SpringPeople

Cassandra & Spark for IoT

Matthias Niehoff

Sparksee Technology overview

Sparsity Technologies

How to size up an Apache Cassandra cluster (Training)

DataStax Academy

The Gremlin Graph Traversal Language

Marko Rodriguez

Quantum Processes in Graph Computing

Marko Rodriguez

Cassandra as an event sourced journal for big data analytics Cassandra Summit...

Martin Zapletal

Sparksee overview

Sparsity Technologies

This talk argues that the future of data query/analytic languages will be all about embedding the language into the native programming language of the developer. As an example of this style, the Gremlin graph traversal language is presented. Gremlin can be represented in any programming language that supports function composition and function nesting. The language representation is then compiled to Gremlin bytecode to ultimately be executed by the/a Gremlin graph traversal machine. This enables both the Gremlin language and machine to be agnostic to the execution language.

Gremlin's Graph Traversal Machinery

Marko Rodriguez

En vedette (20)

NYC* 2013 — "Using Cassandra for DVR Scheduling at Comcast"

Migrating Netflix from Datacenter Oracle to Global Cassandra

C* Summit 2013: Time for a New Relationship - Intuit's Journey from RDBMS to ...

Seattle Scalability - GigaSpaces / Cassandra

Blueflood: Open Source Metrics Processing at CassandraEU 2013

Best Practices for couchDB developers on Microsoft Azure

Flash Economics and Lessons learned from operating low latency platforms at h...

Getting started with Serverless on AWS

Cassandra Summit - What's New In Apache TinkerPop?

Kai – An Open Source Implementation of Amazon’s Dynamo

Managing (Schema) Migrations in Cassandra

SpringPeople Introduction to Agile and Scrum

Cassandra & Spark for IoT

Sparksee Technology overview

How to size up an Apache Cassandra cluster (Training)

The Gremlin Graph Traversal Language

Quantum Processes in Graph Computing

Cassandra as an event sourced journal for big data analytics Cassandra Summit...

Sparksee overview

Gremlin's Graph Traversal Machinery

Similaire à Cassandra & puppet, scaling data at $15 per month

Many data pipelines share common characteristics and are often built in similar but bespoke ways, even within a single organisation. In this talk, we will outline the key considerations which need to be applied when building data pipelines, such as performance, idempotency, reproducibility, and tackling the small file problem. We’ll work towards describing a common Data Engineering toolkit which separates these concerns from business logic code, allowing non-Data-Engineers (e.g. Business Analysts and Data Scientists) to define data pipelines without worrying about the nitty-gritty production considerations. We’ll then introduce an implementation of such a toolkit in the form of Waimak, our open-source library for Apache Spark (https://github.com/CoxAutomotiveDataSolutions/waimak), which has massively shortened our route from prototype to production. Finally, we’ll define new approaches and best practices about what we believe is the most overlooked aspect of Data Engineering: deploying data pipelines.

Best Practices for Building and Deploying Data Pipelines in Apache Spark

Databricks

Questions On The Code And Core Module

Katie Gulley

Python and Oracle : allies for best of data management

Laurent Leturgez

Advanced Web Development

Robert J. Stein

Hands on Mahout!

OSCON Byrum

The "Holy Grail" of Dev/Ops

Erik Osterman

Nhibernate Part 1

guest075fec

No more Three Tier - A path to a better code for Cloud and Azure

Marco Parenzan

Building Social Enterprise with Ruby and Salesforce

Raymond Gao

"Data mesh is a relatively recent architectural innovation, espoused as one of the best ways to fix analytic data. We renegotiate aged social conventions by focusing on treating data as a product, with a clearly defined data product owner, akin to that of any other product. In addition, we focus on building out a self-service platform with integrated governance, letting consumers safely access and use the data they need to solve their business problems. Data mesh is prescribed as a solution for _analytical data_, so that conventionally analytical results (think weekly sales or monthly revenue reports) can be more accurately and predictably computed. But what about non-analytical business operations? Would they not also benefit from data products backed by self-service capabilities and dedicated owners? If you've ever provided a customer with an analytical report that differed from their operational conclusions, then this talk is for you. Adam discusses the resounding successes he has seen from applying data mesh _off-label_ to both analytical and operational domains. The key? Event streams. Well-defined, incrementally updating data products that can power both real-time and batch-based applications, providing a single source of data for a wide variety of application and analytical use cases. Adam digs into the common areas of success seen across numerous clients and customers and provides you with a set of practical guidelines for implementing your own minimally viable data mesh. Finally, Adam covers the main social and technical hurdles that you'll encounter as you implement your own data mesh. Learn about important data use cases, data domain modeling techniques, self-service platforms, and building an iteratively successful data mesh."

Off-Label Data Mesh: A Prescription for Healthier Data

HostedbyConfluent

Deep Learning architectures, such as deep neural networks, are currently the hottest emerging areas of data science, especially in Big Data. Deep Learning could be effectively exploited to address some major issues of Big Data, such as fast information retrieval, data classification, semantic indexing and so on. In this work, we designed and implemented a framework to train deep neural networks using Spark, fast and general data flow engine for large scale data processing, which can utilize cluster computing to train large scale deep networks. Training Deep Learning models requires extensive data and computation. Our proposed framework can accelerate the training time by distributing the model replicas, via stochastic gradient descent, among cluster nodes for data resided on HDFS.

Spark Based Distributed Deep Learning Framework For Big Data Applications

Humoyun Ahmedov

If you're new to Puppet Enterprise, this is the webinar for you. You'll learn why thousands of companies rely on Puppet to automate the delivery and operation of their software, and see it in action with a live demo. We'll cover how to use Puppet Enterprise to: Discover what you have using Puppet Discovery Orchestrate changes to infrastructure and applications Continually enforce your desired state and remediate any unexpected changes Get real-time visibility and reporting to prove compliance Automatically build, test and promote Puppet code changes using Continuous Delivery for Puppet Enterprise

Introduction to Puppet Enterprise - Jan 30, 2019

Puppet

Orchestrating the Intelligent Web with Apache Mahout

aneeshabakharia

Introduction to Azure DocumentDB

Denny Lee

data-mesh-101.pptx

TarekHamdi8

A few years ago, processing large volumes of data was an exclusive problem of big companies. Nowadays, technological advancement allows people to be connected with each other all the time, generating and consuming large amounts of data. In the challenge to follow Movile's exponential growth and increasing volume of information, we soon realized that traditional relational database and data analysis solutions were no longer a good fit to solve new order issues. Therefore, we present Movile's 'Change Of Seasons', a use case on adopting Apache Cassandra as a solution for critical high-performance distributed systems.

Movile Internet Movel SA: A Change of Seasons: A big move to Apache Cassandra

DataStax Academy

A CHANGE OF SEASONS: A big move to Apache Cassandra! This is an extended version of the material presented at Cassandra Summit 2015 - Santa Clara - California - USA. In this presentation I will show you 3 moves, use cases, that constitute our Big Move to Apache Cassandra @Movile. Walking through relational model to NoSQL solution, hybrid platforms and a staggering cost reduction and throughput increase.

Cassandra Summit 2015 - A Change of Seasons

Eiti Kimura

Amazon Machine Learning is a service that makes it easy for developers of all skill levels to use machine learning technology and Amazon Redshift is a fast, fully managed, petabyte-scale data warehouse that makes it simple and cost-effective to efficiently analyze all your data using your existing business intelligence tools. The combination of the two can provide a solution to power advanced analytics for not only what has happened in the past, but make intelligent predictions about the future. Please join this webinar to learn how get the most value from your data for your data driven business. Learning Objectives: How to scale your Redshift queries with user-defined functions (UDFs) How to apply Machine learning to historical data in Amazon Redshift How to visualize your data with Amazon QuickSight Present a reference architecture for advanced analytics Who Should Attend: Application developers looking to add UDFs, or predictive analytics to their applications, database administrators that need to meet the demand of data driven organizations, decision makers looking to derive more insight from their data

AWS November Webinar Series - Advanced Analytics with Amazon Redshift and the...

Amazon Web Services

Map Reduce amrp presentation

renjan131

Ben ford intro

Puppet

Similaire à Cassandra & puppet, scaling data at $15 per month (20)

Best Practices for Building and Deploying Data Pipelines in Apache Spark

Questions On The Code And Core Module

Python and Oracle : allies for best of data management

Advanced Web Development

Hands on Mahout!

The "Holy Grail" of Dev/Ops

Nhibernate Part 1

No more Three Tier - A path to a better code for Cloud and Azure

Building Social Enterprise with Ruby and Salesforce

Off-Label Data Mesh: A Prescription for Healthier Data

Spark Based Distributed Deep Learning Framework For Big Data Applications

Introduction to Puppet Enterprise - Jan 30, 2019

Orchestrating the Intelligent Web with Apache Mahout

Introduction to Azure DocumentDB

data-mesh-101.pptx

Movile Internet Movel SA: A Change of Seasons: A big move to Apache Cassandra

Cassandra Summit 2015 - A Change of Seasons

AWS November Webinar Series - Advanced Analytics with Amazon Redshift and the...

Map Reduce amrp presentation

Ben ford intro

Dernier

The Good, the Bad and the Governed - Why is governance a dirty word? David O'Neill, Chief Operating Officer - APIContext Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

apidays

DBX First Quarter 2024 Investor Presentation

Dropbox

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the deployment of external web forms using Jotform for Bonterra Impact Management. This solution can be customized to your organization’s needs and deployed to support the common use cases below: - Intake and consent - Assessments - Surveys - Applications - Program registration Interested in deploying web form automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Jeffrey Haguewood

Corporate and higher education. Two industries that, in the past, have had a clear divide with very little crossover. The difference in goals, learning styles and objectives paved the way for differing learning technologies platforms to evolve. Now, those stark lines are blurring as both sides are discovering they have content that’s relevant to the other. Join Tammy Rutherford as she walks through the pros and cons of corporate and higher ed collaborating. And the challenges of these different technology platforms working together for a brighter future.

Corporate and higher education May webinar.pptx

Rustici Software

Building Digital Trust in a Digital Economy Veronica Tan, Director - Cyber Security Agency of Singapore Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

apidays

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

MadyBayot

The value of a flexible API Management solution for Open Banking Steve Melan, Manager for IT Innovation and Architecture - State's and Saving's Bank of Luxembourg Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The value of a flexible API Management solution for O...

apidays

As privacy and data protection regulations evolve rapidly, organizations operating in multiple jurisdictions face mounting challenges to ensure compliance and safeguard customer data. With state-specific privacy laws coming up in multiple states this year, it is essential to understand what their unique data protection regulations will require clearly. How will data privacy evolve in the US in 2024? How to stay compliant? Our panellists will guide you through the intricacies of these states' specific data privacy laws, clarifying complex legal frameworks and compliance requirements. This webinar will review: - The essential aspects of each state's privacy landscape and the latest updates - Common compliance challenges faced by organizations operating in multiple states and best practices to achieve regulatory adherence - Valuable insights into potential changes to existing regulations and prepare your organization for the evolving landscape

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

TrustArc

Webinar Recording: https://www.panagenda.com/webinars/why-teams-call-analytics-is-critical-to-your-entire-business Nothing is as frustrating and noticeable as being in an important call and being unable to see or hear the other person. Not surprising then, that issues with Teams calls are among the most common problems users call their helpdesk for. Having in depth insight into everything relevant going on at the user’s device, local network, ISP and Microsoft itself during the call is crucial for good Microsoft Teams Call quality support. To ensure a quick and adequate solution and to ensure your users get the most out of their Microsoft 365. But did you know that ‘bad calls’ are also an excellent indicator of other problems arising? Precisely because it is so noticeable!? Like the canary in the mine, bad calls can be early indicators of problems. Problems that might otherwise not have been noticed for a while but can have a big impact on productivity and satisfaction. Join this session by Christoph Adler to learn how true Microsoft Teams call quality analytics helped other organizations troubleshoot bad calls and identify and fix problems that impacted Teams calls or the use of Microsoft365 in general. See what it can do to keep your users happy and productive! In this session we will cover - Why CQD data alone is not enough to troubleshoot call problems - The importance of attributing call problems to the right call participant - What call quality analytics can do to help you quickly find, fix-, and prevent problems - Why having retrospective detailed insights matters - Real life examples of how others have used Microsoft Teams call quality monitoring to problem shoot problems with their ISP, network, device health and more.

Why Teams call analytics are critical to your entire business

panagenda

In this session, we will delve into strategic approaches for optimizing knowledge management within Microsoft 365, amidst the evolving landscape of Copilot. From leveraging automatic metadata classification and permission governance with SharePoint Premium, to unlocking Viva Engage for the cultivation of knowledge and communities, you will gain actionable insights to bolster your organization's knowledge-sharing initiatives. In this session, we will also explore how to facilitate solutions to enable your employees to find answers and expertise within Microsoft 365. You will leave equipped with practical techniques and a deeper understanding of how there is more to effective knowledge management than just enabling Copilot, but building actual solutions to prepare the knowledge that Copilot and your employees can use.

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Drew Madelung

A Beginners Guide to Building a RAG App Using Open Source Milvus

Zilliz

This presentations targets students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many developer tools, platforms & APIs? This comprehensive yet still high-level overview outlines the most impactful tools for where to run your code, store & analyze your data. It will also inspire you as to what's possible. This talk is 50 minutes in length.

Powerful Google developer tools for immediate impact! (2023-24 C)

wesley chun

Automating Google Workspace (GWS) & more with Apps Script

wesley chun

FWD Group - Insurer Innovation Award 2024

The Digital Insurer

In the thrilling conclusion to 2023, ransomware groups had a banner year, really outdoing themselves in the "make everyone's life miserable" department. LockBit 3.0 took gold in the hacking olympics, followed by the plucky upstarts Clop and ALPHV/BlackCat. Apparently, 48% of organizations were feeling left out and decided to get in on the cyber attack action. Business services won the "most likely to get digitally mugged" award, with education and retail nipping at their heels. Hackers expanded their repertoire beyond boring old encryption to the much more exciting world of extortion. The US, UK and Canada took top honors in the "countries most likely to pay up" category. Bitcoins were the currency of choice for discerning hackers, because who doesn't love untraceable money?

Ransomware_Q4_2023. The report. [EN].pdf

Overkill Security

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Martijn de Jong

Modernizing Securities Finance: The cloud-native prime brokerage platform transforming capital markets. Madhu Subbu, Managing Director, Head of Securities Finance Engineering Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu

apidays

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

MS Copilot expands with MS Graph connectors

Nanddeep Nachan

Dernier (20)

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

DBX First Quarter 2024 Investor Presentation

presentation ICT roal in 21st century education

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Corporate and higher education May webinar.pptx

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

Apidays New York 2024 - The value of a flexible API Management solution for O...

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

Why Teams call analytics are critical to your entire business

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

A Beginners Guide to Building a RAG App Using Open Source Milvus

Powerful Google developer tools for immediate impact! (2023-24 C)

Automating Google Workspace (GWS) & more with Apps Script

FWD Group - Insurer Innovation Award 2024

Ransomware_Q4_2023. The report. [EN].pdf

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

MS Copilot expands with MS Graph connectors

Cassandra & puppet, scaling data at $15 per month

1. Cassandra & Puppet: Scaling data at $15/month Constant Contact March 2011 Dave Connors – VP Operations Jim Ancona – Systems Architect Mark Schena – Manager Systems Automation

3. Over 400k paying customers

8. Cost = Low

10. Monitoring

11. Authentication

12. Logging

13. Risk profile

14.

15.

16. Open sourced in 2008

17. Incubated at Apache

18. Became an Apache top-level project in 2010

19. http://cassandra.apache.org

20. In use at Digg, Facebook, Twitter, Reddit, Rackspace, Cloudkick, Cisco, …

21.

22. Fault Tolerant

23. Elastic

24. Durable

25. Rich data model

26. Replicated data

27.

28. Consistency LevelONE Consistency Level One Y

29. Consistency Level Quorum X

30.

31. Developer unfamiliarity

32. Operational procedures

33. Reliability concerns

34. Deployment automation

35. Community involvement

36. Training/Consulting

37. Application selection

38. Lots of monitoring

39.

40.

41. Paid support and training is available: http://datastax.com

42.

43. Mirroring

44.

45. Close collaboration

46. Flexible roles

47.

48.

49. 1 250G disk

50. No SWAP

51. RAID Zero Root Partition and Data Storage

52.

53.

54. Multiple Datacenters = 2

55. Use only half the available disk = 2

56. 12 Servers = ~1 TB Of Data Storage

57. ~6 TB of Data Storage 72 x 6 = x 2 = 12 3 x 2 = 6

58. Ran Random Partitioner

59. Tool Chain Tool Chain

60.

61. Versioning of puppet code allows for adoption of development best practices

62. Leverage Domain specific knowledge and skillDevOps with Puppet

63. Always Move Forward Always Move Forward

64.

65. Cassandra uses log4j natively

66. Resources not available for remote log4j development

67. Scribed with Puppet provides the solutionOperational Efficiencies

68.

69. JMX trending

70. Identify critical data points

71. Rapid development of graphs

72.

73. Puppet Code Example: Munin Puppet Code define munin::cassandracolumnfamily ( ) { include cassandravirtual File <| title == "jmxbin" |> $confdir="/opt/cassandra-munin-plugins” $plugindir="/etc/munin/plugins" $target="/opt/cassandra-munin-plugins/jmx_" # Match 3 strings separated by periods $pattern = '^([^.]*)[.]([^.]*)[.]([^.]*)$' $keyspace = regsubst($name, $pattern, '') $columnfamily = regsubst($name, $pattern, '') $file = regsubst($name, $pattern, '') file {"${keyspace}_${columnfamily}_${file}.conf": owner => 'root', ensure => 'file', group => 'root', type => 'file', path => "${confdir}/${keyspace}_${columnfamily}_${file}.conf", mode => '644', content => template("munin/attribute_${file}.conf.erb"), require => [ Package['munin-node'], File['/opt/cassandra-munin-plugins'], File['jmxquery'], ], } file {"$plugindir/${keyspace}_${columnfamily}_${file}": ensure => 'link', owner => 'root', group => 'root', mode => '511', type => 'link', target => "$target", require => [ File['/opt/cassandra-munin-plugins'], File["${keyspace}_${columnfamily}_${file}.conf"], File['jmxquery'], Package['munin-node'], ],

74.

75. Development Best Practices with Life Cycle Management

76. Traditional vs. Today

77.

78. Q&A Thank You!

Notes de l'éditeur

“… a highly scalable second-generation distributed database, bringing together Dynamo's fully distributed design and Bigtable'sColumnFamily-based data model.”
Operational attributesFault TolerantData is automatically replicated to multiple nodes for fault-tolerance. Replication across multiple data centers is supported. Failed nodes can be replaced with no downtime.DecentralizedEvery node in the cluster is identical. There are no network bottlenecks. There are no single points of failure.ElasticRead and write throughput both increase linearly as new machines are added, with no downtime or interruption to applications.DurableCassandra is suitable for applications that can't afford to lose data, even when an entire data center goes down.Not just key-value. Replication and Consistency are configurable and datacenter aware
Can also be configured cross-datacenter.
Consistency Level is tunableONEQUORUMALLAt level ONE, one copy makes it to disk synchronously, before caller returns success.Same with reads. One node is read, so can get old data
At QUORUM, two of three (QUORUM) written before returningQUORUM Read: Quorum must AGREEFirst two don’t, so wait for the third node to resolve the tie
RISKS0.7.x in beta when we started, multiple betas and RCsRDBMS best practices are understood, if they exist for Cassandra how to discover them?Complicated system, lots of knobs, how to tune themMITIGATIONSWe deployed 0.7.2 across 72 servers in 90 minutes two days before we went live. 0.7.3 any day nowMailing lists, read code, file bugsA little about DatastaxStarted with a small app, higher risk ones come later, Mark will talk about monitoring—we have hundreds of graphs
Data model: no joins, referential integrity or fixed schema. If you want those things, you have to code them.Rows with millions of columnsThrift: driver-level interface, doesn’t do things an application-level client should do, e.g. failover, retry
Contributed bug reports and patches to Cassandra and HectorIncorporated in follow-on releasesNo need to maintain our own fork
Mirror modeShort timeoutsLog errors DB2 is still database of record
Necessary for success
Authentication and Authorization; test basic functionaiity; rapidly deploy new changes

Cassandra & puppet, scaling data at $15 per month

Recommandé

Recommandé

Contenu connexe

Tendances

Tendances (20)

En vedette

En vedette (20)

Similaire à Cassandra & puppet, scaling data at $15 per month

Similaire à Cassandra & puppet, scaling data at $15 per month (20)

Dernier

Dernier (20)

Cassandra & puppet, scaling data at $15 per month

Notes de l'éditeur