Intergalactic data speak_highload++_20131028

•Télécharger en tant que PPT, PDF•

0 j'aime•777 vues

David Fetter

Slides from my Highload++ 2013 talk. Join the fun!

Technologie

Intergalactic Dataspeak
Highload++ 2013/10/28
Copyright© 2013
David Fetter david.fetter@disqus.com
All rights reserved.

A Disqus Hour
• 50 GB raw log data
• 30 GB event data
• 100 million embed loads
• ...last week.

{CREATE | ALTER | DROP}
FOREIGN DATA WRAPPER
FOREIGN DATA WRAPPER

{CREATE | ALTER | DROP}
USER MAPPING
USER MAPPING

Remote Partitioning
• Expose information_schema.columns.
• Create view over them.
• Create foreign table generator.

The ever-interesting:
Stuff I Never Thought Of

Большое
спасибо!
Highload++ 2013/10/28
Copyright© 2013
David Fetter david.fetter@disqus.com
All rights reserved.

Contenu connexe

Tendances

Fluentd and Docker - running fluentd within a docker container

Treasure Data, Inc.

NDC Minnesota - Analyzing StackExchange data with Azure Data Lake

Tom Kerkhove

Bitquery GraphQL for Analytics on ClickHouse

Altinity Ltd

CouchDB Mobile - From Couch to 5K in 1 Hour

Peter Friese

Cassandra in e-commerce

Alexander Solovyev

Евгений Курпилянский "Индексирование поверх Cassandra". Выступление на Cassan...

it-people

Big data is the new big thing where storing the data is the easy part. Gaining insights in your pile of data is something different. Based on a data dump of the well-known StackExchange websites, we will store & analyse 150+ GB of data with Azure Data Lake Store & Analytics to gain some insights about their users. After that we will use Power BI to give an at a glance overview of our learnings. If you are a developer that is interested in big data, this is your time to shine! We will use our existing SQL & C# skills to analyse everything without having to worry about running clusters.

NDC Sydney - Analyzing StackExchange with Azure Data Lake

Tom Kerkhove

Introducing CouchDB

Hatem Ben Yacoub

Google App Engine Developer - Day4

Simon Su

What's new in MongoDB 2.6 at India event by company

MongoDB APAC

MongoDB WiredTiger Internals

Norberto Leite

Elastic Stack Introduction

Vikram Shinde

In this webinar, we will be covering general best practices for running MongoDB on AWS. Topics will range from instance selection to storage selection and service distribution to ensure service availability. We will also look at any specific best practices related to using WiredTiger. We will then shift gears and explore recommended strategies for managing your MongoDB instance on AWS. This session also includes a live Q&A portion during which you are encouraged to ask questions of our team.

Running MongoDB 3.0 on AWS

MongoDB

Codealike plugins in Visual Studio, Eclipse and Chrome, track developers while they code and perform analytic calculations at the millisecond level. For such write heavy workloads and using RavenDB as the main and only database was not without challenge. In this talk, we will reveal how we built and scaled such a solution, how we were able to improve performance with Voron and glance at our own mistakes and architectural choices down the line.

Building Codealike: a journey into the developers analytics world

Oren Eini

From MySQL to MongoDB at Wordnik (Tony Tam)

MongoSF

MongoDB 3.0 introduces a new pluggable storage engine API and a new storage engine called WiredTiger. The engineering team behind WiredTiger team has a long and distinguished career, having architected and built Berkeley DB, now the world's most widely used embedded database. In this talk we will describe our original design goals for WiredTiger, including considerations we made for heavily threaded hardware, large on-chip caches, and SSD storage. We'll also look at some of the latch-free and non-blocking algorithms we've implemented, as well as other techniques that improve scaling, overall throughput and latency. Finally, we'll take a look at some of the features we hope to incorporate into WiredTiger and MongoDB in the future.

https://docs.google.com/presentation/d/1DcL4zK6i3HZRDD4xTGX1VpSOwyu2xBeWLT6a_...

MongoDB

A Carrier grade PaaS aims to bring the network and application together. That means that application can easily deployed on multiple sites on different physical location as if it was one big data centre. Unlike regular cloud environment where application need to explicitly handle multi-zone deployments with Carrier PaaS the application workload and availability is handled through policy driven approach. The policy describes the desired application SLA and the Carrier PaaS maps the deployment of the application resources on the cloud node that best fit the latency, load or availability requirements.

Carrier Paas - CloudStack Collaboration Event 2012

Uri Cohen

From qconsf 2010 - this presentation focuses on how the classic querying models like plain SQL and JPA map to distributed data stores. It first reviews the current distributed data stores landscape and its querying models, and then discuss the wide range of APIs for data extraction from these data stores. It then discusses the main challenges of mapping various APIs to a distributed data model and the trade offs to be aware off.

Yes, Sql!

Uri Cohen

MongoDB San Francisco DrupalCon 2010

Karoly Negyesi

CouchDB

Niklas Gustavsson

Tendances (20)

Fluentd and Docker - running fluentd within a docker container

NDC Minnesota - Analyzing StackExchange data with Azure Data Lake

Bitquery GraphQL for Analytics on ClickHouse

CouchDB Mobile - From Couch to 5K in 1 Hour

Cassandra in e-commerce

Евгений Курпилянский "Индексирование поверх Cassandra". Выступление на Cassan...

NDC Sydney - Analyzing StackExchange with Azure Data Lake

Introducing CouchDB

Google App Engine Developer - Day4

What's new in MongoDB 2.6 at India event by company

MongoDB WiredTiger Internals

Elastic Stack Introduction

Running MongoDB 3.0 on AWS

Building Codealike: a journey into the developers analytics world

From MySQL to MongoDB at Wordnik (Tony Tam)

https://docs.google.com/presentation/d/1DcL4zK6i3HZRDD4xTGX1VpSOwyu2xBeWLT6a_...

Carrier Paas - CloudStack Collaboration Event 2012

Yes, Sql!

MongoDB San Francisco DrupalCon 2010

CouchDB

En vedette

Presentation1

guesta394021

8020rule

michelletw

Ct es past_present_future_nycpgday_20130322

David Fetter

G so c_and_commitfests_and_pointy_hair_oh_my_sfpug_20131008

David Fetter

8020rule

michelletw

Rdbms roadmap 20140130

David Fetter

Presentación Analisis de Resultados PSU 2008

mauxmatta

View triggers pg_east_20110325

David Fetter

Security revolutionized fosdem_20120205

David Fetter

Lightning sf perl_mongers_20120327

David Fetter

Threat modeling sf_perl_mongers_20130227

David Fetter

Slides pg conf_eu_20131031

David Fetter

Grouping sets sfpug_20141118

David Fetter

Success with Synergy

HollyPSynergy

Writeable ct es_pgcon_may_2011

David Fetter

Universal data access_with_sql_med

David Fetter

PL/Parrot San Francisco Perl Mongers 2010/05/25

David Fetter

Tree tricks osdc_melbourne_20101124

David Fetter

En vedette (18)

Presentation1

8020rule

Ct es past_present_future_nycpgday_20130322

G so c_and_commitfests_and_pointy_hair_oh_my_sfpug_20131008

8020rule

Rdbms roadmap 20140130

Presentación Analisis de Resultados PSU 2008

View triggers pg_east_20110325

Security revolutionized fosdem_20120205

Lightning sf perl_mongers_20120327

Threat modeling sf_perl_mongers_20130227

Slides pg conf_eu_20131031

Grouping sets sfpug_20141118

Success with Synergy

Writeable ct es_pgcon_may_2011

Universal data access_with_sql_med

PL/Parrot San Francisco Perl Mongers 2010/05/25

Tree tricks osdc_melbourne_20101124

Similaire à Intergalactic data speak_highload++_20131028

Azure Synapse Analytics is Azure SQL Data Warehouse evolved: a limitless analytics service, that brings together enterprise data warehousing and Big Data analytics into a single service. It gives you the freedom to query data on your terms, using either serverless on-demand or provisioned resources, at scale. Azure Synapse brings these two worlds together with a unified experience to ingest, prepare, manage, and serve data for immediate business intelligence and machine learning needs. This is a huge deck with lots of screenshots so you can see exactly how it works.

Azure Synapse Analytics Overview (r2)

James Serra

JoTechies - Azure SQL DB

JoTechies

Copy Data Management for the DBA

Kellyn Pot'Vin-Gorman

Denver SQL Saturday The Next Frontier

Kellyn Pot'Vin-Gorman

Spark to DocumentDB connector

Denny Lee

Presented at All Things Open 2023 Presented by Dave Stokes - Percona Title: PostgreSQL versus MySQL - What Are The Real Differences Abstract: Two open source databases both started by guys named Michael that have been around more than twenty five years and have thriving communities. They are both popular, have thriving communities, and at a certain vantage point can be seen as being pretty much the same thing - a relational database. However the differences can drastically impact how your project operates. While there are a few features that each have that the other does not, there are real differences that materially effect how your project works. Both support transactions but the differences in technique determine just how many transactions you will want to support. There are many different approaches to indexing columns that you can architecturally take advantage of easily. Replication between servers have different technologies and high availability options. This session will show you which areas are similar, where they differ vastly, and help you decided between PostgreSQL and MySQL. Find more info about All Things Open: On the web: https://www.allthingsopen.org/ Twitter: https://twitter.com/AllThingsOpen LinkedIn: https://www.linkedin.com/company/all-things-open/ Instagram: https://www.instagram.com/allthingsopen/ Facebook: https://www.facebook.com/AllThingsOpen Mastodon: https://mastodon.social/@allthingsopen Threads: https://www.threads.net/@allthingsopen 2023 conference: https://2023.allthingsopen.org/

PostgreSQL versus MySQL - What Are The Real Differences

All Things Open

Easily create dashboards to manage your databases with OVH

OVHcloud

Drilling into Data with Apache Drill

MapR Technologies

Azure Data platform

Mostafa

Intro to Azure SQL database

Steve Knutson

Qtp connect to an oracle database database - database skill

siva1991

Apache Spark 2.0 and subsequent releases of Spark 2.1 and 2.2 have laid the foundation for many new features and functionality. Its main three themes—easier, faster, and smarter—are pervasive in its unified and simplified high-level APIs for Structured data. In this introductory part lecture and part hands-on workshop, you’ll learn how to apply some of these new APIs using Databricks Community Edition. In particular, we will cover the following areas: Agenda: • Overview of Spark Fundamentals & Architecture • What’s new in Spark 2.x • Unified APIs: SparkSessions, SQL, DataFrames, Datasets • Introduction to DataFrames, Datasets and Spark SQL • Introduction to Structured Streaming Concepts • Four Hands-On Labs

Jump Start on Apache Spark 2.2 with Databricks

Anyscale

MySQL Without the SQL -- Oh My! Longhorn PHP Conference

Dave Stokes

NewSQL - Deliverance from BASE and back to SQL and ACID

Tony Rogerson

SQL for Everything at CWT2014

N Masahiro

In September 2016, the PostgreSQL community is rolling out PostgreSQL 9.6 which includes improvements in parallelism for query performance, overall performance improvements and the integration of foreign data sources. This presentation introduces the new features of 9.6 and how they will benefit you. - Parallel sequential scans, joins and aggregates - Elimination of repetitive scanning of old data by autovacuum - Synchronous replication now allows multiple standby servers for increased reliability - Full-text search for phrases - Support for remote joins, sorts, and updates in postgres_fdw - Substantial performance improvements, especially in the area of improving scalability on many-CPU servers If you have any questions on how to get started with Postgres, please email sales@enterprisedb.com

What's New in PostgreSQL 9.6

EDB

Drilling into Data with Apache Drill

DataWorks Summit

Mysql

guest817344

Building a high-performance data lake analytics engine at Alibaba Cloud with ...

Alluxio, Inc.

SQL on Hadoop in Taiwan

Treasure Data, Inc.

Similaire à Intergalactic data speak_highload++_20131028 (20)

Azure Synapse Analytics Overview (r2)

JoTechies - Azure SQL DB

Copy Data Management for the DBA

Denver SQL Saturday The Next Frontier

Spark to DocumentDB connector

PostgreSQL versus MySQL - What Are The Real Differences

Easily create dashboards to manage your databases with OVH

Drilling into Data with Apache Drill

Azure Data platform

Intro to Azure SQL database

Qtp connect to an oracle database database - database skill

Jump Start on Apache Spark 2.2 with Databricks

MySQL Without the SQL -- Oh My! Longhorn PHP Conference

NewSQL - Deliverance from BASE and back to SQL and ACID

SQL for Everything at CWT2014

What's New in PostgreSQL 9.6

Drilling into Data with Apache Drill

Mysql

Building a high-performance data lake analytics engine at Alibaba Cloud with ...

SQL on Hadoop in Taiwan

Dernier

The value of a flexible API Management solution for Open Banking Steve Melan, Manager for IT Innovation and Architecture - State's and Saving's Bank of Luxembourg Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The value of a flexible API Management solution for O...

apidays

CNIC Information System with Pakdata Cf In Pakistan

danishmna97

💥 You’re lucky! We’ve found two different (lead) developers that are willing to share their valuable lessons learned about using UiPath Document Understanding! Based on recent implementations in appealing use cases at Partou and SPIE. Don’t expect fancy videos or slide decks, but real and practical experiences that will help you with your own implementations. 📕 Topics that will be addressed: • Training the ML-model by humans: do or don't? • Rule-based versus AI extractors • Tips for finding use cases • How to start 👨‍🏫👨‍💻 Speakers: o Dion Morskieft, RPA Product Owner @Partou o Jack Klein-Schiphorst, Automation Developer @Tacstone Technology

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

UiPathCommunity

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

Accelerating FinTech Innovation: Unleashing API Economy and GenAI Vasa Krishnan, Chief Technology Officer - FinResults Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

apidays

Discover the innovative features and strategic vision that keep WSO2 an industry leader. Explore the exciting 2024 roadmap of WSO2 API management, showcasing innovations, unified APIM/APK control plane, natural language API interaction, and cloud native agility. Discover how open source solutions, microservices architecture, and cloud native technologies unlock seamless API management in today's dynamic landscapes. Leave with a clear blueprint to revolutionize your API journey and achieve industry success!

WSO2's API Vision: Unifying Control, Empowering Developers

WSO2

Keynote 2: APIs in 2030: The Risk of Technological Sleepwalk Paolo Malinverno, Growth Advisor - The Business of Technology Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

apidays

The Good, the Bad and the Governed - Why is governance a dirty word? David O'Neill, Chief Operating Officer - APIContext Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

apidays

Dubai, known for its towering skyscrapers, luxurious lifestyle, and relentless pursuit of innovation, often finds itself in the global spotlight. However, amidst the glitz and glamour, the emirate faces its own set of challenges, including the occasional threat of flooding. In recent years, Dubai has experienced sporadic but significant floods, disrupting normalcy and posing unique challenges to its infrastructure. Among the critical nodes in this bustling metropolis is the Dubai International Airport, a vital hub connecting the world. This article delves into the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Orbitshub

Retrieval augmented generation (RAG) is the most popular style of large language model application to emerge from 2023. The most basic style of RAG works by vectorizing your data and injecting it into a vector database like Milvus for retrieval to augment the text output generated by an LLM. This is just the beginning. One of the ways that we can extend RAG, and extend AI, is through multilingual use cases. Typical RAG is done in English using embedding models that are trained in English. In this talk, we’ll explore how RAG could work in languages other than English. We’ll explore French, Chinese, and Polish.

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Zilliz

FWD Group - Insurer Innovation Award 2024

The Digital Insurer

Angeliki Cooney has spent over twenty years at the forefront of the life sciences industry, working out of Wynantskill, NY. She is highly regarded for her dedication to advancing the development and accessibility of innovative treatments for chronic diseases, rare disorders, and cancer. Her professional journey has centered on strategic consulting for biopharmaceutical companies, facilitating digital transformation, enhancing omnichannel engagement, and refining strategic commercial practices. Angeliki's innovative contributions include pioneering several software-as-a-service (SaaS) products for the life sciences sector, earning her three patents. As the Senior Vice President of Life Sciences at Avenga, Angeliki orchestrated the firm's strategic entry into the U.S. market. Avenga, a renowned digital engineering and consulting firm, partners with significant entities in the pharmaceutical and biotechnology fields. Her leadership was instrumental in expanding Avenga's client base and establishing its presence in the competitive U.S. market.

Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...

Angeliki Cooney

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

apidays

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the deployment of external web forms using Jotform for Bonterra Impact Management. This solution can be customized to your organization’s needs and deployed to support the common use cases below: - Intake and consent - Assessments - Surveys - Applications - Program registration Interested in deploying web form automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Jeffrey Haguewood

Corporate and higher education. Two industries that, in the past, have had a clear divide with very little crossover. The difference in goals, learning styles and objectives paved the way for differing learning technologies platforms to evolve. Now, those stark lines are blurring as both sides are discovering they have content that’s relevant to the other. Join Tammy Rutherford as she walks through the pros and cons of corporate and higher ed collaborating. And the challenges of these different technology platforms working together for a brighter future.

Corporate and higher education May webinar.pptx

Rustici Software

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

DianaGray10

Passkeys: Developing APIs to enable passwordless authentication Cody Salas, Sr Developer Advocate | Solutions Architect - Yubico Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

apidays

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Zilliz

Exploring Multimodal Embeddings with Milvus

Zilliz

Dernier (20)

Apidays New York 2024 - The value of a flexible API Management solution for O...

CNIC Information System with Pakdata Cf In Pakistan

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

Strategies for Landing an Oracle DBA Job as a Fresher

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

WSO2's API Vision: Unifying Control, Empowering Developers

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Introduction to Multilingual Retrieval Augmented Generation (RAG)

FWD Group - Insurer Innovation Award 2024

Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Corporate and higher education May webinar.pptx

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Exploring Multimodal Embeddings with Milvus