Streak + Google Cloud Platform

•

3 j'aime•1,001 vues

How to use the Google Cloud Platform - as used at Streak

Technologie Business

Data @ Streak
How we use the Google Cloud Platform

Aleem Mawani, aleem@streak.com, @aloo

What is Streak?

What do we use Google Cloud Platform for?

1. Serve our app and run business logic
AppEngine + Prediction API + Search API

2. Store and Analyze user data
AppEngine Datastore + Memcache + Cloud Storage + BigQuery

3. Record and analyze every UI action
BigQuery (Streaming + Bigquery Extension)

4. Record and analyze all server logs
BigQuery (Streaming + Bigquery Extension)

5. Record and analyze all client logs
BigQuery (Streaming + Bigquery Extension)

Streak on Google Cloud

App Engine

...

app
data

Datastore +
Memcache

Streak on Google Cloud

Logstore

lo

App Engine

dat
a

g

da

ta

log

BigQuery

...

app
data

Datastore +
Memcache

Streak on Google Cloud

Logstore

lo

App Engine

dat
a

g

da

ta

log

BigQuery

...

app
data

Datastore +
Memcache

app
data
Cloud
Storage
Prediction
API

Streak on Google Cloud

Logstore

lo

App Engine

dat
a

g

da

ta

log

BigQuery

...

app
data

Datastore +
Memcache

app
data
Cloud
Storage

ata

pd

ap
App Engine
Search API

Prediction
API

Streak on Google Cloud

Logstore

lo

App Engine

dat
a

g

da

ta

log

BigQuery

Cloud
Storage

ata

pd

Translation API &
Human Translators

app
data

ap

n

Datastore +
Memcache

i18

...

app
data

App Engine
Search API

Prediction
API

Streak on Google Cloud

t

ta
lo

g

ta

da

da

App Engine

dat
a

ata
nt d

en

log

event d
ata

eve

ev

Logstore

BigQuery

Cloud
Storage

ata

pd

Translation API &
Human Translators

app
data

ap

n

Datastore +
Memcache

i18

...

app
data

App Engine
Search API

Prediction
API

BigQuery Demo

Thanks!

Like big data? Streak.com is hiring!
jobs@streak.com

Summary

Benefits
● Move fast and build lean!
● Google quality infrastructure for everyone
● Ask critical business questions
Tradeoffs
● Need to move data incrementally
● Need to make your pipelines fault tolerant at scale
Tips
● Mirror your data in multiple systems, storage is cheap!
● Build systems incrementally

Contenu connexe

Similaire à Streak + Google Cloud Platform

Google cloud platform

Google cloud platform

Google cloud platform

File Repository on GAE

File Repository on GAE

File Repository on GAE

Teaser: provide developers a new way of understanding advanced analytics and choosing the right cloud architecture The new buzzword is #serverless, as there are many great services that helps us abstract away the complexity associated with managing servers. In this session we will see how serverless helps on large data analytics backends. We will see how to architect for Cloud and implement into an existing project components that will take us into the #serverless architecture that will ingest our streaming data, run advanced analytics on petabytes of data using BigQuery on Google Cloud Platform - all this next to an existing stack, without being forced to reengineer our app. BigQuery enables super-fast, SQL/Javascript queries against petabytes of data using the processing power of Google’s infrastructure. We will cover its core features, SQL 2011 standard, working with streaming inserts, User Defined Functions written in Javascript, reference external JS libraries, and several use cases for everyday backend developer: funnel analytics, email heatmap, custom data processing, building dashboards, extracting data using JS functions, emitting rows based on business logic.

CodeCamp Iasi - Creating serverless data analytics system on GCP using BigQuery

CodeCamp Iasi - Creating serverless data analytics system on GCP using BigQuery

CodeCamp Iasi - Creating serverless data analytics system on GCP using BigQuery

Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)

Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)

Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)

#MBLTdev: Разработка backend для мобильного приложения с использованием Googl...

#MBLTdev: Разработка backend для мобильного приложения с использованием Googl...

#MBLTdev: Разработка backend для мобильного приложения с использованием Googl...

Sumo Logic Webinar: Visibility into your Host Metrics

Sumo Logic Webinar: Visibility into your Host Metrics

Sumo Logic Webinar: Visibility into your Host Metrics

Introduction to Google Cloud Platform Technologies

Introduction to Google Cloud Platform Technologies

Introduction to Google Cloud Platform Technologies

Google Cloud Platform Update

Google Cloud Platform Update

Google Cloud Platform Update

ALT-F1.BE : The Accelerator (Google Cloud Platform)

ALT-F1.BE : The Accelerator (Google Cloud Platform)

ALT-F1.BE : The Accelerator (Google Cloud Platform)

Abdelkrim Boujraf

This is a 1-hr tech talk designed for developers to give a comprehensive, vendor-agnostic overview of cloud computing, primarily targeting educators in the higher education market but is open to any developer. This is followed by an introduction to products in Google Cloud, focusing on the serverless products. The talk ends with several inspirational examples of what can be built with Google Cloud.

Cloud computing overview & running your code on Google Cloud (Jun 2019)

Cloud computing overview & running your code on Google Cloud (Jun 2019)

Cloud computing overview & running your code on Google Cloud (Jun 2019)

Streamlining data analysis through environmental alerts how to integrate ambe...

Streamlining data analysis through environmental alerts how to integrate ambe...

Streamlining data analysis through environmental alerts how to integrate ambe...

MongoDB World 2018: Ch-Ch-Ch-Ch-Changes: Taking Your Stitch Application to th...

MongoDB World 2018: Ch-Ch-Ch-Ch-Changes: Taking Your Stitch Application to th...

MongoDB World 2018: Ch-Ch-Ch-Ch-Changes: Taking Your Stitch Application to th...

Javaedge 2010-cschalk

Javaedge 2010-cschalk

Javaedge 2010-cschalk

End To End Business Intelligence On Google Cloud

End To End Business Intelligence On Google Cloud

End To End Business Intelligence On Google Cloud

In this presentation we give an overview on several services of the Google Cloud Platform and showcase an Android application utilizing these technologies. We cover technologies, such as Google App Engine, Cloud Endpoints, Cloud Storage, Cloud Datastore and Google Cloud Messaging (GCM). We will talk about pitfalls, show meaningful code examples (in Java) and provide several tips and dev tools on how to get the most out of Google’s Cloud Platform.

Google Cloud Platform - Building a scalable mobile application

Google Cloud Platform - Building a scalable mobile application

Google Cloud Platform - Building a scalable mobile application

by Lukas Masuch, Henning Muszynski and Benjamin Raethlein Originally held on 'Karlsruhe Entwicklertag 2015' In this presentation we give an overview on several services of the Google Cloud Platform and showcase an Android application utilizing these technologies. We cover technologies, such as Google App Engine, Cloud Endpoints, Cloud Storage, Cloud Datastore and Google Cloud Messaging (GCM). We will talk about pitfalls, show meaningful code examples (in Java) and provide several tips and dev tools on how to get the most out of Google’s Cloud Platform.

Google Cloud Platform - Building a scalable Mobile Application

Google Cloud Platform - Building a scalable Mobile Application

Google Cloud Platform - Building a scalable Mobile Application

Benjamin Raethlein

Automating some google things

Automating some google things

Automating some google things

Scott Sunderland

Introduction to Digital Analytics for Apps Presented by Benoit Weber, Digital Analytics Specialist In this session we will have an overview and an introduction to Analytics for Apps (basics of digital analytics focusing on apps): how it works, how it is different from websites tracking (metrics and dimensions), how to implement it (firebase implementation versus GTM + Google Analytics). We will be exploring the 2 interfaces and review the different reports to learn about users and how they interacted with the app.

Introduction to Digital Analytics for Apps - Trusted Conf

Introduction to Digital Analytics for Apps - Trusted Conf

Introduction to Digital Analytics for Apps - Trusted Conf

In Marketing We Trust

AnDevCon - Tracking User Behavior Creatively

AnDevCon - Tracking User Behavior Creatively

AnDevCon - Tracking User Behavior Creatively

In this session, we discuss the AWS Cloud Adoption Framework and how you can use AWS Application Discovery Service to plan your migration. Learn how to analyze the data collected by Application Discovery Service agents combined with other sources of data, such as configuration management database (CMDB) exports using services like Amazon Athena and Amazon QuickSight. Learn how to profile workloads and identify interdependencies and utilization patterns to help you make decisions, like identifying assets to validate accuracy and completeness of data, finding the right size EC2 instance types, and planning migration waves and sequencing.

Migration Planning with AWS Application Discovery Service - ENT308 - Chicago ...

Migration Planning with AWS Application Discovery Service - ENT308 - Chicago ...

Migration Planning with AWS Application Discovery Service - ENT308 - Chicago ...

Amazon Web Services

Similaire à Streak + Google Cloud Platform (20)

Google cloud platform

Google cloud platform

Google cloud platform

File Repository on GAE

File Repository on GAE

File Repository on GAE

CodeCamp Iasi - Creating serverless data analytics system on GCP using BigQuery

CodeCamp Iasi - Creating serverless data analytics system on GCP using BigQuery

CodeCamp Iasi - Creating serverless data analytics system on GCP using BigQuery

Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)

Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)

Entrepreneurship Tips With HTML5 & App Engine Startup Weekend (June 2012)

#MBLTdev: Разработка backend для мобильного приложения с использованием Googl...

#MBLTdev: Разработка backend для мобильного приложения с использованием Googl...

#MBLTdev: Разработка backend для мобильного приложения с использованием Googl...

Sumo Logic Webinar: Visibility into your Host Metrics

Sumo Logic Webinar: Visibility into your Host Metrics

Sumo Logic Webinar: Visibility into your Host Metrics

Introduction to Google Cloud Platform Technologies

Introduction to Google Cloud Platform Technologies

Introduction to Google Cloud Platform Technologies

Google Cloud Platform Update

Google Cloud Platform Update

Google Cloud Platform Update

ALT-F1.BE : The Accelerator (Google Cloud Platform)

ALT-F1.BE : The Accelerator (Google Cloud Platform)

ALT-F1.BE : The Accelerator (Google Cloud Platform)

Cloud computing overview & running your code on Google Cloud (Jun 2019)

Cloud computing overview & running your code on Google Cloud (Jun 2019)

Cloud computing overview & running your code on Google Cloud (Jun 2019)

Streamlining data analysis through environmental alerts how to integrate ambe...

Streamlining data analysis through environmental alerts how to integrate ambe...

Streamlining data analysis through environmental alerts how to integrate ambe...

MongoDB World 2018: Ch-Ch-Ch-Ch-Changes: Taking Your Stitch Application to th...

MongoDB World 2018: Ch-Ch-Ch-Ch-Changes: Taking Your Stitch Application to th...

MongoDB World 2018: Ch-Ch-Ch-Ch-Changes: Taking Your Stitch Application to th...

Javaedge 2010-cschalk

Javaedge 2010-cschalk

Javaedge 2010-cschalk

End To End Business Intelligence On Google Cloud

End To End Business Intelligence On Google Cloud

End To End Business Intelligence On Google Cloud

Google Cloud Platform - Building a scalable mobile application

Google Cloud Platform - Building a scalable mobile application

Google Cloud Platform - Building a scalable mobile application

Google Cloud Platform - Building a scalable Mobile Application

Google Cloud Platform - Building a scalable Mobile Application

Google Cloud Platform - Building a scalable Mobile Application

Automating some google things

Automating some google things

Automating some google things

Introduction to Digital Analytics for Apps - Trusted Conf

Introduction to Digital Analytics for Apps - Trusted Conf

Introduction to Digital Analytics for Apps - Trusted Conf

AnDevCon - Tracking User Behavior Creatively

AnDevCon - Tracking User Behavior Creatively

AnDevCon - Tracking User Behavior Creatively

Migration Planning with AWS Application Discovery Service - ENT308 - Chicago ...

Migration Planning with AWS Application Discovery Service - ENT308 - Chicago ...

Migration Planning with AWS Application Discovery Service - ENT308 - Chicago ...

Plus de BigDataCloud

Webinar - Comparative Analysis of Cloud based Machine Learning Platforms

Webinar - Comparative Analysis of Cloud based Machine Learning Platforms

Webinar - Comparative Analysis of Cloud based Machine Learning Platforms

Crime Analysis & Prediction System

Crime Analysis & Prediction System

Crime Analysis & Prediction System

Generally in recommendation engines, user's past history on engagements with different items is a key input. However, in many situations in an enterprise’s business cycle, it is necessary to generate recommendations based on user activity in real time. In this Big Data Cloud's meetup on April 3, 2014, we discussed how to decipher real time click streams into meaningful recommendations in real time. Pranab Ghosh discussed the real time recommendations feature of Sifarish, which is an open source project built on Hadoop, Storm and Redis. Sifarish is a recommendation engine that does content based recommendation as well as social collaborative filtering based recommendation.

REAL-TIME RECOMMENDATION SYSTEMS

REAL-TIME RECOMMENDATION SYSTEMS

REAL-TIME RECOMMENDATION SYSTEMS

Cloud Computing Services

Cloud Computing Services

Cloud Computing Services

Google Enterprise Cloud Platform - Resources & $2000 credit!

Google Enterprise Cloud Platform - Resources & $2000 credit!

Google Enterprise Cloud Platform - Resources & $2000 credit!

Big Data in the Cloud - Solutions & Apps

Big Data in the Cloud - Solutions & Apps

Big Data in the Cloud - Solutions & Apps

Big Data Analytics in Motorola on the Google Cloud Platform

Big Data Analytics in Motorola on the Google Cloud Platform

Big Data Analytics in Motorola on the Google Cloud Platform

Using Advanced Analyics to bring Business Value

Using Advanced Analyics to bring Business Value

Using Advanced Analyics to bring Business Value

Creating Business Value from Big Data, Analytics & Technology.

Creating Business Value from Big Data, Analytics & Technology.

Creating Business Value from Big Data, Analytics & Technology.

A tutorial given at NAACL HLT 2013. Richard Socher and Christopher Manning http://nlp.stanford.edu/courses/NAACL2013/ Machine learning is everywhere in today's NLP, but by and large machine learning amounts to numerical optimization of weights for human designed representations and features. The goal of deep learning is to explore how computers can take advantage of data to develop features and representations appropriate for complex interpretation tasks. This tutorial aims to cover the basic motivation, ideas, models and learning algorithms in deep learning for natural language processing. Recently, these methods have been shown to perform very well on various NLP tasks such as language modeling, POS tagging, named entity recognition, sentiment analysis and paraphrase detection, among others. The most attractive quality of these techniques is that they can perform well without any external hand-designed resources or time-intensive feature engineering. Despite these advantages, many researchers in NLP are not familiar with these methods. Our focus is on insight and understanding, using graphical illustrations and simple, intuitive derivations. The goal of the tutorial is to make the inner workings of these techniques transparent, intuitive and their results interpretable, rather than black boxes labeled "magic here". The first part of the tutorial presents the basics of neural networks, neural word vectors, several simple models based on local windows and the math and algorithms of training via backpropagation. In this section applications include language modeling and POS tagging. In the second section we present recursive neural networks which can learn structured tree outputs as well as vector representations for phrases and sentences. We cover both equations as well as applications. We show how training can be achieved by a modified version of the backpropagation algorithm introduced before. These modifications allow the algorithm to work on tree structures. Applications include sentiment analysis and paraphrase detection. We also draw connections to recent work in semantic compositionality in vector spaces. The principle goal, again, is to make these methods appear intuitive and interpretable rather than mathematically confusing. By this point in the tutorial, the audience members should have a clear understanding of how to build a deep learning system for word-, sentence- and document-level tasks. The last part of the tutorial gives a general overview of the different applications of deep learning in NLP, including bag of words models. We will provide a discussion of NLP-oriented issues in modeling, interpretation, representational power, and optimization.

Deep Learning for NLP (without Magic) - Richard Socher and Christopher Manning

Deep Learning for NLP (without Magic) - Richard Socher and Christopher Manning

Deep Learning for NLP (without Magic) - Richard Socher and Christopher Manning

Recommendation Engines - An Architectural Guide

Recommendation Engines - An Architectural Guide

Recommendation Engines - An Architectural Guide

As the big data market matures, discussions about Hadoop are expanding from pure technology to how businesses can use it to innovate and leap frog competitors. In this session, Karmasphere will outline how technologists can effectively work with their CMOs - the likely drivers of widespread Hadoop adoption, to unlock its business value. The discussion will include: how changes in marketing are driving the adoption of Hadoop big data analytics, the evolving role of the data and business analysts and a review of real-world big data analytics use cases. Karmasphere will demonstrate how the Full Fidelity Analytics of Hadoop can empower high-tech, e-commerce, etail and reatil banking to quickly and easily analyze complex data types across silos and apply sophisticated analytics to personalize customer engagement and optimize revenue.

Why Hadoop is the New Infrastructure for the CMO?

Why Hadoop is the New Infrastructure for the CMO?

Why Hadoop is the New Infrastructure for the CMO?

Hadoop : A Foundation for Change - Milind Bhandarkar Chief Scientist, Pivotal

Hadoop : A Foundation for Change - Milind Bhandarkar Chief Scientist, Pivotal

Hadoop : A Foundation for Change - Milind Bhandarkar Chief Scientist, Pivotal

Big Data Cloud Meetup - Jan 29 2013 - Mike Stonebraker & Scott Jarr of VoltDB

Big Data Cloud Meetup - Jan 29 2013 - Mike Stonebraker & Scott Jarr of VoltDB

Big Data Cloud Meetup - Jan 29 2013 - Mike Stonebraker & Scott Jarr of VoltDB

Big Data Cloud Meetup - Jan 24 2013 - Zettaset

Big Data Cloud Meetup - Jan 24 2013 - Zettaset

Big Data Cloud Meetup - Jan 24 2013 - Zettaset

At Facebook, we use various types of databases and storage system to satisfy the needs of different applications. The solutions built around these data store systems have a common set of requirements: they have to be highly scalable, maintenance costs should be low and they have to perform efficiently. We use a sharded mySQL+memcache solution to support real-time access of tens of petabytes of data and we use TAO to provide consistency of this web-scale database across geographical distances. We use Haystack datastore for storing the 3 billion new photos we host every week. We use Apache Hadoop to mine intelligence from 100 petabytes of clicklogs and combine it with the power of Apache HBase to store all Facebook Messages. This talk describes the reasons why each of these databases are appropriate for their workloads and the design decisions and tradeoffs that were made while implementing these solutions. We touch upon the consistency, availability and partitioning tolerance of each of these solutions. We touch upon the reasons why some of these systems need ACID semantics and other systems do not. We briefly touch upon some futures of how we plan to do big-data deployments across geographical locations and our requirements for a new breed of pure-memory and pure-SSD based transactional database.

A Survey of Petabyte Scale Databases and Storage Systems Deployed at Facebook

A Survey of Petabyte Scale Databases and Storage Systems Deployed at Facebook

A Survey of Petabyte Scale Databases and Storage Systems Deployed at Facebook

Michael Ralph Stonebraker is a computer scientist specializing in database research. He is currently an adjunct professor at MIT, where he has been involved in the development of the Aurora, C-Store, H-Store, Morpheus, and SciDB systems.Through a series of academic prototypes and commercial startups, Stonebraker's research and products are central to many relational database systems on the market today. He is also the founder of a number of database companies, including Ingres, Illustra, Cohera, StreamBase Systems, Vertica, VoltDB, and Paradigm4. He was previously the Chief Technical Officer (CTO) of Informix & a Professor of Computer Science at University of California, Berkeley. He is also an editor for the book "Readings in Database Systems"

What Does Big Data Mean and Who Will Win

What Does Big Data Mean and Who Will Win

What Does Big Data Mean and Who Will Win

Big Data Analytics is characterized by analysis of data on three vectors: exploding data volume, proliferating data variety (relational, multi-media), and accelerating data velocity. However, other key vectors such as costs and skill set needed for Big Data Analytics are often overlooked. In this session, we will consider all five vectors by exploring various techniques where traditional but progressive technologies such as column store DBMS and Event Stream Processing is combined with open source frameworks such as Hadoop to exploit the full potential of Big Data Analytics. Agenda: - Big Data Analytics in the real world - Commercial and Open Source techniques - Bringing together Commercial and Open Source techniques * Architectures * Programming APIs (e.g. embedded and federated MapReduce) - Conclusions

Big Data Analytics in a Heterogeneous World - Joydeep Das of Sybase

Big Data Analytics in a Heterogeneous World - Joydeep Das of Sybase

Big Data Analytics in a Heterogeneous World - Joydeep Das of Sybase

BigDataCloud meetup Feb 16th - Microsoft's Saptak Sen's presentation

BigDataCloud meetup Feb 16th - Microsoft's Saptak Sen's presentation

BigDataCloud meetup Feb 16th - Microsoft's Saptak Sen's presentation

BigDataCloud Sept 8 2011 Meetup - Fail-Proofing Hadoop Clusters with Automati...

BigDataCloud Sept 8 2011 Meetup - Fail-Proofing Hadoop Clusters with Automati...

BigDataCloud Sept 8 2011 Meetup - Fail-Proofing Hadoop Clusters with Automati...

Plus de BigDataCloud (20)

Webinar - Comparative Analysis of Cloud based Machine Learning Platforms

Webinar - Comparative Analysis of Cloud based Machine Learning Platforms

Webinar - Comparative Analysis of Cloud based Machine Learning Platforms

Crime Analysis & Prediction System

Crime Analysis & Prediction System

Crime Analysis & Prediction System

REAL-TIME RECOMMENDATION SYSTEMS

REAL-TIME RECOMMENDATION SYSTEMS

REAL-TIME RECOMMENDATION SYSTEMS

Cloud Computing Services

Cloud Computing Services

Cloud Computing Services

Google Enterprise Cloud Platform - Resources & $2000 credit!

Google Enterprise Cloud Platform - Resources & $2000 credit!

Google Enterprise Cloud Platform - Resources & $2000 credit!

Big Data in the Cloud - Solutions & Apps

Big Data in the Cloud - Solutions & Apps

Big Data in the Cloud - Solutions & Apps

Big Data Analytics in Motorola on the Google Cloud Platform

Big Data Analytics in Motorola on the Google Cloud Platform

Big Data Analytics in Motorola on the Google Cloud Platform

Using Advanced Analyics to bring Business Value

Using Advanced Analyics to bring Business Value

Using Advanced Analyics to bring Business Value

Creating Business Value from Big Data, Analytics & Technology.

Creating Business Value from Big Data, Analytics & Technology.

Creating Business Value from Big Data, Analytics & Technology.

Deep Learning for NLP (without Magic) - Richard Socher and Christopher Manning

Deep Learning for NLP (without Magic) - Richard Socher and Christopher Manning

Deep Learning for NLP (without Magic) - Richard Socher and Christopher Manning

Recommendation Engines - An Architectural Guide

Recommendation Engines - An Architectural Guide

Recommendation Engines - An Architectural Guide

Why Hadoop is the New Infrastructure for the CMO?

Why Hadoop is the New Infrastructure for the CMO?

Why Hadoop is the New Infrastructure for the CMO?

Hadoop : A Foundation for Change - Milind Bhandarkar Chief Scientist, Pivotal

Hadoop : A Foundation for Change - Milind Bhandarkar Chief Scientist, Pivotal

Hadoop : A Foundation for Change - Milind Bhandarkar Chief Scientist, Pivotal

Big Data Cloud Meetup - Jan 29 2013 - Mike Stonebraker & Scott Jarr of VoltDB

Big Data Cloud Meetup - Jan 29 2013 - Mike Stonebraker & Scott Jarr of VoltDB

Big Data Cloud Meetup - Jan 29 2013 - Mike Stonebraker & Scott Jarr of VoltDB

Big Data Cloud Meetup - Jan 24 2013 - Zettaset

Big Data Cloud Meetup - Jan 24 2013 - Zettaset

Big Data Cloud Meetup - Jan 24 2013 - Zettaset

A Survey of Petabyte Scale Databases and Storage Systems Deployed at Facebook

A Survey of Petabyte Scale Databases and Storage Systems Deployed at Facebook

A Survey of Petabyte Scale Databases and Storage Systems Deployed at Facebook

What Does Big Data Mean and Who Will Win

What Does Big Data Mean and Who Will Win

What Does Big Data Mean and Who Will Win

Big Data Analytics in a Heterogeneous World - Joydeep Das of Sybase

Big Data Analytics in a Heterogeneous World - Joydeep Das of Sybase

Big Data Analytics in a Heterogeneous World - Joydeep Das of Sybase

BigDataCloud meetup Feb 16th - Microsoft's Saptak Sen's presentation

BigDataCloud meetup Feb 16th - Microsoft's Saptak Sen's presentation

BigDataCloud meetup Feb 16th - Microsoft's Saptak Sen's presentation

BigDataCloud Sept 8 2011 Meetup - Fail-Proofing Hadoop Clusters with Automati...

BigDataCloud Sept 8 2011 Meetup - Fail-Proofing Hadoop Clusters with Automati...

BigDataCloud Sept 8 2011 Meetup - Fail-Proofing Hadoop Clusters with Automati...

Dernier

How to convert PDF to text with Nanonets

How to convert PDF to text with Nanonets

How to convert PDF to text with Nanonets

The presentation explores the development and application of artificial intelligence (AI) from its inception to its current status in the modern world. The term "artificial intelligence" was first coined by John McCarthy in 1956 to describe efforts to develop computer programs capable of performing tasks that typically require human intelligence. This concept was first introduced at a conference held at Dartmouth College, where programs demonstrated capabilities such as playing chess, proving theorems, and interpreting texts. In the early stages, Alan Turing contributed to the field by defining intelligence as the ability of a being to respond to certain questions intelligently, proposing what is now known as the Turing Test to evaluate the presence of intelligent behavior in machines. As the decades progressed, AI evolved significantly. The 1980s focused on machine learning, teaching computers to learn from data, leading to the development of models that could improve their performance based on their experiences. The 1990s and 2000s saw further advances in algorithms and computational power, which allowed for more sophisticated data analysis techniques, including data mining. By the 2010s, the proliferation of big data and the refinement of deep learning techniques enabled AI to become mainstream. Notable milestones included the success of Google's AlphaGo and advancements in autonomous vehicles by companies like Tesla and Waymo. A major theme of the presentation is the application of generative AI, which has been used for tasks such as natural language text generation, translation, and question answering. Generative AI uses large datasets to train models that can then produce new, coherent pieces of text or other media. The presentation also discusses the ethical implications and the need for regulation in AI, highlighting issues such as privacy, bias, and the potential for misuse. These concerns have prompted calls for comprehensive regulations to ensure the safe and equitable use of AI technologies. Artificial intelligence has also played a significant role in healthcare, particularly highlighted during the COVID-19 pandemic, where it was used in drug discovery, vaccine development, and analyzing the spread of the virus. The capabilities of AI in healthcare are vast, ranging from medical diagnostics to personalized medicine, demonstrating the technology's potential to revolutionize fields beyond just technical or consumer applications. In conclusion, AI continues to be a rapidly evolving field with significant implications for various aspects of society. The development from theoretical concepts to real-world applications illustrates both the potential benefits and the challenges that come with integrating advanced technologies into everyday life. The ongoing discussion about AI ethics and regulation underscores the importance of managing these technologies responsibly to maximize their their benefits while minimizing potential harms.

Artificial Intelligence: Facts and Myths

Artificial Intelligence: Facts and Myths

Artificial Intelligence: Facts and Myths

The 7 Things I Know About Cyber Security After 25 Years | April 2024

The 7 Things I Know About Cyber Security After 25 Years | April 2024

The 7 Things I Know About Cyber Security After 25 Years | April 2024

Partners Life - Insurer Innovation Award 2024

Partners Life - Insurer Innovation Award 2024

Partners Life - Insurer Innovation Award 2024

The Digital Insurer

MySQL Webinar, presented on the 25th of April, 2024. Summary: MySQL solutions enable the deployment of diverse Database Architectures tailored to specific needs, including High Availability, Disaster Recovery, and Read Scale-Out. With MySQL Shell's AdminAPI, administrators can seamlessly set up, manage, and monitor these solutions, ensuring efficiency and ease of use in their administration. MySQL Router, on the other hand, provides transparent routing from the application traffic to the backend servers in the architectures, requiring minimal configuration. Completely built in-house and supported by Oracle, these solutions have been adopted by enterprises of all sizes for their business-critical applications. In this presentation, we'll delve into various database architecture solutions to help you choose the right one based on your business requirements. Focusing on technical details and the latest features to maximize the potential of these solutions.

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Data Cloud, More than a CDP by Matt Robison

Data Cloud, More than a CDP by Matt Robison

Data Cloud, More than a CDP by Matt Robison

Anna Loughnan Colquhoun

Abhishek Deb(1), Mr Abdul Kalam(2) M. Des (UX) , School of Design, DIT University , Dehradun. This paper explores the future potential of AI-enabled smartphone processors, aiming to investigate the advancements, capabilities, and implications of integrating artificial intelligence (AI) into smartphone technology. The research study goals consist of evaluating the development of AI in mobile phone processors, analyzing the existing state as well as abilities of AI-enabled cpus determining future patterns as well as chances together with reviewing obstacles as well as factors to consider for more growth.

Exploring the Future Potential of AI-Enabled Smartphone Processors

Exploring the Future Potential of AI-Enabled Smartphone Processors

Exploring the Future Potential of AI-Enabled Smartphone Processors

BooK Now Call us at +918448380779 to hire a gorgeous and seductive call girl for sex. Take a Delhi Escort Service. The help of our escort agency is mostly meant for men who want sexual Indian Escorts In Delhi NCR. It should be noted that any impersonator will get 100 attention from our Young Girls Escorts in Delhi. They will assume the position of reliable allies. VIP Call Girl With Original Photos Book Tonight +918448380779 Our Cheap Price 1 Hour not available 2 Hours 5000 Full Night 8000 TAG: Call Girls in Delhi, Noida, Gurgaon, Ghaziabad, Connaught Place, Greater Kailash Delhi, Lajpat Nagar Delhi, Mayur Vihar Delhi, Chanakyapuri Delhi, New Friends Colony Delhi, Majnu Ka Tilla, Karol Bagh, Malviya Nagar, Saket, Khan Market, Noida Sector 18, Noida Sector 76, Noida Sector 51, Gurgaon Mg Road, Iffco Chowk Gurgaon, Rajiv Chowk Gurgaon All Delhi Ncr Free Home Deliver

08448380779 Call Girls In Greater Kailash - I Women Seeking Men

08448380779 Call Girls In Greater Kailash - I Women Seeking Men

08448380779 Call Girls In Greater Kailash - I Women Seeking Men

Delhi Call girls

Finology Group – Insurtech Innovation Award 2024

Finology Group – Insurtech Innovation Award 2024

Finology Group – Insurtech Innovation Award 2024

The Digital Insurer

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

In this session, we will delve into strategic approaches for optimizing knowledge management within Microsoft 365, amidst the evolving landscape of Copilot. From leveraging automatic metadata classification and permission governance with SharePoint Premium, to unlocking Viva Engage for the cultivation of knowledge and communities, you will gain actionable insights to bolster your organization's knowledge-sharing initiatives. In this session, we will also explore how to facilitate solutions to enable your employees to find answers and expertise within Microsoft 365. You will leave equipped with practical techniques and a deeper understanding of how there is more to effective knowledge management than just enabling Copilot, but building actual solutions to prepare the knowledge that Copilot and your employees can use.

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Heather Hedden, Senior Consultant at Enterprise Knowledge, presented “The Role of Taxonomy and Ontology in Semantic Layers” at a webinar hosted by Progress Semaphore on April 16, 2024. Taxonomies at their core enable effective tagging and retrieval of content, and combined with ontologies they extend to the management and understanding of related data. There are even greater benefits of taxonomies and ontologies to enhance your enterprise information architecture when applying them to a semantic layer. A survey by DBP-Institute found that enterprises using a semantic layer see their business outcomes improve by four times, while reducing their data and analytics costs. Extending taxonomies to a semantic layer can be a game-changing solution, allowing you to connect information silos, alleviate knowledge gaps, and derive new insights. Hedden, who specializes in taxonomy design and implementation, presented how the value of taxonomies shouldn’t reside in silos but be integrated with ontologies into a semantic layer. Learn about: - The essence and purpose of taxonomies and ontologies in information and knowledge management; - Advantages of semantic layers leveraging organizational taxonomies; and - Components and approaches to creating a semantic layer, including the integration of taxonomies and ontologies

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

Enterprise Knowledge

With more memory available, system performance of three Dell devices increased, which can translate to a better user experience Conclusion When your system has plenty of RAM to meet your needs, you can efficiently access the applications and data you need to finish projects and to-do lists without sacrificing time and focus. Our test results show that with more memory available, three Dell PCs delivered better performance and took less time to complete the Procyon Office Productivity benchmark. These advantages translate to users being able to complete workflows more quickly and multitask more easily. Whether you need the mobility of the Latitude 5440, the creative capabilities of the Precision 3470, or the high performance of the OptiPlex Tower Plus 7010, configuring your system with more RAM can help keep processes running smoothly, enabling you to do more without compromising performance.

Boost PC performance: How more available memory can improve productivity

Boost PC performance: How more available memory can improve productivity

Boost PC performance: How more available memory can improve productivity

Principled Technologies

BooK Now Call us at +918448380779 to hire a gorgeous and seductive call girl for sex. Take a Delhi Escort Service. The help of our escort agency is mostly meant for men who want sexual Indian Escorts In Delhi NCR. It should be noted that any impersonator will get 100 attention from our Young Girls Escorts in Delhi. They will assume the position of reliable allies. VIP Call Girl With Original Photos Book Tonight +918448380779 Our Cheap Price 1 Hour not available 2 Hours 5000 Full Night 8000 TAG: Call Girls in Delhi, Noida, Gurgaon, Ghaziabad, Connaught Place, Greater Kailash Delhi, Lajpat Nagar Delhi, Mayur Vihar Delhi, Chanakyapuri Delhi, New Friends Colony Delhi, Majnu Ka Tilla, Karol Bagh, Malviya Nagar, Saket, Khan Market, Noida Sector 18, Noida Sector 76, Noida Sector 51, Gurgaon Mg Road, Iffco Chowk Gurgaon, Rajiv Chowk Gurgaon All Delhi Ncr Free Home Deliver

08448380779 Call Girls In Civil Lines Women Seeking Men

08448380779 Call Girls In Civil Lines Women Seeking Men

08448380779 Call Girls In Civil Lines Women Seeking Men

Delhi Call girls

🐬 The future of MySQL is Postgres 🐘

🐬 The future of MySQL is Postgres 🐘

🐬 The future of MySQL is Postgres 🐘

As privacy and data protection regulations evolve rapidly, organizations operating in multiple jurisdictions face mounting challenges to ensure compliance and safeguard customer data. With state-specific privacy laws coming up in multiple states this year, it is essential to understand what their unique data protection regulations will require clearly. How will data privacy evolve in the US in 2024? How to stay compliant? Our panellists will guide you through the intricacies of these states' specific data privacy laws, clarifying complex legal frameworks and compliance requirements. This webinar will review: - The essential aspects of each state's privacy landscape and the latest updates - Common compliance challenges faced by organizations operating in multiple states and best practices to achieve regulatory adherence - Valuable insights into potential changes to existing regulations and prepare your organization for the evolving landscape

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

In an era where artificial intelligence (AI) stands at the forefront of business innovation, Information Architecture (IA) is at the core of functionality. See “There’s No AI Without IA” – (from 2016 but even more relevant today) Understanding and leveraging how Information Architecture (IA) supports AI synergies between knowledge engineering and prompt engineering is critical for senior leaders looking to successfully deploy AI for internal and externally facing knowledge processes. This webinar be a high-level overview of the methodologies that can elevate AI-driven knowledge processes supporting both employees and customers. Core Insights Include: Strategic Knowledge Engineering: Delve into how structuring AI's knowledge base is required to prevent hallucinations, enable contextual retrieval of accurate information. This will include discussion of gold standard libraries of use cases support testing various LLMs and structures and configurations of knowledge base. Precision in Prompt Engineering: Learn the art of crafting prompts that direct AI to deliver targeted, relevant responses, thereby optimizing customer experiences and business outcomes. Unified Approach for Enhanced AI Performance: Explore the intersection of knowledge and prompt engineering to develop AI systems that are not only more responsive but also aligned with overarching business strategies. Guiding Principles for Implementation: Equip yourself with best practices, ethical guidelines, and strategic considerations for embedding these technologies into your business ecosystem effectively. This webinar is designed to empower business and technology leaders with the knowledge to harness the full potential of AI, ensuring their organizations not only keep pace with digital transformation but lead the charge. Join us to map a roadmap to fully leverage Information Architecture (IA) and AI chart a course towards a future where AI is a key pillar of strategic innovation and business success.

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx

Earley Information Science

The Raspberry Pi 5 was announced on October 2023. This new version of the popular embedded device comes with a new iteration of Broadcom’s VideoCore GPU platform, and was released with a fully open source driver stack, developed by Igalia. The presentation will discuss some of the major changes required to support this new Video Core iteration, the challenges we faced in the process and the solutions we provided in order to deliver conformant OpenGL ES and Vulkan drivers. The talk will also cover the next steps for the open source Raspberry Pi 5 graphics stack. (c) Embedded Open Source Summit 2024 April 16-18, 2024 Seattle, Washington (US) https://events.linuxfoundation.org/embedded-open-source-summit/ https://eoss24.sched.com/event/1aBEx

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Enterprise Knowledge’s Urmi Majumder, Principal Data Architecture Consultant, and Fernando Aguilar Islas, Senior Data Science Consultant, presented "Driving Behavioral Change for Information Management through Data-Driven Green Strategy" on March 27, 2024 at Enterprise Data World (EDW) in Orlando, Florida. In this presentation, Urmi and Fernando discussed a case study describing how the information management division in a large supply chain organization drove user behavior change through awareness of the carbon footprint of their duplicated and near-duplicated content, identified via advanced data analytics. Check out their presentation to gain valuable perspectives on utilizing data-driven strategies to influence positive behavioral shifts and support sustainability initiatives within your organization. In this session, participants gained answers to the following questions: - What is a Green Information Management (IM) Strategy, and why should you have one? - How can Artificial Intelligence (AI) and Machine Learning (ML) support your Green IM Strategy through content deduplication? - How can an organization use insights into their data to influence employee behavior for IM? - How can you reap additional benefits from content reduction that go beyond Green IM?

Driving Behavioral Change for Information Management through Data-Driven Gree...

Driving Behavioral Change for Information Management through Data-Driven Gree...

Driving Behavioral Change for Information Management through Data-Driven Gree...

Enterprise Knowledge

Dernier (20)

How to convert PDF to text with Nanonets

How to convert PDF to text with Nanonets

How to convert PDF to text with Nanonets

Artificial Intelligence: Facts and Myths

Artificial Intelligence: Facts and Myths

Artificial Intelligence: Facts and Myths

The 7 Things I Know About Cyber Security After 25 Years | April 2024

The 7 Things I Know About Cyber Security After 25 Years | April 2024

The 7 Things I Know About Cyber Security After 25 Years | April 2024

Partners Life - Insurer Innovation Award 2024

Partners Life - Insurer Innovation Award 2024

Partners Life - Insurer Innovation Award 2024

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Data Cloud, More than a CDP by Matt Robison

Data Cloud, More than a CDP by Matt Robison

Data Cloud, More than a CDP by Matt Robison

Exploring the Future Potential of AI-Enabled Smartphone Processors

Exploring the Future Potential of AI-Enabled Smartphone Processors

Exploring the Future Potential of AI-Enabled Smartphone Processors

08448380779 Call Girls In Greater Kailash - I Women Seeking Men

08448380779 Call Girls In Greater Kailash - I Women Seeking Men

08448380779 Call Girls In Greater Kailash - I Women Seeking Men

Finology Group – Insurtech Innovation Award 2024

Finology Group – Insurtech Innovation Award 2024

Finology Group – Insurtech Innovation Award 2024

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

Boost PC performance: How more available memory can improve productivity

Boost PC performance: How more available memory can improve productivity

Boost PC performance: How more available memory can improve productivity

08448380779 Call Girls In Civil Lines Women Seeking Men

08448380779 Call Girls In Civil Lines Women Seeking Men

08448380779 Call Girls In Civil Lines Women Seeking Men

🐬 The future of MySQL is Postgres 🐘

🐬 The future of MySQL is Postgres 🐘

🐬 The future of MySQL is Postgres 🐘

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Driving Behavioral Change for Information Management through Data-Driven Gree...

Driving Behavioral Change for Information Management through Data-Driven Gree...

Driving Behavioral Change for Information Management through Data-Driven Gree...

Streak + Google Cloud Platform

1. Data @ Streak How we use the Google Cloud Platform Aleem Mawani, aleem@streak.com, @aloo

2. What is Streak?

3. What do we use Google Cloud Platform for? 1. Serve our app and run business logic AppEngine + Prediction API + Search API 2. Store and Analyze user data AppEngine Datastore + Memcache + Cloud Storage + BigQuery 3. Record and analyze every UI action BigQuery (Streaming + Bigquery Extension) 4. Record and analyze all server logs BigQuery (Streaming + Bigquery Extension) 5. Record and analyze all client logs BigQuery (Streaming + Bigquery Extension)

4.

5.

6. Streak on Google Cloud App Engine ... app data Datastore + Memcache

7. Streak on Google Cloud Logstore lo App Engine dat a g da ta log BigQuery ... app data Datastore + Memcache

8. Streak on Google Cloud Logstore lo App Engine dat a g da ta log BigQuery ... app data Datastore + Memcache app data Cloud Storage Prediction API

9. Streak on Google Cloud Logstore lo App Engine dat a g da ta log BigQuery ... app data Datastore + Memcache app data Cloud Storage ata pd ap App Engine Search API Prediction API

10. Streak on Google Cloud Logstore lo App Engine dat a g da ta log BigQuery Cloud Storage ata pd Translation API & Human Translators app data ap n Datastore + Memcache i18 ... app data App Engine Search API Prediction API

11. Streak on Google Cloud t ta lo g ta da da App Engine dat a ata nt d en log event d ata eve ev Logstore BigQuery Cloud Storage ata pd Translation API & Human Translators app data ap n Datastore + Memcache i18 ... app data App Engine Search API Prediction API

12. BigQuery Demo

13. Thanks! Like big data? Streak.com is hiring! jobs@streak.com

14. Summary Benefits ● Move fast and build lean! ● Google quality infrastructure for everyone ● Ask critical business questions Tradeoffs ● Need to move data incrementally ● Need to make your pipelines fault tolerant at scale Tips ● Mirror your data in multiple systems, storage is cheap! ● Build systems incrementally