Big Data for SQL Developers: Get Started for Free

•

0 likes•410 views

This presentation shows people with SQL knowledge how to get started in the Big Data world, from creating your own cluster, to getting hands on experience with Spark and Hadoop. Best of all, you can do all of these without spending dollar one.

Technology

BIG DATA FOR SQL DEVELOPERS:
GET STARTED (FOR FREE)
JULY 6, 2017

BIG DATA FOR SQL DEVELOPERS
I KNOW SQL, BUT…
1. How can I run a cluster without setting one
up at home, or paying for expensive cloud
services?
2. Where do I ﬁnd “big data” to analyze?
3. Do I need to learn a different programming
language?

BIG DATA FOR SQL DEVELOPERS
YOUR RDBMS - HOW WE COMMONLY VIEW IT
RDBMS
SELECT … FROM …

BIG DATA FOR SQL DEVELOPERS
YOUR RDBMS - A COLLECTION OF SYSTEMS
SELECT * FROM …
QUERY LANGUAGE INTERPRETER
QUERY PLANNER & OPTIMIZER
SECURITY
I/O
MEMORY CACHE
DATA STORAGE
DISASTER
RECOVERY
LOGGING
CONCURRENCY&TRANSACTIONALCONSISTENCY

BIG DATA FOR SQL DEVELOPERS
YOUR RDBMS - A COLLECTION OF SYSTEMS
SELECT … FROM …
OR
SQLCONTEXT.SQL(“
SELECT…”)
YARN
HDFS
CONSISTENCY?SECURITY?

BIG DATA FOR SQL DEVELOPERS
QUESTION #1 - HOW DO I GET MY OWN CLUSTER?
‣ Use IaaS
‣ AWS Free Tier
‣ Use Managed Services (AWS EMR, Azure
HDInsight)
‣ Can, but have to wait for them to contact you.
‣ Databricks Community Edition

BIG DATA FOR SQL DEVELOPERS
QUESTION #2 - WHERE CAN I FIND DATA?
‣ Census.gov
‣ The CIA world Factbook
‣ HealthData.gov
‣ World Health Organization
‣ AWS Public Datasets
‣ Facebook Graph API
‣ Google Public Data
‣ Databricks

YOU DON’T NEED
BIG DATA TO
LEARN BIG DATA.
- Mark Smith

BIG DATA FOR SQL DEVELOPERS
QUESTION #3 - DO I NEED TO LEARN ANOTHER LANGUAGE?
‣Yes, but you don’t have to be a software dev
‣ Python, Java, or Scala (my choice: Python)
‣ Good news: Your SQL can still help you!

BIG DATA FOR SQL DEVELOPERS
WHY SPARK?
‣Popular, vital
‣A framework for processing distributed datasets
‣Has a SQL Implementation

BIG DATA FOR SQL DEVELOPERS
YOUR NEXT STEPS
1. Sign up for Databricks Community Edition
2. Read and complete “A Gentle Introduction to
Apache Spark on Databricks”
3. Read and complete “Apache Spark on
Databricks for Data Engineers”
4. Read a book on the RDBMS you use most often.

BIG DATA FOR SQL DEVELOPERS
DEMO
https://community.cloud.databricks.com/?
o=8158027403376652#notebook/
3636183528035570/command/3636183528035585

DO YOU KNOW DATA, OR
DO YOU KNOW A FLAVOR
OF SQL?

BIG DATA FOR SQL DEVELOPERS
RESOURCES & CONTACT
Brent Lightsey 
http://ﬁrstlightanalytics.com 
brent@ﬁrstlightanalytics.com 
405-295-5502 
https://www.linkedin.com/in/brentlightsey/

Recently uploaded

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

💥 You’re lucky! We’ve found two different (lead) developers that are willing to share their valuable lessons learned about using UiPath Document Understanding! Based on recent implementations in appealing use cases at Partou and SPIE. Don’t expect fancy videos or slide decks, but real and practical experiences that will help you with your own implementations. 📕 Topics that will be addressed: • Training the ML-model by humans: do or don't? • Rule-based versus AI extractors • Tips for finding use cases • How to start 👨‍🏫👨‍💻 Speakers: o Dion Morskieft, RPA Product Owner @Partou o Jack Klein-Schiphorst, Automation Developer @Tacstone Technology

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

UiPathCommunity

Dubai, often portrayed as a shimmering oasis in the desert, faces its own set of challenges, including the occasional threat of flooding. Despite its reputation for opulence and modernity, the emirate is not immune to the forces of nature. In recent years, Dubai has experienced sporadic but significant floods, testing the resilience of its infrastructure and communities. Among the critical lifelines in this bustling metropolis is the Dubai International Airport, a bustling hub that connects the city to the world. This article explores the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Orbitshub

Following the popularity of "Cloud Revolution: Exploring the New Wave of Serverless Spatial Data," we're thrilled to announce this much-anticipated encore webinar. In this sequel, we'll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you're building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

Tracing the root cause of a performance issue requires a lot of patience, experience, and focus. It’s so hard that we sometimes attempt to guess by trying out tentative fixes, but that usually results in frustration, messy code, and a considerable waste of time and money. This talk explains how to correctly zoom in on a performance bottleneck using three levels of profiling: distributed tracing, metrics, and method profiling. After we learn to read the JVM profiler output as a flame graph, we explore a series of bottlenecks typical for backend systems, like connection/thread pool starvation, invisible aspects, blocking code, hot CPU methods, lock contention, and Virtual Thread pinning, and we learn to trace them even if they occur in library code you are not familiar with. Attend this talk and prepare for the performance issues that will eventually hit any successful system. About authorWith two decades of experience, Victor is a Java Champion working as a trainer for top companies in Europe. Five thousands developers in 120 companies attended his workshops, so he gets to debate every week the challenges that various projects struggle with. In return, Victor summarizes key points from these workshops in conference talks and online meetups for the European Software Crafters, the world’s largest developer community around architecture, refactoring, and testing. Discover how Victor can help you on victorrentea.ro : company training catalog, consultancy and YouTube playlists.

Finding Java's Hidden Performance Traps @ DevoxxUK 2024

Victor Rentea

DBX First Quarter 2024 Investor Presentation

Dropbox

Whatsapp Number Escorts Call girls 8617370543 Available 24x7 Mcleodganj Call Girls Service Offer Genuine VIP Model Escorts Call Girls in Your Budget. Mcleodganj Call Girls Service Provide Real Call Girls Number. Make Your Sexual Pleasure Memorable with Our Mcleodganj Call Girls at Affordable Price. Top VIP Escorts Call Girls, High Profile Independent Escorts Call Girls, Housewife Women Escorts Call Girl, College Girls Escorts Call Girls, Russian Escorts Call girls Service in Your Budget.

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Deepika Singh

Artificial Intelligence Chap.5 : Uncertainty

Khushali Kathiriya

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Zilliz

CNIC Information System with Pakdata Cf In Pakistan

danishmna97

[BuildWithAI] Introduction to Gemini.pdf

Sandro Moreira

ICT role in 21st century education and its challenges

rafiqahmad00786416

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

MadyBayot

Exploring Multimodal Embeddings with Milvus

Zilliz

Architecting Cloud Native Applications

WSO2

Discover the innovative features and strategic vision that keep WSO2 an industry leader. Explore the exciting 2024 roadmap of WSO2 API management, showcasing innovations, unified APIM/APK control plane, natural language API interaction, and cloud native agility. Discover how open source solutions, microservices architecture, and cloud native technologies unlock seamless API management in today's dynamic landscapes. Leave with a clear blueprint to revolutionize your API journey and achieve industry success!

WSO2's API Vision: Unifying Control, Empowering Developers

WSO2

The Good, the Bad and the Governed - Why is governance a dirty word? David O'Neill, Chief Operating Officer - APIContext Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

apidays

AWS Community Day CPH - Three problems of Terraform

Andrey Devyatkin

Dubai, known for its towering skyscrapers, luxurious lifestyle, and relentless pursuit of innovation, often finds itself in the global spotlight. However, amidst the glitz and glamour, the emirate faces its own set of challenges, including the occasional threat of flooding. In recent years, Dubai has experienced sporadic but significant floods, disrupting normalcy and posing unique challenges to its infrastructure. Among the critical nodes in this bustling metropolis is the Dubai International Airport, a vital hub connecting the world. This article delves into the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Orbitshub

Recently uploaded (20)

How to Troubleshoot Apps for the Modern Connected Worker

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Finding Java's Hidden Performance Traps @ DevoxxUK 2024

DBX First Quarter 2024 Investor Presentation

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Artificial Intelligence Chap.5 : Uncertainty

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

CNIC Information System with Pakdata Cf In Pakistan

[BuildWithAI] Introduction to Gemini.pdf

ICT role in 21st century education and its challenges

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

Exploring Multimodal Embeddings with Milvus

Architecting Cloud Native Applications

WSO2's API Vision: Unifying Control, Empowering Developers

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

AWS Community Day CPH - Three problems of Terraform

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Featured

How to Prepare For a Successful Job Search for 2024

Albert Qian

A report by thenetworkone and Kurio. The contributing experts and agencies are (in an alphabetical order): Sylwia Rytel, Social Media Supervisor, 180heartbeats + JUNG v MATT (PL), Sharlene Jenner, Vice President - Director of Engagement Strategy, Abelson Taylor (USA), Alex Casanovas, Digital Director, Atrevia (ES), Dora Beilin, Senior Social Strategist, Barrett Hoffher (USA), Min Seo, Campaign Director, Brand New Agency (KR), Deshé M. Gully, Associate Strategist, Day One Agency (USA), Francesca Trevisan, Strategist, Different (IT), Trevor Crossman, CX and Digital Transformation Director; Olivia Hussey, Strategic Planner; Simi Srinarula, Social Media Manager, The Hallway (AUS), James Hebbert, Managing Director, Hylink (CN / UK), Mundy Álvarez, Planning Director; Pedro Rojas, Social Media Manager; Pancho González, CCO, Inbrax (CH), Oana Oprea, Head of Digital Planning, Jam Session Agency (RO), Amy Bottrill, Social Account Director, Launch (UK), Gaby Arriaga, Founder, Leonardo1452 (MX), Shantesh S Row, Creative Director, Liwa (UAE), Rajesh Mehta, Chief Strategy Officer; Dhruv Gaur, Digital Planning Lead; Leonie Mergulhao, Account Supervisor - Social Media & PR, Medulla (IN), Aurelija Plioplytė, Head of Digital & Social, Not Perfect (LI), Daiana Khaidargaliyeva, Account Manager, Osaka Labs (UK / USA), Stefanie Söhnchen, Vice President Digital, PIABO Communications (DE), Elisabeth Winiartati, Managing Consultant, Head of Global Integrated Communications; Lydia Aprina, Account Manager, Integrated Marketing and Communications; Nita Prabowo, Account Manager, Integrated Marketing and Communications; Okhi, Web Developer, PNTR Group (ID), Kei Obusan, Insights Director; Daffi Ranandi, Insights Manager, Radarr (SG), Gautam Reghunath, Co-founder & CEO, Talented (IN), Donagh Humphreys, Head of Social and Digital Innovation, THINKHOUSE (IRE), Sarah Yim, Strategy Director, Zulu Alpha Kilo (CA).

Social Media Marketing Trends 2024 // The Global Indie Insights

Kurio // The Social Media Age(ncy)

The search marketing landscape is evolving rapidly with new technologies, and professionals, like you, rely on innovative paid search strategies to meet changing demands. It’s important that you’re ready to implement new strategies in 2024. Check this out and learn the top trends in paid search advertising that are expected to gain traction, so you can drive higher ROI more efficiently in 2024. You’ll learn: - The latest trends in AI and automation, and what this means for an evolving paid search ecosystem. - New developments in privacy and data regulation. - Emerging ad formats that are expected to make an impact next year. Watch Sreekant Lanka from iQuanti and Irina Klein from OneMain Financial as they dive into the future of paid search and explore the trends, strategies, and technologies that will shape the search marketing landscape. If you’re looking to assess your paid search strategy and design an industry-aligned plan for 2024, then this webinar is for you.

Trends In Paid Search: Navigating The Digital Landscape In 2024

Search Engine Journal

From their humble beginnings in 1984, TED has grown into the world’s most powerful amplifier for speakers and thought-leaders to share their ideas. They have over 2,400 filmed talks (not including the 30,000+ TEDx videos) freely available online, and have hosted over 17,500 events around the world. With over one billion views in a year, it’s no wonder that so many speakers are looking to TED for ideas on how to share their message more effectively. The article “5 Public-Speaking Tips TED Gives Its Speakers”, by Carmine Gallo for Forbes, gives speakers five practical ways to connect with their audience, and effectively share their ideas on stage. Whether you are gearing up to get on a TED stage yourself, or just want to master the skills that so many of their speakers possess, these tips and quotes from Chris Anderson, the TED Talks Curator, will encourage you to make the most impactful impression on your audience. See the full article and more summaries like this on SpeakerHub here: https://speakerhub.com/blog/5-presentation-tips-ted-gives-its-speakers See the original article on Forbes here: http://www.forbes.com/forbes/welcome/?toURL=http://www.forbes.com/sites/carminegallo/2016/05/06/5-public-speaking-tips-ted-gives-its-speakers/&refURL=&referrer=#5c07a8221d9b

5 Public speaking tips from TED - Visualized summary

SpeakerHub

Everyone is in agreement that ChatGPT (and other generative AI tools) will shape the future of work. Yet there is little consensus on exactly how, when, and to what extent this technology will change our world. Businesses that extract maximum value from ChatGPT will use it as a collaborative tool for everything from brainstorming to technical maintenance. For individuals, now is the time to pinpoint the skills the future professional will need to thrive in the AI age. Check out this presentation to understand what ChatGPT is, how it will shape the future of work, and how you can prepare to take advantage.

ChatGPT and the Future of Work - Clark Boyd

Clark Boyd

Getting into the tech field. what next

Tessa Mero

Google's Just Not That Into You: Understanding Core Updates & Search Intent

Lily Ray

How to have difficult conversations

Rajiv Jayarajah, MAppComm, ACC

Introduction to Data Science

Christy Abraham Joy

Time Management & Productivity - Best Practices

Vit Horky

The six step guide to practical project management If you think managing projects is too difficult, think again. We’ve stripped back project management processes to the basics – to make it quicker and easier, without sacrificing the vital ingredients for success. “If you’re looking for some real-world guidance, then The Six Step Guide to Practical Project Management will help.” Dr Andrew Makar, Tactical Project Management

The six step guide to practical project management

MindGenius

Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...

RachelPearson36

During this webinar, Anand Bagmar demonstrates how AI tools such as ChatGPT can be applied to various stages of the software development life cycle (SDLC) using an eCommerce application case study. Find the on-demand recording and more info at https://applitools.info/b59 Key takeaways: • Learn how to use ChatGPT to add AI power to your testing and test automation • Understand the limitations of the technology and where human expertise is crucial • Gain insight into different AI-based tools • Adopt AI-based tools to stay relevant and optimize work for developers and testers * ChatGPT and OpenAI belong to OpenAI, L.L.C.

Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...

Applitools

12 Ways to Increase Your Influence at Work

GetSmarter

ChatGPT webinar slides

Alireza Esmikhani

More than Just Lines on a Map: Best Practices for U.S Bike Routes

Project for Public Spaces & National Center for Biking and Walking

Has your project been caught in a storm of deadlines, clashing requirements, and the need to change course halfway through? If yes, then check out how the administration team navigated through all of this, relocating 160 people from 3 countries and opening 2 offices during the most turbulent time in the last 20 years. Belka Games’ Chief Administrative Officer, Katerina Rudko, will share universal approaches and life hacks that can help your project survive unstable periods when there seem to be too many tasks and a lack of time and people.

Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...

DevGAMM Conference

Barbie - Brand Strategy Presentation

Erica Santiago

According to the latest State of the American Manager report from Gallup, employees who have regular meetings with their managers are almost three times as likely to be engaged as those who don’t. These regular check-ins keep managers and employees in sync and aligned. Want to see better manager/employee relationships in your organisation? Then make an all-in commitment to 1:1 meetings. Not sure how? You’ve come to the right place. In this webinar with Jamie Resker, Founder and Practice Leader for Employee Performance Solutions (EPS), and Teala Wilson, Talent Management Consultant at Saba Software, you’ll get the inside track on how to hold effective 1:1 meetings, including tips for getting managers on board. • Go beyond discussing the status of everyday work to higher level topics, including recognition, performance, development, and career aspirations • Learn how to decide meeting frequency, what to cover, as well as roles and responsibilities of the manager and employee • Understand how managers can build trust and make it comfortable for employees to provide upward feedback • Unite your organisation with a unified approach to 1:1 meetings Join us for this 1-hour webinar to get practical tips for building better manager-employee relationships with intention and purpose. About the Speakers Jamie Resker - Founder and Practice Leader for Employee Performance Solutions (EPS) Jamie Resker, Practice Leader and Founder of Employee Performance Solutions, is a recognized innovator in performance management. She is the originator of the-the Performance Continuum Feedback Method® and Conversations to Optimize Employee Performance training program; tools and training that reshape communications between managers and employees to drive and align performance. Jamie is on the faculty for the Northeast Human Resources Association, is a contributor to Halogen Software's Talent Space Blog, and is an editorial advisory board member for HR Examiner. Teala Wilson - Senior Consultant, Strategic Services, Saba Software Teala is a Talent Management Consultant at Halogen Software, now a part of Saba Software. She has worked with teams on a national and global level supporting human resources in areas such as performance management, recruitment, employee benefit programs, training and talent development, workforce planning and internal communications. Teala also has a personal passion for visual arts and design. Want to learn more? Join us for an upcoming Product Tour! http://bit.ly/2yitfqu

Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well

Saba Software

This video by Simplilearn will explain to you Introduction to C Programming Language. Introduction to C Programming Language Tutorial For Beginners will explain to you the C language's history, C's importance, its features, real-world applications, and some of its advantages and disadvantages. 00:00 Introduction to C 1:42-History of C language Dennis Ritchie, a computer scientist, could identify the gaps and tap out the best features from both B and BCPL languages to invent a new hybrid. Hence, C was born in 1972 at Bell Laboratories. A remarkably simple and highly readable programming language resulted in groundbreaking advancements in the IT industry. 2:48-Importance and unraveling the powerful capabilities of C, The widespread use of C started to take over the IT industry. Unraveling the potential of C, the designers began to discover new possibilities that led them to focus on the big picture. 3:56-C's cutting-edge features The designers at Bell Laboratories ensured that their programming language solved the issues with B and BCPL and the ones they had foreseen. 6:35-The popular real-world applications of C -UNIX operating system -google file system -Mozilla -Graphical user interface 8:30-The advantages and disadvantages of C 10:34-The popular IT companies and their domains that employ C · MasterCard · IBM · Flipkart · Dell · Twitter · GitHub and twitch 11:09-First c program. 🔥 Explore our FREE courses with completion certificates: https://www.simplilearn.com/skillup-f... ✅Subscribe to our Channel to learn more about the top Technologies: https://bit.ly/2VT4WtH ⏩ Check out the C++ Programming training videos: https://www.youtube.com/playlist?list... #IntroductiontoCProgrammingLanguage #CLanguage #CProgramming #CProgram #CProgrammingLanguage #LearnCProgramming #HowToCodeInCForBeginners #CTutorialForBeginners #LearnCProgramming #Simplilearn Dennis Ritchie, a computer scientist, was able to identify the gaps and tap out the best features from both B and BCPL languages to invent a new hybrid. Hence, C was born in 1972 at Bell Laboratories. A remarkably simple and highly readable programming language resulted in groundbreaking advancements in the IT industry. ✅What is C++ Programming? C++ is an enhanced and extended version of C programming language, developed by Bjarne Stroustrup in 1979 as part of his Ph.D. project. Bjarne developed what he called ‘C with Classes’ (later renamed C++) because he felt limited by the existing programming languages that were not ideal for large scale projects. He used C to build what he wanted because C was already a general-purpose language that was efficient and fast in its operations. ✅C++ Career Prospects: With just C++ programming expertise, you will have excellent job opportunities, salaries, and career prospects. However, for a career based on programming languages such as Java and Python (which are in more demand than C++) or for careers based on front-end, back-end, and full-stack

Introduction to C Programming Language

Simplilearn

Featured (20)

How to Prepare For a Successful Job Search for 2024

Social Media Marketing Trends 2024 // The Global Indie Insights

Trends In Paid Search: Navigating The Digital Landscape In 2024

5 Public speaking tips from TED - Visualized summary

ChatGPT and the Future of Work - Clark Boyd

Getting into the tech field. what next

Google's Just Not That Into You: Understanding Core Updates & Search Intent

How to have difficult conversations

Introduction to Data Science

Time Management & Productivity - Best Practices

The six step guide to practical project management

Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...

Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...

12 Ways to Increase Your Influence at Work

ChatGPT webinar slides

More than Just Lines on a Map: Best Practices for U.S Bike Routes

Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...

Barbie - Brand Strategy Presentation

Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well

Introduction to C Programming Language

Big Data for SQL Developers: Get Started for Free

1. BIG DATA FOR SQL DEVELOPERS: GET STARTED (FOR FREE) JULY 6, 2017

2. BIG DATA FOR SQL DEVELOPERS I KNOW SQL, BUT… 1. How can I run a cluster without setting one up at home, or paying for expensive cloud services? 2. Where do I ﬁnd “big data” to analyze? 3. Do I need to learn a different programming language?

3. BIG DATA FOR SQL DEVELOPERS YOUR RDBMS - HOW WE COMMONLY VIEW IT RDBMS SELECT … FROM …

4. BIG DATA FOR SQL DEVELOPERS YOUR RDBMS - A COLLECTION OF SYSTEMS SELECT * FROM … QUERY LANGUAGE INTERPRETER QUERY PLANNER & OPTIMIZER SECURITY I/O MEMORY CACHE DATA STORAGE DISASTER RECOVERY LOGGING CONCURRENCY&TRANSACTIONALCONSISTENCY

5. BIG DATA FOR SQL DEVELOPERS YOUR RDBMS - A COLLECTION OF SYSTEMS SELECT … FROM … OR SQLCONTEXT.SQL(“ SELECT…”) YARN HDFS CONSISTENCY?SECURITY?

6. BIG DATA FOR SQL DEVELOPERS QUESTION #1 - HOW DO I GET MY OWN CLUSTER? ‣ Use IaaS ‣ AWS Free Tier ‣ Use Managed Services (AWS EMR, Azure HDInsight) ‣ Can, but have to wait for them to contact you. ‣ Databricks Community Edition

7. BIG DATA FOR SQL DEVELOPERS QUESTION #2 - WHERE CAN I FIND DATA? ‣ Census.gov ‣ The CIA world Factbook ‣ HealthData.gov ‣ World Health Organization ‣ AWS Public Datasets ‣ Facebook Graph API ‣ Google Public Data ‣ Databricks

8. YOU DON’T NEED BIG DATA TO LEARN BIG DATA. - Mark Smith

9. BIG DATA FOR SQL DEVELOPERS QUESTION #3 - DO I NEED TO LEARN ANOTHER LANGUAGE? ‣Yes, but you don’t have to be a software dev ‣ Python, Java, or Scala (my choice: Python) ‣ Good news: Your SQL can still help you!

10. BIG DATA FOR SQL DEVELOPERS WHY SPARK? ‣Popular, vital ‣A framework for processing distributed datasets ‣Has a SQL Implementation

11. BIG DATA FOR SQL DEVELOPERS WHY SPARK?

12. BIG DATA FOR SQL DEVELOPERS YOUR NEXT STEPS 1. Sign up for Databricks Community Edition 2. Read and complete “A Gentle Introduction to Apache Spark on Databricks” 3. Read and complete “Apache Spark on Databricks for Data Engineers” 4. Read a book on the RDBMS you use most often.

13. BIG DATA FOR SQL DEVELOPERS DEMO https://community.cloud.databricks.com/? o=8158027403376652#notebook/ 3636183528035570/command/3636183528035585

14. DO YOU KNOW DATA, OR DO YOU KNOW A FLAVOR OF SQL?

15. BIG DATA FOR SQL DEVELOPERS RESOURCES & CONTACT Brent Lightsey  http://ﬁrstlightanalytics.com  brent@ﬁrstlightanalytics.com  405-295-5502  https://www.linkedin.com/in/brentlightsey/

Big Data for SQL Developers: Get Started for Free

Recommended

Recommended

More Related Content

Recently uploaded

Recently uploaded (20)

Featured

Featured (20)

Big Data for SQL Developers: Get Started for Free