SlideShare une entreprise Scribd logo
1  sur  99
Big Data Mind Map
Big Data Landscape Mind Map
How BIGDATA is utilising in the life
Big Data is still a big problem for many companies.
● How do you collect, process and distribute it?
● How do you analyze it?
Hadoop promises an answer to these questions.
Hadoop
Apache Hadoop® is an open source Java based framework for distributed storage and
processing of large sets of data on commodity hardware. Hadoop enables businesses to quickly
gain insight from massive amounts of structured and unstructured data.
Hadoop vs SAP HANA
Hadoop vs DWH
Business intelligence (BI) is a technology-driven process for analyzing data and presenting actionable
information to help corporate executives, business managers and other end users make more informed
business decisions.
Common BigData Deployment Architecture
Hadoop Batch Processing:
Hadoop Live stream Processing:
Hadoop
What is Spark?
● Spark is new technology that sits on top of Hadoop Distributed File System (HDFS)
● It is characterized as “a fast and general engine for large-scale data processing.”
● Spark has three key features:
1. For iterative analysis like logistic regression, Random Forests, or other advanced algorithms,
Spark has demonstrated 100X increase in speed that scales to hundreds of millions of rows.
2. Spark has native support for the latest and greatest programming languages Java, Scala, and of
course Python.
3. Spark has generality or platform compatibility in both directions meaning it integrates nicely with
SQL engines (Shark), Machine Learning (MLlib), and streaming (Spark Streaming) without
requiring new software installed on the cluster using Hadoop’s new YARN cluster manager.
Data Analysis Flow with Spark
Spark Or Hadoop--
Which Is The Best Big Data Framework?
● Hadoop, for many years, was the leading open source Big Data framework
● Spark has become the more popular of the Apache Software Foundation tool from 2014.
● Spark does not include its own system for organizing files in a distributed way (the file system)
● so it requires one provided by a third-party. For this reason many Big Data projects involve installing
Spark on top of Hadoop
● Spark’s advanced analytics applications can make use of data stored using the Hadoop Distributed File
System (HDFS).
● Many of the big vendors (i.e Cloudera) now offer Spark as well as Hadoop, so will be in a good position
to advise companies on which they will find most suitable, on a job-by-job basis.
Top 6 Hadoop Vendors providing Big Data Solutions in Open Data Platform
WHAT IS BIG DATA MARKET
Big Data Is Big Market & Big Business - $50 Billion Market
by 2017
Big Data not only refers to the data itself but also a set of
technologies that capture, store, manage and analyze large
and variable collections of data to solve complex problems.
BIG DATA OPPORTUNITY
How companies are succeeding
by using BIGDATA Analytics
What is BIGDATA needs
to CUSTOMER
QA IN BIG
DATA
7 Ways Big Data Training Can
Change Your Organization
1.Information Technology: Improving productivity with Big Data Training
2.Product Development: Rethinking innovation across all stages of R&D
3.Finance: Training employees on big data platforms to handle financial modelling
4.Human Resources: Redefining HR employee capabilities
5.Supply Chain & Logistics: Training delivery team with big data platforms
6.Operations, Support & Customer service: Employee training on big data at every customer interaction
7.Marketing: Training employees on a systematic marketing approach with big data
RESOURCE REQUIRED IN BIG DATA
Krisshhna
dkrishna.hadoop@gmail.com

Contenu connexe

Tendances (20)

Big Data
Big DataBig Data
Big Data
 
Thilga
ThilgaThilga
Thilga
 
Overview of Bigdata Analytics
Overview of Bigdata Analytics Overview of Bigdata Analytics
Overview of Bigdata Analytics
 
What is Big Data ?
What is Big Data ?What is Big Data ?
What is Big Data ?
 
Big data tools
Big data toolsBig data tools
Big data tools
 
Bigdata Analytics using Hadoop
Bigdata Analytics using HadoopBigdata Analytics using Hadoop
Bigdata Analytics using Hadoop
 
Introduction to BigData
Introduction to BigData Introduction to BigData
Introduction to BigData
 
Big data
Big dataBig data
Big data
 
Big Data & Data Science
Big Data & Data ScienceBig Data & Data Science
Big Data & Data Science
 
Introduction to Big Data
Introduction to Big DataIntroduction to Big Data
Introduction to Big Data
 
Bigdata " new level"
Bigdata " new level"Bigdata " new level"
Bigdata " new level"
 
Big data hadoop
Big data hadoopBig data hadoop
Big data hadoop
 
Big data analytics, research report
Big data analytics, research reportBig data analytics, research report
Big data analytics, research report
 
Introduction to Big Data & Hadoop
Introduction to Big Data & Hadoop Introduction to Big Data & Hadoop
Introduction to Big Data & Hadoop
 
Big Data Projects Research Ideas
Big Data Projects Research IdeasBig Data Projects Research Ideas
Big Data Projects Research Ideas
 
Big Data Hadoop
Big Data HadoopBig Data Hadoop
Big Data Hadoop
 
Presentation About Big Data (DBMS)
Presentation About Big Data (DBMS)Presentation About Big Data (DBMS)
Presentation About Big Data (DBMS)
 
Bigdata
BigdataBigdata
Bigdata
 
Big data
Big dataBig data
Big data
 
Big data by Mithlesh sadh
Big data by Mithlesh sadhBig data by Mithlesh sadh
Big data by Mithlesh sadh
 

En vedette

BigQuery for the Big Data win
BigQuery for the Big Data winBigQuery for the Big Data win
BigQuery for the Big Data winKen Taylor
 
Chapter 14 replication
Chapter 14 replicationChapter 14 replication
Chapter 14 replicationAbDul ThaYyal
 
SQL, NoSQL, BigData in Data Architecture
SQL, NoSQL, BigData in Data ArchitectureSQL, NoSQL, BigData in Data Architecture
SQL, NoSQL, BigData in Data ArchitectureVenu Anuganti
 
Storage Area Network (San)
Storage Area Network (San)Storage Area Network (San)
Storage Area Network (San)sankcomp
 
Uce filosofia janeth andrade
Uce filosofia janeth andradeUce filosofia janeth andrade
Uce filosofia janeth andradebruj5
 
REGIONE TOSCANA - Rapporto partecipazione 2009
REGIONE TOSCANA - Rapporto partecipazione 2009REGIONE TOSCANA - Rapporto partecipazione 2009
REGIONE TOSCANA - Rapporto partecipazione 2009BTO Educational
 
How to integrate planning and budgeting? Jaehyuk Choi, OECD Secretariat
How to integrate planning and budgeting? Jaehyuk Choi, OECD SecretariatHow to integrate planning and budgeting? Jaehyuk Choi, OECD Secretariat
How to integrate planning and budgeting? Jaehyuk Choi, OECD SecretariatOECD Governance
 
Isha Arogya Information
Isha Arogya InformationIsha Arogya Information
Isha Arogya InformationIsha Outreach
 
Conversion of Seawater and Carbon Dioxide into Biofuel/Food and Sweet Water, ...
Conversion of Seawater and Carbon Dioxide into Biofuel/Food and Sweet Water, ...Conversion of Seawater and Carbon Dioxide into Biofuel/Food and Sweet Water, ...
Conversion of Seawater and Carbon Dioxide into Biofuel/Food and Sweet Water, ...Private Consultants
 
RAPPORTO 2009 - Toscana, la società dell’informazione e della conoscenza
RAPPORTO 2009 - Toscana, la società dell’informazione e della conoscenzaRAPPORTO 2009 - Toscana, la società dell’informazione e della conoscenza
RAPPORTO 2009 - Toscana, la società dell’informazione e della conoscenzaBTO Educational
 
From Design to Delivery
From Design to DeliveryFrom Design to Delivery
From Design to DeliveryJeff Cortez
 
Search Intelligence - Social Media e Search Marketing - Proxxima 2011
Search Intelligence - Social Media e Search Marketing - Proxxima 2011Search Intelligence - Social Media e Search Marketing - Proxxima 2011
Search Intelligence - Social Media e Search Marketing - Proxxima 2011Leonardo Naressi
 
Informações do Bairro do Rio Jaguari
Informações do Bairro do Rio JaguariInformações do Bairro do Rio Jaguari
Informações do Bairro do Rio JaguariRogerio Catanese
 
Mf0012 taxation management
Mf0012   taxation managementMf0012   taxation management
Mf0012 taxation managementStudy Stuff
 
Liberalismo 3.0: o terceiro ciclo de descentralização da humanidade
Liberalismo 3.0:  o terceiro ciclo de descentralização da humanidadeLiberalismo 3.0:  o terceiro ciclo de descentralização da humanidade
Liberalismo 3.0: o terceiro ciclo de descentralização da humanidadeCarlos Nepomuceno (Nepô)
 
Heal ohio conference-poster
Heal ohio conference-posterHeal ohio conference-poster
Heal ohio conference-posterSudeer K
 

En vedette (20)

BigQuery for the Big Data win
BigQuery for the Big Data winBigQuery for the Big Data win
BigQuery for the Big Data win
 
Storage area network (san)
Storage area network (san) Storage area network (san)
Storage area network (san)
 
Chapter 14 replication
Chapter 14 replicationChapter 14 replication
Chapter 14 replication
 
SQL, NoSQL, BigData in Data Architecture
SQL, NoSQL, BigData in Data ArchitectureSQL, NoSQL, BigData in Data Architecture
SQL, NoSQL, BigData in Data Architecture
 
Storage Area Network (San)
Storage Area Network (San)Storage Area Network (San)
Storage Area Network (San)
 
Uce filosofia janeth andrade
Uce filosofia janeth andradeUce filosofia janeth andrade
Uce filosofia janeth andrade
 
REGIONE TOSCANA - Rapporto partecipazione 2009
REGIONE TOSCANA - Rapporto partecipazione 2009REGIONE TOSCANA - Rapporto partecipazione 2009
REGIONE TOSCANA - Rapporto partecipazione 2009
 
2partedesfile
2partedesfile2partedesfile
2partedesfile
 
How to integrate planning and budgeting? Jaehyuk Choi, OECD Secretariat
How to integrate planning and budgeting? Jaehyuk Choi, OECD SecretariatHow to integrate planning and budgeting? Jaehyuk Choi, OECD Secretariat
How to integrate planning and budgeting? Jaehyuk Choi, OECD Secretariat
 
Isha Arogya Information
Isha Arogya InformationIsha Arogya Information
Isha Arogya Information
 
Conversion of Seawater and Carbon Dioxide into Biofuel/Food and Sweet Water, ...
Conversion of Seawater and Carbon Dioxide into Biofuel/Food and Sweet Water, ...Conversion of Seawater and Carbon Dioxide into Biofuel/Food and Sweet Water, ...
Conversion of Seawater and Carbon Dioxide into Biofuel/Food and Sweet Water, ...
 
RAPPORTO 2009 - Toscana, la società dell’informazione e della conoscenza
RAPPORTO 2009 - Toscana, la società dell’informazione e della conoscenzaRAPPORTO 2009 - Toscana, la società dell’informazione e della conoscenza
RAPPORTO 2009 - Toscana, la società dell’informazione e della conoscenza
 
Ajuda ao apocalipse
Ajuda ao apocalipseAjuda ao apocalipse
Ajuda ao apocalipse
 
From Design to Delivery
From Design to DeliveryFrom Design to Delivery
From Design to Delivery
 
Search Intelligence - Social Media e Search Marketing - Proxxima 2011
Search Intelligence - Social Media e Search Marketing - Proxxima 2011Search Intelligence - Social Media e Search Marketing - Proxxima 2011
Search Intelligence - Social Media e Search Marketing - Proxxima 2011
 
Informações do Bairro do Rio Jaguari
Informações do Bairro do Rio JaguariInformações do Bairro do Rio Jaguari
Informações do Bairro do Rio Jaguari
 
Ficha94
Ficha94Ficha94
Ficha94
 
Mf0012 taxation management
Mf0012   taxation managementMf0012   taxation management
Mf0012 taxation management
 
Liberalismo 3.0: o terceiro ciclo de descentralização da humanidade
Liberalismo 3.0:  o terceiro ciclo de descentralização da humanidadeLiberalismo 3.0:  o terceiro ciclo de descentralização da humanidade
Liberalismo 3.0: o terceiro ciclo de descentralização da humanidade
 
Heal ohio conference-poster
Heal ohio conference-posterHeal ohio conference-poster
Heal ohio conference-poster
 

Similaire à View on big data technologies

Learn About Big Data and Hadoop The Most Significant Resource
Learn About Big Data and Hadoop The Most Significant ResourceLearn About Big Data and Hadoop The Most Significant Resource
Learn About Big Data and Hadoop The Most Significant ResourceAssignment Help
 
Hadoop data-lake-white-paper
Hadoop data-lake-white-paperHadoop data-lake-white-paper
Hadoop data-lake-white-paperSupratim Ray
 
Modern data warehouse
Modern data warehouseModern data warehouse
Modern data warehouseStephen Alex
 
Modern data warehouse
Modern data warehouseModern data warehouse
Modern data warehouseStephen Alex
 
Rajesh Angadi Brochure
Rajesh Angadi Brochure Rajesh Angadi Brochure
Rajesh Angadi Brochure Rajesh Angadi
 
Introduction-to-Big-Data-and-Hadoop.pptx
Introduction-to-Big-Data-and-Hadoop.pptxIntroduction-to-Big-Data-and-Hadoop.pptx
Introduction-to-Big-Data-and-Hadoop.pptxPratimakumari213460
 
The Forrester Wave - Big Data Hadoop
The Forrester Wave - Big Data HadoopThe Forrester Wave - Big Data Hadoop
The Forrester Wave - Big Data HadoopIBM Software India
 
Big Data Tools: A Deep Dive into Essential Tools
Big Data Tools: A Deep Dive into Essential ToolsBig Data Tools: A Deep Dive into Essential Tools
Big Data Tools: A Deep Dive into Essential ToolsFredReynolds2
 
Leveraging SAP HANA with Apache Hadoop and SAP Analytics
Leveraging SAP HANA with Apache Hadoop and SAP AnalyticsLeveraging SAP HANA with Apache Hadoop and SAP Analytics
Leveraging SAP HANA with Apache Hadoop and SAP AnalyticsMethod360
 
Hadoop training kit from lcc infotech
Hadoop   training kit from lcc infotechHadoop   training kit from lcc infotech
Hadoop training kit from lcc infotechlccinfotech
 
Big data and apache hadoop adoption
Big data and apache hadoop adoptionBig data and apache hadoop adoption
Big data and apache hadoop adoptionfaizrashid1995
 
Comparison among rdbms, hadoop and spark
Comparison among rdbms, hadoop and sparkComparison among rdbms, hadoop and spark
Comparison among rdbms, hadoop and sparkAgnihotriGhosh2
 
Big Data Hadoop Technology
Big Data Hadoop TechnologyBig Data Hadoop Technology
Big Data Hadoop TechnologyRahul Sharma
 
Hadoop and Big Data Analytics | Sysfore
Hadoop and Big Data Analytics | SysforeHadoop and Big Data Analytics | Sysfore
Hadoop and Big Data Analytics | SysforeSysfore Technologies
 
Introduction to Apache hadoop
Introduction to Apache hadoopIntroduction to Apache hadoop
Introduction to Apache hadoopOmar Jaber
 
The Big Picture on Big Data and Cognos
The Big Picture on Big Data and CognosThe Big Picture on Big Data and Cognos
The Big Picture on Big Data and CognosSenturus
 

Similaire à View on big data technologies (20)

finap ppt conference.pptx
finap ppt conference.pptxfinap ppt conference.pptx
finap ppt conference.pptx
 
Learn About Big Data and Hadoop The Most Significant Resource
Learn About Big Data and Hadoop The Most Significant ResourceLearn About Big Data and Hadoop The Most Significant Resource
Learn About Big Data and Hadoop The Most Significant Resource
 
Hadoop data-lake-white-paper
Hadoop data-lake-white-paperHadoop data-lake-white-paper
Hadoop data-lake-white-paper
 
Modern data warehouse
Modern data warehouseModern data warehouse
Modern data warehouse
 
Modern data warehouse
Modern data warehouseModern data warehouse
Modern data warehouse
 
Rajesh Angadi Brochure
Rajesh Angadi Brochure Rajesh Angadi Brochure
Rajesh Angadi Brochure
 
Introduction-to-Big-Data-and-Hadoop.pptx
Introduction-to-Big-Data-and-Hadoop.pptxIntroduction-to-Big-Data-and-Hadoop.pptx
Introduction-to-Big-Data-and-Hadoop.pptx
 
Hadoop in a Nutshell
Hadoop in a NutshellHadoop in a Nutshell
Hadoop in a Nutshell
 
The Forrester Wave - Big Data Hadoop
The Forrester Wave - Big Data HadoopThe Forrester Wave - Big Data Hadoop
The Forrester Wave - Big Data Hadoop
 
Big Data Tools: A Deep Dive into Essential Tools
Big Data Tools: A Deep Dive into Essential ToolsBig Data Tools: A Deep Dive into Essential Tools
Big Data Tools: A Deep Dive into Essential Tools
 
Leveraging SAP HANA with Apache Hadoop and SAP Analytics
Leveraging SAP HANA with Apache Hadoop and SAP AnalyticsLeveraging SAP HANA with Apache Hadoop and SAP Analytics
Leveraging SAP HANA with Apache Hadoop and SAP Analytics
 
Hadoop training kit from lcc infotech
Hadoop   training kit from lcc infotechHadoop   training kit from lcc infotech
Hadoop training kit from lcc infotech
 
Big data and apache hadoop adoption
Big data and apache hadoop adoptionBig data and apache hadoop adoption
Big data and apache hadoop adoption
 
Comparison among rdbms, hadoop and spark
Comparison among rdbms, hadoop and sparkComparison among rdbms, hadoop and spark
Comparison among rdbms, hadoop and spark
 
Hadoop Business Cases
Hadoop Business CasesHadoop Business Cases
Hadoop Business Cases
 
Big Data Hadoop Technology
Big Data Hadoop TechnologyBig Data Hadoop Technology
Big Data Hadoop Technology
 
Big Data
Big DataBig Data
Big Data
 
Hadoop and Big Data Analytics | Sysfore
Hadoop and Big Data Analytics | SysforeHadoop and Big Data Analytics | Sysfore
Hadoop and Big Data Analytics | Sysfore
 
Introduction to Apache hadoop
Introduction to Apache hadoopIntroduction to Apache hadoop
Introduction to Apache hadoop
 
The Big Picture on Big Data and Cognos
The Big Picture on Big Data and CognosThe Big Picture on Big Data and Cognos
The Big Picture on Big Data and Cognos
 

Dernier

Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embeddingZilliz
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESmohitsingh558521
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 

Dernier (20)

Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embedding
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 

View on big data technologies

  • 1.
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.
  • 21.
  • 22.
  • 23.
  • 24.
  • 26. Big Data Landscape Mind Map
  • 27.
  • 28. How BIGDATA is utilising in the life
  • 29.
  • 30.
  • 31. Big Data is still a big problem for many companies. ● How do you collect, process and distribute it? ● How do you analyze it? Hadoop promises an answer to these questions.
  • 32. Hadoop Apache Hadoop® is an open source Java based framework for distributed storage and processing of large sets of data on commodity hardware. Hadoop enables businesses to quickly gain insight from massive amounts of structured and unstructured data.
  • 33.
  • 34.
  • 35.
  • 36.
  • 37.
  • 38.
  • 39.
  • 40.
  • 41.
  • 42.
  • 45. Business intelligence (BI) is a technology-driven process for analyzing data and presenting actionable information to help corporate executives, business managers and other end users make more informed business decisions.
  • 47. Hadoop Batch Processing: Hadoop Live stream Processing: Hadoop
  • 48.
  • 49.
  • 50.
  • 51.
  • 52.
  • 53. What is Spark? ● Spark is new technology that sits on top of Hadoop Distributed File System (HDFS) ● It is characterized as “a fast and general engine for large-scale data processing.” ● Spark has three key features: 1. For iterative analysis like logistic regression, Random Forests, or other advanced algorithms, Spark has demonstrated 100X increase in speed that scales to hundreds of millions of rows. 2. Spark has native support for the latest and greatest programming languages Java, Scala, and of course Python. 3. Spark has generality or platform compatibility in both directions meaning it integrates nicely with SQL engines (Shark), Machine Learning (MLlib), and streaming (Spark Streaming) without requiring new software installed on the cluster using Hadoop’s new YARN cluster manager.
  • 54. Data Analysis Flow with Spark
  • 55.
  • 56.
  • 57.
  • 58.
  • 59.
  • 60.
  • 61.
  • 62.
  • 63.
  • 64. Spark Or Hadoop-- Which Is The Best Big Data Framework? ● Hadoop, for many years, was the leading open source Big Data framework ● Spark has become the more popular of the Apache Software Foundation tool from 2014. ● Spark does not include its own system for organizing files in a distributed way (the file system) ● so it requires one provided by a third-party. For this reason many Big Data projects involve installing Spark on top of Hadoop ● Spark’s advanced analytics applications can make use of data stored using the Hadoop Distributed File System (HDFS). ● Many of the big vendors (i.e Cloudera) now offer Spark as well as Hadoop, so will be in a good position to advise companies on which they will find most suitable, on a job-by-job basis.
  • 65.
  • 66.
  • 67. Top 6 Hadoop Vendors providing Big Data Solutions in Open Data Platform
  • 68. WHAT IS BIG DATA MARKET
  • 69. Big Data Is Big Market & Big Business - $50 Billion Market by 2017 Big Data not only refers to the data itself but also a set of technologies that capture, store, manage and analyze large and variable collections of data to solve complex problems.
  • 70.
  • 71.
  • 72.
  • 73.
  • 74.
  • 75.
  • 76.
  • 77.
  • 79.
  • 80.
  • 81. How companies are succeeding by using BIGDATA Analytics
  • 82.
  • 83.
  • 84.
  • 85.
  • 86.
  • 87. What is BIGDATA needs to CUSTOMER
  • 88.
  • 89.
  • 90.
  • 91.
  • 93.
  • 94.
  • 95. 7 Ways Big Data Training Can Change Your Organization
  • 96. 1.Information Technology: Improving productivity with Big Data Training 2.Product Development: Rethinking innovation across all stages of R&D 3.Finance: Training employees on big data platforms to handle financial modelling 4.Human Resources: Redefining HR employee capabilities 5.Supply Chain & Logistics: Training delivery team with big data platforms 6.Operations, Support & Customer service: Employee training on big data at every customer interaction 7.Marketing: Training employees on a systematic marketing approach with big data
  • 98.