Data cloud lab version v.001.2020

1. 1
2
3
4
5
6
7
8
Data Sourc
Data source is the primary location from
where data comes. The data source can be a
database, a dataset, a spreadsheet or even
hard-coded data
Data Lake
A data lake is usually a single store
of all enterprise data
Data Pipeline
a pipeline, also known as a data
pipeline, is a set of data processing
elements connected in series
Data Store
A Data Store is a connection to a
store of data, whether the data is
stored in a database or in one or
more files
Data Warehouse
A data warehouse is a system that
pulls together data from many
different sources
Data Processing
Data processing is, generally, "the
collection and manipulation of items
of data to produce meaningful
information
Data Revenue
The statistic shows the revenue from
the global big data
Data Visulization
Data visualization is the graphical
representation of information and
data
Data Analysis Model
Linux O/S ,
Hadoop Big Data,
Hadoop File System(HDFS)
3 replication Datanode
Hive Database,
Data Warehouse
SELECT * FROM Customers;
SELECT Country FROM Customers;
SELECT * FROM Customers
WHERE Country='Mexico';
Web, App Cloud,
Database, Excel,
Notepad, etc. Data Set:
01.Healthcare: [Record–46935]
02.Weather-history:[Record–4573]
03.World Demography
04.Census Tracts 2010:[Record-21]
05.Animal_Services_Intake_Data
06.Average_Daily_Traffic_Counts
07.Acciental_Durg_Related_Death
08.Popular_Baby_Names:[Record
09.Sales_Tax_Rates:[Record-1911]
10.Restaurants:[Record-1328]
11.Acciental_Durg_Related_Death
12.Census Tracts 2010:[Record-216]
13.Employees_Salary:[Record–824]
14.Customer_transactional_spending
15.Customer_Order:[Record–1000]
16.Employees_Salary:-[Record–824]
JSON, Web Application File Format : {
"employee":{
"name":"John", "age":30, "city":"New York" }
}
Excel/CVS/Text File Format:
John,30,New York
Robert,25,DC
Text File/Sequence File
RC File/ORC File
AVRO File
Parquet/Binary File
Customer
Product
1M Data
ETL/ELT, sqoop import-all-tables
-Top 10 Revenue-
generating products
-Total revenue per product
- Top 10 Diseases
-Weather Analysis
Version: v.001.2020
Database
Power by Open Source Platform