Hadoop Architecture

Hadoop architecture An overview - Hari Shankar Sreekumar

Ideas ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What is Hadoop? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hadoop Distributed File System ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

HDFS Blocks ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Namenode and Datanodes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Datanodes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Secondary namenode/Checkpoint node ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Image: Hadoop, The definitive Guide (Tom White)

Replication and rack-awareness ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Reading from HDFS Image: Hadoop, The definitive Guide (Tom White) Failure=>Move to next 'closest' node with the block. Direct connection between client and datanode

Writing to HDFS ,[object Object],[object Object],Image: Hadoop, The definitive Guide (Tom White)

Hadoop Common ,[object Object],[object Object],[object Object],[object Object]

[object Object],[object Object],[object Object],[object Object],[object Object],Data Integrity

Compression utilities ,[object Object],[object Object],Ref: Hadoop, The definitive Guide (Tom White) Splittable LZO is available separately and is a good trade-off between compression speed and compressed size.

Serialization utilities ,[object Object],[object Object],[object Object]

MapReduce Framework ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

References ,[object Object],[object Object],[object Object]

Hadoop Architecture

Recommandé

Recommandé

Contenu connexe

Tendances

Tendances (20)

Similaire à Hadoop Architecture

Similaire à Hadoop Architecture (20)

Dernier

Dernier (20)

Hadoop Architecture