Hadoopの紹介

Introduction to Hadoop Satoshi Yamada 2008/11/5

内容 ,[object Object],[object Object]

謝辞 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

outline ,[object Object],[object Object],[object Object],[object Object],[object Object]

Hadoop とは ,[object Object],[object Object]

Hadoop の開発 ,[object Object],[object Object]

Hadoop の使用状況 ,[object Object],[object Object],[object Object]

Yahoo! における使用状況 ( おそらく Hadoop を使用する最大規模のアプリケーション ) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

ちなみに・・・ Google のプラットフォームの状況 http://www.techcrunch.com/2008/01/09/google-processing-20000-terabytes-a-day-and-growing/

Hadoop の特徴的な機能 ,[object Object],[object Object],[object Object],[object Object],[object Object]

Hadoop Core ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hadoop Core ,[object Object],[object Object],[object Object],[object Object]

Hadoop Core ,[object Object],公式サイトより

Hadoop Distributed File System ,[object Object],[object Object],[object Object],[object Object]

HDFS が想定する問題とゴールその１ ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

HDFS が想定する問題とゴールその２ ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

HDFS が想定する問題とゴールその 3 ,[object Object],[object Object]

HDFS が想定する問題とゴールその 4 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

データ構造 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Google での MapReduce 利用例 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],・・・ etc

Hadoop での MapReduce ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

MapReduce 実行におけるマスタ／スレーブ ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

MapReduce のインタフェース ,[object Object],[object Object],[object Object],[object Object]

実行例 wordcount プログラム ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Mapper ,[object Object],[object Object],[object Object],[object Object]

Reducer ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hadoop に関連するその他のモジュール

hBase ,[object Object],[object Object],http://codezine.jp/article/detail/2448?p=1

Pig ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

ZooKeeper ,[object Object],[object Object]

How to use Hadoop ,[object Object],[object Object],[object Object],[object Object]

Requirement ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hadoop における実行モード ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

セットアップ ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hadoop StartUp ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

これまでの失敗例 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hadoop 使用時に注意すべき点 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hadoopの紹介

Recommandé

Recommandé

Contenu connexe

Tendances

Tendances (19)

En vedette

En vedette (20)

Similaire à Hadoopの紹介

Similaire à Hadoopの紹介 (20)

Dernier

Dernier (9)

Hadoopの紹介