Project preview presentation for ID2219.

1. Highly Available
NG Hadoop MapReduce
Arinto Murdopo
Mário Almeida
Umit Cavus
Strahinja Lazetic
Supervisor: Jim Dowling

2. Aim
High Availability in YARN

3. Aim
HA with ZooKeeper

4. Aim
HA with NDB

5. Outcome
● Highly Available implementation of YARN
○ with Zookeeper before the hadoop team
○ with NDB MySql-Cluster before Jim kicks us out
● (Secondary goal) make RM stateless so we
can have more than one running at each
moment.
○ So we can have failover when there is failure in a
RM
● (Eventual goal) Get a job!

6. Expected graphs (fictional values)

7. Expected graphs (fictional values)