1. Installation
7/6/2012
© 2012 MapR Technologies Installation 1

2. Installation
Agenda
• Installation Overview
• Installation Methods
• Installation Details
• High Availability Considerations
• LAB: Installation
© 2012 MapR Technologies Installation 2

3. Installation
Objectives
At the end of this module you will be able to:
• Describe the steps involved in MapR installation
• Install a cluster using the maprinstall script
• Install MapR on a single node manually and with the maprinstall script
• Install MapR Metrics
• Explain what is involved in setting up HA for MapR
© 2012 MapR Technologies Installation 3

4. Installation Overview
© 2012 MapR Technologies Installation 4

5. Installation Overview
 What needs to happen to install MapR on each node ?
– Add MapR repository
– Install MapR services and packages from repository
– Configure the node (configure.sh)
– Format disks (disksetup)
– Install and configure MapR Metrics (optional)
– Start the cluster
– Additional configuration steps after install
• Set up HA
• Set up node topology (covered in Configuration module)
© 2012 MapR Technologies Installation 5

6. Installation Methods
© 2012 MapR Technologies Installation 6

7. Installation Methods
 Cluster installation
– Bring up an entire cluster with a script from one node
• Download the maprinstall script and move to /opt/install-mapr
• Run/opt/install-mapr/maprinstall –R <roles_file>
– Performs node validation (OS partition, ports, memory, swap space, etc.)
– Assumes ability to SSH from node running script to other nodes
– Provide a roles file with comma-delimited lists of:
» Nodes
» Packages
» Disks
10.10.100.2 mapr-fileserver,mapr-tasktracker /dev/sdb
10.10.100.3 mapr-fileserver,mapr-tasktracker /dev/sdb
10.10.100.1 mapr-cldb,mapr-zookeeper,mapr-jobtracker,mapr-
webserver,mapr-fileserver,mapr-tasktracker /dev/sdb
© 2012 MapR Technologies Installation 7

8. Installation Methods
 Individual node installation
– Scripted
• Download the maprinstall script and move to /opt/install-mapr
• Run/opt/install-mapr/maprinstall
– Assumes you can provide mandatory data (package list, CLDB, Zookeeper)
– Performs node validation (OS partition, ports, memory, swap space, etc.)
– Executes all steps below from one script
– Manual
• Add MapR repository
• Install MapR services (apt-get, yum, etc.)
• configure.sh
• disksetup
• Bring up the cluster
© 2012 MapR Technologies Installation 8

9. Installation Details
© 2012 MapR Technologies Installation 9

10. MapR Repository
 From MapR repositories
– apt-get or yum
 From local repositories
– Download .tar.gz
– Set up repository
– apt-get or yum
 From local packages
– Use dpkg or rpm
– Must resolve dependencies manually
© 2012 MapR Technologies Installation 10

11. Configuration Script
 configure.sh
– Run on each node
– Sets up mapr-clusters.conf
– Writes ZK node IPs several places (mapr-cldb.conf is one)
– Registers node with ZooKeeper and CLDB
© 2012 MapR Technologies Installation 11

12. Choosing Disks for MapR
 MapR formats and uses disks for MapR-FS
– Should use physical drives/partitions
 Disk ready for MapR?
– mount: partition in use?
– df: partition in use?
– Entry in /etc/fstab?
– Not accessible to mkfs? mkfs fails?
 If any above are true, disk is not ready
© 2012 MapR Technologies Installation 12

13. Disk Setup Script
 disksetup
– Takes input from a text file listing usable disks. E.g.
/dev/sdb
/dev/sdc1 /dev/sdc2 /dev/sdc4
/dev/sdd
– Adds disks to disktab
– Use –F option to force formatting
– Creates storage pools (-w option specifies stripe width)
– Run after configure.sh
© 2012 MapR Technologies Installation 13

14. Installing MapR Metrics
 Prerequisites
– MySQL server (on a node or separate machine)
– EPEL repository
– M5 license for all features (M3: no charts or histograms)
 Installation procedure:
– Install MapR Metrics package on all JobTracker and Webserver nodes
• e.g. apt-get install mapr-metrics
– MCS: System Settings > Metrics
• Enter <hostname/IP>:<port> of MySQL server
• Enter MySQL credentials
– Source /opt/mapr/bin/setup.sql at mysql> prompt on a node
where MapR Metrics is installed
© 2012 MapR Technologies Installation 14

15. Starting the Cluster
 Bring up ZooKeeper on ZooKeeper nodes
 Bring up Warden
– Wait for services to start (use jps to see)
 Set up administrative user
 Log onto MapR Control System
 Add license
© 2012 MapR Technologies Installation 15

16. High Availability
Considerations
© 2012 MapR Technologies Installation 16

17. High Availability (HA)
 CLDB
 JobTracker
 NFS
© 2012 MapR Technologies Installation 17

18. High Availability CLDB
 Warm standby
– One Primary CLDB active at a time
– Secondary CLDB supports reads
 Configure multiple CLDBs
– Up to 6
 Install across physical topology
 Can isolate from all other services
 Can also isolate CLDB volume on its own topology
 Don’t run active JobTracker on primary CLDB node
© 2012 MapR Technologies Installation 18

19. High Availability JobTracker
 Cold standby
– One active JobTracker at a time
– Stateful failover preserves running jobs
 In most cases 3
– Unless > 100 nodes, then 5
© 2012 MapR Technologies Installation 19

20. High Availability NFS
 Active standby
– Multiple concurrent NFS servers allowed
– VIPs provide immediate failover
– Failover triggered by CLDB if NFS server fails
– Reads/writes continue after failover
© 2012 MapR Technologies Installation 20

21. Setting Up NFS HA
 Install and run mapr-nfs service on assigned nodes
 Create a pool of VIPs
 Use MapR Control System or the API to assign VIPs to NFS nodes
– One VIP across multiple NFS nodes
– Multiple VIPs across multiple NFS nodes
© 2012 MapR Technologies Installation 21

22. LAB: Installation
© 2012 MapR Technologies Installation 22

23. Questions
© 2012 MapR Technologies Installation 23