An introduction to Apache Bigtop

Apache Bigtop
●

What is it ?

●

What is it for ?

●

Automated Testing

●

Platforms

●

Dependencies

www.semtech-solutions.co.nz

info@semtech-solutions.co.nz

Apache Bigtop – What is it ?
●

For testing Hadoop and related tools

●

For test development

●

Uses Jenkins continuous integration

●

Based on Cloudera's CDH

●

BigTop for Hadoop is equivalent to a Linux release
–

i.e. Ubuntu, Fedora, CentOS

●

Use it for deploying the Hadoop stack

●

Guarantees version inter-operability within the stack



Apache Bigtop – What is it for ?
It is for testing Hadoop at a number of levels
–

Packaging

–

Platform

–

Runtime

–

Upgrades

–

Integration testing

–

Validation !



Automation Methodology – An Example



Apache Bigtop – Platforms
Platforms supported
–

Ubuntu 10.10

–

CentOS 5/6

–

Fedora 18

–

Mageia 1

–

openSUSE 12.2



Apache Bigtop – Dependencies
The following tools are required
Java JDK 1.6
– Apache Maven
– tar
– subversion
– gcc-c++
– fuse
– autoconf
– libtool
– asciidoc
–


Apache Ant
wget
git
gcc
make
protobuf-compiler
automake
sharutils
xmlto


Apache Bigtop – The Players
Who has bought into the use of Bigtop ?
–

Canonical

–

Cloudera

–

Ebay

–

EMC

–

Hortonworks

–

Illumos

–

Intel

–

Trendmicro

–

WANdisco



Light Humour
A bit of humour ........



Contact Us
●

Feel free to contact us at
–


–


●

We offer IT project consultancy

●

We are happy to hear about your problems

●

You can just pay for those hours that you need

●

To solve your problems

An introduction to Apache Bigtop

Recommandé

Recommandé

Contenu connexe

Plus de Mike Frampton

Plus de Mike Frampton (20)

Dernier

Dernier (20)

An introduction to Apache Bigtop