1. OpenStack Data Processing
(Savanna) Project Update
January 16, 2014
Sergey Lukjanov, Data Processing Program PTL

2. Havana Release Overview
●
●
●
●
●
●
69 blueprints implemented
~150 bugs fixed
880 code commits from 31 people
3000+ code reviews
officially incubated for Icehouse!
more info: https://launchpad.net/savanna/havana
● 0.2 and 0.3 releases
● https://wiki.openstack.org/wiki/Savanna/ReleaseNotes

3. Havana Highlights
● from PoC to community-backed project
● contributors
○ core: Mirantis, Hortonworks, Red Hat
○ plus: HP, IBM, UnitedStack, Rackspace
● two plugins:
○ Vanilla
○ Hortonworks Data Platform
● clustering
● Elastic Data Processing
● OpenStack Dashboard plugin

4. Havana Highlights: Clustering
●
●
●
●
●
cluster provisioning
configuration management (templates)
cluster scaling
data nodes anti-affinity
200 nodes in 5 mins

5. Havana Highlights: EDP
● API to execute MapReduce jobs without exposing
details of underlying infrastructure
○ pluggable data sources: Swift
○ supported job types: jar, Pig, Hive
○ integration with Oozie for workflow management
● user-friendly UI for ad-hoc analytics queries based on
Hive or Pig

6. Icehouse Overview
● working on i-2 dev milestone now (release next week)
● so far:
○
○
○
○
24 blueprints implemented
~43 fixed
220 code commits from 26 people
1530+ code reviews
● more info: https://launchpad.net/savanna/icehouse

7. Icehouse Highlights
● new contributors
○ eNovance, Samsung, Intel, EPAM Systems, Zurich
University of Applied Science
● Heat integration for orchestration
● Intel Distribution of Hadoop plugin
● Gating Savanna (async)
○ DevStack integration
○ Tempest tests (base API)
● CLI proof of concept

8. Icehouse plans
●
●
●
●
●
Heat by default for orchestration
Tempest: scenarios, CLI
v2 API based on Pecan/WSME
complete CLI implementation
guest agents PoC

9. Q&A
email: slukjanov@mirantis.com
irc: SergeyLukjanov on Freenode