ApacheCon slides

1. ODPi 101: Who We Are, What We Do
Alan Gates
Apache Member
Co-founder, Hortonworks
Chairperson ODPi Technical Steering Committee
gates@hortonworks.com
@alanfgates#futureofdata

2. 4ZB
DATA
INTERNE
T
OF
ANYTHIN
G
44ZB
DATA
TOMORROW
2

3. AGE OF DATA
Open source is the norm,
and Apache is the center of gravity
3

4. 4
Assembly of data-defined applications

5. INTRODUCTORY
PRESENTATION
Who we are and our objectives
 Non-profit organization committed to simplification
and standardization of the big data ecosystem
 Removes costs and complexity and accelerates the
development of Big Data solutions
 Provide a common runtime, reference
implementations and test suites
Open ecosystem of big dataCommon Reference
Specification
5

6. • ODPi, a Linux Foundation Collaborative Project,
operates under an open governance model
• Any company can join as a member
• All member companies have an equal vote on ODPi
Core decisions
• The elected Board of Directors is responsible for the
financial, legal, and promotional aspects of ODPi
Collaborative, Independent, and Openly-Governed
INTRODUCTORY
PRESENTATION
29 member companies
35maintainers
6

7. INTRODUCTORY
PRESENTATION
7

8. INTRODUCTORY
PRESENTATION
What Benefit Does ODPi Bring?
8
Without ODPi
Multi-distro certifications and regression
testing increases ISV development, burden,
and enterprise support costs
With ODPi

9. INTRODUCTORY
PRESENTATION
What Benefit Does ODPi Bring? (cont’d.)
• Run any “ODPi-compatible” big data software on any “ODPi-compliant”
platform
End-Customers
• ISVs
• Apps
Developers
• System
Integrators
Hadoop
platform
providers
• Compatibility guidelines to “test once, run everywhere.”
• Eliminate the burden and cost of certification and testing across multiple
Hadoop distributions.
• Predictable release cadence and reduced maintenance and support costs.
• Compliance guidelines that enable ODPi-compatible software to run
successfully on their solutions.
• The guidelines allow providers to patch their customers in an expeditious
manner to deal with emergencies.
9

10. • Hadoop 2.7
o HDFS, YARN, and MapReduce
• Use version 7 or 8 of Java
• Not alter the public API
• Vendors may include patches, but not feature patches
• Vendors may include additional features/functions
o They make the source code available
o Code must be committed to the ASF
Runtime Spec
• Ambari 2.3.0 (future release)
• Use version 7 or 8 of Java
• Defines how distributions and ISVs should define and
deploy custom stacks and services
• Provides standards for custom views and for
monitoring custom applications
Operations Spec (draft)
Runtime and Operations Spec Components
INTRODUCTORY
PRESENTATION
10
June/
July
Big Data Application Vendors can test their
App and be confident that it will run on All
ODPi Runtime-Compliant Distros
Big Data Application Vendors can deploy and
monitor their in any ODPi Operations-
Compliant Distros

11. ODPi leverages Apache Bigtop testing capabilities
INTRODUCTORY
PRESENTATION
Packaging Smoke testing Virtualization
Bigtop packages Hadoop RPMs
and DEBs, so that you can
manage and maintain your
Hadoop cluster.
Bigtop provides an integrated
smoke testing framework,
alongside a suite of over 50 test
files.
Bigtop provides vagrant recipes,
raw images, and (work-in-progress)
docker recipes for deploying
Hadoop from zero.
● The ODPi Test Framework is based on Apache Bigtop.
○ More than 50% of the code in the latest Big Top release originated in ODPi
● All ODPi Runtime-Compliance tests are linked directly to lines in the ODPi Runtime Specification
● To assist with compliance, in addition to the test suite, ODPi also provides:
○ A reference build
○ Recipes for building VM, Vagrant, and Docker images
11

12. INTRODUCTORY
PRESENTATION
1) Become ODPi member www.odpi.org
2) Get involved with the ODPi project on GitHub
http://www.github.com/odpi
3) Join ODPi User Advisory Board (UAB)
Get Involved!
12