EMC XCHANGE 2015 Denis FRAVAL-OLIVIER http://france.emc.com/big-data/data-lake/index.htm https://france.emc.com/events/webinar/index.htm#180903 https://community.emc.com/docs/DOC-41870

1. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved
JEUDI 19 NOVEMBRE 2015
Denis FRAVAL-OLIVIER : ISD Presales Manager
DATA LAKE FOUNDATION 2.0

2. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved
Module 4: Horizontal and Vertical Markets
EMC Isilon – Unifying Workloads in one place

3. © Copyright 2015 EMC Corporation. All rights reserved
Archive &
Backup Target
File sharesHome
Directories
BLOBS
Design, Test
& Manufacture
Consumerization
Personalization
Splunk
Processes &
Transaction
Hadoop &
Analytics
Sync ‘n Share
Demographics
Web Content
Social &
Next-Gen
Surveillance
ISILON FOR ALL TYPES OF DATA

4. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved
EMC Isilon Scale-Out platform
Clients and Applications
RESTful API
GET PUT POST DELETE
Gig-e
10 Gig-e
Network
OneFS Operating
Environment
Multi-Protocol Client/Application Layer Ethernet Layer
Protocols
SMBNFS
FTPHTTP
HDFS
for Hadoop
REST
for Object
Intra-cluster
Communication

5. © Copyright 2015 EMC Corporation. All rights reserved
DATA LAKE
EMC ISILON SCALE-OUT NAS
DATA PROTECTION
DATA SECURITY PERFORMANCE MANAGEMENT
DATA MANAGEMENT
Data Lake
S-Series X-Series
NL-Series HD-Series
5

6. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved
S - Series X - Series
NL-Series
Isilon
CloudPools
3rd Platform cloud Innovation
HD-Series
6
FUTURE

7. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved
NFS
HDFS
SMB, NFS, HTTP,
FTP, HDFS
Node
reply
Node
reply
Node
reply
Node
reply
Support for Multiple Analytics Applications
name
node
name
node
name
node
name
node
datanode
NFS
SMB
SMB
NFS MAP Reduce
MAP Reduce
MAP Reduce
MAP Reduce
MAP Reduce
MAP Reduce

8. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved
Splunk Index Architecture

9. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved
The Big, Cold Data Lake

10. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved
Benefit: Unmatched Scalability = Unmatched Simplicity
Cold
Isilon
Single Volume scaling to
50PB
****.gz
****.tsidx
The “Bottomless” Cold Bucket

11. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved
Use Splunk Multi-Site Clustering
For Site Protection
Use Array Snapshots For Data
Protection
****.gz
****.tsidx
Snapshots
Benefit: Snapshots + Splunk Replication = NO BACKUPS
Hot/Warm
XtremIO
****.gz
****.tsidx
Splunk Multi-
Site
Clustering
Backupless “Bliss”
Cold
Isilon

12. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved
Using Self Encrypting Drives (SED)
AES256 Encryption Algorithm
Drives Taken Out Are Unreadable
Benefit: Encryption = Piece Of Mind
Hot/Warm
XtremIO
Cold
Isilon
Bonus !! Encryption

13. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved
Benefit: Automation = Simplicity
Automated Tiering For High Density Capacity
Keep Data In Cold Then Delete
Write-Once-Read-Many (WORM) protection
SEC Rule 17a-4(f) definition standards
Bonus !! Always Searchable
Cold
Isilon

14. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved
Data-in-place analytics
Multi-protocol access
Efficiency gains of 20% vs 300% overhead
Enterprise Features For Hadoop
Benefit: Isilon HDFS = SIMPLE Hadoop Analytics
Bonus !! HUNK Ready…

15. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved
Hadoop Market Leadership
Market Leader in
Hadoop Shared Storage#1
Customers700+
YoY Growth250%

16. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved
Hbase StormHive PigMap Red
YARN
Tez SqoopKnox SparkKafka
NameNode
HADOOP ARCHITECTURE - TRADITIONAL
Ethernet
Data Node + Compute Node
Data Node + Compute Node
Data Node + Compute Node
Data Node + Compute Node
Data Node + Compute Node
Data Node + Compute Node

17. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved
Ethernet
DataNode
Compute Node Compute Node Compute Node
Compute NodeCompute Node Compute Node
NameNode
name
node
name
node
name
node
name
node
datanode
Hbase StormHive PigMap Red
YARN
Tez SqoopKnox SparkKafka
Ambari Agent
HADOOP ARCHITECTURE – WITH ISILON

18. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved
Traditional Hadoop - Layers

19. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved
Isilon + Hadoop – NO Layers

20. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved

21. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved

22. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved
HDFS
SMB, NFS, HTTP,
FTP, HDFS
Node
reply
Node
reply
Node
reply
Node
reply
HDFS: Integrated Isilon and vHadoop
name
node
name
node
name
node
name
node
datanode
NFS
SMB
SMB
NFS
Apache

23. © Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved
Si vous avez des questions sur cette présentation,
n’hésitez pas à prendre contact directement contact
avec :
Denis FRAVAL-OLIVIER
denis.fraval@emc.com