SlideShare une entreprise Scribd logo
1  sur  21
Télécharger pour lire hors ligne
Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.     1 
Agenda

!     About NTTPC
!     GlusterFS Challenges and Achievements by NTTPC
!     After Diving into GlusterFS
!     Some kind of ULTIMATE GlusterFS which I devise
!     Focus on the community




          Me ->
                             Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.     2 
About!
NTTPC

  NTTPCについて
     Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.     3 
About NTTPC
NTT was originally a part of the Japanese Government, and has dealt with
telephone and telegram service for a long period.
Now, NTT forms a large telephony and IT related group that more than 500
companies are included.
The major companies are the followings;

                                                 As a group, about $100bil.
                     NTT Co.                     revenue in fiscal year 2009
               (Stock Holding Company)           (2009/4-2010/3)             The biggest ISP
                                                                             in Japan


                                    $13.5bil.

  NTT EAST         NTT WEST                                                          NTT
  (Regional        (Regional         NTT Communications                                                      NTT Data
                                           (Long Distance &                        docomo                          (SI)
   Carrier)         Carrier)             International Carrier)                     (Mobile)


                                  NTTPC Communications

 The strategic technology company of the group
  - The 1st ISP of the NTT group (InfoSphere was established in 1995)
  - The 1st iDC in Japan (WebArena was released in 1997)
  - Import Foreign Hardware and Software as a Reseller of NTT Group
                                              Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.     4 
GlusterFS!
 Challenges!
     and!
Achievements!
  by NTTPC!

  GlusterFSに関するNTTPCのチャレンジと成果
                Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.     5 
Challenges and Achievements in 2007


!  Evaluating distributed storage software
   GlusterFS 1.3.7
   Gfarm
   Red Hat Global File System
   Ceph
   MogileFS




                          Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.     6 
Challenges and Achievements in 2008


!  Field service trial
!  Evaluating GlusterFS 1.3.12
!  Developing
   tools for operation
   RESTful API




                          Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.     7 
Challenges and Achievements in 2009

!  Evaluating
   GlusterFS 2.0.2
   GlusterFS 2.0.8
   GlusterFS on KVM guests
!  Developing
   an alternative tool for self-heal feature
   mobile front-end application for iPhone and feature
    phone
!  Authoring Japanese documents of
   GlusterFS
!  Getting supported by Gluster,Inc.
!  Introducing GlusterFS into
   Master’s ONE Mobile Folder service
   an enterprise e-mail service (for archive storage)

                              Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.     8 
Challenges and Achievements in 2010


!  Evaluating InfiniBand for GlusterFS
!  Visiting Gluster,Inc.
!  Developing
   entire-self-heal, a tool for running self-heal quietly
   an original thin-provisioning module (just as a
    prototype)




                             Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.     9 
Challenges and Achievements in 2011


!    Evaluating GlusterFS 3.2.x
!    Trying iSCSI target on GlusterFS
!    Distributor contract
!    Co-working with Mr. Kenta Takahashi
!    Speech at
     the 1st GlusterFS round-table talk
     the 4th Cloud Storage Conference
     Internet Week 2012 Virtualization Day




                             Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.     10 
Challenges and Achievements in 2012


!  Approached by a few companies for
   GlusterFS
!  Writing an article in our company
   portal
!  Speech at InfiniBand DAY 05
!  Evaluating Red Hat Storage 2.0 Beta2
!  Introducing GlusterFS into
   our e-mail service
   a cloud storage service
!  And Today!
                          Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.     11 
After!
Diving into!
GlusterFS!

   GlusterFSに取り組んでみて
            Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.     12 
I like ...


!  Module architecture
   Clean, beautiful and pluggable
!  Elastic Hashing Algorithm
   The best way at present
!  Performance translators
   Ingenious attempt as an userspace filesystem
!  The community!
   Many tough developers and cool hackers!




                         Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.     13 
But we also need ...


!  Thin-provisioning feature
   For capital spending cuts
!  Cleaning 0 byte sparse files
   For inode shortage avoidance
!  Controlling silent data corruption
   For long term service providing
!  REST API for operation and monitoring
   Can oVirt do it?
! libglusterfsclient again!
   Be lost to the history (available until 3.0.x)

                           Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.     14 
Some kind of!
ULTIMATE GlusterFS!
   which I devise


     ぼくのかんがえたさいきょうのGlusterFS
                 Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.     15 
Some kind of ULTIMATE GlusterFS which I devise

GlusterFS’ front-end is enough cool. But rather back-end
 can be expanded. Simply mix cloud and on premise
    storages to provide services in a good balance.

                                   cluster/dht
        Distributing data
       Between local file
    system and Amazon S3
          cluster/afr                                                          cluster/afr



storage/posix     storage/posix                                  storage/s3                    storage/s3
                                    cluster/afr

                                                                                    One of paired
                                                                                  replicas is saved in
                          storage/posix      storage/s3                                    S3


                                          Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.     16 
Some kind of ULTIMATE GlusterFS which I devise

File storage and object storage are both achieved.
           To become truly unified storage,
  block storage interface should be implemented.

    FUSE         NFS                    swift                         iSCSI target




                       cluster/dht




                             Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.     17 
Focus!
  on the!
Community

   コミュニティについて
        Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.     18 
Focus on the community

!  High interests in Japan, not only English-
   speaking countries
   About 30 cutting-edge engineers had a discussion
    in GlusterFS round-table talk.
   Engaging in a heated Qs and As in front of 100
    people in Cloud Storage Conference.
   Regardless of professions or places of employment,
    about 6 of 45 already had experiences with
    GlusterFS in InfiniBand DAY 05.
   A few companies ask us consult as to GlusterFS.
!  But Japanese are ...
   Not good at English (especially speaking and listening)
   Shy
   GMT+9 (a long time distance on the earth far, far away ....)
    Japanese localized community is important.
               Let’s get it started!                                                                            19 
                                Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.  
Focus on the community




                                                                                            I would like
                                                                                           to enlighten
                                                                                             NTT (Com)
                                                                                              group to
                                                                                             join in the
                                                                                              GlusterFS
                                                                                              Advisory
                                                                                               Board!
http://www.slideshare.net/johnmarkorg/the-future-of-glusterfs-and-glusterorg
                                                             Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.     20 
To contact us, e-mail here -> storage-contact@nttpc.co.jp
                               Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.   21 

Contenu connexe

Similaire à NTTPC's GlusterFS Journey and Vision for the Ultimate Distributed Storage

GlusterFS座談会テクニカルセッション
GlusterFS座談会テクニカルセッションGlusterFS座談会テクニカルセッション
GlusterFS座談会テクニカルセッションKeisuke Takahashi
 
NTT Docomo's Challenge looking ahead the world pf 5G × OpenStack - OpenStack最...
NTT Docomo's Challenge looking ahead the world pf 5G × OpenStack - OpenStack最...NTT Docomo's Challenge looking ahead the world pf 5G × OpenStack - OpenStack最...
NTT Docomo's Challenge looking ahead the world pf 5G × OpenStack - OpenStack最...VirtualTech Japan Inc.
 
RTMFP Overview for IETF77
RTMFP Overview for IETF77RTMFP Overview for IETF77
RTMFP Overview for IETF77stoem
 
OSBConf 2015 | Contemporary and cost efficient backups to to tape by josef we...
OSBConf 2015 | Contemporary and cost efficient backups to to tape by josef we...OSBConf 2015 | Contemporary and cost efficient backups to to tape by josef we...
OSBConf 2015 | Contemporary and cost efficient backups to to tape by josef we...NETWAYS
 
Using Storlets/Docker For Large Scale Image Processing
Using Storlets/Docker For Large Scale Image ProcessingUsing Storlets/Docker For Large Scale Image Processing
Using Storlets/Docker For Large Scale Image ProcessingKota Tsuyuzaki
 
Z109889 z4 r-storage-dfsms-jburg-v1909d
Z109889 z4 r-storage-dfsms-jburg-v1909dZ109889 z4 r-storage-dfsms-jburg-v1909d
Z109889 z4 r-storage-dfsms-jburg-v1909dTony Pearson
 
Z4R: Intro to Storage and DFSMS for z/OS
Z4R: Intro to Storage and DFSMS for z/OSZ4R: Intro to Storage and DFSMS for z/OS
Z4R: Intro to Storage and DFSMS for z/OSTony Pearson
 
OpenStack Swiftの最新機能とStorlets
OpenStack Swiftの最新機能とStorletsOpenStack Swiftの最新機能とStorlets
OpenStack Swiftの最新機能とStorletsKota Tsuyuzaki
 
Spark1.0での動作検証 - Hadoopユーザ・デベロッパから見たSparkへの期待 (Hadoop Conference Japan 2014)
Spark1.0での動作検証 - Hadoopユーザ・デベロッパから見たSparkへの期待 (Hadoop Conference Japan 2014)Spark1.0での動作検証 - Hadoopユーザ・デベロッパから見たSparkへの期待 (Hadoop Conference Japan 2014)
Spark1.0での動作検証 - Hadoopユーザ・デベロッパから見たSparkへの期待 (Hadoop Conference Japan 2014)NTT DATA OSS Professional Services
 
3. EMC Storage for future Surveillance.pdf
3. EMC Storage for future Surveillance.pdf3. EMC Storage for future Surveillance.pdf
3. EMC Storage for future Surveillance.pdfPawachMetharattanara
 
Zettabyte еQual To 1 Billion Terabytes
Zettabyte еQual To 1 Billion TerabytesZettabyte еQual To 1 Billion Terabytes
Zettabyte еQual To 1 Billion TerabytesStas Kolbin
 
NTT Data - Shinichi Yamada - Hadoop World 2010
NTT Data - Shinichi Yamada - Hadoop World 2010NTT Data - Shinichi Yamada - Hadoop World 2010
NTT Data - Shinichi Yamada - Hadoop World 2010Cloudera, Inc.
 
Expectation for SDN as Carrier's Network
Expectation for SDN as Carrier's NetworkExpectation for SDN as Carrier's Network
Expectation for SDN as Carrier's NetworkOpen Networking Summits
 
DDS Interoperability Demo
DDS Interoperability DemoDDS Interoperability Demo
DDS Interoperability DemoAngelo Corsaro
 
2014-4Q-OpenStack-Fall-presentation-public-20150310a
2014-4Q-OpenStack-Fall-presentation-public-20150310a2014-4Q-OpenStack-Fall-presentation-public-20150310a
2014-4Q-OpenStack-Fall-presentation-public-20150310aKen Igarashi
 
Design and Operation of OpenStack Cloud on 100 Physical Servers - OpenStack S...
Design and Operation of OpenStack Cloud on 100 Physical Servers - OpenStack S...Design and Operation of OpenStack Cloud on 100 Physical Servers - OpenStack S...
Design and Operation of OpenStack Cloud on 100 Physical Servers - OpenStack S...VirtualTech Japan Inc.
 
Tmw dallas ngoss1 dacco covino
Tmw dallas ngoss1 dacco covinoTmw dallas ngoss1 dacco covino
Tmw dallas ngoss1 dacco covinoMarco Daccò
 
Novidades interessantes e importantes do z/os 2.2
Novidades interessantes e importantes do z/os 2.2Novidades interessantes e importantes do z/os 2.2
Novidades interessantes e importantes do z/os 2.2Joao Galdino Mello de Souza
 

Similaire à NTTPC's GlusterFS Journey and Vision for the Ultimate Distributed Storage (20)

Gluster in Japan 2012-2013
Gluster in Japan 2012-2013Gluster in Japan 2012-2013
Gluster in Japan 2012-2013
 
GlusterFS座談会テクニカルセッション
GlusterFS座談会テクニカルセッションGlusterFS座談会テクニカルセッション
GlusterFS座談会テクニカルセッション
 
NTT Docomo's Challenge looking ahead the world pf 5G × OpenStack - OpenStack最...
NTT Docomo's Challenge looking ahead the world pf 5G × OpenStack - OpenStack最...NTT Docomo's Challenge looking ahead the world pf 5G × OpenStack - OpenStack最...
NTT Docomo's Challenge looking ahead the world pf 5G × OpenStack - OpenStack最...
 
RTMFP Overview for IETF77
RTMFP Overview for IETF77RTMFP Overview for IETF77
RTMFP Overview for IETF77
 
OSBConf 2015 | Contemporary and cost efficient backups to to tape by josef we...
OSBConf 2015 | Contemporary and cost efficient backups to to tape by josef we...OSBConf 2015 | Contemporary and cost efficient backups to to tape by josef we...
OSBConf 2015 | Contemporary and cost efficient backups to to tape by josef we...
 
Using Storlets/Docker For Large Scale Image Processing
Using Storlets/Docker For Large Scale Image ProcessingUsing Storlets/Docker For Large Scale Image Processing
Using Storlets/Docker For Large Scale Image Processing
 
Z109889 z4 r-storage-dfsms-jburg-v1909d
Z109889 z4 r-storage-dfsms-jburg-v1909dZ109889 z4 r-storage-dfsms-jburg-v1909d
Z109889 z4 r-storage-dfsms-jburg-v1909d
 
Z4R: Intro to Storage and DFSMS for z/OS
Z4R: Intro to Storage and DFSMS for z/OSZ4R: Intro to Storage and DFSMS for z/OS
Z4R: Intro to Storage and DFSMS for z/OS
 
OpenStack Swiftの最新機能とStorlets
OpenStack Swiftの最新機能とStorletsOpenStack Swiftの最新機能とStorlets
OpenStack Swiftの最新機能とStorlets
 
Spark1.0での動作検証 - Hadoopユーザ・デベロッパから見たSparkへの期待 (Hadoop Conference Japan 2014)
Spark1.0での動作検証 - Hadoopユーザ・デベロッパから見たSparkへの期待 (Hadoop Conference Japan 2014)Spark1.0での動作検証 - Hadoopユーザ・デベロッパから見たSparkへの期待 (Hadoop Conference Japan 2014)
Spark1.0での動作検証 - Hadoopユーザ・デベロッパから見たSparkへの期待 (Hadoop Conference Japan 2014)
 
3. EMC Storage for future Surveillance.pdf
3. EMC Storage for future Surveillance.pdf3. EMC Storage for future Surveillance.pdf
3. EMC Storage for future Surveillance.pdf
 
Zettabyte еQual To 1 Billion Terabytes
Zettabyte еQual To 1 Billion TerabytesZettabyte еQual To 1 Billion Terabytes
Zettabyte еQual To 1 Billion Terabytes
 
NTT Data - Shinichi Yamada - Hadoop World 2010
NTT Data - Shinichi Yamada - Hadoop World 2010NTT Data - Shinichi Yamada - Hadoop World 2010
NTT Data - Shinichi Yamada - Hadoop World 2010
 
Expectation for SDN as Carrier's Network
Expectation for SDN as Carrier's NetworkExpectation for SDN as Carrier's Network
Expectation for SDN as Carrier's Network
 
Dita Accelerator Xml2008
Dita Accelerator Xml2008Dita Accelerator Xml2008
Dita Accelerator Xml2008
 
DDS Interoperability Demo
DDS Interoperability DemoDDS Interoperability Demo
DDS Interoperability Demo
 
2014-4Q-OpenStack-Fall-presentation-public-20150310a
2014-4Q-OpenStack-Fall-presentation-public-20150310a2014-4Q-OpenStack-Fall-presentation-public-20150310a
2014-4Q-OpenStack-Fall-presentation-public-20150310a
 
Design and Operation of OpenStack Cloud on 100 Physical Servers - OpenStack S...
Design and Operation of OpenStack Cloud on 100 Physical Servers - OpenStack S...Design and Operation of OpenStack Cloud on 100 Physical Servers - OpenStack S...
Design and Operation of OpenStack Cloud on 100 Physical Servers - OpenStack S...
 
Tmw dallas ngoss1 dacco covino
Tmw dallas ngoss1 dacco covinoTmw dallas ngoss1 dacco covino
Tmw dallas ngoss1 dacco covino
 
Novidades interessantes e importantes do z/os 2.2
Novidades interessantes e importantes do z/os 2.2Novidades interessantes e importantes do z/os 2.2
Novidades interessantes e importantes do z/os 2.2
 

Plus de Keisuke Takahashi

Azure Database for PostgreSQL 入門 (PostgreSQL Conference Japan 2021)
Azure Database for PostgreSQL 入門 (PostgreSQL Conference Japan 2021)Azure Database for PostgreSQL 入門 (PostgreSQL Conference Japan 2021)
Azure Database for PostgreSQL 入門 (PostgreSQL Conference Japan 2021)Keisuke Takahashi
 
パーフェクト"Elixir情報収集"
パーフェクト"Elixir情報収集"パーフェクト"Elixir情報収集"
パーフェクト"Elixir情報収集"Keisuke Takahashi
 
GlusterFS Updates (and more) in 第六回クラウドストレージ研究会
GlusterFS Updates (and more) in 第六回クラウドストレージ研究会GlusterFS Updates (and more) in 第六回クラウドストレージ研究会
GlusterFS Updates (and more) in 第六回クラウドストレージ研究会Keisuke Takahashi
 
Trying and evaluating the new features of GlusterFS 3.5
Trying and evaluating the new features of GlusterFS 3.5Trying and evaluating the new features of GlusterFS 3.5
Trying and evaluating the new features of GlusterFS 3.5Keisuke Takahashi
 
Big Data入門に見せかけたFluentd入門
Big Data入門に見せかけたFluentd入門Big Data入門に見せかけたFluentd入門
Big Data入門に見せかけたFluentd入門Keisuke Takahashi
 
GlusterFS 技術と動向 1of2
GlusterFS 技術と動向 1of2GlusterFS 技術と動向 1of2
GlusterFS 技術と動向 1of2Keisuke Takahashi
 
最新技術動向 GlusterFS (仮想化DAY, Internet Week 2011)
最新技術動向 GlusterFS (仮想化DAY, Internet Week 2011)最新技術動向 GlusterFS (仮想化DAY, Internet Week 2011)
最新技術動向 GlusterFS (仮想化DAY, Internet Week 2011)Keisuke Takahashi
 

Plus de Keisuke Takahashi (8)

Azure Database for PostgreSQL 入門 (PostgreSQL Conference Japan 2021)
Azure Database for PostgreSQL 入門 (PostgreSQL Conference Japan 2021)Azure Database for PostgreSQL 入門 (PostgreSQL Conference Japan 2021)
Azure Database for PostgreSQL 入門 (PostgreSQL Conference Japan 2021)
 
パーフェクト"Elixir情報収集"
パーフェクト"Elixir情報収集"パーフェクト"Elixir情報収集"
パーフェクト"Elixir情報収集"
 
GlusterFS Masakari Talks
GlusterFS Masakari TalksGlusterFS Masakari Talks
GlusterFS Masakari Talks
 
GlusterFS Updates (and more) in 第六回クラウドストレージ研究会
GlusterFS Updates (and more) in 第六回クラウドストレージ研究会GlusterFS Updates (and more) in 第六回クラウドストレージ研究会
GlusterFS Updates (and more) in 第六回クラウドストレージ研究会
 
Trying and evaluating the new features of GlusterFS 3.5
Trying and evaluating the new features of GlusterFS 3.5Trying and evaluating the new features of GlusterFS 3.5
Trying and evaluating the new features of GlusterFS 3.5
 
Big Data入門に見せかけたFluentd入門
Big Data入門に見せかけたFluentd入門Big Data入門に見せかけたFluentd入門
Big Data入門に見せかけたFluentd入門
 
GlusterFS 技術と動向 1of2
GlusterFS 技術と動向 1of2GlusterFS 技術と動向 1of2
GlusterFS 技術と動向 1of2
 
最新技術動向 GlusterFS (仮想化DAY, Internet Week 2011)
最新技術動向 GlusterFS (仮想化DAY, Internet Week 2011)最新技術動向 GlusterFS (仮想化DAY, Internet Week 2011)
最新技術動向 GlusterFS (仮想化DAY, Internet Week 2011)
 

Dernier

Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embeddingZilliz
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clashcharlottematthew16
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 

Dernier (20)

Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embedding
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 

NTTPC's GlusterFS Journey and Vision for the Ultimate Distributed Storage

  • 1. Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.   1 
  • 2. Agenda !   About NTTPC !   GlusterFS Challenges and Achievements by NTTPC !   After Diving into GlusterFS !   Some kind of ULTIMATE GlusterFS which I devise !   Focus on the community Me -> Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.   2 
  • 3. About! NTTPC NTTPCについて Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.   3 
  • 4. About NTTPC NTT was originally a part of the Japanese Government, and has dealt with telephone and telegram service for a long period. Now, NTT forms a large telephony and IT related group that more than 500 companies are included. The major companies are the followings; As a group, about $100bil. NTT Co. revenue in fiscal year 2009 (Stock Holding Company) (2009/4-2010/3) The biggest ISP in Japan $13.5bil. NTT EAST NTT WEST NTT (Regional (Regional NTT Communications NTT Data (Long Distance & docomo (SI) Carrier) Carrier) International Carrier) (Mobile) NTTPC Communications The strategic technology company of the group - The 1st ISP of the NTT group (InfoSphere was established in 1995) - The 1st iDC in Japan (WebArena was released in 1997) - Import Foreign Hardware and Software as a Reseller of NTT Group Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.   4 
  • 5. GlusterFS! Challenges! and! Achievements! by NTTPC! GlusterFSに関するNTTPCのチャレンジと成果 Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.   5 
  • 6. Challenges and Achievements in 2007 !  Evaluating distributed storage software  GlusterFS 1.3.7  Gfarm  Red Hat Global File System  Ceph  MogileFS Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.   6 
  • 7. Challenges and Achievements in 2008 !  Field service trial !  Evaluating GlusterFS 1.3.12 !  Developing  tools for operation  RESTful API Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.   7 
  • 8. Challenges and Achievements in 2009 !  Evaluating  GlusterFS 2.0.2  GlusterFS 2.0.8  GlusterFS on KVM guests !  Developing  an alternative tool for self-heal feature  mobile front-end application for iPhone and feature phone !  Authoring Japanese documents of GlusterFS !  Getting supported by Gluster,Inc. !  Introducing GlusterFS into  Master’s ONE Mobile Folder service  an enterprise e-mail service (for archive storage) Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.   8 
  • 9. Challenges and Achievements in 2010 !  Evaluating InfiniBand for GlusterFS !  Visiting Gluster,Inc. !  Developing  entire-self-heal, a tool for running self-heal quietly  an original thin-provisioning module (just as a prototype) Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.   9 
  • 10. Challenges and Achievements in 2011 !  Evaluating GlusterFS 3.2.x !  Trying iSCSI target on GlusterFS !  Distributor contract !  Co-working with Mr. Kenta Takahashi !  Speech at  the 1st GlusterFS round-table talk  the 4th Cloud Storage Conference  Internet Week 2012 Virtualization Day Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.   10 
  • 11. Challenges and Achievements in 2012 !  Approached by a few companies for GlusterFS !  Writing an article in our company portal !  Speech at InfiniBand DAY 05 !  Evaluating Red Hat Storage 2.0 Beta2 !  Introducing GlusterFS into  our e-mail service  a cloud storage service !  And Today! Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.   11 
  • 12. After! Diving into! GlusterFS! GlusterFSに取り組んでみて Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.   12 
  • 13. I like ... !  Module architecture  Clean, beautiful and pluggable !  Elastic Hashing Algorithm  The best way at present !  Performance translators  Ingenious attempt as an userspace filesystem !  The community!  Many tough developers and cool hackers! Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.   13 
  • 14. But we also need ... !  Thin-provisioning feature  For capital spending cuts !  Cleaning 0 byte sparse files  For inode shortage avoidance !  Controlling silent data corruption  For long term service providing !  REST API for operation and monitoring  Can oVirt do it? ! libglusterfsclient again!  Be lost to the history (available until 3.0.x) Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.   14 
  • 15. Some kind of! ULTIMATE GlusterFS! which I devise ぼくのかんがえたさいきょうのGlusterFS Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.   15 
  • 16. Some kind of ULTIMATE GlusterFS which I devise GlusterFS’ front-end is enough cool. But rather back-end can be expanded. Simply mix cloud and on premise storages to provide services in a good balance. cluster/dht Distributing data Between local file system and Amazon S3 cluster/afr cluster/afr storage/posix storage/posix storage/s3 storage/s3 cluster/afr One of paired replicas is saved in storage/posix storage/s3 S3 Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.   16 
  • 17. Some kind of ULTIMATE GlusterFS which I devise File storage and object storage are both achieved. To become truly unified storage, block storage interface should be implemented. FUSE NFS swift iSCSI target cluster/dht Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.   17 
  • 18. Focus! on the! Community コミュニティについて Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.   18 
  • 19. Focus on the community !  High interests in Japan, not only English- speaking countries  About 30 cutting-edge engineers had a discussion in GlusterFS round-table talk.  Engaging in a heated Qs and As in front of 100 people in Cloud Storage Conference.  Regardless of professions or places of employment, about 6 of 45 already had experiences with GlusterFS in InfiniBand DAY 05.  A few companies ask us consult as to GlusterFS. !  But Japanese are ...  Not good at English (especially speaking and listening)  Shy  GMT+9 (a long time distance on the earth far, far away ....) Japanese localized community is important. Let’s get it started! 19  Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.  
  • 20. Focus on the community I would like to enlighten NTT (Com) group to join in the GlusterFS Advisory Board! http://www.slideshare.net/johnmarkorg/the-future-of-glusterfs-and-glusterorg Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.   20 
  • 21. To contact us, e-mail here -> storage-contact@nttpc.co.jp Copyright  (C)  2012,  NTTPC  Communications,  Inc.  All  Rights  Reserved.   21