SlideShare une entreprise Scribd logo
1  sur  4
Télécharger pour lire hors ligne
University of Cologne
Panasas ActiveStor
July 2006
Customer Success Story
University of Cologne
1.888.PANASAS www.panasas.com
University of Cologne
Abstract
In 2004, the Center for Applied Informatics at the
University of Cologne in Germany, sought to bring
high-performance computing (HPC) in the form of
Linux cluster computing to one of the oldest and most
prestigious institutions of higher education. Over
the years as the demand on their HPC resources
continued to grow, their existing storage systems could
not keep pace. This case study details the challenges
faced by the Center at the University of Cologne and
how Panasas storage successfully met the Center’s
requirements for a scalable, ultra high-performance
storage infrastructure.
Introduction
The Center for Applied Informatics at the University of
Cologne in Germany is a centralized resource for the
study of applied computer science and general-purpose
computing services for more than 50,000 students
and faculty. In addition to serving the University, this
testing facility also supports regional academic research
projects that require high-performance computing. The
facility was established by merging the resources of the
University’s regional computing center with those of the
University’s center for parallel processing.
In 2004, the Center sought to bring high-performance
computing (HPC) in the form of Linux cluster computing
to one of the oldest and most prestigious institutions
of higher education. Researchers would be able to
use a NPACI Rocks Linux cluster for climate modeling
simulations and supporting other applications in
chemistry and geophysics. Over time, researchers at
other universities and regional technical laboratories
would come to rely on the Center to provide the
computing capabilities they needed to study complex
problems ranging from molecular processes to stellar
formation.
The applications being undertaken at the Center
required substantial computing power and generated
large amounts of data. As the demand on HPC
resources continued to grow, the existing storage
and associated NFS file
systems that supported
the HPC environment
could not keep pace. A
comprehensive evaluation
was launched to select
a new high-performance
storage solution and led to
the selection of Panasas
storage.
This case study details
the challenges faced by
the Center for Applied
Informatics at the University
of Cologne, and how the
Panasas storage system
has successfully met the
Center’s requirements
for a scalable, ultra high-
performance storage
infrastructure.
Linux Cluster Architecture
To support HPC users at the University of Cologne, the
Center procured two new parallel compute systems
including a distributed memory system known as Clio
and a shared memory system called Altix1. Clio is a
129-node Linux NPACI Rocks cluster that has been
in operation since late 2004. It serves as an entrance
computer and it is comprised of the following:
• 2 x 2.2 GHz AMD Opteron processors
• 4GB RAM
• 2 x 36 GB SCSI discs
• 6 x Cisco 3750 switches
• 2GB Ethernet connections
• 1 x 10 GB Infiniband interface
• 1 x Sun Fire Z20z system
• Red Hat Linux Enterprise 3.0
The cluster also supports a shared memory model for
parallel programming with an MPI library. For research
that is not conducive to efficient parallel processing, the
2
1.888.PANASAS www.panasas.com
University of Cologne
Center secured an SGI Altix system – an SMP-based
computer with 24 Itanium-2, 1.5GHz processors and
48GB of memory. The Center also uses a variety of
compute services, including Sun Microsystems
SunFire and Sun Ultra Enterprise servers for user
applications that require high disk storage and fast
I/O to achieve results.
System Characteristics
The NPACI Rocks Linux cluster is used for meteorology
research (climate modeling) that requires substantial
computing power and generates very large data sets.
Additionally, applications in chemistry and geophysics
make use of the high-performance cluster to perform
complex data analysis and simulations. Research
conducted at regional scientific laboratories relies on the
Center’s HPC resources to test complex theories and
conduct compute-intensive research that can only be
accomplished with supercomputing capabilities. In each
of these projects, the network storage infrastructure
must be very fast. It must be capable of approximately
one gigabyte per second of throughput with near-linear
performance scalability as more storage is added.
Putting the Industry’s Best to the Test
The Center realized its reliance on legacy
NFS servers was creating a significant
performance bottleneck. The management
of the system was also become a burden
to the IT staff. The decision was made to
upgrade the storage infrastructure.
The Center needed a new storage system
that could easily integrate into the existing
environment, and scale with ease to
support multiple clusters in the future.
This would dramatically reduce time to
deployment and enable the Center to
maximize previous IT investments. Because
the Center projected the HPC environment
would increase from just over a hundred
nodes to thousands of nodes within two
years, the new storage solution would have
to easily scale to thousands of terabytes
without significant reductions in performance. The
new storage system also needed to deliver the highest
levels of availability as the demand for cluster time was
expected to grow. Finally, because the Center had a
relatively small IT staff, system reliability, ease-of-use
and low management overhead were considered “must-
have” features.
Panasas Makes the Grade at University
of Cologne
The Center tested solutions from several leading
storage vendors using agreed-upon parameters in
performance and I/O. The Panasas storage solution was
purchased after only a few weeks of evaluation. While
benchmarking continues today, the Center has thus far
achieved more than a 30X performance improvement
over the previous storage system. Benchmarks show
a transfer rate of up to 1.3 GB/second when running
on 128 dual-processor nodes accessing 20TB of disk
space. The Panasas storage solution was deployed in
less than four hours while competitive solutions took
weeks to implement.
Each of the products offered a different methodology
for incorporating NFS, CIFS or GPFS as part of their
3
070520111040
University of Cologne
| Phone: 1.888.PANASAS | www.panasas.com
© 2011 Panasas Incorporated. All rights reserved. Panasas is a trademark of Panasas, Inc. in the United States and other countries.
overall solution. Panasas’ PanFS™, with its fully-parallel
DirectFlow®
protocol, was the only system to provide
direct access between the Linux cluster nodes and
storage system to eliminate the performance bottleneck
caused by legacy storage systems. Unlike other
systems, the Panasas solution required no modifications
to the Linux OS kernel.
Summary
The Center for Applied Informatics at the University of
Cologne has successfully deployed the Panasas storage
system, creating a storage infrastructure with unlimited
scalability, higher performance and higher availability.
The Center uses Panasas storage with DirectFlow
client access software to provide very high bandwidth
to all nodes in a NPACI Rocks Linux cluster without
the performance bottlenecks associated with legacy
file systems. The Panasas storage solution enables the
Linux cluster to avoid idle time and continue processing
jobs without waiting for I/O processes, improving the
speed at which research projects can be completed.
As the Linux cluster grows from hundreds to thousands
of nodes, Panasas storage is more than capable of
keeping pace by scaling performance in near-linear
fashion as capacity is increased.
4

Contenu connexe

Tendances (16)

3 archiver omc deployment_scenarios
3 archiver omc deployment_scenarios3 archiver omc deployment_scenarios
3 archiver omc deployment_scenarios
 
NetApp Unified Scale-Out/Clustered Storage
NetApp Unified Scale-Out/Clustered StorageNetApp Unified Scale-Out/Clustered Storage
NetApp Unified Scale-Out/Clustered Storage
 
Parallel HDF5 Developments
Parallel HDF5 DevelopmentsParallel HDF5 Developments
Parallel HDF5 Developments
 
Converting between HDF4 and HDF5
Converting between HDF4 and HDF5Converting between HDF4 and HDF5
Converting between HDF4 and HDF5
 
Pic archiver stansted
Pic archiver stanstedPic archiver stansted
Pic archiver stansted
 
A Survey on Different File Handling Mechanisms in HDFS
A Survey on Different File Handling Mechanisms in HDFSA Survey on Different File Handling Mechanisms in HDFS
A Survey on Different File Handling Mechanisms in HDFS
 
Using HDF5 Archive Information Package to preserve HDF-EOS2 data
Using HDF5 Archive Information Package to preserve HDF-EOS2 dataUsing HDF5 Archive Information Package to preserve HDF-EOS2 data
Using HDF5 Archive Information Package to preserve HDF-EOS2 data
 
Hdfs
HdfsHdfs
Hdfs
 
Hdf5 intro
Hdf5 introHdf5 intro
Hdf5 intro
 
Hdf5
Hdf5Hdf5
Hdf5
 
Archive Information Packages for NASA HDF-EOS Data
Archive Information Packages for NASA HDF-EOS DataArchive Information Packages for NASA HDF-EOS Data
Archive Information Packages for NASA HDF-EOS Data
 
Sector Vs Hadoop
Sector Vs HadoopSector Vs Hadoop
Sector Vs Hadoop
 
Swiss National Supercomputing Center
Swiss National Supercomputing CenterSwiss National Supercomputing Center
Swiss National Supercomputing Center
 
Stansted slides-desy
Stansted slides-desyStansted slides-desy
Stansted slides-desy
 
Systore07 V4
Systore07 V4Systore07 V4
Systore07 V4
 
HDF & HDF-EOS Data & Support at NSIDC
HDF & HDF-EOS Data & Support at NSIDCHDF & HDF-EOS Data & Support at NSIDC
HDF & HDF-EOS Data & Support at NSIDC
 

En vedette

2012 BMW 1 Series Convertible For Sale NJ | BMW Dealer In Eatontown
2012 BMW 1 Series Convertible For Sale NJ | BMW Dealer In Eatontown2012 BMW 1 Series Convertible For Sale NJ | BMW Dealer In Eatontown
2012 BMW 1 Series Convertible For Sale NJ | BMW Dealer In EatontownJoseph Falotico
 
2010 BMW M5 Sedan Circle BMW NJ
2010 BMW M5 Sedan Circle BMW NJ2010 BMW M5 Sedan Circle BMW NJ
2010 BMW M5 Sedan Circle BMW NJJoseph Falotico
 
Hawaii shippers council foreign built - arctic icebreakers for the us coast...
Hawaii shippers council   foreign built - arctic icebreakers for the us coast...Hawaii shippers council   foreign built - arctic icebreakers for the us coast...
Hawaii shippers council foreign built - arctic icebreakers for the us coast...Clifton M. Hasegawa & Associates, LLC
 
HAWAI`I RACEWAY PARK - A MOTOR SPORTS VENUE FOR THE STATE OF HAWAI`I
HAWAI`I RACEWAY PARK - A MOTOR SPORTS VENUE FOR THE STATE OF HAWAI`IHAWAI`I RACEWAY PARK - A MOTOR SPORTS VENUE FOR THE STATE OF HAWAI`I
HAWAI`I RACEWAY PARK - A MOTOR SPORTS VENUE FOR THE STATE OF HAWAI`IClifton M. Hasegawa & Associates, LLC
 
BUILDING THE HAWAIIAN NATION - THE LEADERSHIP, WISDOM AND VISION OF OUR KINGS
BUILDING THE HAWAIIAN NATION - THE LEADERSHIP, WISDOM AND VISION OF OUR KINGSBUILDING THE HAWAIIAN NATION - THE LEADERSHIP, WISDOM AND VISION OF OUR KINGS
BUILDING THE HAWAIIAN NATION - THE LEADERSHIP, WISDOM AND VISION OF OUR KINGSClifton M. Hasegawa & Associates, LLC
 
President Barack Obama & The Federal Maritime Commission | Passē ~ Impassé | ...
President Barack Obama & The Federal Maritime Commission | Passē ~ Impassé | ...President Barack Obama & The Federal Maritime Commission | Passē ~ Impassé | ...
President Barack Obama & The Federal Maritime Commission | Passē ~ Impassé | ...Clifton M. Hasegawa & Associates, LLC
 
Building The Hawaiian Nation - Bilateral Treaties - Hawaii the Past, The Futu...
Building The Hawaiian Nation - Bilateral Treaties - Hawaii the Past, The Futu...Building The Hawaiian Nation - Bilateral Treaties - Hawaii the Past, The Futu...
Building The Hawaiian Nation - Bilateral Treaties - Hawaii the Past, The Futu...Clifton M. Hasegawa & Associates, LLC
 
2011 BMW Z4 Roadster Circle BMW NJ
2011 BMW Z4 Roadster Circle BMW NJ2011 BMW Z4 Roadster Circle BMW NJ
2011 BMW Z4 Roadster Circle BMW NJJoseph Falotico
 
MAUNA KEA - THIRTY METER TELESCOPE - ISSUANCE OF AN EXECUTIVE ORDER REQUIRED...
MAUNA KEA - THIRTY METER TELESCOPE -  ISSUANCE OF AN EXECUTIVE ORDER REQUIRED...MAUNA KEA - THIRTY METER TELESCOPE -  ISSUANCE OF AN EXECUTIVE ORDER REQUIRED...
MAUNA KEA - THIRTY METER TELESCOPE - ISSUANCE OF AN EXECUTIVE ORDER REQUIRED...Clifton M. Hasegawa & Associates, LLC
 
CHIEF LOUIS KEALOHA - HONOLULU POLICE DEPARTMENT --- ACTION ITEM FOR HONOLULU...
CHIEF LOUIS KEALOHA - HONOLULU POLICE DEPARTMENT --- ACTION ITEM FOR HONOLULU...CHIEF LOUIS KEALOHA - HONOLULU POLICE DEPARTMENT --- ACTION ITEM FOR HONOLULU...
CHIEF LOUIS KEALOHA - HONOLULU POLICE DEPARTMENT --- ACTION ITEM FOR HONOLULU...Clifton M. Hasegawa & Associates, LLC
 
Maui gmo initiative decision by us district court - district of hawaii 2015
Maui gmo initiative   decision by us district court - district of hawaii 2015Maui gmo initiative   decision by us district court - district of hawaii 2015
Maui gmo initiative decision by us district court - district of hawaii 2015Clifton M. Hasegawa & Associates, LLC
 
US DISTRICT JUDGE BARRY M. KURREN - KAUAI MAYOR BERNARD P. CARVALHO - SYGENT...
US DISTRICT JUDGE BARRY M. KURREN - KAUAI  MAYOR BERNARD P. CARVALHO - SYGENT...US DISTRICT JUDGE BARRY M. KURREN - KAUAI  MAYOR BERNARD P. CARVALHO - SYGENT...
US DISTRICT JUDGE BARRY M. KURREN - KAUAI MAYOR BERNARD P. CARVALHO - SYGENT...Clifton M. Hasegawa & Associates, LLC
 
The Hawai`i Commission on Water Resource Management --- A Good Steward, A Goo...
The Hawai`i Commission on Water Resource Management --- A Good Steward, A Goo...The Hawai`i Commission on Water Resource Management --- A Good Steward, A Goo...
The Hawai`i Commission on Water Resource Management --- A Good Steward, A Goo...Clifton M. Hasegawa & Associates, LLC
 

En vedette (20)

2012 BMW 1 Series Convertible For Sale NJ | BMW Dealer In Eatontown
2012 BMW 1 Series Convertible For Sale NJ | BMW Dealer In Eatontown2012 BMW 1 Series Convertible For Sale NJ | BMW Dealer In Eatontown
2012 BMW 1 Series Convertible For Sale NJ | BMW Dealer In Eatontown
 
2010 BMW M5 Sedan Circle BMW NJ
2010 BMW M5 Sedan Circle BMW NJ2010 BMW M5 Sedan Circle BMW NJ
2010 BMW M5 Sedan Circle BMW NJ
 
Erehown Ranch
Erehown Ranch Erehown Ranch
Erehown Ranch
 
Maui GMO initiative - US DISTRICT COURT - HAWAII
Maui GMO initiative - US DISTRICT COURT - HAWAII Maui GMO initiative - US DISTRICT COURT - HAWAII
Maui GMO initiative - US DISTRICT COURT - HAWAII
 
THE JONES ACT - Exemption or Reform - HAWAII - ALASKA - PUERTO RICO
THE JONES ACT - Exemption or Reform - HAWAII - ALASKA - PUERTO RICOTHE JONES ACT - Exemption or Reform - HAWAII - ALASKA - PUERTO RICO
THE JONES ACT - Exemption or Reform - HAWAII - ALASKA - PUERTO RICO
 
Governor neil abercrombie august 24 2014
Governor neil abercrombie   august 24 2014Governor neil abercrombie   august 24 2014
Governor neil abercrombie august 24 2014
 
Hawaii shippers council foreign built - arctic icebreakers for the us coast...
Hawaii shippers council   foreign built - arctic icebreakers for the us coast...Hawaii shippers council   foreign built - arctic icebreakers for the us coast...
Hawaii shippers council foreign built - arctic icebreakers for the us coast...
 
HAWAI`I RACEWAY PARK - A MOTOR SPORTS VENUE FOR THE STATE OF HAWAI`I
HAWAI`I RACEWAY PARK - A MOTOR SPORTS VENUE FOR THE STATE OF HAWAI`IHAWAI`I RACEWAY PARK - A MOTOR SPORTS VENUE FOR THE STATE OF HAWAI`I
HAWAI`I RACEWAY PARK - A MOTOR SPORTS VENUE FOR THE STATE OF HAWAI`I
 
BUILDING THE HAWAIIAN NATION - THE LEADERSHIP, WISDOM AND VISION OF OUR KINGS
BUILDING THE HAWAIIAN NATION - THE LEADERSHIP, WISDOM AND VISION OF OUR KINGSBUILDING THE HAWAIIAN NATION - THE LEADERSHIP, WISDOM AND VISION OF OUR KINGS
BUILDING THE HAWAIIAN NATION - THE LEADERSHIP, WISDOM AND VISION OF OUR KINGS
 
Columbia Community Exchange registration form
Columbia Community Exchange registration formColumbia Community Exchange registration form
Columbia Community Exchange registration form
 
President Barack Obama & The Federal Maritime Commission | Passē ~ Impassé | ...
President Barack Obama & The Federal Maritime Commission | Passē ~ Impassé | ...President Barack Obama & The Federal Maritime Commission | Passē ~ Impassé | ...
President Barack Obama & The Federal Maritime Commission | Passē ~ Impassé | ...
 
Building The Hawaiian Nation - Bilateral Treaties - Hawaii the Past, The Futu...
Building The Hawaiian Nation - Bilateral Treaties - Hawaii the Past, The Futu...Building The Hawaiian Nation - Bilateral Treaties - Hawaii the Past, The Futu...
Building The Hawaiian Nation - Bilateral Treaties - Hawaii the Past, The Futu...
 
Governor Neil Abercrombie August 24 2014
Governor Neil Abercrombie   August 24 2014Governor Neil Abercrombie   August 24 2014
Governor Neil Abercrombie August 24 2014
 
2011 BMW Z4 Roadster Circle BMW NJ
2011 BMW Z4 Roadster Circle BMW NJ2011 BMW Z4 Roadster Circle BMW NJ
2011 BMW Z4 Roadster Circle BMW NJ
 
MAUNA KEA - THIRTY METER TELESCOPE - ISSUANCE OF AN EXECUTIVE ORDER REQUIRED...
MAUNA KEA - THIRTY METER TELESCOPE -  ISSUANCE OF AN EXECUTIVE ORDER REQUIRED...MAUNA KEA - THIRTY METER TELESCOPE -  ISSUANCE OF AN EXECUTIVE ORDER REQUIRED...
MAUNA KEA - THIRTY METER TELESCOPE - ISSUANCE OF AN EXECUTIVE ORDER REQUIRED...
 
CHIEF LOUIS KEALOHA - HONOLULU POLICE DEPARTMENT --- ACTION ITEM FOR HONOLULU...
CHIEF LOUIS KEALOHA - HONOLULU POLICE DEPARTMENT --- ACTION ITEM FOR HONOLULU...CHIEF LOUIS KEALOHA - HONOLULU POLICE DEPARTMENT --- ACTION ITEM FOR HONOLULU...
CHIEF LOUIS KEALOHA - HONOLULU POLICE DEPARTMENT --- ACTION ITEM FOR HONOLULU...
 
Maui gmo initiative decision by us district court - district of hawaii 2015
Maui gmo initiative   decision by us district court - district of hawaii 2015Maui gmo initiative   decision by us district court - district of hawaii 2015
Maui gmo initiative decision by us district court - district of hawaii 2015
 
US DISTRICT JUDGE BARRY M. KURREN - KAUAI MAYOR BERNARD P. CARVALHO - SYGENT...
US DISTRICT JUDGE BARRY M. KURREN - KAUAI  MAYOR BERNARD P. CARVALHO - SYGENT...US DISTRICT JUDGE BARRY M. KURREN - KAUAI  MAYOR BERNARD P. CARVALHO - SYGENT...
US DISTRICT JUDGE BARRY M. KURREN - KAUAI MAYOR BERNARD P. CARVALHO - SYGENT...
 
The Hawai`i Commission on Water Resource Management --- A Good Steward, A Goo...
The Hawai`i Commission on Water Resource Management --- A Good Steward, A Goo...The Hawai`i Commission on Water Resource Management --- A Good Steward, A Goo...
The Hawai`i Commission on Water Resource Management --- A Good Steward, A Goo...
 
GMO - MAUI COUNTY FARM BAN - MAUI COUNTY VOTER INITIATIVE 2014
GMO - MAUI COUNTY FARM BAN - MAUI COUNTY VOTER INITIATIVE 2014GMO - MAUI COUNTY FARM BAN - MAUI COUNTY VOTER INITIATIVE 2014
GMO - MAUI COUNTY FARM BAN - MAUI COUNTY VOTER INITIATIVE 2014
 

Similaire à Panasas ® University of Cologne Success Story

Panasas® activestor® and ansys
Panasas® activestor® and ansysPanasas® activestor® and ansys
Panasas® activestor® and ansysPanasas
 
CloudLightning and the OPM-based Use Case
CloudLightning and the OPM-based Use CaseCloudLightning and the OPM-based Use Case
CloudLightning and the OPM-based Use CaseCloudLightning
 
Gestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMF
Gestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMFGestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMF
Gestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMFSUSE Italy
 
BUILDING A PRIVATE HPC CLOUD FOR COMPUTE AND DATA-INTENSIVE APPLICATIONS
BUILDING A PRIVATE HPC CLOUD FOR COMPUTE AND DATA-INTENSIVE APPLICATIONSBUILDING A PRIVATE HPC CLOUD FOR COMPUTE AND DATA-INTENSIVE APPLICATIONS
BUILDING A PRIVATE HPC CLOUD FOR COMPUTE AND DATA-INTENSIVE APPLICATIONSijccsa
 
UCSC's Biomolecular Department Eliminates I/O Bottleneck with Panasas
UCSC's Biomolecular Department Eliminates I/O Bottleneck with PanasasUCSC's Biomolecular Department Eliminates I/O Bottleneck with Panasas
UCSC's Biomolecular Department Eliminates I/O Bottleneck with PanasasPanasas
 
Carlson Companies is one of the largest privately held compani.docx
Carlson Companies is one of the largest privately held compani.docxCarlson Companies is one of the largest privately held compani.docx
Carlson Companies is one of the largest privately held compani.docxwendolynhalbert
 
Panasas® Utah State Univercity
Panasas®  Utah State UnivercityPanasas®  Utah State Univercity
Panasas® Utah State UnivercityPanasas
 
MayaData Datastax webinar - Operating Cassandra on Kubernetes with the help ...
MayaData  Datastax webinar - Operating Cassandra on Kubernetes with the help ...MayaData  Datastax webinar - Operating Cassandra on Kubernetes with the help ...
MayaData Datastax webinar - Operating Cassandra on Kubernetes with the help ...MayaData Inc
 
Silverton consulting a review of hus and hnas platform
Silverton consulting a review of hus and hnas platformSilverton consulting a review of hus and hnas platform
Silverton consulting a review of hus and hnas platformHitachi Vantara
 
Desktop as a Service supporting Environmental ‘omics
Desktop as a Service supporting Environmental ‘omicsDesktop as a Service supporting Environmental ‘omics
Desktop as a Service supporting Environmental ‘omicsDavid Wallom
 
Introduction to Apache Mesos and DC/OS
Introduction to Apache Mesos and DC/OSIntroduction to Apache Mesos and DC/OS
Introduction to Apache Mesos and DC/OSSteve Wong
 
Ceph Day New York 2014: Ceph over High Performance Networks
Ceph Day New York 2014: Ceph over High Performance NetworksCeph Day New York 2014: Ceph over High Performance Networks
Ceph Day New York 2014: Ceph over High Performance NetworksCeph Community
 
IEEE Paper - A Study Of Cloud Computing Environments For High Performance App...
IEEE Paper - A Study Of Cloud Computing Environments For High Performance App...IEEE Paper - A Study Of Cloud Computing Environments For High Performance App...
IEEE Paper - A Study Of Cloud Computing Environments For High Performance App...Angela Williams
 
Ceph Day London 2014 - Ceph Over High-Performance Networks
Ceph Day London 2014 - Ceph Over High-Performance Networks Ceph Day London 2014 - Ceph Over High-Performance Networks
Ceph Day London 2014 - Ceph Over High-Performance Networks Ceph Community
 
Designing HPC, Deep Learning, and Cloud Middleware for Exascale Systems
Designing HPC, Deep Learning, and Cloud Middleware for Exascale SystemsDesigning HPC, Deep Learning, and Cloud Middleware for Exascale Systems
Designing HPC, Deep Learning, and Cloud Middleware for Exascale Systemsinside-BigData.com
 
Alfresco benchmark report_bl100093
Alfresco benchmark report_bl100093Alfresco benchmark report_bl100093
Alfresco benchmark report_bl100093ECNU
 
Genomics Center Compares 100s of Computations Simultaneously with Panasas
Genomics Center Compares 100s of Computations Simultaneously with PanasasGenomics Center Compares 100s of Computations Simultaneously with Panasas
Genomics Center Compares 100s of Computations Simultaneously with PanasasPanasas
 
High-Performance Storage for the Evolving Computational Requirements of Energ...
High-Performance Storage for the Evolving Computational Requirements of Energ...High-Performance Storage for the Evolving Computational Requirements of Energ...
High-Performance Storage for the Evolving Computational Requirements of Energ...Hitachi Vantara
 

Similaire à Panasas ® University of Cologne Success Story (20)

Panasas® activestor® and ansys
Panasas® activestor® and ansysPanasas® activestor® and ansys
Panasas® activestor® and ansys
 
CloudLightning and the OPM-based Use Case
CloudLightning and the OPM-based Use CaseCloudLightning and the OPM-based Use Case
CloudLightning and the OPM-based Use Case
 
Gestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMF
Gestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMFGestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMF
Gestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMF
 
BUILDING A PRIVATE HPC CLOUD FOR COMPUTE AND DATA-INTENSIVE APPLICATIONS
BUILDING A PRIVATE HPC CLOUD FOR COMPUTE AND DATA-INTENSIVE APPLICATIONSBUILDING A PRIVATE HPC CLOUD FOR COMPUTE AND DATA-INTENSIVE APPLICATIONS
BUILDING A PRIVATE HPC CLOUD FOR COMPUTE AND DATA-INTENSIVE APPLICATIONS
 
UCSC's Biomolecular Department Eliminates I/O Bottleneck with Panasas
UCSC's Biomolecular Department Eliminates I/O Bottleneck with PanasasUCSC's Biomolecular Department Eliminates I/O Bottleneck with Panasas
UCSC's Biomolecular Department Eliminates I/O Bottleneck with Panasas
 
Carlson Companies is one of the largest privately held compani.docx
Carlson Companies is one of the largest privately held compani.docxCarlson Companies is one of the largest privately held compani.docx
Carlson Companies is one of the largest privately held compani.docx
 
Panasas® Utah State Univercity
Panasas®  Utah State UnivercityPanasas®  Utah State Univercity
Panasas® Utah State Univercity
 
MayaData Datastax webinar - Operating Cassandra on Kubernetes with the help ...
MayaData  Datastax webinar - Operating Cassandra on Kubernetes with the help ...MayaData  Datastax webinar - Operating Cassandra on Kubernetes with the help ...
MayaData Datastax webinar - Operating Cassandra on Kubernetes with the help ...
 
Silverton consulting a review of hus and hnas platform
Silverton consulting a review of hus and hnas platformSilverton consulting a review of hus and hnas platform
Silverton consulting a review of hus and hnas platform
 
Desktop as a Service supporting Environmental ‘omics
Desktop as a Service supporting Environmental ‘omicsDesktop as a Service supporting Environmental ‘omics
Desktop as a Service supporting Environmental ‘omics
 
OpenStack Kilo - April 2015
OpenStack Kilo - April 2015OpenStack Kilo - April 2015
OpenStack Kilo - April 2015
 
Introduction to Apache Mesos and DC/OS
Introduction to Apache Mesos and DC/OSIntroduction to Apache Mesos and DC/OS
Introduction to Apache Mesos and DC/OS
 
Ceph Day New York 2014: Ceph over High Performance Networks
Ceph Day New York 2014: Ceph over High Performance NetworksCeph Day New York 2014: Ceph over High Performance Networks
Ceph Day New York 2014: Ceph over High Performance Networks
 
IEEE Paper - A Study Of Cloud Computing Environments For High Performance App...
IEEE Paper - A Study Of Cloud Computing Environments For High Performance App...IEEE Paper - A Study Of Cloud Computing Environments For High Performance App...
IEEE Paper - A Study Of Cloud Computing Environments For High Performance App...
 
Ceph Day London 2014 - Ceph Over High-Performance Networks
Ceph Day London 2014 - Ceph Over High-Performance Networks Ceph Day London 2014 - Ceph Over High-Performance Networks
Ceph Day London 2014 - Ceph Over High-Performance Networks
 
Designing HPC, Deep Learning, and Cloud Middleware for Exascale Systems
Designing HPC, Deep Learning, and Cloud Middleware for Exascale SystemsDesigning HPC, Deep Learning, and Cloud Middleware for Exascale Systems
Designing HPC, Deep Learning, and Cloud Middleware for Exascale Systems
 
8 Strategies For Building A Modern DataCenter
8 Strategies For Building A Modern DataCenter8 Strategies For Building A Modern DataCenter
8 Strategies For Building A Modern DataCenter
 
Alfresco benchmark report_bl100093
Alfresco benchmark report_bl100093Alfresco benchmark report_bl100093
Alfresco benchmark report_bl100093
 
Genomics Center Compares 100s of Computations Simultaneously with Panasas
Genomics Center Compares 100s of Computations Simultaneously with PanasasGenomics Center Compares 100s of Computations Simultaneously with Panasas
Genomics Center Compares 100s of Computations Simultaneously with Panasas
 
High-Performance Storage for the Evolving Computational Requirements of Energ...
High-Performance Storage for the Evolving Computational Requirements of Energ...High-Performance Storage for the Evolving Computational Requirements of Energ...
High-Performance Storage for the Evolving Computational Requirements of Energ...
 

Plus de Panasas

Is Your Storage Ready for Commercial HPC? - Three Steps to Take
Is Your Storage Ready for Commercial HPC? - Three Steps to TakeIs Your Storage Ready for Commercial HPC? - Three Steps to Take
Is Your Storage Ready for Commercial HPC? - Three Steps to TakePanasas
 
PanasasActiveStor
PanasasActiveStorPanasasActiveStor
PanasasActiveStorPanasas
 
Panasas ActiveStor Reliability that Improves with Scale
Panasas ActiveStor Reliability that Improves with ScalePanasas ActiveStor Reliability that Improves with Scale
Panasas ActiveStor Reliability that Improves with ScalePanasas
 
Evolution of RAID
Evolution of RAIDEvolution of RAID
Evolution of RAIDPanasas
 
ActiveStor Performance at Scale
ActiveStor Performance at ScaleActiveStor Performance at Scale
ActiveStor Performance at ScalePanasas
 
Panasas ® California Institute of Technology Success Story
Panasas ® California Institute of Technology Success StoryPanasas ® California Institute of Technology Success Story
Panasas ® California Institute of Technology Success StoryPanasas
 
PANASAS® ACTIVESTOR® AND STAR-CCM+
PANASAS® ACTIVESTOR® AND STAR-CCM+PANASAS® ACTIVESTOR® AND STAR-CCM+
PANASAS® ACTIVESTOR® AND STAR-CCM+Panasas
 
Panasas ® Deluxe Australlia
Panasas ® Deluxe Australlia Panasas ® Deluxe Australlia
Panasas ® Deluxe Australlia Panasas
 
Panasas ® University of Oxford
Panasas ®  University of OxfordPanasas ®  University of Oxford
Panasas ® University of OxfordPanasas
 
Panasas ® Terraspark Geosciences Customer Success Story
Panasas ®  Terraspark Geosciences Customer Success StoryPanasas ®  Terraspark Geosciences Customer Success Story
Panasas ® Terraspark Geosciences Customer Success StoryPanasas
 
Panasas ® UCLA Customer Success Story
Panasas ®  UCLA Customer Success StoryPanasas ®  UCLA Customer Success Story
Panasas ® UCLA Customer Success StoryPanasas
 
Panasas ® The Defence Academy of the United Kingdom
Panasas ®  The Defence Academy of the United Kingdom Panasas ®  The Defence Academy of the United Kingdom
Panasas ® The Defence Academy of the United Kingdom Panasas
 
Accelerate Discovery
Accelerate DiscoveryAccelerate Discovery
Accelerate DiscoveryPanasas
 
Accelerate Financial Simulation & Analytics
Accelerate Financial Simulation & AnalyticsAccelerate Financial Simulation & Analytics
Accelerate Financial Simulation & AnalyticsPanasas
 
Accelerate Oil & Gas Discovery
Accelerate Oil & Gas DiscoveryAccelerate Oil & Gas Discovery
Accelerate Oil & Gas DiscoveryPanasas
 
Panasas® ActiveStor ® 16
Panasas® ActiveStor ® 16Panasas® ActiveStor ® 16
Panasas® ActiveStor ® 16Panasas
 
Accelerating Design in Manufacturing Environments
Accelerating Design in Manufacturing EnvironmentsAccelerating Design in Manufacturing Environments
Accelerating Design in Manufacturing EnvironmentsPanasas
 
Panasas ActiveStor 11 and 12: Parallel NAS Appliance for HPC Workloads
Panasas ActiveStor 11 and 12: Parallel NAS Appliance for HPC WorkloadsPanasas ActiveStor 11 and 12: Parallel NAS Appliance for HPC Workloads
Panasas ActiveStor 11 and 12: Parallel NAS Appliance for HPC WorkloadsPanasas
 
The Andrej Sali Lab Processes Millions of Small Files with Panasas
The Andrej Sali Lab Processes Millions of Small Files with PanasasThe Andrej Sali Lab Processes Millions of Small Files with Panasas
The Andrej Sali Lab Processes Millions of Small Files with PanasasPanasas
 
Panasas Storage Smooths Turbulence for ICME at Stanford University
Panasas Storage Smooths Turbulence for ICME at Stanford UniversityPanasas Storage Smooths Turbulence for ICME at Stanford University
Panasas Storage Smooths Turbulence for ICME at Stanford UniversityPanasas
 

Plus de Panasas (20)

Is Your Storage Ready for Commercial HPC? - Three Steps to Take
Is Your Storage Ready for Commercial HPC? - Three Steps to TakeIs Your Storage Ready for Commercial HPC? - Three Steps to Take
Is Your Storage Ready for Commercial HPC? - Three Steps to Take
 
PanasasActiveStor
PanasasActiveStorPanasasActiveStor
PanasasActiveStor
 
Panasas ActiveStor Reliability that Improves with Scale
Panasas ActiveStor Reliability that Improves with ScalePanasas ActiveStor Reliability that Improves with Scale
Panasas ActiveStor Reliability that Improves with Scale
 
Evolution of RAID
Evolution of RAIDEvolution of RAID
Evolution of RAID
 
ActiveStor Performance at Scale
ActiveStor Performance at ScaleActiveStor Performance at Scale
ActiveStor Performance at Scale
 
Panasas ® California Institute of Technology Success Story
Panasas ® California Institute of Technology Success StoryPanasas ® California Institute of Technology Success Story
Panasas ® California Institute of Technology Success Story
 
PANASAS® ACTIVESTOR® AND STAR-CCM+
PANASAS® ACTIVESTOR® AND STAR-CCM+PANASAS® ACTIVESTOR® AND STAR-CCM+
PANASAS® ACTIVESTOR® AND STAR-CCM+
 
Panasas ® Deluxe Australlia
Panasas ® Deluxe Australlia Panasas ® Deluxe Australlia
Panasas ® Deluxe Australlia
 
Panasas ® University of Oxford
Panasas ®  University of OxfordPanasas ®  University of Oxford
Panasas ® University of Oxford
 
Panasas ® Terraspark Geosciences Customer Success Story
Panasas ®  Terraspark Geosciences Customer Success StoryPanasas ®  Terraspark Geosciences Customer Success Story
Panasas ® Terraspark Geosciences Customer Success Story
 
Panasas ® UCLA Customer Success Story
Panasas ®  UCLA Customer Success StoryPanasas ®  UCLA Customer Success Story
Panasas ® UCLA Customer Success Story
 
Panasas ® The Defence Academy of the United Kingdom
Panasas ®  The Defence Academy of the United Kingdom Panasas ®  The Defence Academy of the United Kingdom
Panasas ® The Defence Academy of the United Kingdom
 
Accelerate Discovery
Accelerate DiscoveryAccelerate Discovery
Accelerate Discovery
 
Accelerate Financial Simulation & Analytics
Accelerate Financial Simulation & AnalyticsAccelerate Financial Simulation & Analytics
Accelerate Financial Simulation & Analytics
 
Accelerate Oil & Gas Discovery
Accelerate Oil & Gas DiscoveryAccelerate Oil & Gas Discovery
Accelerate Oil & Gas Discovery
 
Panasas® ActiveStor ® 16
Panasas® ActiveStor ® 16Panasas® ActiveStor ® 16
Panasas® ActiveStor ® 16
 
Accelerating Design in Manufacturing Environments
Accelerating Design in Manufacturing EnvironmentsAccelerating Design in Manufacturing Environments
Accelerating Design in Manufacturing Environments
 
Panasas ActiveStor 11 and 12: Parallel NAS Appliance for HPC Workloads
Panasas ActiveStor 11 and 12: Parallel NAS Appliance for HPC WorkloadsPanasas ActiveStor 11 and 12: Parallel NAS Appliance for HPC Workloads
Panasas ActiveStor 11 and 12: Parallel NAS Appliance for HPC Workloads
 
The Andrej Sali Lab Processes Millions of Small Files with Panasas
The Andrej Sali Lab Processes Millions of Small Files with PanasasThe Andrej Sali Lab Processes Millions of Small Files with Panasas
The Andrej Sali Lab Processes Millions of Small Files with Panasas
 
Panasas Storage Smooths Turbulence for ICME at Stanford University
Panasas Storage Smooths Turbulence for ICME at Stanford UniversityPanasas Storage Smooths Turbulence for ICME at Stanford University
Panasas Storage Smooths Turbulence for ICME at Stanford University
 

Panasas ® University of Cologne Success Story

  • 1. University of Cologne Panasas ActiveStor July 2006 Customer Success Story University of Cologne
  • 2. 1.888.PANASAS www.panasas.com University of Cologne Abstract In 2004, the Center for Applied Informatics at the University of Cologne in Germany, sought to bring high-performance computing (HPC) in the form of Linux cluster computing to one of the oldest and most prestigious institutions of higher education. Over the years as the demand on their HPC resources continued to grow, their existing storage systems could not keep pace. This case study details the challenges faced by the Center at the University of Cologne and how Panasas storage successfully met the Center’s requirements for a scalable, ultra high-performance storage infrastructure. Introduction The Center for Applied Informatics at the University of Cologne in Germany is a centralized resource for the study of applied computer science and general-purpose computing services for more than 50,000 students and faculty. In addition to serving the University, this testing facility also supports regional academic research projects that require high-performance computing. The facility was established by merging the resources of the University’s regional computing center with those of the University’s center for parallel processing. In 2004, the Center sought to bring high-performance computing (HPC) in the form of Linux cluster computing to one of the oldest and most prestigious institutions of higher education. Researchers would be able to use a NPACI Rocks Linux cluster for climate modeling simulations and supporting other applications in chemistry and geophysics. Over time, researchers at other universities and regional technical laboratories would come to rely on the Center to provide the computing capabilities they needed to study complex problems ranging from molecular processes to stellar formation. The applications being undertaken at the Center required substantial computing power and generated large amounts of data. As the demand on HPC resources continued to grow, the existing storage and associated NFS file systems that supported the HPC environment could not keep pace. A comprehensive evaluation was launched to select a new high-performance storage solution and led to the selection of Panasas storage. This case study details the challenges faced by the Center for Applied Informatics at the University of Cologne, and how the Panasas storage system has successfully met the Center’s requirements for a scalable, ultra high- performance storage infrastructure. Linux Cluster Architecture To support HPC users at the University of Cologne, the Center procured two new parallel compute systems including a distributed memory system known as Clio and a shared memory system called Altix1. Clio is a 129-node Linux NPACI Rocks cluster that has been in operation since late 2004. It serves as an entrance computer and it is comprised of the following: • 2 x 2.2 GHz AMD Opteron processors • 4GB RAM • 2 x 36 GB SCSI discs • 6 x Cisco 3750 switches • 2GB Ethernet connections • 1 x 10 GB Infiniband interface • 1 x Sun Fire Z20z system • Red Hat Linux Enterprise 3.0 The cluster also supports a shared memory model for parallel programming with an MPI library. For research that is not conducive to efficient parallel processing, the 2
  • 3. 1.888.PANASAS www.panasas.com University of Cologne Center secured an SGI Altix system – an SMP-based computer with 24 Itanium-2, 1.5GHz processors and 48GB of memory. The Center also uses a variety of compute services, including Sun Microsystems SunFire and Sun Ultra Enterprise servers for user applications that require high disk storage and fast I/O to achieve results. System Characteristics The NPACI Rocks Linux cluster is used for meteorology research (climate modeling) that requires substantial computing power and generates very large data sets. Additionally, applications in chemistry and geophysics make use of the high-performance cluster to perform complex data analysis and simulations. Research conducted at regional scientific laboratories relies on the Center’s HPC resources to test complex theories and conduct compute-intensive research that can only be accomplished with supercomputing capabilities. In each of these projects, the network storage infrastructure must be very fast. It must be capable of approximately one gigabyte per second of throughput with near-linear performance scalability as more storage is added. Putting the Industry’s Best to the Test The Center realized its reliance on legacy NFS servers was creating a significant performance bottleneck. The management of the system was also become a burden to the IT staff. The decision was made to upgrade the storage infrastructure. The Center needed a new storage system that could easily integrate into the existing environment, and scale with ease to support multiple clusters in the future. This would dramatically reduce time to deployment and enable the Center to maximize previous IT investments. Because the Center projected the HPC environment would increase from just over a hundred nodes to thousands of nodes within two years, the new storage solution would have to easily scale to thousands of terabytes without significant reductions in performance. The new storage system also needed to deliver the highest levels of availability as the demand for cluster time was expected to grow. Finally, because the Center had a relatively small IT staff, system reliability, ease-of-use and low management overhead were considered “must- have” features. Panasas Makes the Grade at University of Cologne The Center tested solutions from several leading storage vendors using agreed-upon parameters in performance and I/O. The Panasas storage solution was purchased after only a few weeks of evaluation. While benchmarking continues today, the Center has thus far achieved more than a 30X performance improvement over the previous storage system. Benchmarks show a transfer rate of up to 1.3 GB/second when running on 128 dual-processor nodes accessing 20TB of disk space. The Panasas storage solution was deployed in less than four hours while competitive solutions took weeks to implement. Each of the products offered a different methodology for incorporating NFS, CIFS or GPFS as part of their 3
  • 4. 070520111040 University of Cologne | Phone: 1.888.PANASAS | www.panasas.com © 2011 Panasas Incorporated. All rights reserved. Panasas is a trademark of Panasas, Inc. in the United States and other countries. overall solution. Panasas’ PanFS™, with its fully-parallel DirectFlow® protocol, was the only system to provide direct access between the Linux cluster nodes and storage system to eliminate the performance bottleneck caused by legacy storage systems. Unlike other systems, the Panasas solution required no modifications to the Linux OS kernel. Summary The Center for Applied Informatics at the University of Cologne has successfully deployed the Panasas storage system, creating a storage infrastructure with unlimited scalability, higher performance and higher availability. The Center uses Panasas storage with DirectFlow client access software to provide very high bandwidth to all nodes in a NPACI Rocks Linux cluster without the performance bottlenecks associated with legacy file systems. The Panasas storage solution enables the Linux cluster to avoid idle time and continue processing jobs without waiting for I/O processes, improving the speed at which research projects can be completed. As the Linux cluster grows from hundreds to thousands of nodes, Panasas storage is more than capable of keeping pace by scaling performance in near-linear fashion as capacity is increased. 4