The document discusses grid computing and the speaker's background in the topic. It provides key takeaways about understanding the evolution of technologies like grid computing and envisioning upcoming trends. It then discusses what a grid is, including early definitions, and elements of grid computing like resource sharing, coordinated problem solving, and dynamic virtual organizations. The document also outlines attributes of grid computing related to virtualization, dynamic provisioning, resource pooling, and self-adaptive software. It provides examples of how grids are used and lists common grid components.
prashanth updated resume 2024 for Teaching Profession
Gc vit sttp cc december 2013
1. 11-12-2013
GRID COMPUTING
Reference : Internet
12/11/2013
SPEAKER’S BACKGROUND IN GRID AND CLOUD
COMPUTING
An opening caveat
This talk is based on my:
My doctoral research in Grid Computing and
Shared memory
Review and session chair experience for
various conferences
Expert talks at various Institutes for faculty
and students in STTPs, Conferences etc.
Experience as a Project mentor
2
1
2. 11-12-2013
12/11/2013
KEY TAKEAWAYS
Widen personal technical spectrum
Understand the evolution of recent
technologies
Envision the upcoming technological trends
Be useful in Teaching STTP related and allied
subjects
Guiding projects –UG/PG
3
12/11/2013
ELECTRICAL GRID
4
2
3. 11-12-2013
12/11/2013
WHY GRIDS ? LARGE SCALE EXPLORATION NEEDS
THEM—KILLER APPLICATIONS.
Solving grand challenge applications using computer modeling,
simulation and analysis
Life Sciences
Aerospace
Internet &
Ecommerce
CAD/CAM
5
Digital Biology
Military Applications
12/11/2013
WHAT IS A GRID?
Early defs: Foster and Kesselman, 1998
“A computational grid is a hardware and software
infrastructure
that
provides
dependable,
consistent, pervasive, and inexpensive access to
high-end computational facilities”
Kleinrock 1969:
“We will probably see the spread of ‘computer
utilities’, which, like present electric and
telephone utilities, will service individual homes
and offices across the country.”
6
3
4. 11-12-2013
12/11/2013
GRID COMPUTING
7
12/11/2013
ELEMENTS OF GRID COMPUTING
Resource sharing
Computers, data, storage, sensors, networks, …
Sharing always conditional: issues of trust, policy,
negotiation, payment, …
Coordinated problem solving
Beyond client-server: distributed data analysis,
computation, collaboration, …
Dynamic, multi-institutional virtual
organizations
Community overlays on classic org structures
Large or small, static or dynamic
8
4
5. 11-12-2013
A Typical Grid Computing Environment
Grid Information Service
Grid Resource Broker
R2
2
R5
R3
Application
database
R4
RN
Grid Resource Broker
R6
R1
Resource Broker
Grid Information Service
12/
11/
201
3
9
12/11/2013
GRID COMPUTING: ATTRIBUTES (1)
Virtualization: Abstracting grid entity into service
It enables grid components to integrate tightly without creating rigidity
and brittleness in the system.
Components quickly react to change, and adapt failures without
compromising performance and reliability.
Dynamic Provisioning:
It simply means distributing supplies where they are needed. Supplies
mean request, data, computation
A grid service broker links grid elements together automatically and
dynamically, based on the knowledge about their requirements and
attributes. and adjust the association according to the change and
failures
10
5
6. 11-12-2013
12/11/2013
GRID COMPUTING: ATTRIBUTES (2)
Resource Pooling: contributes to lower cost
Consolidation and pooling is used for better utilization.
Provide flexibility to optimize the association
Self-Adaptive Software:
Everyday task of administrator are automated and simplified. The bulk
of maintenance and tuning is automated to reduce IT staff cost.
Unified Management:
Self-adaptive software does not eliminate human interaction. Unified
management is provided to simplify the management process.
Single tool can be used to provision, monitor, administer
11
12/11/2013
HOW ARE GRIDS USED?
Utility computing
High-performance computing
Collaborative design
Financial modeling
BELLE
Collaborative data-sharing
High-energy physics
E-Business
Drug discovery
Life sciences
Data center automation
E-Science
Natural language
processing
12
Business Intelligence
(Data Mining)
6
7. 11-12-2013
ONLINE ACCESS TO
SCIENTIFIC INSTRUMENTS
Advanced Photon Source
wide-area
dissemination
real-time
collection
archival
storage
desktop & VR clients
with shared controls
tomographic reconstruction
DOE X-ray grand challenge: USC NIST, U.Chicago
13
12/11/2013
12/11/2013
GRID COMPUTING: COMPONENTS
•
Computation:
–
•
Networked Storage:
–
•
Integrated view of data storage (Datagrid). Local disk,
secondary storage, mountable, Unified name space
Network interconnects:
–
•
Computing cycles provided by processors of grid machines.
Simple, parallel, iterative uses of computing elements
Fast interconnection technologies. Redundant and external
Internet connections makes parallel processing faster, and
management better.
Software and licenses
–
Expensive software, Sharing Expensive licenses, Limited
use of multiple installation
14
7
8. 11-12-2013
12/11/2013
GRID ARCHITECTURE (SERVICE-ORIENTED)
Applications
Grid Architected Services
Web Services (Extended Web Services)
Security
Filesystems
Servers
Database
Storage
Directory
Messaging
Network
15
Grid developers
Tool developers
Application developers
End Users
System
Administrators
GRID TYPES
12/11/2013
GRID USERS
Compute grid
Data grid
Grids on the Internet
16
8
9. 11-12-2013
12/11/2013
OPEN GRID SERVICES ARCHITECTURE
Developed by the Global Grid Forum to define a
common, standard, and open architectures for
Grid-based applications.
Provides a standard approach to all services on the
Grid.
VO Management Service.
Resource discovery and management service:
Job management service.
Security services.
Data management services.
Built on top of and extends the Web Services
architecture, protocols, and interfaces.
12/11/2013
CDAC: GARUDA COMPONENT ARCHITECTURE
17
18
9
10. 11-12-2013
12/11/2013
MANY GRID PROJECTS & INITIATIVES
Australia
Nimrod-G
GridSim
Virtual Lab
Gridbus
DISCWorld
..new coming up
USA
Globus
Legion
OGSA
Javelin
AppLeS
NASA IPG
Condor-G
Jxta
NetSolve
AccessGrid
and many more...
Europe
UNICORE
MOL
UK eScience
Poland MC Broker
EU Data Grid
EuroGrid
MetaMPI
Dutch DAS
XW, JaWS
Japan
Cycle Stealing & .com Initiatives
Distributed.net
SETI@Home, ….
Entropia, UD, Parabon,….
Public Forums
Global Grid Forum
P2P Working Group
IEEE TFCC
Grid & CCGrid conferences
Ninf
DataFarm
Korea...
N*Grid
19
http://www.gridcomputing.com
12/11/2013
GRID APPLICATIONS-DRIVERS
Distributed HPC (Supercomputing):
Computational science.
High-throughput computing:
Large scale simulation/chip design & parameter studies.
Content Sharing
Sharing digital contents among peers (e.g., Napster)
Remote software access/renting services:
Application service provides (ASPs).
Data-intensive computing:
Data mining, particle physics (CERN), Drug Design.
On-demand computing:
Medical instrumentation & network-enabled solvers.
Collaborative:
Collaborative design, data exploration, education.
20
10
11. 11-12-2013
12/11/2013
GLOBUS
Five parts:
Common Runtime
GT Core for building new services
Security
To provide secure access. Based upon Grid Security
Infrastructure (GSI)
Execution management
Initiation, monitoring, management, scheduling and
coordination of executable programs (jobs)
Data management
Discover, transfer, and access large data
Information services
Discover & monitor dynamic services
12/11/2013
GLOBUS TOOLKIT
21
22
11
12. 11-12-2013
G
T
4
G
T
3
G
T
2
Python WS Core
[contribution]
C WS Core
Community
Authorization
Service
OGSA-DAI
[Tech Preview]
WS
Authentication
Authorization
Reliable
File
Transfer
Grid
Resource
Allocation Mgmt
(WS GRAM)
Monitoring
& Discovery
System
(MDS4)
Java WS Core
Pre-WS
Authentication
Authorization
GridFTP
Grid
Resource
Allocation Mgmt
(Pre-WS GRAM)
Monitoring
& Discovery
System
(MDS2)
C Common
Libraries
G
T
3
G
T
4
Community
Scheduler
Framework
[contribution]
Delegation
Service
Web
Services
Components
Non-WS
Components
Replica
Location
Service
XIO
Credential
Management
23
Security
Data
Management
Execution
Management
Information
Services
Common
Runtime
G
T
3
G
T
2
Python WS Core
[contribution]
C WS Core
Community
Authorization
Service
OGSA-DAI
[Tech Preview]
WS
Authentication
Authorization
Reliable
File
Transfer
Grid
Resource
Allocation Mgmt
(WS GRAM)
Monitoring
& Discovery
System
(MDS4)
Java WS Core
Pre-WS
Authentication
Authorization
GridFTP
Grid
Resource
Allocation Mgmt
(Pre-WS GRAM)
Monitoring
& Discovery
System
(MDS2)
C Common
Libraries
G
T
3
G
T
4
Community
Scheduler
Framework
[contribution]
Delegation
Service
12/11/2013
Globus Open Source Grid Software
G
T
4
12/11/2013
Globus Open Source Grid Software
Web
Services
Components
Non-WS
Components
Replica
Location
Service
XIO
Credential
Management
24
Security
Data
Management
Execution
Management
Information
Services
Common
Runtime
12
13. 11-12-2013
12/11/2013
GRID SIMULATOR: OPTORSIM
Models the interactions of the individual components of a
running Data Grid.
Simulates optimization and replication
25
12/11/2013
CONVERGENCE OF COMPETING
PARADIGMS/COMMUNITIES NEEDED
} ?
Web
Data Centres
Utility Computing
Service Computing
Grid Computing
P2P Computing
Cloud Computing
Market-Oriented
Computing
…
Paradigms
+
•Ubiquitous
access
•Reliability
•Scalability
•Autonomic
•Dynamic
discovery
•Composability
•QoS
•SLA
•…
Attributes/Capabilities
-Trillion $ business
- Who will own it?
26
Manjrasoft
13
14. 11-12-2013
VOLUNTEERS ARE SELDOM PAID; NOT
BECAUSE THEY ARE WORTHLESS, BUT
BECAUSE THEY ARE PRICELESS!
--AUTHOR UNKNOWN
Contact:
principal@vit.edu.in; 4.seema@gmail.com
+919833818846
14