SlideShare une entreprise Scribd logo
1  sur  14
Télécharger pour lire hors ligne
11-12-2013

GRID COMPUTING
Reference : Internet

12/11/2013

SPEAKER’S BACKGROUND IN GRID AND CLOUD
COMPUTING

An opening caveat
This talk is based on my:
My doctoral research in Grid Computing and
Shared memory
Review and session chair experience for
various conferences
Expert talks at various Institutes for faculty
and students in STTPs, Conferences etc.
Experience as a Project mentor
2

1
11-12-2013

12/11/2013

KEY TAKEAWAYS
Widen personal technical spectrum
Understand the evolution of recent
technologies
Envision the upcoming technological trends
Be useful in Teaching STTP related and allied
subjects
Guiding projects –UG/PG

3

12/11/2013

ELECTRICAL GRID

4

2
11-12-2013

12/11/2013

WHY GRIDS ? LARGE SCALE EXPLORATION NEEDS
THEM—KILLER APPLICATIONS.
Solving grand challenge applications using computer modeling,
simulation and analysis

Life Sciences

Aerospace
Internet &
Ecommerce

CAD/CAM

5

Digital Biology

Military Applications

12/11/2013

WHAT IS A GRID?
Early defs: Foster and Kesselman, 1998
“A computational grid is a hardware and software
infrastructure
that
provides
dependable,
consistent, pervasive, and inexpensive access to
high-end computational facilities”

Kleinrock 1969:
“We will probably see the spread of ‘computer
utilities’, which, like present electric and
telephone utilities, will service individual homes
and offices across the country.”
6

3
11-12-2013

12/11/2013

GRID COMPUTING

7

12/11/2013

ELEMENTS OF GRID COMPUTING

Resource sharing
Computers, data, storage, sensors, networks, …
Sharing always conditional: issues of trust, policy,
negotiation, payment, …
Coordinated problem solving
Beyond client-server: distributed data analysis,
computation, collaboration, …
Dynamic, multi-institutional virtual
organizations
Community overlays on classic org structures
Large or small, static or dynamic
8

4
11-12-2013

A Typical Grid Computing Environment

Grid Information Service

Grid Resource Broker

R2

2

R5

R3

Application

database

R4

RN

Grid Resource Broker
R6

R1

Resource Broker

Grid Information Service
12/
11/
201
3

9

12/11/2013

GRID COMPUTING: ATTRIBUTES (1)
Virtualization: Abstracting grid entity into service

It enables grid components to integrate tightly without creating rigidity
and brittleness in the system.
Components quickly react to change, and adapt failures without
compromising performance and reliability.

Dynamic Provisioning:
It simply means distributing supplies where they are needed. Supplies
mean request, data, computation
A grid service broker links grid elements together automatically and
dynamically, based on the knowledge about their requirements and
attributes. and adjust the association according to the change and
failures
10

5
11-12-2013

12/11/2013

GRID COMPUTING: ATTRIBUTES (2)
Resource Pooling: contributes to lower cost
Consolidation and pooling is used for better utilization.
Provide flexibility to optimize the association

Self-Adaptive Software:
Everyday task of administrator are automated and simplified. The bulk
of maintenance and tuning is automated to reduce IT staff cost.

Unified Management:
Self-adaptive software does not eliminate human interaction. Unified
management is provided to simplify the management process.
Single tool can be used to provision, monitor, administer
11

12/11/2013

HOW ARE GRIDS USED?
Utility computing

High-performance computing

Collaborative design
Financial modeling

BELLE

Collaborative data-sharing
High-energy physics

E-Business

Drug discovery

Life sciences

Data center automation

E-Science
Natural language
processing
12

Business Intelligence
(Data Mining)

6
11-12-2013

ONLINE ACCESS TO
SCIENTIFIC INSTRUMENTS
Advanced Photon Source

wide-area
dissemination

real-time
collection

archival
storage

desktop & VR clients
with shared controls

tomographic reconstruction
DOE X-ray grand challenge: USC NIST, U.Chicago

13

12/11/2013

12/11/2013

GRID COMPUTING: COMPONENTS
•

Computation:
–

•

Networked Storage:
–

•

Integrated view of data storage (Datagrid). Local disk,
secondary storage, mountable, Unified name space

Network interconnects:
–

•

Computing cycles provided by processors of grid machines.
Simple, parallel, iterative uses of computing elements

Fast interconnection technologies. Redundant and external
Internet connections makes parallel processing faster, and
management better.

Software and licenses
–

Expensive software, Sharing Expensive licenses, Limited
use of multiple installation

14

7
11-12-2013

12/11/2013

GRID ARCHITECTURE (SERVICE-ORIENTED)
Applications

Grid Architected Services
Web Services (Extended Web Services)
Security

Filesystems

Servers

Database

Storage

Directory

Messaging

Network
15

Grid developers
Tool developers
Application developers
End Users
System
Administrators

GRID TYPES

12/11/2013

GRID USERS

Compute grid
Data grid
Grids on the Internet

16

8
11-12-2013

12/11/2013

OPEN GRID SERVICES ARCHITECTURE
Developed by the Global Grid Forum to define a
common, standard, and open architectures for
Grid-based applications.
Provides a standard approach to all services on the
Grid.
VO Management Service.
Resource discovery and management service:
Job management service.
Security services.
Data management services.

Built on top of and extends the Web Services
architecture, protocols, and interfaces.

12/11/2013

CDAC: GARUDA COMPONENT ARCHITECTURE

17

18

9
11-12-2013

12/11/2013

MANY GRID PROJECTS & INITIATIVES
Australia

Nimrod-G
GridSim
Virtual Lab
Gridbus
DISCWorld
..new coming up

USA
Globus
Legion
OGSA
Javelin
AppLeS
NASA IPG
Condor-G
Jxta
NetSolve
AccessGrid
and many more...

Europe

UNICORE
MOL
UK eScience
Poland MC Broker
EU Data Grid
EuroGrid
MetaMPI
Dutch DAS
XW, JaWS
Japan

Cycle Stealing & .com Initiatives
Distributed.net
SETI@Home, ….
Entropia, UD, Parabon,….

Public Forums
Global Grid Forum
P2P Working Group
IEEE TFCC
Grid & CCGrid conferences

Ninf
DataFarm

Korea...
N*Grid

19

http://www.gridcomputing.com

12/11/2013

GRID APPLICATIONS-DRIVERS
Distributed HPC (Supercomputing):
Computational science.
High-throughput computing:
Large scale simulation/chip design & parameter studies.
Content Sharing
Sharing digital contents among peers (e.g., Napster)
Remote software access/renting services:
Application service provides (ASPs).
Data-intensive computing:
Data mining, particle physics (CERN), Drug Design.
On-demand computing:
Medical instrumentation & network-enabled solvers.
Collaborative:
Collaborative design, data exploration, education.

20

10
11-12-2013

12/11/2013

GLOBUS
Five parts:
Common Runtime
GT Core for building new services

Security
To provide secure access. Based upon Grid Security
Infrastructure (GSI)

Execution management
Initiation, monitoring, management, scheduling and
coordination of executable programs (jobs)

Data management
Discover, transfer, and access large data

Information services
Discover & monitor dynamic services

12/11/2013

GLOBUS TOOLKIT

21

22

11
11-12-2013

G
T
4

G
T
3

G
T
2

Python WS Core
[contribution]
C WS Core

Community
Authorization
Service

OGSA-DAI
[Tech Preview]

WS
Authentication
Authorization

Reliable
File
Transfer

Grid
Resource
Allocation Mgmt
(WS GRAM)

Monitoring
& Discovery
System
(MDS4)

Java WS Core

Pre-WS
Authentication
Authorization

GridFTP

Grid
Resource
Allocation Mgmt
(Pre-WS GRAM)

Monitoring
& Discovery
System
(MDS2)

C Common
Libraries

G
T
3
G
T
4

Community
Scheduler
Framework
[contribution]

Delegation
Service

Web
Services
Components

Non-WS
Components

Replica
Location
Service

XIO

Credential
Management

23
Security

Data
Management

Execution
Management

Information
Services

Common
Runtime

G
T
3

G
T
2

Python WS Core
[contribution]
C WS Core

Community
Authorization
Service

OGSA-DAI
[Tech Preview]

WS
Authentication
Authorization

Reliable
File
Transfer

Grid
Resource
Allocation Mgmt
(WS GRAM)

Monitoring
& Discovery
System
(MDS4)

Java WS Core

Pre-WS
Authentication
Authorization

GridFTP

Grid
Resource
Allocation Mgmt
(Pre-WS GRAM)

Monitoring
& Discovery
System
(MDS2)

C Common
Libraries

G
T
3
G
T
4

Community
Scheduler
Framework
[contribution]

Delegation
Service

12/11/2013

Globus Open Source Grid Software
G
T
4

12/11/2013

Globus Open Source Grid Software

Web
Services
Components

Non-WS
Components

Replica
Location
Service

XIO

Credential
Management

24
Security

Data
Management

Execution
Management

Information
Services

Common
Runtime

12
11-12-2013

12/11/2013

GRID SIMULATOR: OPTORSIM
Models the interactions of the individual components of a
running Data Grid.
Simulates optimization and replication

25

12/11/2013

CONVERGENCE OF COMPETING
PARADIGMS/COMMUNITIES NEEDED

} ?

Web
Data Centres
Utility Computing
Service Computing
Grid Computing
P2P Computing
Cloud Computing
Market-Oriented
Computing
…
Paradigms

+

•Ubiquitous
access
•Reliability
•Scalability
•Autonomic
•Dynamic
discovery
•Composability
•QoS
•SLA
•…

Attributes/Capabilities

-Trillion $ business
- Who will own it?

26

Manjrasoft

13
11-12-2013

VOLUNTEERS ARE SELDOM PAID; NOT
BECAUSE THEY ARE WORTHLESS, BUT
BECAUSE THEY ARE PRICELESS!
--AUTHOR UNKNOWN

Contact:
principal@vit.edu.in; 4.seema@gmail.com
+919833818846

14

Contenu connexe

Tendances

Introduction to Grid Computing
Introduction to Grid ComputingIntroduction to Grid Computing
Introduction to Grid Computingabhijeetnawal
 
Cloud Computing And Android Apps For The Indian
Cloud Computing And Android Apps For The IndianCloud Computing And Android Apps For The Indian
Cloud Computing And Android Apps For The IndianSanjay Chitnis
 
Crowdsourcing Approaches to Big Data Curation for Earth Sciences
Crowdsourcing Approaches to Big Data Curation for Earth SciencesCrowdsourcing Approaches to Big Data Curation for Earth Sciences
Crowdsourcing Approaches to Big Data Curation for Earth SciencesEdward Curry
 
Welcome to Your Compact, Data-Driven, Generator-Free Data Center Future
Welcome to Your Compact, Data-Driven, Generator-Free Data Center FutureWelcome to Your Compact, Data-Driven, Generator-Free Data Center Future
Welcome to Your Compact, Data-Driven, Generator-Free Data Center FutureAbaram Network Solutions
 
Approximate Semantic Matching of Heterogeneous Events
Approximate Semantic Matching of Heterogeneous EventsApproximate Semantic Matching of Heterogeneous Events
Approximate Semantic Matching of Heterogeneous EventsEdward Curry
 
Denodo Global Cloud Survey 2020
Denodo Global Cloud Survey 2020Denodo Global Cloud Survey 2020
Denodo Global Cloud Survey 2020Denodo
 
Bridging the Last Mile: Getting Data to the People Who Need It
Bridging the Last Mile: Getting Data to the People Who Need ItBridging the Last Mile: Getting Data to the People Who Need It
Bridging the Last Mile: Getting Data to the People Who Need ItDenodo
 
Cloud Computing, SDN, Big Data and Internet of Everything - Lew Tucker
Cloud Computing, SDN, Big Data and Internet of Everything - Lew TuckerCloud Computing, SDN, Big Data and Internet of Everything - Lew Tucker
Cloud Computing, SDN, Big Data and Internet of Everything - Lew TuckerLew Tucker
 
Data Decentralisation: Efficiency, Privacy and Fair Monetisation
Data Decentralisation: Efficiency, Privacy and Fair MonetisationData Decentralisation: Efficiency, Privacy and Fair Monetisation
Data Decentralisation: Efficiency, Privacy and Fair MonetisationAngelo Corsaro
 
Cloud Sobriety for Life Science IT Leadership (2018 Edition)
Cloud Sobriety for Life Science IT Leadership (2018 Edition)Cloud Sobriety for Life Science IT Leadership (2018 Edition)
Cloud Sobriety for Life Science IT Leadership (2018 Edition)Chris Dagdigian
 
Deploying cost effective cloud data center
Deploying cost effective cloud data centerDeploying cost effective cloud data center
Deploying cost effective cloud data centerWiudo Laos
 
NextGen Infrastructure for Big Data
NextGen Infrastructure for Big DataNextGen Infrastructure for Big Data
NextGen Infrastructure for Big DataEd Dodds
 
Introduction to Cloud computing and Big Data-Hadoop
Introduction to Cloud computing and  Big Data-HadoopIntroduction to Cloud computing and  Big Data-Hadoop
Introduction to Cloud computing and Big Data-HadoopNagarjuna D.N
 
Bio-IT Trends From The Trenches (digital edition)
Bio-IT Trends From The Trenches (digital edition)Bio-IT Trends From The Trenches (digital edition)
Bio-IT Trends From The Trenches (digital edition)Chris Dagdigian
 
New Horizons for a Data-Driven Economy – A Roadmap for Big Data in Europe
New Horizons for a Data-Driven Economy – A Roadmap for Big Data in Europe New Horizons for a Data-Driven Economy – A Roadmap for Big Data in Europe
New Horizons for a Data-Driven Economy – A Roadmap for Big Data in Europe inside-BigData.com
 
HPC Top 5 Stories: January 12, 2018
HPC Top 5 Stories: January 12, 2018HPC Top 5 Stories: January 12, 2018
HPC Top 5 Stories: January 12, 2018NVIDIA
 

Tendances (20)

Introduction to Grid Computing
Introduction to Grid ComputingIntroduction to Grid Computing
Introduction to Grid Computing
 
Cloud Computing And Android Apps For The Indian
Cloud Computing And Android Apps For The IndianCloud Computing And Android Apps For The Indian
Cloud Computing And Android Apps For The Indian
 
Crowdsourcing Approaches to Big Data Curation for Earth Sciences
Crowdsourcing Approaches to Big Data Curation for Earth SciencesCrowdsourcing Approaches to Big Data Curation for Earth Sciences
Crowdsourcing Approaches to Big Data Curation for Earth Sciences
 
Welcome to Your Compact, Data-Driven, Generator-Free Data Center Future
Welcome to Your Compact, Data-Driven, Generator-Free Data Center FutureWelcome to Your Compact, Data-Driven, Generator-Free Data Center Future
Welcome to Your Compact, Data-Driven, Generator-Free Data Center Future
 
Approximate Semantic Matching of Heterogeneous Events
Approximate Semantic Matching of Heterogeneous EventsApproximate Semantic Matching of Heterogeneous Events
Approximate Semantic Matching of Heterogeneous Events
 
Denodo Global Cloud Survey 2020
Denodo Global Cloud Survey 2020Denodo Global Cloud Survey 2020
Denodo Global Cloud Survey 2020
 
40 41
40 4140 41
40 41
 
Grid Computing
Grid ComputingGrid Computing
Grid Computing
 
Bridging the Last Mile: Getting Data to the People Who Need It
Bridging the Last Mile: Getting Data to the People Who Need ItBridging the Last Mile: Getting Data to the People Who Need It
Bridging the Last Mile: Getting Data to the People Who Need It
 
Grid Computing
Grid ComputingGrid Computing
Grid Computing
 
Cloud Computing, SDN, Big Data and Internet of Everything - Lew Tucker
Cloud Computing, SDN, Big Data and Internet of Everything - Lew TuckerCloud Computing, SDN, Big Data and Internet of Everything - Lew Tucker
Cloud Computing, SDN, Big Data and Internet of Everything - Lew Tucker
 
Cloud vs grid
Cloud vs gridCloud vs grid
Cloud vs grid
 
Data Decentralisation: Efficiency, Privacy and Fair Monetisation
Data Decentralisation: Efficiency, Privacy and Fair MonetisationData Decentralisation: Efficiency, Privacy and Fair Monetisation
Data Decentralisation: Efficiency, Privacy and Fair Monetisation
 
Cloud Sobriety for Life Science IT Leadership (2018 Edition)
Cloud Sobriety for Life Science IT Leadership (2018 Edition)Cloud Sobriety for Life Science IT Leadership (2018 Edition)
Cloud Sobriety for Life Science IT Leadership (2018 Edition)
 
Deploying cost effective cloud data center
Deploying cost effective cloud data centerDeploying cost effective cloud data center
Deploying cost effective cloud data center
 
NextGen Infrastructure for Big Data
NextGen Infrastructure for Big DataNextGen Infrastructure for Big Data
NextGen Infrastructure for Big Data
 
Introduction to Cloud computing and Big Data-Hadoop
Introduction to Cloud computing and  Big Data-HadoopIntroduction to Cloud computing and  Big Data-Hadoop
Introduction to Cloud computing and Big Data-Hadoop
 
Bio-IT Trends From The Trenches (digital edition)
Bio-IT Trends From The Trenches (digital edition)Bio-IT Trends From The Trenches (digital edition)
Bio-IT Trends From The Trenches (digital edition)
 
New Horizons for a Data-Driven Economy – A Roadmap for Big Data in Europe
New Horizons for a Data-Driven Economy – A Roadmap for Big Data in Europe New Horizons for a Data-Driven Economy – A Roadmap for Big Data in Europe
New Horizons for a Data-Driven Economy – A Roadmap for Big Data in Europe
 
HPC Top 5 Stories: January 12, 2018
HPC Top 5 Stories: January 12, 2018HPC Top 5 Stories: January 12, 2018
HPC Top 5 Stories: January 12, 2018
 

En vedette

Придурочное лидерство по русски. Что делать
Придурочное лидерство по русски. Что делатьПридурочное лидерство по русски. Что делать
Придурочное лидерство по русски. Что делатьSTRADIS
 
India: an Evolving IT Hub
India: an Evolving IT HubIndia: an Evolving IT Hub
India: an Evolving IT HubSeema Shah
 
Grow your consulting business 150503 01
Grow your consulting business 150503 01Grow your consulting business 150503 01
Grow your consulting business 150503 01Julian Atherley
 
Conflict Management
Conflict ManagementConflict Management
Conflict ManagementSeema Shah
 
Attitude building
Attitude building Attitude building
Attitude building Seema Shah
 
Key technologies in 2035
Key technologies in 2035Key technologies in 2035
Key technologies in 2035Seema Shah
 

En vedette (7)

Придурочное лидерство по русски. Что делать
Придурочное лидерство по русски. Что делатьПридурочное лидерство по русски. Что делать
Придурочное лидерство по русски. Что делать
 
India: an Evolving IT Hub
India: an Evolving IT HubIndia: an Evolving IT Hub
India: an Evolving IT Hub
 
Grow your consulting business 150503 01
Grow your consulting business 150503 01Grow your consulting business 150503 01
Grow your consulting business 150503 01
 
Spm l01
Spm l01Spm l01
Spm l01
 
Conflict Management
Conflict ManagementConflict Management
Conflict Management
 
Attitude building
Attitude building Attitude building
Attitude building
 
Key technologies in 2035
Key technologies in 2035Key technologies in 2035
Key technologies in 2035
 

Similaire à Gc vit sttp cc december 2013

Implementing K-Out-Of-N Computing For Fault Tolerant Processing In Mobile and...
Implementing K-Out-Of-N Computing For Fault Tolerant Processing In Mobile and...Implementing K-Out-Of-N Computing For Fault Tolerant Processing In Mobile and...
Implementing K-Out-Of-N Computing For Fault Tolerant Processing In Mobile and...IJERA Editor
 
A Hybrid Cloud Approach for Secure Authorized De-Duplication
A Hybrid Cloud Approach for Secure Authorized De-DuplicationA Hybrid Cloud Approach for Secure Authorized De-Duplication
A Hybrid Cloud Approach for Secure Authorized De-DuplicationEditor IJMTER
 
Cloud Computing in D-Grid
Cloud Computing in D-GridCloud Computing in D-Grid
Cloud Computing in D-GridStefan Freitag
 
Comprehensive Study on Deployment Models and Service Models in Cloud Computing.
Comprehensive Study on Deployment Models and Service Models in Cloud Computing.Comprehensive Study on Deployment Models and Service Models in Cloud Computing.
Comprehensive Study on Deployment Models and Service Models in Cloud Computing.IRJET Journal
 
IRJET- Comparatively Analysis on K-Means++ and Mini Batch K-Means Clustering ...
IRJET- Comparatively Analysis on K-Means++ and Mini Batch K-Means Clustering ...IRJET- Comparatively Analysis on K-Means++ and Mini Batch K-Means Clustering ...
IRJET- Comparatively Analysis on K-Means++ and Mini Batch K-Means Clustering ...IRJET Journal
 
2010 Future of Advanced Computing
2010 Future of Advanced Computing2010 Future of Advanced Computing
2010 Future of Advanced ComputingBob Marcus
 
MPLS/SDN 2013 Intercloud Standardization and Testbeds - Sill
MPLS/SDN 2013 Intercloud Standardization and Testbeds - SillMPLS/SDN 2013 Intercloud Standardization and Testbeds - Sill
MPLS/SDN 2013 Intercloud Standardization and Testbeds - SillAlan Sill
 
IRJET - Cloud Computing Application
IRJET -  	  Cloud Computing ApplicationIRJET -  	  Cloud Computing Application
IRJET - Cloud Computing ApplicationIRJET Journal
 
OGF Standards Overview - ITU-T JCA Cloud
OGF Standards Overview - ITU-T JCA CloudOGF Standards Overview - ITU-T JCA Cloud
OGF Standards Overview - ITU-T JCA CloudAlan Sill
 
The Role of Machine Learning in Fluid Network Control and Data Planes.pdf
The Role of Machine Learning in Fluid Network Control and Data Planes.pdfThe Role of Machine Learning in Fluid Network Control and Data Planes.pdf
The Role of Machine Learning in Fluid Network Control and Data Planes.pdfFörderverein Technische Fakultät
 
Fog Computing – Enhancing the Maximum Energy Consumption of Data Servers.
Fog Computing – Enhancing the Maximum Energy Consumption of Data Servers.Fog Computing – Enhancing the Maximum Energy Consumption of Data Servers.
Fog Computing – Enhancing the Maximum Energy Consumption of Data Servers.dbpublications
 
2012 - 2013 DOTNET IEEE PROJECT TITLES
2012 - 2013 DOTNET IEEE PROJECT TITLES2012 - 2013 DOTNET IEEE PROJECT TITLES
2012 - 2013 DOTNET IEEE PROJECT TITLESJPINFOTECH JAYAPRAKASH
 
Tiarrah Computing: The Next Generation of Computing
Tiarrah Computing: The Next Generation of ComputingTiarrah Computing: The Next Generation of Computing
Tiarrah Computing: The Next Generation of ComputingIJECEIAES
 
Architecture and Practices on Cloud Interoperability and Portability
Architecture and Practices on Cloud Interoperability and PortabilityArchitecture and Practices on Cloud Interoperability and Portability
Architecture and Practices on Cloud Interoperability and PortabilityThomas Lee
 

Similaire à Gc vit sttp cc december 2013 (20)

Implementing K-Out-Of-N Computing For Fault Tolerant Processing In Mobile and...
Implementing K-Out-Of-N Computing For Fault Tolerant Processing In Mobile and...Implementing K-Out-Of-N Computing For Fault Tolerant Processing In Mobile and...
Implementing K-Out-Of-N Computing For Fault Tolerant Processing In Mobile and...
 
A Hybrid Cloud Approach for Secure Authorized De-Duplication
A Hybrid Cloud Approach for Secure Authorized De-DuplicationA Hybrid Cloud Approach for Secure Authorized De-Duplication
A Hybrid Cloud Approach for Secure Authorized De-Duplication
 
8. 9590 1-pb
8. 9590 1-pb8. 9590 1-pb
8. 9590 1-pb
 
Netsoft19 Keynote: Fluid Network Planes
Netsoft19 Keynote: Fluid Network PlanesNetsoft19 Keynote: Fluid Network Planes
Netsoft19 Keynote: Fluid Network Planes
 
Cloud Computing in D-Grid
Cloud Computing in D-GridCloud Computing in D-Grid
Cloud Computing in D-Grid
 
Comprehensive Study on Deployment Models and Service Models in Cloud Computing.
Comprehensive Study on Deployment Models and Service Models in Cloud Computing.Comprehensive Study on Deployment Models and Service Models in Cloud Computing.
Comprehensive Study on Deployment Models and Service Models in Cloud Computing.
 
IRJET- Comparatively Analysis on K-Means++ and Mini Batch K-Means Clustering ...
IRJET- Comparatively Analysis on K-Means++ and Mini Batch K-Means Clustering ...IRJET- Comparatively Analysis on K-Means++ and Mini Batch K-Means Clustering ...
IRJET- Comparatively Analysis on K-Means++ and Mini Batch K-Means Clustering ...
 
RMC_final
RMC_finalRMC_final
RMC_final
 
2010 Future of Advanced Computing
2010 Future of Advanced Computing2010 Future of Advanced Computing
2010 Future of Advanced Computing
 
MPLS/SDN 2013 Intercloud Standardization and Testbeds - Sill
MPLS/SDN 2013 Intercloud Standardization and Testbeds - SillMPLS/SDN 2013 Intercloud Standardization and Testbeds - Sill
MPLS/SDN 2013 Intercloud Standardization and Testbeds - Sill
 
D-Grid Infrastructure
D-Grid InfrastructureD-Grid Infrastructure
D-Grid Infrastructure
 
IRJET - Cloud Computing Application
IRJET -  	  Cloud Computing ApplicationIRJET -  	  Cloud Computing Application
IRJET - Cloud Computing Application
 
Cloud computing
Cloud computing Cloud computing
Cloud computing
 
OGF Standards Overview - ITU-T JCA Cloud
OGF Standards Overview - ITU-T JCA CloudOGF Standards Overview - ITU-T JCA Cloud
OGF Standards Overview - ITU-T JCA Cloud
 
The Role of Machine Learning in Fluid Network Control and Data Planes.pdf
The Role of Machine Learning in Fluid Network Control and Data Planes.pdfThe Role of Machine Learning in Fluid Network Control and Data Planes.pdf
The Role of Machine Learning in Fluid Network Control and Data Planes.pdf
 
Ey35869874
Ey35869874Ey35869874
Ey35869874
 
Fog Computing – Enhancing the Maximum Energy Consumption of Data Servers.
Fog Computing – Enhancing the Maximum Energy Consumption of Data Servers.Fog Computing – Enhancing the Maximum Energy Consumption of Data Servers.
Fog Computing – Enhancing the Maximum Energy Consumption of Data Servers.
 
2012 - 2013 DOTNET IEEE PROJECT TITLES
2012 - 2013 DOTNET IEEE PROJECT TITLES2012 - 2013 DOTNET IEEE PROJECT TITLES
2012 - 2013 DOTNET IEEE PROJECT TITLES
 
Tiarrah Computing: The Next Generation of Computing
Tiarrah Computing: The Next Generation of ComputingTiarrah Computing: The Next Generation of Computing
Tiarrah Computing: The Next Generation of Computing
 
Architecture and Practices on Cloud Interoperability and Portability
Architecture and Practices on Cloud Interoperability and PortabilityArchitecture and Practices on Cloud Interoperability and Portability
Architecture and Practices on Cloud Interoperability and Portability
 

Dernier

How to Make a Duplicate of Your Odoo 17 Database
How to Make a Duplicate of Your Odoo 17 DatabaseHow to Make a Duplicate of Your Odoo 17 Database
How to Make a Duplicate of Your Odoo 17 DatabaseCeline George
 
ESP 4-EDITED.pdfmmcncncncmcmmnmnmncnmncmnnjvnnv
ESP 4-EDITED.pdfmmcncncncmcmmnmnmncnmncmnnjvnnvESP 4-EDITED.pdfmmcncncncmcmmnmnmncnmncmnnjvnnv
ESP 4-EDITED.pdfmmcncncncmcmmnmnmncnmncmnnjvnnvRicaMaeCastro1
 
ClimART Action | eTwinning Project
ClimART Action    |    eTwinning ProjectClimART Action    |    eTwinning Project
ClimART Action | eTwinning Projectjordimapav
 
Reading and Writing Skills 11 quarter 4 melc 1
Reading and Writing Skills 11 quarter 4 melc 1Reading and Writing Skills 11 quarter 4 melc 1
Reading and Writing Skills 11 quarter 4 melc 1GloryAnnCastre1
 
Expanded definition: technical and operational
Expanded definition: technical and operationalExpanded definition: technical and operational
Expanded definition: technical and operationalssuser3e220a
 
4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptxmary850239
 
Congestive Cardiac Failure..presentation
Congestive Cardiac Failure..presentationCongestive Cardiac Failure..presentation
Congestive Cardiac Failure..presentationdeepaannamalai16
 
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...DhatriParmar
 
Unraveling Hypertext_ Analyzing Postmodern Elements in Literature.pptx
Unraveling Hypertext_ Analyzing  Postmodern Elements in  Literature.pptxUnraveling Hypertext_ Analyzing  Postmodern Elements in  Literature.pptx
Unraveling Hypertext_ Analyzing Postmodern Elements in Literature.pptxDhatriParmar
 
How to Manage Buy 3 Get 1 Free in Odoo 17
How to Manage Buy 3 Get 1 Free in Odoo 17How to Manage Buy 3 Get 1 Free in Odoo 17
How to Manage Buy 3 Get 1 Free in Odoo 17Celine George
 
Active Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfActive Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfPatidar M
 
Grade Three -ELLNA-REVIEWER-ENGLISH.pptx
Grade Three -ELLNA-REVIEWER-ENGLISH.pptxGrade Three -ELLNA-REVIEWER-ENGLISH.pptx
Grade Three -ELLNA-REVIEWER-ENGLISH.pptxkarenfajardo43
 
CLASSIFICATION OF ANTI - CANCER DRUGS.pptx
CLASSIFICATION OF ANTI - CANCER DRUGS.pptxCLASSIFICATION OF ANTI - CANCER DRUGS.pptx
CLASSIFICATION OF ANTI - CANCER DRUGS.pptxAnupam32727
 
Using Grammatical Signals Suitable to Patterns of Idea Development
Using Grammatical Signals Suitable to Patterns of Idea DevelopmentUsing Grammatical Signals Suitable to Patterns of Idea Development
Using Grammatical Signals Suitable to Patterns of Idea Developmentchesterberbo7
 
ARTERIAL BLOOD GAS ANALYSIS........pptx
ARTERIAL BLOOD  GAS ANALYSIS........pptxARTERIAL BLOOD  GAS ANALYSIS........pptx
ARTERIAL BLOOD GAS ANALYSIS........pptxAneriPatwari
 
Q-Factor General Quiz-7th April 2024, Quiz Club NITW
Q-Factor General Quiz-7th April 2024, Quiz Club NITWQ-Factor General Quiz-7th April 2024, Quiz Club NITW
Q-Factor General Quiz-7th April 2024, Quiz Club NITWQuiz Club NITW
 
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITW
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITWQ-Factor HISPOL Quiz-6th April 2024, Quiz Club NITW
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITWQuiz Club NITW
 
ICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfVanessa Camilleri
 

Dernier (20)

How to Make a Duplicate of Your Odoo 17 Database
How to Make a Duplicate of Your Odoo 17 DatabaseHow to Make a Duplicate of Your Odoo 17 Database
How to Make a Duplicate of Your Odoo 17 Database
 
ESP 4-EDITED.pdfmmcncncncmcmmnmnmncnmncmnnjvnnv
ESP 4-EDITED.pdfmmcncncncmcmmnmnmncnmncmnnjvnnvESP 4-EDITED.pdfmmcncncncmcmmnmnmncnmncmnnjvnnv
ESP 4-EDITED.pdfmmcncncncmcmmnmnmncnmncmnnjvnnv
 
ClimART Action | eTwinning Project
ClimART Action    |    eTwinning ProjectClimART Action    |    eTwinning Project
ClimART Action | eTwinning Project
 
Reading and Writing Skills 11 quarter 4 melc 1
Reading and Writing Skills 11 quarter 4 melc 1Reading and Writing Skills 11 quarter 4 melc 1
Reading and Writing Skills 11 quarter 4 melc 1
 
Expanded definition: technical and operational
Expanded definition: technical and operationalExpanded definition: technical and operational
Expanded definition: technical and operational
 
4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx
 
Congestive Cardiac Failure..presentation
Congestive Cardiac Failure..presentationCongestive Cardiac Failure..presentation
Congestive Cardiac Failure..presentation
 
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...
 
Unraveling Hypertext_ Analyzing Postmodern Elements in Literature.pptx
Unraveling Hypertext_ Analyzing  Postmodern Elements in  Literature.pptxUnraveling Hypertext_ Analyzing  Postmodern Elements in  Literature.pptx
Unraveling Hypertext_ Analyzing Postmodern Elements in Literature.pptx
 
How to Manage Buy 3 Get 1 Free in Odoo 17
How to Manage Buy 3 Get 1 Free in Odoo 17How to Manage Buy 3 Get 1 Free in Odoo 17
How to Manage Buy 3 Get 1 Free in Odoo 17
 
Active Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfActive Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdf
 
Grade Three -ELLNA-REVIEWER-ENGLISH.pptx
Grade Three -ELLNA-REVIEWER-ENGLISH.pptxGrade Three -ELLNA-REVIEWER-ENGLISH.pptx
Grade Three -ELLNA-REVIEWER-ENGLISH.pptx
 
CLASSIFICATION OF ANTI - CANCER DRUGS.pptx
CLASSIFICATION OF ANTI - CANCER DRUGS.pptxCLASSIFICATION OF ANTI - CANCER DRUGS.pptx
CLASSIFICATION OF ANTI - CANCER DRUGS.pptx
 
Using Grammatical Signals Suitable to Patterns of Idea Development
Using Grammatical Signals Suitable to Patterns of Idea DevelopmentUsing Grammatical Signals Suitable to Patterns of Idea Development
Using Grammatical Signals Suitable to Patterns of Idea Development
 
ARTERIAL BLOOD GAS ANALYSIS........pptx
ARTERIAL BLOOD  GAS ANALYSIS........pptxARTERIAL BLOOD  GAS ANALYSIS........pptx
ARTERIAL BLOOD GAS ANALYSIS........pptx
 
Paradigm shift in nursing research by RS MEHTA
Paradigm shift in nursing research by RS MEHTAParadigm shift in nursing research by RS MEHTA
Paradigm shift in nursing research by RS MEHTA
 
Q-Factor General Quiz-7th April 2024, Quiz Club NITW
Q-Factor General Quiz-7th April 2024, Quiz Club NITWQ-Factor General Quiz-7th April 2024, Quiz Club NITW
Q-Factor General Quiz-7th April 2024, Quiz Club NITW
 
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITW
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITWQ-Factor HISPOL Quiz-6th April 2024, Quiz Club NITW
Q-Factor HISPOL Quiz-6th April 2024, Quiz Club NITW
 
ICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdf
 
prashanth updated resume 2024 for Teaching Profession
prashanth updated resume 2024 for Teaching Professionprashanth updated resume 2024 for Teaching Profession
prashanth updated resume 2024 for Teaching Profession
 

Gc vit sttp cc december 2013

  • 1. 11-12-2013 GRID COMPUTING Reference : Internet 12/11/2013 SPEAKER’S BACKGROUND IN GRID AND CLOUD COMPUTING An opening caveat This talk is based on my: My doctoral research in Grid Computing and Shared memory Review and session chair experience for various conferences Expert talks at various Institutes for faculty and students in STTPs, Conferences etc. Experience as a Project mentor 2 1
  • 2. 11-12-2013 12/11/2013 KEY TAKEAWAYS Widen personal technical spectrum Understand the evolution of recent technologies Envision the upcoming technological trends Be useful in Teaching STTP related and allied subjects Guiding projects –UG/PG 3 12/11/2013 ELECTRICAL GRID 4 2
  • 3. 11-12-2013 12/11/2013 WHY GRIDS ? LARGE SCALE EXPLORATION NEEDS THEM—KILLER APPLICATIONS. Solving grand challenge applications using computer modeling, simulation and analysis Life Sciences Aerospace Internet & Ecommerce CAD/CAM 5 Digital Biology Military Applications 12/11/2013 WHAT IS A GRID? Early defs: Foster and Kesselman, 1998 “A computational grid is a hardware and software infrastructure that provides dependable, consistent, pervasive, and inexpensive access to high-end computational facilities” Kleinrock 1969: “We will probably see the spread of ‘computer utilities’, which, like present electric and telephone utilities, will service individual homes and offices across the country.” 6 3
  • 4. 11-12-2013 12/11/2013 GRID COMPUTING 7 12/11/2013 ELEMENTS OF GRID COMPUTING Resource sharing Computers, data, storage, sensors, networks, … Sharing always conditional: issues of trust, policy, negotiation, payment, … Coordinated problem solving Beyond client-server: distributed data analysis, computation, collaboration, … Dynamic, multi-institutional virtual organizations Community overlays on classic org structures Large or small, static or dynamic 8 4
  • 5. 11-12-2013 A Typical Grid Computing Environment Grid Information Service Grid Resource Broker R2 2 R5 R3 Application database R4 RN Grid Resource Broker R6 R1 Resource Broker Grid Information Service 12/ 11/ 201 3 9 12/11/2013 GRID COMPUTING: ATTRIBUTES (1) Virtualization: Abstracting grid entity into service It enables grid components to integrate tightly without creating rigidity and brittleness in the system. Components quickly react to change, and adapt failures without compromising performance and reliability. Dynamic Provisioning: It simply means distributing supplies where they are needed. Supplies mean request, data, computation A grid service broker links grid elements together automatically and dynamically, based on the knowledge about their requirements and attributes. and adjust the association according to the change and failures 10 5
  • 6. 11-12-2013 12/11/2013 GRID COMPUTING: ATTRIBUTES (2) Resource Pooling: contributes to lower cost Consolidation and pooling is used for better utilization. Provide flexibility to optimize the association Self-Adaptive Software: Everyday task of administrator are automated and simplified. The bulk of maintenance and tuning is automated to reduce IT staff cost. Unified Management: Self-adaptive software does not eliminate human interaction. Unified management is provided to simplify the management process. Single tool can be used to provision, monitor, administer 11 12/11/2013 HOW ARE GRIDS USED? Utility computing High-performance computing Collaborative design Financial modeling BELLE Collaborative data-sharing High-energy physics E-Business Drug discovery Life sciences Data center automation E-Science Natural language processing 12 Business Intelligence (Data Mining) 6
  • 7. 11-12-2013 ONLINE ACCESS TO SCIENTIFIC INSTRUMENTS Advanced Photon Source wide-area dissemination real-time collection archival storage desktop & VR clients with shared controls tomographic reconstruction DOE X-ray grand challenge: USC NIST, U.Chicago 13 12/11/2013 12/11/2013 GRID COMPUTING: COMPONENTS • Computation: – • Networked Storage: – • Integrated view of data storage (Datagrid). Local disk, secondary storage, mountable, Unified name space Network interconnects: – • Computing cycles provided by processors of grid machines. Simple, parallel, iterative uses of computing elements Fast interconnection technologies. Redundant and external Internet connections makes parallel processing faster, and management better. Software and licenses – Expensive software, Sharing Expensive licenses, Limited use of multiple installation 14 7
  • 8. 11-12-2013 12/11/2013 GRID ARCHITECTURE (SERVICE-ORIENTED) Applications Grid Architected Services Web Services (Extended Web Services) Security Filesystems Servers Database Storage Directory Messaging Network 15 Grid developers Tool developers Application developers End Users System Administrators GRID TYPES 12/11/2013 GRID USERS Compute grid Data grid Grids on the Internet 16 8
  • 9. 11-12-2013 12/11/2013 OPEN GRID SERVICES ARCHITECTURE Developed by the Global Grid Forum to define a common, standard, and open architectures for Grid-based applications. Provides a standard approach to all services on the Grid. VO Management Service. Resource discovery and management service: Job management service. Security services. Data management services. Built on top of and extends the Web Services architecture, protocols, and interfaces. 12/11/2013 CDAC: GARUDA COMPONENT ARCHITECTURE 17 18 9
  • 10. 11-12-2013 12/11/2013 MANY GRID PROJECTS & INITIATIVES Australia Nimrod-G GridSim Virtual Lab Gridbus DISCWorld ..new coming up USA Globus Legion OGSA Javelin AppLeS NASA IPG Condor-G Jxta NetSolve AccessGrid and many more... Europe UNICORE MOL UK eScience Poland MC Broker EU Data Grid EuroGrid MetaMPI Dutch DAS XW, JaWS Japan Cycle Stealing & .com Initiatives Distributed.net SETI@Home, …. Entropia, UD, Parabon,…. Public Forums Global Grid Forum P2P Working Group IEEE TFCC Grid & CCGrid conferences Ninf DataFarm Korea... N*Grid 19 http://www.gridcomputing.com 12/11/2013 GRID APPLICATIONS-DRIVERS Distributed HPC (Supercomputing): Computational science. High-throughput computing: Large scale simulation/chip design & parameter studies. Content Sharing Sharing digital contents among peers (e.g., Napster) Remote software access/renting services: Application service provides (ASPs). Data-intensive computing: Data mining, particle physics (CERN), Drug Design. On-demand computing: Medical instrumentation & network-enabled solvers. Collaborative: Collaborative design, data exploration, education. 20 10
  • 11. 11-12-2013 12/11/2013 GLOBUS Five parts: Common Runtime GT Core for building new services Security To provide secure access. Based upon Grid Security Infrastructure (GSI) Execution management Initiation, monitoring, management, scheduling and coordination of executable programs (jobs) Data management Discover, transfer, and access large data Information services Discover & monitor dynamic services 12/11/2013 GLOBUS TOOLKIT 21 22 11
  • 12. 11-12-2013 G T 4 G T 3 G T 2 Python WS Core [contribution] C WS Core Community Authorization Service OGSA-DAI [Tech Preview] WS Authentication Authorization Reliable File Transfer Grid Resource Allocation Mgmt (WS GRAM) Monitoring & Discovery System (MDS4) Java WS Core Pre-WS Authentication Authorization GridFTP Grid Resource Allocation Mgmt (Pre-WS GRAM) Monitoring & Discovery System (MDS2) C Common Libraries G T 3 G T 4 Community Scheduler Framework [contribution] Delegation Service Web Services Components Non-WS Components Replica Location Service XIO Credential Management 23 Security Data Management Execution Management Information Services Common Runtime G T 3 G T 2 Python WS Core [contribution] C WS Core Community Authorization Service OGSA-DAI [Tech Preview] WS Authentication Authorization Reliable File Transfer Grid Resource Allocation Mgmt (WS GRAM) Monitoring & Discovery System (MDS4) Java WS Core Pre-WS Authentication Authorization GridFTP Grid Resource Allocation Mgmt (Pre-WS GRAM) Monitoring & Discovery System (MDS2) C Common Libraries G T 3 G T 4 Community Scheduler Framework [contribution] Delegation Service 12/11/2013 Globus Open Source Grid Software G T 4 12/11/2013 Globus Open Source Grid Software Web Services Components Non-WS Components Replica Location Service XIO Credential Management 24 Security Data Management Execution Management Information Services Common Runtime 12
  • 13. 11-12-2013 12/11/2013 GRID SIMULATOR: OPTORSIM Models the interactions of the individual components of a running Data Grid. Simulates optimization and replication 25 12/11/2013 CONVERGENCE OF COMPETING PARADIGMS/COMMUNITIES NEEDED } ? Web Data Centres Utility Computing Service Computing Grid Computing P2P Computing Cloud Computing Market-Oriented Computing … Paradigms + •Ubiquitous access •Reliability •Scalability •Autonomic •Dynamic discovery •Composability •QoS •SLA •… Attributes/Capabilities -Trillion $ business - Who will own it? 26 Manjrasoft 13
  • 14. 11-12-2013 VOLUNTEERS ARE SELDOM PAID; NOT BECAUSE THEY ARE WORTHLESS, BUT BECAUSE THEY ARE PRICELESS! --AUTHOR UNKNOWN Contact: principal@vit.edu.in; 4.seema@gmail.com +919833818846 14