SlideShare une entreprise Scribd logo
1  sur  48
Lecture 1 – Parallel Programming Primer CPE 458 – Parallel Programming, Spring 2009 Except as otherwise noted, the content of this presentation is licensed under the Creative Commons Attribution 2.5 License.http://creativecommons.org/licenses/by/2.5
Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Introduction to Parallel Computing ,[object Object],[object Object],[object Object],[object Object],[object Object]
Introduction to Parallel Computing ,[object Object],[object Object],[object Object],[object Object],[object Object]
Introduction to Parallel Computing ,[object Object],[object Object]
Introduction to Parallel Computing ,[object Object],[object Object],[object Object],[object Object],[object Object]
Introduction to Parallel Computing ,[object Object],[object Object],[object Object]
Introduction to Parallel Computing ,[object Object],[object Object],[object Object],[object Object]
Introduction to Parallel Computing ,[object Object],[object Object],[object Object],[object Object]
Introduction to Parallel Computing ,[object Object],[object Object],[object Object],[object Object]
Introduction to Parallel Computing ,[object Object],[object Object]
Parallel Architectures ,[object Object],CPU RAM BUS Bottlenecks
Parallel Architectures ,[object Object],[object Object],[object Object],[object Object]
Parallel Architectures ,[object Object],[object Object],Processing  Unit Control Unit Interconnect Processing  Unit Processing  Unit Processing  Unit Processing  Unit
Parallel Architectures ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Architectures ,[object Object],[object Object],Processing/Control  Unit Processing/Control  Unit Processing/Control  Unit Processing/Control  Unit Interconnect
Parallel Architectures ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Architectures ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Architectures ,[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Architectures ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],[object Object]
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],P P P P P D D D D D O O O O O
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],P P P P P P D D D O O
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],P Work Pool P P P P Input queue Output queue
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Parallel Algorithms ,[object Object],P Input queue Output queue P P buffer buffer
Common Parallel Programming Models ,[object Object],[object Object]
Common Parallel Programming Models ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Common Parallel Programming Models ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Common Parallel Programming Models ,[object Object],Workstation Workstation Workstation Workstation Data P4 P3 P2 P1 send(buff1, 1024, p3) receive(buff3, 1024, p1)
Common Parallel Programming Models ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Common Parallel Programming Models ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Common Parallel Programming Models ,[object Object],Workstation T3 T4 T2 T1 Data SMP RAM
Parallel Programming Pitfalls ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Prelude to MapReduce ,[object Object],[object Object],[object Object]
Prelude to MapReduce ,[object Object],[object Object]
References ,[object Object],[object Object],[object Object],[object Object]

Contenu connexe

Tendances

Instruction Set (Part 2)
Instruction Set (Part 2)Instruction Set (Part 2)
Instruction Set (Part 2)Ajeng Savitri
 
Data flow architecture
Data flow architectureData flow architecture
Data flow architectureSourav Routh
 
Data Parallel and Object Oriented Model
Data Parallel and Object Oriented ModelData Parallel and Object Oriented Model
Data Parallel and Object Oriented ModelNikhil Sharma
 
Map reduce in Hadoop
Map reduce in HadoopMap reduce in Hadoop
Map reduce in Hadoopishan0019
 
Parallel algorithms
Parallel algorithmsParallel algorithms
Parallel algorithmsguest084d20
 
Parallel language & compilers
Parallel language & compilersParallel language & compilers
Parallel language & compilersdikshagupta111
 
Parallel programming model
Parallel programming modelParallel programming model
Parallel programming modeleasy notes
 
Content addressable-memory
Content addressable-memoryContent addressable-memory
Content addressable-memorySaravanan Ns
 
Raminder kaur presentation_two
Raminder kaur presentation_twoRaminder kaur presentation_two
Raminder kaur presentation_tworamikaurraminder
 
FME and Complex GML: INSPIRE and AIXM
FME and Complex GML: INSPIRE and AIXMFME and Complex GML: INSPIRE and AIXM
FME and Complex GML: INSPIRE and AIXMSafe Software
 
Matlab for Electrical Engineers
Matlab for Electrical EngineersMatlab for Electrical Engineers
Matlab for Electrical EngineersManish Joshi
 
FME and Complex GML
FME and Complex GMLFME and Complex GML
FME and Complex GMLIMGS
 
Specter - AAL
Specter - AALSpecter - AAL
Specter - AALPROBOTEK
 
Summer training on matlab
Summer training on matlabSummer training on matlab
Summer training on matlabdangerahad
 

Tendances (20)

Instruction Set (Part 2)
Instruction Set (Part 2)Instruction Set (Part 2)
Instruction Set (Part 2)
 
Data flow architecture
Data flow architectureData flow architecture
Data flow architecture
 
sCode optimization
sCode optimizationsCode optimization
sCode optimization
 
Unit 3 part2
Unit 3 part2Unit 3 part2
Unit 3 part2
 
Data Parallel and Object Oriented Model
Data Parallel and Object Oriented ModelData Parallel and Object Oriented Model
Data Parallel and Object Oriented Model
 
Map reduce in Hadoop
Map reduce in HadoopMap reduce in Hadoop
Map reduce in Hadoop
 
Parallel algorithms
Parallel algorithmsParallel algorithms
Parallel algorithms
 
Parallel language & compilers
Parallel language & compilersParallel language & compilers
Parallel language & compilers
 
Parallel programming model
Parallel programming modelParallel programming model
Parallel programming model
 
Matlab demo
Matlab demoMatlab demo
Matlab demo
 
Content addressable-memory
Content addressable-memoryContent addressable-memory
Content addressable-memory
 
Raminder kaur presentation_two
Raminder kaur presentation_twoRaminder kaur presentation_two
Raminder kaur presentation_two
 
FME and Complex GML: INSPIRE and AIXM
FME and Complex GML: INSPIRE and AIXMFME and Complex GML: INSPIRE and AIXM
FME and Complex GML: INSPIRE and AIXM
 
Matlab for Electrical Engineers
Matlab for Electrical EngineersMatlab for Electrical Engineers
Matlab for Electrical Engineers
 
FME and Complex GML
FME and Complex GMLFME and Complex GML
FME and Complex GML
 
Matrix multiplication
Matrix multiplicationMatrix multiplication
Matrix multiplication
 
Specter - AAL
Specter - AALSpecter - AAL
Specter - AAL
 
Summer training on matlab
Summer training on matlabSummer training on matlab
Summer training on matlab
 
BSTM-MM in VISUM
BSTM-MM in VISUMBSTM-MM in VISUM
BSTM-MM in VISUM
 
Tutorial
TutorialTutorial
Tutorial
 

En vedette

Industrial management
Industrial management Industrial management
Industrial management Anshu Singh
 
Industrial management
Industrial managementIndustrial management
Industrial managementAkshay Yawale
 
Compiler Design
Compiler DesignCompiler Design
Compiler DesignMir Majid
 
Introduction to computer network
Introduction to computer networkIntroduction to computer network
Introduction to computer networkAshita Agrawal
 
BASIC CONCEPTS OF COMPUTER NETWORKS
BASIC CONCEPTS OF COMPUTER NETWORKS BASIC CONCEPTS OF COMPUTER NETWORKS
BASIC CONCEPTS OF COMPUTER NETWORKS Kak Yong
 

En vedette (9)

Lec2 Mapred
Lec2 MapredLec2 Mapred
Lec2 Mapred
 
Industrial management
Industrial management Industrial management
Industrial management
 
Industrial management
Industrial managementIndustrial management
Industrial management
 
Lexical analyzer
Lexical analyzerLexical analyzer
Lexical analyzer
 
Compiler Design
Compiler DesignCompiler Design
Compiler Design
 
Compiler Chapter 1
Compiler Chapter 1Compiler Chapter 1
Compiler Chapter 1
 
Networking
NetworkingNetworking
Networking
 
Introduction to computer network
Introduction to computer networkIntroduction to computer network
Introduction to computer network
 
BASIC CONCEPTS OF COMPUTER NETWORKS
BASIC CONCEPTS OF COMPUTER NETWORKS BASIC CONCEPTS OF COMPUTER NETWORKS
BASIC CONCEPTS OF COMPUTER NETWORKS
 

Similaire à Parallel Programming Primer 1

Migration To Multi Core - Parallel Programming Models
Migration To Multi Core - Parallel Programming ModelsMigration To Multi Core - Parallel Programming Models
Migration To Multi Core - Parallel Programming ModelsZvi Avraham
 
Moving Towards a Streaming Architecture
Moving Towards a Streaming ArchitectureMoving Towards a Streaming Architecture
Moving Towards a Streaming ArchitectureGabriele Modena
 
parellel computing
parellel computingparellel computing
parellel computingkatakdound
 
Parallel and Distributed Computing chapter 1
Parallel and Distributed Computing chapter 1Parallel and Distributed Computing chapter 1
Parallel and Distributed Computing chapter 1AbdullahMunir32
 
Parallel Computing-Part-1.pptx
Parallel Computing-Part-1.pptxParallel Computing-Part-1.pptx
Parallel Computing-Part-1.pptxkrnaween
 
2 parallel processing presentation ph d 1st semester
2 parallel processing presentation ph d 1st semester2 parallel processing presentation ph d 1st semester
2 parallel processing presentation ph d 1st semesterRafi Ullah
 
Introduction to HPC Programming Models - EUDAT Summer School (Stefano Markidi...
Introduction to HPC Programming Models - EUDAT Summer School (Stefano Markidi...Introduction to HPC Programming Models - EUDAT Summer School (Stefano Markidi...
Introduction to HPC Programming Models - EUDAT Summer School (Stefano Markidi...EUDAT
 
Clusters (Distributed computing)
Clusters (Distributed computing)Clusters (Distributed computing)
Clusters (Distributed computing)Sri Prasanna
 
Automatic Compilation Of MATLAB Programs For Synergistic Execution On Heterog...
Automatic Compilation Of MATLAB Programs For Synergistic Execution On Heterog...Automatic Compilation Of MATLAB Programs For Synergistic Execution On Heterog...
Automatic Compilation Of MATLAB Programs For Synergistic Execution On Heterog...Sara Alvarez
 
Parallel architecture
Parallel architectureParallel architecture
Parallel architectureMr SMAK
 
Parallel Computing 2007: Overview
Parallel Computing 2007: OverviewParallel Computing 2007: Overview
Parallel Computing 2007: OverviewGeoffrey Fox
 
Parallel programming in modern world .net technics shared
Parallel programming in modern world .net technics   sharedParallel programming in modern world .net technics   shared
Parallel programming in modern world .net technics sharedIT Weekend
 
Parallel Programming In Modern World .NET Technics
Parallel Programming In Modern World .NET TechnicsParallel Programming In Modern World .NET Technics
Parallel Programming In Modern World .NET TechnicsIT Weekend
 
DYNAMIC TASK PARTITIONING MODEL IN PARALLEL COMPUTING
DYNAMIC TASK PARTITIONING MODEL IN PARALLEL COMPUTINGDYNAMIC TASK PARTITIONING MODEL IN PARALLEL COMPUTING
DYNAMIC TASK PARTITIONING MODEL IN PARALLEL COMPUTINGcscpconf
 
Prelim Slides
Prelim SlidesPrelim Slides
Prelim Slidessmpant
 

Similaire à Parallel Programming Primer 1 (20)

Migration To Multi Core - Parallel Programming Models
Migration To Multi Core - Parallel Programming ModelsMigration To Multi Core - Parallel Programming Models
Migration To Multi Core - Parallel Programming Models
 
Moving Towards a Streaming Architecture
Moving Towards a Streaming ArchitectureMoving Towards a Streaming Architecture
Moving Towards a Streaming Architecture
 
Chap 1(one) general introduction
Chap 1(one)  general introductionChap 1(one)  general introduction
Chap 1(one) general introduction
 
parellel computing
parellel computingparellel computing
parellel computing
 
Distributed Computing
Distributed ComputingDistributed Computing
Distributed Computing
 
Parallel and Distributed Computing chapter 1
Parallel and Distributed Computing chapter 1Parallel and Distributed Computing chapter 1
Parallel and Distributed Computing chapter 1
 
Par com
Par comPar com
Par com
 
Parallel Computing
Parallel ComputingParallel Computing
Parallel Computing
 
Parallel Computing-Part-1.pptx
Parallel Computing-Part-1.pptxParallel Computing-Part-1.pptx
Parallel Computing-Part-1.pptx
 
2 parallel processing presentation ph d 1st semester
2 parallel processing presentation ph d 1st semester2 parallel processing presentation ph d 1st semester
2 parallel processing presentation ph d 1st semester
 
Lecture1
Lecture1Lecture1
Lecture1
 
Introduction to HPC Programming Models - EUDAT Summer School (Stefano Markidi...
Introduction to HPC Programming Models - EUDAT Summer School (Stefano Markidi...Introduction to HPC Programming Models - EUDAT Summer School (Stefano Markidi...
Introduction to HPC Programming Models - EUDAT Summer School (Stefano Markidi...
 
Clusters (Distributed computing)
Clusters (Distributed computing)Clusters (Distributed computing)
Clusters (Distributed computing)
 
Automatic Compilation Of MATLAB Programs For Synergistic Execution On Heterog...
Automatic Compilation Of MATLAB Programs For Synergistic Execution On Heterog...Automatic Compilation Of MATLAB Programs For Synergistic Execution On Heterog...
Automatic Compilation Of MATLAB Programs For Synergistic Execution On Heterog...
 
Parallel architecture
Parallel architectureParallel architecture
Parallel architecture
 
Parallel Computing 2007: Overview
Parallel Computing 2007: OverviewParallel Computing 2007: Overview
Parallel Computing 2007: Overview
 
Parallel programming in modern world .net technics shared
Parallel programming in modern world .net technics   sharedParallel programming in modern world .net technics   shared
Parallel programming in modern world .net technics shared
 
Parallel Programming In Modern World .NET Technics
Parallel Programming In Modern World .NET TechnicsParallel Programming In Modern World .NET Technics
Parallel Programming In Modern World .NET Technics
 
DYNAMIC TASK PARTITIONING MODEL IN PARALLEL COMPUTING
DYNAMIC TASK PARTITIONING MODEL IN PARALLEL COMPUTINGDYNAMIC TASK PARTITIONING MODEL IN PARALLEL COMPUTING
DYNAMIC TASK PARTITIONING MODEL IN PARALLEL COMPUTING
 
Prelim Slides
Prelim SlidesPrelim Slides
Prelim Slides
 

Plus de mobius.cn

Lec4 Clustering
Lec4 ClusteringLec4 Clustering
Lec4 Clusteringmobius.cn
 
Lec5 Pagerank
Lec5 PagerankLec5 Pagerank
Lec5 Pagerankmobius.cn
 
Advanced Lighting Techniques Dan Baker (Meltdown 2005)
Advanced Lighting Techniques   Dan Baker (Meltdown 2005)Advanced Lighting Techniques   Dan Baker (Meltdown 2005)
Advanced Lighting Techniques Dan Baker (Meltdown 2005)mobius.cn
 
Influence map
Influence mapInfluence map
Influence mapmobius.cn
 

Plus de mobius.cn (6)

Lec4 Clustering
Lec4 ClusteringLec4 Clustering
Lec4 Clustering
 
Lec3 Dfs
Lec3 DfsLec3 Dfs
Lec3 Dfs
 
Lec5 Pagerank
Lec5 PagerankLec5 Pagerank
Lec5 Pagerank
 
Lec1 Intro
Lec1 IntroLec1 Intro
Lec1 Intro
 
Advanced Lighting Techniques Dan Baker (Meltdown 2005)
Advanced Lighting Techniques   Dan Baker (Meltdown 2005)Advanced Lighting Techniques   Dan Baker (Meltdown 2005)
Advanced Lighting Techniques Dan Baker (Meltdown 2005)
 
Influence map
Influence mapInfluence map
Influence map
 

Parallel Programming Primer 1

  • 1. Lecture 1 – Parallel Programming Primer CPE 458 – Parallel Programming, Spring 2009 Except as otherwise noted, the content of this presentation is licensed under the Creative Commons Attribution 2.5 License.http://creativecommons.org/licenses/by/2.5
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.
  • 21.
  • 22.
  • 23.
  • 24.
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.
  • 33.
  • 34.
  • 35.
  • 36.
  • 37.
  • 38.
  • 39.
  • 40.
  • 41.
  • 42.
  • 43.
  • 44.
  • 45.
  • 46.
  • 47.
  • 48.