MCSE-011 Parallel Computing
(3 Credits)
Syllabus
Block –I Elements of
Parallel Computing and Architecture
Unit 1 Introduction to Parallel
Computing
·
Basic concepts about program/process/ thread concurrent Execution
Parallel Execution, granularity, Potential of Parallelism
·
Need of Parallel Computation
·
Levels of parallel processing
·
Parallel processing Vs. Parallel computing
·
Dataflow Computing concept
·
Applications of parallel processing
o
Scientific Applications / Image processing
o
Engineering Application
o
Database query / Answering applications
o
A I Applications
o
Mathematical simulations and modeling
Unit 2 Classification
of Parallel Computers
·
Types of Classification
·
Flynn’s/ Handler classification
·
UMA / NUMA /COMA
·
Loosely coupled / tightly coupled
·
Classification based grain size and Instruction level parallelism
Unit 3 Interconnection
Network
·
Need of Interconnection Network
·
Concept Bandwidth Nod degree diameter bisection bandwidth,
In degree and Out degree
·
Static and Dynamic Interconnection network
·
Omega, Parallel Shifter, Bens, permutation, hypercube, butterfly,
·
Shuffle exchange Network
Unit 4 Parallel Computer
Architecture
·
Introduction to various computer architecture
·
Pipeline processing
·
Vector / Array processing
·
VLIW and Super scalar architecture
·
Associative architecture
o
Multithreaded architecture
Block 2 Parallel Algorithm
& Parallel Programming
Unit 1 Parallel Algorithm
·
Introduction to Parallel Algorithms
·
Analysis of Parallel Algorithms
·
Different models of computation
o
Combinational circuit
o
Permutation Circuit
o
Sorting circuit
o
Matrix computation
Unit –2 PRAM Algorithms
·
Message passage programming
o
Shared memory
o
Message passing libraries
o
Data Parallel programming
·
Data Structures for parallel algorithms
o
Link list
o
Arrays pointers
o
Hypercube network
Unit 3 Parallel Programming
·
Introduction to Parallel Programming
·
Types of parallel programming
o
Programming based on message passing
o
Programming based on data parallelism
o
Programming for shared memory systems
o
Example programs for parallel systems
Block –3 Advanced Topics
Unit 1 Operating System for Parallel
Computers
·
Basic issues of Operating Systems for Parallel Computers
·
Process Management
·
Resource Management
·
Memory management
·
I/O Management
·
Inter-Processor Communication
·
Vectorisation Compiler
Unit
2 Performance Evaluation
·
Introduction to performance evaluation
·
Metric of Parallel overhead
·
Law Speedup
·
Measurement Tools
Unit 3 Recent Trends
for Parallel Computer
·
Development of last 3 years
·
Multicompontent CPU
·
Apex architecture IA 64
·
Hyperthreading