CSC Special Topics: Parallel Computing Summer 08

unevenoliveSoftware and s/w Development

Dec 1, 2013 (3 years and 8 months ago)

79 views


CSC

Special Topic
s
: Parallel

Computing

Summer 08



Dr.
Nagi Mekhiel


,

E
-
mail:

nmekhiel@ee.ryerson.ca

Home page: http://
www.ee.ryerson
.ca/~courses/ee8207

Office
&
hours:

Class Hours
:

Class Room
:


TEXT BOOK


David E. Culler, Jaswinder Pal
Singh, with Anoop
Gupta`Parallel Computer
Architecture: A Software/Hardware Approach'' Morgan Kaufmann Publishers, San
Francisco, California ISBN 1
-
55860
-
343
-
3


Refe
rences

1.

MPICH2 “Message Passing Interface”
Reference


2.

http://www
-
unix.mcs.anl.gov/mpi/




Course
Description
:

This course
introduce
s

students to parallel computing including parallel algorithms,
parallel programming and the differ
ent parallel architectures. The

course covers the
basic programming m
odels used in parallel computers, parallel algorithms, parallel
programming, the shared memory multiprocessor and NUMA multiprocessor. The
Laboratory projects include parallel programming using one of the parallel models.


Prerequisites
:


C
omputer architec
ture, mathematics, algorithms and program


Marking Scheme

Labs = 30%, Assignments= 20%, Project Report/Paper= 40
%, Participation=
10
%.


Course Goals/Objectives:

To introduce students to parallel computing including algorithms, architectures and

parallel pro
gramming (MPI).


Class
Preparation

1
-
Download Software for implementing parallel computing

2
-
Install software

3
-
Run a parallel program

4
-
Evaluate the perfo
rmance gain for using parallel computing





Class Participation

1
-
Each group select
a topic
and p
resent a 15 minutes plan (due date: w
eek 2
)

2
-
Each group present 1/2 hour o
n progress in implementing parallel programming


(download, installing..)

(due date: week 4,5
)
.

3
-
Each g
roup discuss the use of parallel computing to run an application


(due

date: week 8,9)
.

4
-
Presentation of final results and conclusions (due date: week 11)


Course Schedule


Date

Topic


Homework &
Project
discussion

Week 1





Introduction to Parallel Architecture


-
shared memory


-
message passing


-
other parallel architec
tures


-
programming model and communication


Introduction to
MPI (read
reference manuals)

Week 2






Parallel Programs


-
Examples of Parallel Applications



Download software for
MPI



Week3


Parallel Programs


-
Examples of Parallel Applications


-
Par
allelization Process

Installing
MPI

Week 4




Parallel Programs


-
Examples of Parallel Applications


-
Parallelization Process

Installing MPI

Week 5


Parallel Programs


-
Example Program

Running
application

Week
6


-
Programming for Performance


-
partiti
onin
g

Running
application

Week 7



-
Programming for Performance


-
partitioning


-
Communication
-
Programming for Performance


Optimization of
Performance

Week 8


Shared Memory Multiprocessors


-
Cache Coherence


-
Memory Consistency


Optimization of
Perform
ance

Week 9




Shared Memory Multiprocessors


-
Design Snooping Protocol


-
Design Trade
-
offs


Evaluate system
Scalability and define
bottleneck

Week 10



Shared Memory Multiprocessors


-
Synchronization


-
Implication for Software

Prepare final
Report

We
ek 11





Projects Presentation

Final
Presentation


Projects and homework

MPI using Windows or MPI using Unix



Grading


Project


and Lab 7
0%


Class P
articipation 1
0%


Assignment 2
0%


Grade dist
ribution

100
-

90


A( >=93:A, >=90:A
-
)


89
-

80


B( >=87 :B+, >=83:B, >=80: B
-
)


79
-

70


C( >=77 :C+, >=73:C, >=70:C
-
)


69
-

60


D( >=67 :D+, >=63:D, >=60:D
-
)



Class conduct guidelines



Collaboration: Discussion of course content
s with other students is an important part
of the academic process and is encouraged. However it is expected that course
assignments, homework, and other course assignments will be completed on an
individual basis unless the assignment specifically states
otherwise. Students may
discuss general concepts with one another, but may not, under any circumstance,
work together on the actual implementation of any course assignment.



For late assignments/projects. With a valid reason, I will accept late exercise wit
hout
penalty. Otherwise a late exercise carries 10% of its total point value for each
calendar day.



Exams: You are expected to take exams during the regular class period on the dates
scheduled. Exceptions to this policy will be allowed if you have a docume
nted
medical excuses and only if you make arrangements with me before the scheduled
exam period.



Plagiarism, cheating and any academic dishonesty in this course will be treated as
specified in the CLU students handbook.


CLU
ACADEMIC DISHONESTY AND ADA S
TATEMENTS


Policy of Academic Honesty

The educational programs of CLOU are designed and dedicated to achieve academic
excellence, honesty and integrity at every level of student life. Part of CLU’s dedication
to academic excellence is our commitment to aca
demic honesty. Students, faculty, staff
and administration share the responsibility for maintaining high levels of scholarship of
on campus. Any behavior or act which might be defined as “deceitful” or “dishonest”
will meet with appropriate disciplinary sa
nctions, including dismissal from the
University, suspension, grade of F in a course, or forms of academic probation.

Statement for ADA Compliance

CLU is committed to providing reasonable accommodation to students with various documented
disability (physic
al, learning, or psychological). If you are a student requesting accommodations
for this course, please contact your professor at the beginning of the semester and register with
the Coordinator for Students with Disabilities (Pearson Library, Center for Ac
ademic Resources,
EXT. 3260} for facilitation and verification of need. Faculty will work closely together with you
and your coordinator to provide necessary accommodations.



Note: The instructor reserves the right to make necessary changes to the syll
abus and the final
version will be given on the first of the class.