OU Supercomputing Center for Education & Research
University of Oklahoma   OSCER   OU IT

 

National Computational Science Institute (NCSI)
2011 Summer Tutorial Workshop on
Introduction to Parallel Programming & Cluster Computing
Sunday June 26 - Friday July 1 2011

Table of Contents


Agenda (TENTATIVE) and Materials

NOTE: This agenda is TENTATIVE and subject to change without notice.
All times are APPROXIMATE.
 
Please fill out this survey to tell us which breakout mini-sessions you'd be interested in.
 
 
Sunday June 26 2011
 
6:00pm MT

5:00pm PT
WORKSHOP CHECK-IN AND PIZZA PARTY
6:30pm MT

5:30pm PT
Welcome and
NCSI Workshop Series Overview
Charlie Peck  
7:00pm MT

6:00pm PT
Tour of Piazzza Andrew Fitz Gibbon  
7:30pm MT

6:30pm PT
Overview: What the Heck is Supercomputing? Henry Neeman PowerPoint   PDF
Video with slides
 
Monday June 27 2011
 
7:00am MT

7:30am PT
BREAKFAST
9:00am MT

8:00am PT
MPI Programming Model:
Desert Islands Analogy
Henry Neeman PowerPoint   PDF
9:30am MT

8:30am PT
Introduction to MPI:
The First Six Routines
Charlie Peck PowerPoint   PDF

Video
10:30am MT

9:30am PT
MIDMORNING BREAK
11:00am MT

10:00am PT
Exercise:
Batch Computing on Sooner
(Serial Hello World)
Henry Neeman Word   PDF
11:30am MT

10:30am PT
Exercise:
MPI Hello World
Henry Neeman Word   PDF
12:00noon MT

11:00am PT
MPI Greetings Andrew Fitz Gibbon Word   PDF
11:00am-1:00pm MT

11:30am PT
LUNCH
2:00pm MT

1:00pm PT
Computation Across the Curriculum Ivan Babic PDF
Video with slides
2:30pm MT

1:30pm PT
The Tyranny of the
Storage Hierarchy
Henry Neeman PowerPoint   PDF

Video
3:30pm MT

2:30pm PT
MIDAFTERNOON BREAK
4:00pm MT

3:00pm PT
Group Coding Exercise:
Serial (Non-parallel)
Area Under a Curve
Aaron Weeden PDF
4:30pm MT

3:30pm PT
Lab Exercise:
MPI Area Under a Curve
Aaron Weeden C source code (Serial)

Fortran 90 source code (MPI)
and its makefile,
courtesy of Isaak Daniels
5:30pm MT

4:30pm PT
SUPPER
6:30pm MT

6:45pm PT
After Supper Field Trip: Cluster Tour
 
Tuesday June 28 2011
 
7:00am MT

7:30am PT
BREAKFAST
9:00am MT

8:00am PT
Project Guidelines Charlie Peck Web
9:15am MT

8:15am PT
MPI Area Under a Curve Aaron Weeden C source code (Serial)
9:45am MT

8:45am PT
Dependency Analysis Henry Neeman PowerPoint   PDF
10:30am MT

9:30am PT
MIDMORNING BREAK
11:00am MT

10:00am PT
MPI Collective Communications Henry Neeman PowerPoint   PDF
11:30am MT

10:30am PT
Applications and Types of Parallelism Henry Neeman PowerPoint   PDF
11:00am-1:00pm MT

11:30am PT
LUNCH
2:00pm MT

1:00pm PT
MPI N-Body via
Collective Communications
Henry Neeman,
Josh Alexander,
Andrew Fitz Gibbon
Video

Source code available on Sooner in Henry's
NCSIPARI2011_exercises
directory
After Dinner MPI Blocking vs
Non-blocking Communication
Andrew Fitz Gibbon PowerPoint   PDF
Video


Exercise: Primes
PDF
Serial C Source Code
MPI C Source Code
TIME PERMITTING Deadlock Exercise Charlie Peck Materials coming soon
5:30pm MT

4:30pm PT
SUPPER
After Supper OPEN LAB
(Catch up on coding or work on your project.)
 
Wednesday June 29 2011
 
7:00am MT

7:30am PT
BREAKFAST
9:00am MT

8:00am PT
Bootable Cluster CD Skylar Thompson, Charlie Peck, Andrew Fitz Gibbon PDF
Video 1
Video 2

Software:
Go to
http://bccd.net/downloads
and select the
bccd-3.0.3.i386.iso
link.
You can then burn it to a CD and run it on a system at home, or boot it up in Virtualbox or VMware.

LittleFe Video
9:30am MT

8:30am PT
OpenMP Andrew Fitz Gibbon PowerPoint   PDF

Video Part 1
Video Part 2
Video (side by side)
10:00am MT

9:00am PT
Profiling Charlie Peck Benchmarking & Tuning (PDF)
Video
Video with slides
gprof (PDF)
10:30am MT

9:30am PT
MIDMORNING BREAK
11:00am MT

10:00am PT
OpenMP'ing N-Body Andrew Fitz Gibbon Materials coming soon
11:00am-1:00pm MT

11:30am PT
LUNCH
2:00am MT

1:00am PT
Open Lab
3:30pm MT

2:30pm PT
MIDAFTERNOON BREAK
4:00pm MT

3:00pm PT
Open Lab
5:30pm MT

4:30pm PT
SUPPER
After Supper MIDWEEK BREAK
 
Thursday June 30 2011
 
7:00am MT

7:30am PT
BREAKFAST
9:00am MT

8:00am PT
Parallel Debugging Charlie Peck PDF
deadlock_mpi.c
Video
10:00am MT

9:00am PT
General Purpose
Graphics Processing Units
(GPGPU)
Henry Neeman PowerPoint   PDF
10:30am MT

9:30am PT
MIDMORNING BREAK
11:00am MT

10:00am PT
Group Coding Exercise:
Game of Life
Andrew Fitz Gibbon PDF
Video
Video with slides

Code is on Sooner in:
/home/fitz/NCSIPARI2011_exercises/GameOfLife/
11:00am-1:00pm MT

11:30am PT
LUNCH
2:00pm MT

1:00pm PT
Building a Cluster/
Building a Data Center
All Video
3:30pm MT

2:30pm PT
MIDAFTERNOON BREAK
4:00pm MT

3:00pm PT
Scientific Libraries Henry Neeman PowerPoint   PDF

Exercise:
Building GotoBLAS
Word   PDF

Word   PDF

Word   PDF
5:30pm MT

4:30pm PT
SUPPER
After Supper OPEN LAB
(Catch up on coding or work on your project.)
 
Friday July 1 2011
 
7:00am MT

7:30am PT
BREAKFAST
9:00am MT

8:00am PT
Project Presentations for Early Departers
10:30am MT

9:30am PT
MIDMORNING BREAK
11:00am MT

10:00am PT
Project Presentations
11:00am-1:00pm MT

11:30am PT
LUNCH
2:00pm MT

1:00pm PT
Project Presentations
3:30pm MT

2:30pm PT
MIDAFTERNOON BREAK
3:45pm MT

2:45pm PT
Project Presentations
5:30pm MT

4:30pm PT
Wrapup and Goodbye


Projects

NCSI workshop attendees are required to devise, design and execute a project during the week of the workshop, and to give a brief presentation on it at the end of the workshop (Friday afternoon is strongly preferred).
 
Projects should be on a topic related to teaching High Performance Computing and/or Computational Science & Engineering, whether at the attendee's institution or elsewhere, and how this teaching will leverage the material covered in this workshop.
 
Student attendees may wish to focus more on how they will put what they've learned to use in their studies.
 
PRESENTATIONS ON AN ATTENDEE'S RESEARCH ARE STRONGLY DISCOURAGED.
 
Presentations should be 5 minutes long, including time for one or two questions.
 
TEAM PROJECTS/PRESENTATIONS by small groups of attendees are STRONGLY ENCOURAGED. A team presentation is limited to 5 minutes total (NOT 5 minutes per team member).
 
Offsite remote attendees (via videoconferencing) CANNOT do project presentations, but are welcome to do projects if they want.


Parallelization Sensation!

A new and exciting challenge for workshop participants with more programming experience!
 
Instructions and rules: Word   PDF

LEADER BOARD

  1. Luobin Yang
    Technologies: C, Intel compiler, Infiniband, MVAPICH
    Original code runtime: 789 sec
    Yang runtime (32 MPI processes) with output: 336 sec
    Yang speedup with output: 2.35x
    Original code runtime without output: 543 sec
    Yang runtime (32 MPI processes) without output: 66 sec
    Yang speedup without output: 8.23x


Offsite Remote Participation via Videoconferencing

OFFSITE REMOTE PARTICIPATION VIA VIDEOCONFERENCING: TABLE OF CONTENTS

  • EVO: FREE but ONLY FOR NON-COMMERCIAL USERS
     
    We STRONGLY recommend EVO for all non-commercial users.
     
    Commercial users CANNOT use EVO.
     
  • H.323: FREE
     
    You can connect from an H.323 device (e.g., Polycom Tandberg/Codian, Lifesize, etc)
    or from Internet Explorer in Windows.
     
    H.323 can be used for FREE by both commercial and non-commerical users.
     
  • Toll free land line phone bridge: FREE for end users but costs someone else; donated by OU Information Technology.
     
    PLEASE DON'T USE THE PHONE BRIDGE UNLESS NOTHING ELSE WORKS FOR YOU.
     
    OU IT's phone bridge has a limited number of users per session, and OU IT has to pay for that usage, so please avoid this unless you have NO OTHER WAY TO CONNECT.
     
    OU IT's phone bridge can be used for FREE by all remote offsite participants ‐ but PLEASE DON'T unless you have no other choice.
     
  • Send questions via Piazzza (explained below).
     
  • Slides will be posted to this webpage before each session (PowerPoint and PDF).
     
    PLEASE DOWNLOAD THE SLIDES BEFORE EACH SESSION STARTS.
     
  • Streaming video will be posted to this webpage, hopefully not long after each session.
     

OFFSITE REMOTE PARTICIPATION VIA VIDEOCONFERENCING: INSTRUCTIONS

  • EVO: FREE but ONLY FOR NON-COMMERCIAL USERS
     
    We STRONGLY recommend EVO for all non-commercial users.
     
    Commercial users CANNOT use EVO.
     
    1. Download and install the latest Java Runtime Environment (JRE) from here
      (click on the Java Download icon, because that install package includes both the JRE and other components).
    2. Go to
      http://evo.caltech.edu/
    3. If you haven't registered yet, then:
      1. Click on
        Register
      2. Fill out the registration page.
      3. Wait for the emailed activation link.
      4. Click on the activation link.
         
        If you get the following error, then wait for approximately 5 minutes and try again:
         
        ERROR: The user registered with this id doesn't exist anymore in our database.
    4. Once that's successful, go back to
      http://evo.caltech.edu/
    5. Click on
      Start EVO
    6. You may be asked whether to open the koala.jnlp application, in which case open it with Java (specifically the Web Start Launcher).
    7. You may be asked whether you trust to run the application. Do so. (This may happen multiple times.)
    8. The "Koala" application will start, and should eventually display a login window.
    9. Log in to EVO.
    10. Scroll through the list of meetings to find
      NCSI: Intro to Parallel Computing Workshop
      and click on it.
       
      Or:
      • Click on
        Meetings -> Search for meetings
      • When the Search window pops up, click on the button by
        From all communities
      • Click on the box next to
        Filter Titles
      • In the text box to the right of Filter Titles, enter
        NCSI: Intro to Parallel Computing Workshop
      • Click on
        Search
      • Join the NCSI: Intro to Parallel Computing Workshop meeting.
    11. Check your speaker and microphone levels to determine whether they're working properly.
    Many thanks to Jeff Pummill, Patrick Calhoun and Josh Alexander for providing these instructions.
  • H.323:
    FREE but may be tricky
    • From an H.323 device (e.g., Polycom, Tandberg/Codian, Lifesize, etc):
      • If you ARE already registered with the OneNet gatekeeper:
        Dial
        2500409
      • If you AREN'T registered with the OneNet gatekeeper (probably the case):
        1. Dial:
          164.58.250.47
        2. Bring up the virtual keypad.
          On some H.323 devices, you can bring up the virtual keypad by typing:
          #
        3. When asked for the conference ID, enter:
          0409
        4. On some H.323 devices, you indicate the end of conference ID with:
          #
    • From a Windows PC running Internet Explorer:
      1. You MUST have the ability to install software on the PC (or have someone install it for you).
      2. Download and install the latest Java Runtime Environment (JRE) from here
        (click on the Java Download icon, because that install package includes both the JRE and other components).
      3. Download and install this video decoder.
      4. Start Internet Explorer (no other browser is guaranteed to work).
      5. Copy-and-paste this URL into your IE window:
        http://164.58.250.47/
      6. When that webpage loads, in the upper left, click on "Streaming".
      7. In the textbox labeled Sign-in Name, type your name.
      8. In the textbox labeled Conference ID, type this:
        0409
      9. Click on "Stream this conference".
      10. When that webpage loads, you may see, at the very top, a bar offering you options.
        If so, click on it and choose "Install this add-on."
  • Toll free land line phone bridge:
    (Please only use if you can't get in via videoconferencing.)
    800-832-0736, Access Code * 623 2874 #
    (without the blank spaces)
     
    OU IT's phone bridge can be used for FREE by all remote offsite participants, but PLEASE DON'T unless you have no other choice.
  • Sending questions:
    If you're participating remotely offsite via videoconferencing, please send your questions via Piazzza.
  • Slides:
    Slides, if any, will be posted to this webpage before each session (PowerPoint and PDF).
    PLEASE DOWNLOAD THE SLIDES BEFORE EACH SESSION STARTS.
  • Streaming video:
    Recordings will be posted to this webpage as soon as possible after each session, but we cannot guarantee a specific turnaround time.


Workshop Locations in Pocatello and Seattle

  • Pocatello:
    • Sunday June 26: GIS Center, Graveley Hall, room B19-B22
    • Monday June 27 - Friday July 1
      • Workshop Sessions (including open labs): Gale Life Sciences, room 205
        On Memorial Dr, just before Turner and Garrison.
      • Meals (excluding breaks): Turner House cafeteria
  • Seattle
    • Sunday June 26 - Friday July 1
      • Workshop Sessions (including open labs): Allen Hall room 002
      • Meals (including breaks): Allen Hall atrium
    Paul G. Allen Center for Computational Science & Engineering
    (home of the Computer Science Dept).
    (map)
    Next to Electrical Engineering and the outdoor Sylvan Theatre and Columns,
    and across Stevens Way E from More Hall (Civil & Environmental Engineering).
    NOTE: NOT Allen Library.


Weather in Pocatello and Seattle

According to the latest 10 day and monthly forecasts:

  • Pocatello: Sunny all week with a little or no chance of precipitation, with highs in the mid 70s to low 80s F and lows in the high 40s to mid 50s F. Up to date weather information is here.
  • Seattle: Chance of showers much of the week, with highs in the mid 60s to low 70s F and lows in the 50s F. Up to date weather information is here.


What to Bring

Clothing: We recommend dressing in layers. Expect to dress light enough for being outdoors a little but in an air conditioned PC lab a lot. The lab may be a little chilly, to keep the PCs happy. For Seattle, bring a jacket and footwear appropriate for rain, and an umbrella.

Laptops NOT Needed in the PC Labs: You're welcome to bring a laptop with you to Pocatello or Seattle, but you won't need it for the workshop, because Sunday June 26 to Friday July 1 we'll be in PC labs with at least as many PCs as attendees. But, you may want your laptop with you at other times.

DON'T bring extraneous stuff. The PC labs will be very full with people, video equipment, etc.
Idaho State U: Your room is lockable and your bedroom ISN'T accessible by others sharing your suite.


Air Travel to the Pocatello Regional Airport (PIH)
Click here.


Idaho State U Logistics

Click here.


Driving Directions to Idaho State U housing from the Pocatello Regional Airport (PIH)

  1. As you drive out of the PIH airport, follow the signs that point to Pocatello, and look for the on-ramp to I-86 eastbound.
  2. Take I-86 eastbound to I-15 southbound.
  3. Take I-15 southbound to the Clark St exit (#69).
  4. Head west (toward ISU) on Clark St, which will become one way.
  5. Turn left onto 15th St.
  6. As you enter campus, 15th St becomes Memorial Dr.
  7. Take Memorial Dr past Holt Arena.
  8. Turner Hall will be on the left side of the road, just before you get to the intersection with Carter on your right. Turner is building #64 on the ISU campus map, just next to its twin, Garrison (#63), with Turner on the left and Garrison on the right as you view them from Memorial Dr. Look for the big 64 on the side of Turner. Here's a view from the street.
  9. Enter Turner (#64) at the entrance between Turner and Garrison (#63).
  10. Check in at Turner to get your keycard and room key.
  11. Non-local attendees are being housed in Rendezvous (#38).
    1. After you check in at Turner, leave Turner and head left out of the parking lot back onto Memorial Dr.
    2. Pass Turner and Garrison, and take a left at Martin Luther King Jr Way (traffic signal).
    3. Soon after turning onto MLK, turn right onto Bartz Way (really more of a parking lot than a street).
    4. Turn right onto Red Hill Rd (again, really more of a parking lot than a street).
    5. Rendezvous (#38) will be on your right side.


Parking at ISU

You can park in the H-10 parking area (green on the ISU campus map) without a parking permit. H-10 parking spaces are on the left hand side of Red Hill Rd, just across Red Hill Rd from Rendezvous.
NOTE: Be sure to park COMPLETELY inside the parking space lines. Apparently parking even a little bit outside the lines can get you a parking ticket.

To park in a General Lot elsewhere on campus, you'd need a parking permit to park Monday through Thursday 9:00am to 3:00pm.

Day permits for General Lots are $4 per day.

The parking office is 208-282-2625.


Checking In at ISU Housing

Check in at the Turner Hall front desk to obtain your keys and guest service card.

One hour before you arrive at Turner's front desk, please call 208-221-0593 (because Rendezvous will be locked).

Housing Front Desk Phone Numbers
208-282-4081
208-282-4638


Workshop Meals

Meals are provided during the workshop, at no charge to attendees, as follows:

  • Sunday June 26
    • 6:00pm Mountain/5:00pm Pacific: PIZZA PARTY (includes vegetarian options)
  • Monday June 27 - Thursday June 30
    • 7:00am Mountain/7:30 Pacific: BREAKFAST
    • 10:30am Mountain/9:30am Pacific: MIDMORNING BREAK
    • 11:00am-1:00pm Mountain/11:30am Pacific: LUNCH
    • 3:30pm Mountain/2:30pm Pacific: MIDAFTERNOON BREAK
    • 5:30pm Mountain/4:30pm Pacific: SUPPER
  • Friday July 1
    • 8:30am Mountain/7:30 Pacific: BREAKFAST
    • 10:30am Mountain/9:30am Pacific: MIDMORNING BREAK
    • 12:30pm Mountain/11:30am Pacific: LUNCH
    • 3:30pm Mountain/2:30pm Pacific: MIDAFTERNOON BREAK
  • Although we will try to accomodate special requests, we cannot make guarantees.
     
    We typically CAN provide a vegetarian option, which typically will include dairy products.
     
    We typically CANNOT provide for more specific needs such as vegan, kosher, halal, gluten-free, etc.
     
    Entrees typically are chicken, turkey or beef, and typically a vegetarian option is provided, but while we make a best effort to provide an appropriate vegetarian option, we CANNOT guarantee that the vegetarian option will meet everyone's specific needs.


Checking Out at ISU

Check out will be at the Rendezvous front desk (208-282-4638), on the 2nd floor by the elevator. The Rendezvous front desk will be staffed at the following times:

  • Friday July 1: 12:00noon-7:00pm
  • Saturday July 2: 8:00am-4:00pm

If you plan to check out at a different time, when desk is not staffed, then please call 208-221-0593 at least 30 minutes before you're ready to check out, and someone will meet you at the Rendezvous front desk.


 

 


Copyright (C) 2010 University of Oklahoma