The Rules

The Rules

Official Competition Rules, Regulations, Details, and Stuff

Teams:

  1. A team consists of five or six students with up to two official coaches/mentors. Additional mentors can work with the teams at any time except during the actual competition period from April 19 to April 23, 2021. During that period, no coaches or outside mentors can help students.
  2. Teams are typically composed of students from the same university or associated with a research institution. However, teams can be from different institutions as long as they compete under a common team name.

Eligible Students:

  1. Any student who has not received an initial degree by July 30th, 2020 is eligible to participate in this competition.
  2. Students who have received their two-year degree but have not received their four-year degree by July 30th, 2020 are eligible for this competition as are masters students who have not received their second degree by July 30th, 2020.
  3. High school students of any age are also eligible to compete either as an entire team or participating as part of a university team.
  4. Masters or PhD students are eligible, but for each Masters/PhD student added to a team, the team will be reduced by two (2) undergraduate students. Thus a team with one PhD student can only have an additional four undergraduate students.

Coaches/Mentors:

  1. Each team can have as many informal coaches or mentors as they want, however, they can only have a maximum of two official coaches.
  2. Coaches/mentors do not have to be faculty members of the team institution.
  3. Teams are encouraged to ask their sponsor for assistance during the months leading up to the competition.
  4. Teams cannot receive any assistance from coaches/mentors during the competition period (April 19-23).

Sponsors:

  1. Each team will have at least one sponsor which will provide technical assistance, remote hardware access and general support for the team.
  2. Teams are not allowed to acquire their own sponsor. All sponsors will be acquired by the Winter Classic Invitational Student Cluster Competition sponsorship committee.
  3. Sponsors and teams are encouraged to closely interact with the goal of forming a tight and successful partnership during the competition.
  4. Sponsors should provide practice clusters well in advance of the competition and ensure that students receive training on how to access and use the cluster properly.

Applications & Competition Rules:

  1. Benchmarks: HPL (also known as LINPACK) and HPCG
  2. Applications: Four HPC applications that are being used daily to help battle the COVID-19 pandemic.
    1. OpenFOAM: (Open-source Field Operation And Manipulation) is a toolbox typically used for computational fluid dynamics. OpenFOAM is currently being used to analyze and model aerosol transportation and virus exposure for COVID-19. Open source, scales well, and has versions for CPU and GPU processors. Read more about it here. 
    2. LAMMPS: (Large-scale Atomic/Molecular Massively Parallel Simulator) software is used for molecular dynamics simulation. Open source, highly scalable and widely used. There are versions that use GPU and other accelerators as well. Read more about it here.
    3. NAMD: (Nanoscale Molecular Dynamics) is used for molecular dynamics simulation. NAMD is being used today to run groundbreaking COVID-19 simulations on the Frontera supercomputer at the Texas Advanced Computing Center. Opensource, highly scalable with CPU and GPU versions. Read more about it here. 
    4. Gromacs: (GROningen MAchine for Chemical Simulations) is a molecular dynamics application typically used to simulate proteins, lipids and nucleic acids. GROMACS is being used to simulate COVID-19 on supercomputers around the world, including the #2 Summit system at Oak Ridge National Laboratory in the US. Here’s a tutorial and a user manual.
    5. These are very well documented applications. There is a wealth of information on the internet about how to install, run, and optimize performance. Student teams will be provided with a sample data set to use for practice sessions.
  3. Hardware is not allowed to be rebooted during the entire period of the competition, April 19-23. If a system encounters a failure, inform competition committee immediately for reboot permission and observation.
  4. Students will be provided with access to clusters that have 80 TFLOP/s theoretical Rpeak performance. As it will be very difficult to configure a system with exactly 80 TFLOP/s Rpeak, all application and benchmark scores will be normalized to 80 TFLOP/s.
    1. Work with your vendor sponsor to come up with the best configuration to tackle the applications in the competition.
    2. Students will be able to configure CPUs, memory, GPU accelerators and other components, depending on your sponsor.
  5. Winter Classic Competition staff will be available to handle questions during the competition.

Practice Datasets and Other Resources

  1. HPL and HPCG optimization webcast with Dr. Jack Dongarra – very helpful and informative!
  2. Practice datasets for all four applications can be found here.
  3. GROMACS tutorials and resources
    1. http://www.strodel.info/index_files/lecture/html/tutorial.html  go through the menu items in the left hand column, solid tutorial
    2. Scroll down this page for GROMACS tutorial:  https://bevanbrownlab.com/tutorials
  4. NAMD tutorials and resources
    1. Tutorials from the home of NAMD:  http://www.ks.uiuc.edu/Training/Tutorials/namd-index.html  don’t miss the link at the bottom of the page for even more NAMD goodness
    2. Video NAMD tutorial sessions:  https://www.youtube.com/watch?v=IArpsQsZ95U
    3. NAMD set up tutorial for beginners:  https://www.youtube.com/watch?v=yKAMRMigmvU
  5. OpenFOAM tutorials and resources
    1. Open source CFD toolbox OpenFOAM tutorial:  https://www.openfoam.com/documentation/tutorial-guide/
    2. An entire list of tutorials, yay!  https://wiki.openfoam.com/Tutorials
  6. LAMMPS tutorials and resources
    1. Nicely done series of LAMMPS tutorials:  https://icme.hpc.msstate.edu/mediawiki/index.php/LAMMPS_Tutorial_1.html
    2. Set of tutorials from Sandia National Lab, the creators of LAMMPS:  https://lammps.sandia.gov/tutorials.html
  7. There are lots of tutorials and other resources out there. If you get stuck on one of the applications, ask for help, don’t flail!

Tuning and Optimization Tools

 

Application Briefs

  1. In order to get credit for completing an application, students must write an Application Brief for each benchmark and application they run.
  2. An “Application Brief” is a short presentation that must include the following components for each benchmark/application:
    1. The ‘out of the box’ initial performance of the application on their cluster. This means the results from the first successful application/benchmark run on your cluster.
    2. Steps your team took to understand the application and optimize it.
    3. Final performance results on the application – we’re interested in your speedup and how you achieved it.
    4. If you had problems with the application, please let us know what they were and if/how you overcame them.
  3. Application Briefs will be THE key factor for judging how well your team did in the competition and your final position in the field.

Judges Interviews

  1. Each interview will last for 30 minutes maximum. Please prepare a PowerPoint presentation and be ready to present it to the judges.
  2. Introduce the team to the judges. Try to ensure that each team member participates in the interview – this shouldn’t be a one person job – the judges want to make sure that everyone worked as a team for the competition.
  3. Expect to get questions about the applications and benchmarks, judges will ask you questions aimed at understanding how much you know about what you did on your systems.
  4. Expect to get questions about the hardware configuration you used (CPUs, GPUs, memory, etc.)
  5. They’ll ask what you did to optimize the applications and the results of your work.
  6. Add any information on analysis and testing you performed to tune/optimize applications.
  7. Use graphs or tables if appropriate.
  8. Share your overall impressions of the competition, what you learned, and how this experience might help you in the future.

Hardware Rules & Regulations

  1. All hardware used must be announced and available for sale at the time of the competition. In other words, no NDA systems allowed, and all technical specifications of the cluster (including software stack) must be provided to the competition committee one month before the start of the event.
  2. No overclocking of hardware is allowed, this includes CPUs and GPUs. The 80 TFLOP/s system cap is in place to provide a level playing field for all. Here’s a handy calculator for figuring out your CPU peak TFLOP/s (remember convert the GFLOP/s result to TFLOP/s by dividing by 1,000). CPU cores x CPU Frequency x Instructions per cycle.
  3. For the GPU portion of your configuration, use these numbers:
    1. For NVIDIA V100 processors, regardless of memory, use 7.8 TFLOP/s per GPU x # of GPUs in your configuration.
    2. For NVIDIA A100 processors, regardless of memory, use 9.7 TFLOP/s per GPU x# of GPUs in your configuration.
    3. Add your CPU TFLOP/s and GPU TFLOP/s to get your total system TFLOP/s number
  4. We will be providing you with a piece of code that will allow you to see your current cluster competition in real time. We will randomly require you to provide us with a screen shot of the output of that application which will include a time stamp. This is to ensure that all configurations remain consistent during the competition.

Software Rules & Regulations

  1. Teams may use any o/s and software stack desired, provide it is approved by their hardware sponsor.
  2. We recommend that teams preload their entire software stacks on their cluster well before the competition begins.
  3. Teams should also be working to optimize their applications before the competition begins.

Event Publicity

  1. Each team will receive a webcam and will be required to use the provided webcam for team interviews, judging sessions, etc, unless we use another tool like Zoom.
  2. Teams can expect to be interviewed three or four times during the months before the competition and during the actual competition as well.
  3. Publicity interviews will be hosted on the competition website as well as on major HPC publications like HPCwire, InsideHPC, and others.

The Brueckner Award

  1. This is a scholarship named after Rich Brueckner, long time tech journalist who passed away this year. He was a big fan of the cluster competitions and would love to see that his name is now associated with this competition.
  2. The award is six $1,000 scholarships, three for the most outstanding female competitors and three for the most outstanding male competitors.
  3. In order for students to be eligible for the award, they need to submit:
    1. A copy of their undergraduate transcripts.
    2. A one page essay covering why they think they are the best choice for this award, their background, academic performance, etc.
    3. These materials need to be sent to the competition committee by April 1st, 2021.
    4. All submissions will be kept strictly confidential.

Final Competition Timeline

  1. Now – April 26: sponsors matched with teams, teams work with sponsors to configure systems, work on systems, and optimize competition applications
  2. Early April: Final technical specifications for each cluster must be provided to the competition committee
  3. Monday, April 26-30: Competition begins with “Benchmarks Rise & Shine” where students optimize and turn in results for HPL and HPCG. Once they turn in results for the benchmarks, they get the data set(s) for their applications. If student teams are having problems with the benchmarks, they can turn in their benchmark results later in the week – up until Friday at 5:00 pm Pacific time. Risky move, but allowed.
  4. Friday April 30: Student turn in all results and Application Briefs by 5:00 pm Pacific
  5. Monday – Thursday, May 3-6 :  judges interview all teams
  6. Friday, May 7: Virtual awards ceremony