Amazon AWS is by far the leader in cloud computing and HPC cloud computing. The idea for AWS came about during a 2003 executive retreat at the home of Amazon founder Jeff Bezos. Part of the meeting included a discussion of the company’s core competencies and while they knew they had the ability to sell a vast range of products online, they also realized that one of their most powerful skills was in building computing infrastructures that were reliable, scalable, and cost effective.
AWS was first introduced to the world in 2006. The growth was slow at first, but it soon blasted off like a rocket. It took several years for competitors to enter the field, allowing AWS to cement a very large installed base with customers large (Netflix for example) and small alike.
AWS passed the million customer mark in 2015 and had more than $88 billion in revenue in 2023. The company is building a larger and larger presence in HPC cloud computing with specialized infrastructure to increase compute performance and throughput.
2024 Winter Classic: Amazon Web Services
2024 Winter Classic: AWS Mentor Interview
The history of AWS and the Winter Classic has been, in a word, tumultuous.
Their initial run in 2022 was a simple task of optimizing a basic OpenFOAM simulation on different processors to achieve the lowest wall clock time to solution. The only requirement was to keep the same airflow coefficient. One team, Prairie View A &M, thought outside the box and tried coarsening the mesh and achieved spectacular results. They scored a perfect 100 points vs. the next highest competitor who only scored 6 points, which vaulted them from a weak fifth place to a tight second place and eventually gave them the 2022 championship.
In 2023, AWS came back with their GROMACS Challenge, won by Team Santa Cruz, which put them in a virtual tie with the Channel Islands High Performance Dolphins heading into the interview. The Dolphins prevailed by only 4.29 (0.65%) points for the championship.
The AWS competition week in 2024 was equally dramatic, but for different reasons. The results did result in leaderboard changes – five out of the 11 teams had their positions changed. But first, let’s talk about the student task, the AWS RELION Challenge.
In the interview, Evan Bollig and Brian Skjerven talk about why they selected RELION, which is used for electron cryomicroscopy (getting stuff really cold and then looking at it close up). The interesting thing about this app, which they discuss in the interview below, is that the AWS teams often have customers come to them with a need to run cryomicroscopy workloads, but not knowing how to do it. So, with the RELION Challenge, students are attempting to do something that stumps real-world customer teams. Very cool.
The goal for AWS in every competition is to present as much of a real life HPC situation as possible for the students – and that was definitely the case this year. We had a system availability interruption in the middle of the week that threw a wrench into the works.
It wasn’t a problem with the systems themselves, it was because of the highly unusual usage pattern of the Winter Classic AWS account. For 51 weeks of the year, the Winter Classic account is at zero utilization and then, for one week, it gets slammed by users from 50+ different IP addresses. This raised automated fraud detection alarms and understandably cut off account access. It was fixed with some phone calls and account adjustments and the students received extra time to complete the task.
Check out the AWS interview, it’s a very thoughtful explanation of what they’re trying to do with mentoring the students and how they’re accomplishing it – and having fun doing it.
(The photo is an image of a tick larvae as seen by Dartmouth’s electron microscope, thank you Dartmouth, that’s really scary.)
After you watch the video, hit our social media and give us huge amounts of praise, and send our links to everyone on your contacts list, make sure you stay tuned for more Winter Classic competition action.
2023 Winter Classic: Amazon Web Services
2023 Winter Classic: AWS Mentor Interview
The overriding theme of the AWS GROMACS Challenge was to expose the students to the real-world life of an HPC application architect. The activities they had the students doing mirrored what these folks do daily as they answer typical customer questions such as “what will my application performance be on the cloud?”, “which instances provide the best performance?” and the all-important “what is this going to cost me?”
In the video, we interview AWS architects Evan Bollig and Sean Smith (who is a past student cluster competition participant). They tell us how they structured the challenge and gave us some tidbits about the teams. For example, just one team accounted for one third of all the traffic on the AWS competition clusters. One team turned in a report that was so good that Evan thought it could be sold for significant money, which was very cool to hear.
Click on the handy video link below to see more…
2023 Winter Classic: AWS GROMACS Results!
Hands off keyboards, the last computational challenge in the 2023 Winter Classic student cluster competition has been completed, the scores have been compiled, tallied, and then compiled again just to make sure.
(BREAKING NEWS: The Winter Classic Gala Awards Ceremony will be held on Friday, 4/14, at 4:00 pm Pacific. Here’s the link to the Zoom webinar.)
In this module, the AWS GROMACS Challenge, the cloudy taskmasters asked our 12 student teams to run GROMACS on three different cluster configurations and report their best results in terms of performance and price/performance.
This turned out to be the most difficult challenge in the entire competition. The average team score was 43.99% with a median of 38.55%, significantly below the marks for previous modules.
The top three finishers, UC Santa Cruz, Cal Poly Pomona, and the Texas Tech Matadors, scored 100%, 87.30% and 85.70% respectively.
The impact on our leaderboard was profound and sets up the closest finish yet in Winter Classic history. The top two teams are only separated by 2.09 points out of a total of 600 points possible. Who’s on top? Who’s in second? Check out the video below to see the detailed results.
2022 Winter Classic: Amazon Web Services
2022 Winter Classic: AWS Mentor Interview
If you want to learn how Prairied View blew the field away with OpenFOAM, take a look at our interview with the AWS mentors below. They reveal all and were highly impressed with the teams, but particularly Prairie View and how they pwoned OpenFOAM.
2022 Winter Classic: AWS OpenFOAM Challenge Results Revealed!
When we first lined up AWS to host the final computational event in the 2022 Winter Classic student cluster competition, we figured that by this time in the event that the drama would be over. One team would have pulled ahead and there’d be some distance between teams in the rest of the field. We were dead wrong.
Up until the AWS OpenFOAM Challenge, Tennessee State University had built a comfortable 50 point lead and looked to run the table on their way to the Overall Championship. The second to sixth place race was tight, with only 35 points separating the competitors, which was great. That’s until we opened up the spreadsheet with the OpenFOAM results.
The task for the twelve student teams was to run an OpenFOAM model the fastest while keeping the accuracy within a specified range. Accuracy, in this case, was the drag co-efficient on a racing motorcycle. Teams needed to turn in two results, one run on AMD CPUs in an AWS cluster and the other run on Intel fueled AWS instances.
The results shocked us: Prairie View A&M, a previously fifth or sixth place competitor, absolutely destroyed the rest of the field with scores that were orders of magnitude better than the other teams. Take a look at the detailed AWS results below….
Measured in seconds, Prairie View turned in scores that were 6.8 and 12 times less than second-place Tennessee State University – who had scores that were overall twice as good as the rest of the field.
Our methodology for apportioning competition points is to normalize all scores to the best score and allocate points based on a 100 point scale. This means that Prairie View gets the 100, the next best team received 11.518 points, and so on down the list.
These results had a profound impact on the overall competition leaderboard. Here’s what it looks like now:
With their overwhelming win on OpenFOAM, Prairie View has vaulted themselves from fifth place into a breathtakingly close second. Only a razor thin 2.21 points separate Tennessee State in first place and Prairie View in second. The race for third place is still tight, with just over 24 points between third and fifth place.
The final event in the competition is the judges interview. This is where a panel of HPC experts grill the students on a variety of criteria including how well they understand HPC technology, the applications, and how well they worked together as a team and used what the mentors taught them. Like all of the tasks, the interview is worth a maximum of 100 points with the scores normalized to the top scoring team.
Prairie View has turned the competition for first place into a two horse race – them and Tennessee State. With an excellent interview, Prairie View could take the championship or Tennessee State could salt it away. While it’s possible, it’s difficult to imagine that the Red Raider team in third place could make up enough ground to overtake the two leaders. But they have their own battle to hold on to their potential third place finish, UTEP and FAMU could, with a great interview and a Red Raider stumble, sneak their way into third.
Addison Snell and I recorded a spectacular Studio Update Show where we’re, in a word, gobsmacked over the results we’re revealing. Check it out below.
So what will happen with the interviews? Will Prairie View complete their Cinderella-like run and take home the championship trophy? Will Tennessee State hold them off and add a new statue to their trophy case? Can the Texas Tech Red Raiders defend their third place finish or will UTEP or FAMU snatch it from them at the last possible moment?