The University of Adelaide, established in South Australia in 1874, maintains a rich history of scientific innovation. For more than 140 years, the institution and its researchers have had an impact all over the world—making vital contributions to the invention of X-ray crystallography, insulin, penicillin, and the Olympic torch.
Bioinformaticians from the university’s School of Biological Sciences are carrying on this tradition of innovation. The researchers foster collaborations across the university with the aim of shaping the future of bioscience research at the institution. To support their goals, they develop and deliver bioinformatics training on campus. Recently, in collaboration with Dr. Radosław Suchecki, research scientist at the Commonwealth Scientific and Industrial Research Organization, they offered hands-on virtual training in the Snakemake workflow engine and Nextflow workflow manager to bioinformaticians across Australia, with the support of Australian BioCommons.
To deliver this training, they needed to quickly spin up automated virtual training environments, which presented unique challenges. “In this field, the compute requirements can be very large and usually beyond what one can expect in a computing suite at any one institution,” says Dr. Nathan Watson-Haigh, research fellow in bioinformatics at the university’s School of Biological Sciences. “In addition, we needed to set up a training environment where everyone could access the same resources, regardless of where they were or what their local infrastructure was. These were capabilities we didn’t have ourselves.”
The bioinformaticians engaged RONIN, a Select Consulting Partner in the Amazon Web Services (AWS) Partner Network (APN), to help design and deploy an AWS-based compute cluster that runs on hundreds of Amazon Elastic Compute Cloud (Amazon EC2) instances. The cluster uses AWS Auto Scaling for automatic on-demand scalability, and it takes advantage of the Slurm open-source cluster management system.
“We wanted to develop training for tools that would work in a cluster environment that bioinformatics researchers would typically work on,” says Watson-Haigh. “We knew the AWS Cloud was the right technology, and RONIN was a trusted technology partner we had worked with previously.”
The university collaborated with RONIN to conduct a trial of the cluster before the training event. “The barrier to entry seemed significant at the time, so when we conducted the trial, we clearly saw how good the technology was, as well as the support from RONIN. Just the fact that we could spin something up with no more than a few clicks and have infrastructure at our fingertips was very powerful.”
Using the RONIN solution, the university’s bioinformaticians created a workshop that ran simultaneously across eight locations spanning four time zones in Australia.
With the RONIN compute cluster, the trainers were able to quickly create virtual training for event participants. “Using RONIN and AWS, we spun up training environments in minutes outside of the institutional firewall, so more than 150 bioinformaticians got access to the same virtual resources, regardless of their location,” says Watson-Haigh.
Read the full story here and learn more about Amazon HPC solution.
Get started with running your CAE/CFD workloads now – fill the form and get a $100 AWS credit!