Linkedin

  • Home >
  • General HPC Architecture on AWS A series of processes that constitute high-performance computing (HPC) on AWS with lift and shift approach

General HPC Architecture on AWS A series of processes that constitute high-performance computing (HPC) on AWS with lift and shift approach

Project Overview

Project Detail

Installs AWS ParallelCluster, which is used to provision HPC resources. 2 3 4 5 6 7 8 9 10 11 12 Use the installed AWS ParallelCluster to define the resource you want to provision in the form of a script. This is called the “configure file”. Provision the configure file defined in Step 2 with an AWS ParallelCluster command. The real provisioning of resources is performed through an infrastructure as code (IaC) service called AWS CloudFormation linked with AWS ParallelCluster. When provisioning is complete, the defined resources are created. A head node (including defined scheduler) and a file system (Amazon FSx for Lustre) are created. To perform the simulation, the user connects to the created head node through a secure shell protocol (SSH) or DCV connection. Create a job script on the head node and submit it to the scheduler already installed on the head node. The job is queued until it is processed. The amount of computing power defined in the job script is allocated to process the job. A compute cluster to process the job in the queue is created, and computing is performed. The created cluster nodes and various HPC resources are monitored through a monitoring service called Amazon CloudWatch. The processed results can be stored in Amazon Simple Storage Service (Amazon S3), and  sent to the on-premises environment if necessary. If necessary, you can do post-processing with DC

http://chrome-extension://efaidnbmnnnibpcajpcglclefindmkaj/https://d1.awsstatic.com/architecture-diagrams/ArchitectureDiagrams/hpc-on-aws-ra.pdf?did=wp_card&trk=wp_card

To know more about this project connect with us

General HPC Architecture on AWS A series of processes that constitute high-performance computing (HPC) on AWS with lift and shift approach