Linkedin

  • Home >
  • Decoupled Serverless Scheduler, Part 1 of 2 Deploy a Decoupled Serverless Scheduler To Run Any HPC Application At Scale

Decoupled Serverless Scheduler, Part 1 of 2 Deploy a Decoupled Serverless Scheduler To Run Any HPC Application At Scale

Project Overview

Project Detail

ted to Amazon Simple Queue Service (Amazon SQS) use AWS Systems Manager Run Command such as bash or Windows PowerShell. The user launches an Amazon EC2 instance or cluster of EC2 instances with tag key scheduler-queue. On EC2 launch, an Amazon CloudWatch Eventtriggers an AWS Lambdafunction. The Lambda functionlooks for tag key scheduler-queueand triggers a new AWS Step Function state machine, passing the instance_idand tag value (SQS job queue name) Workflow polls Amazon SQS for a new job, and continues to poll until there are no more jobs. Workflow runs job on previously launched EC2 instances or cluster of EC2 instances. Workflow continuously writes job status to Amazon DynamoDB table. User monitors job status through AWS Management Console or AWS Command Line Interface (AWS CLI). 1

http://chrome-extension://efaidnbmnnnibpcajpcglclefindmkaj/https://d1.awsstatic.com/architecture-diagrams/ArchitectureDiagrams/decoupled_serverless_scheduler_ra.pdf?did=wp_card&trk=wp_card

To know more about this project connect with us

Decoupled Serverless Scheduler, Part 1 of 2 Deploy a Decoupled Serverless Scheduler To Run Any HPC Application At Scale