Linkedin

Lab instrument log acquisition and analytics

Project Overview

Project Detail

machine attached to the instrument. An agent (virtual machine) is deployed in the user environment, and is used to read data from their NFS storage. An AWS DataSync task created in the customer’s AWS account syncs data from NFS to a customer-owned Amazon S3 bucket. A lab scientist invokes a client application to look for an experiment output log file in Amazon S3 for an associated experiment ID. The client application gets a token from Amazon Cognito and invokes the API with the experiment ID and the Amazon S3 file path (and possibly more IDs as needed from the client application). Amazon API Gateway validates the token fro

http://chrome-extension://efaidnbmnnnibpcajpcglclefindmkaj/https://d1.awsstatic.com/architecture-diagrams/ArchitectureDiagrams/lab-instruments-log-analytics-ra.pdf?did=wp_card&trk=wp_cardm Amazon Cognito, then calls the processing AWS Lambda function (one Lambda function for each type of log file), and returns response after the Lambda function runs. The Lambda function reads the file from Amazon S3, and adds the experiment ID as a tag to the Amazon S3 log file. The Lambda function transforms the S3 file, applies any business rules, converts the log to one or multiple JSON records, and pushes data to Amazon Elasticsearch Service. If the processing Lambda function fails, it writes the S3 file info to an error monitoring queue. A Lambda function based on a pre-defined timed event can read from the queue to reprocess or to inform support staff. Optionally, a processing Lambda function

To know more about this project connect with us

Lab instrument log acquisition and analytics