The SWIM Consumer Appconsumes SWIM data and sends it to the Amazon Kinesis Data Stream. AWS Lambda converts XML data to JSON data. AWS Lambda simplifies the JSON data. The AWS Lambda Task filters customer flight data. It writes one copy of the data to Amazon Kinesis Data Stream and a second copy to the subsequent AWS Lambda Task. The AWS Lambda Task enriches customer flight messages with one or more operational or external datasets. The AWS Lambda Task writes enriched flight data to Amazon Aurora. The AWS Lambda Task writes enriched flight data to the Amazon Kinesis Data Stream. AWS Glue ETL jobs transform enriched flight data from JSON files to Parquet files with appropriate partitions. The jobs register Parquet files as external tables in Glue Data Catalog. Transformed and enriched flight data is analyzed by services such as Amazon Athena, Amazon Redshift, and Amazon Aurora. Analyzed data is consumed by various services such as Amazon QuickSight, custom applications, and APIs. The Glue Data Catalog with databases and tables representing raw, transformed, enriched, and analyzed datasets is s
