Website customers search for availability on the website served through Amazon CloudFront. Amazon CloudFront sends the request log to a Kinesis Data Stream in real time. 3 Kinesis Data Firehose takes data out of the Kinesis Data Stream. This allows processing and delivery of data. AWS Lambda maps the log properties to their respective tags (IP, headers, cookies, etc.). 4 5 6 7 Kinesis Data Firehose delivers the transformed logs as JSON to an Amazon S3 data lake and an Amazon Elasticsearch cluster. An AWS Glue Crawler runs on a schedule, deriving a schema from the data and updating a Data Catalog in Amazon Athena. Data Analysts visualize historical/aggregated data via Amazon QuickSight and real-time data in Amazon Elasticsearch. As new purchases happen, the cookie header or session ID value, along with the relevant purchase information, is inserted to the
