This solution shows how to integrate Chef Infra, Chef InSpec, Test Kitchen, Terraform, Terraform Cloud, and GitHub Actions to automate and to create data analytics environments. It uses an Azure Databricks cluster to analyze the data.
earn.microsoft.com/en-us/azure/architecture/example-scenario/analytics/ingest-faa-swim-analyze-flight-data