Media & Entertainment
Operations Management for Disney's Data Foundation Platform
Industry: Media & Entertainment
Executive Summary
Operationalizing Industrial IoT with KCF Technologies SMARTDiagnostics platform for mission-critical machine health monitoring.
Challenge
1. Scaling Constraints: The EC2-based metadata store required manual intervention to handle traffic spikes, leading to performance bottlenecks. 2. Operational Complexity: Managing fragmented data pipelines across different business units was resource-intensive and prone to configuration drift.
Solution Overview
1. Metadata Mart API: Built using Node.js 18.x on the Serverless Framework, leveraging AWS AppSync for a managed GraphQL interface and AWS Lambda for compute. 2. Unified Ingestion: Developed robust Spark-based ingestion pipelines to unify historic and ongoing data feeds into a central repository. 3. Global Resilience: Deployed Amazon DynamoDB Global Tables to ensure active-active multi-region support with sub-200ms ingestion latency. 4. Snowflake Integration: Designed and implemented downstream data marts in Snowflake to support advanced analytics and reporting.



