NBCUniversal Migrates to Databricks Lakehouse for Scalable Analytics
NBCUniversal successfully migrated its data infrastructure to the Databricks Lakehouse Platform, achieving a 30% cost reduction by switching to dedicated job compute. This move enables independent scaling of data pipelines, faster job completion, and meets Service Level Agreements. The migration impacts data analysts, engineers, and scientists by providing a unified platform for advanced ML model development and real-time analytics, with a phased, partner-led implementation by EXL minimizing disruption.
- →Cost Reduction and Performance Gains with Databricks
- →Unified Platform for Advanced Analytics and ML
- →NBCUniversal's Data Infrastructure Modernization
- →Partner-Led Migration Strategy with Custom Tools
- →Lakehouse Architecture Benefits
Features (2) ›
- Cost Reduction and Performance Gains with Databricks
By migrating to Databricks' job-specific compute and away from a slot-based reservation model, NBCUniversal achieved a 30% cost reduction. This allows independent scaling of parallel pipelines, resulting in faster job completion and consistent SLA adherence.
- Unified Platform for Advanced Analytics and ML
The migration to Databricks provides NBCUniversal with a unified platform that supports advanced capabilities for ML model development, real-time analytics, and collaborative data engineering at scale.
Enhancements (3) ›
- Partner-Led Migration Strategy with Custom Tools
EXL implemented a phased migration strategy using custom automation tools, including a SQL translation engine and an orchestration migrator, to accelerate the process, reduce manual effort, and ensure code conversion, data migration, and validation.
- Lakehouse Architecture Benefits
Databricks' lakehouse architecture, leveraging Delta Lake and Apache Spark, provides NBCUniversal with flexibility for diverse data formats, enhanced machine learning capabilities via MLflow integration, and granular compute control for dedicated pipeline execution.
- Unity Catalog for Data Governance
NBCUniversal implemented Unity Catalog as the central governance layer within the Databricks environment, enhancing data lineage tracking and policy enforcement.
Notes (1) ›
- NBCUniversal's Data Infrastructure Modernization
NBCUniversal modernized its data infrastructure to support a growing content ecosystem, seeking a more scalable and integrated solution to enhance flexibility, improve performance, and optimize compute expenses.
https://www.databricks.com/blog/nbcuniversals-seamless-migration-unlocking-scalable-analytics-databricks
Related releases
- Building an AI-Forward Healthcare Organization on Data and Governance Databricks Blog ·
- Databricks Accelerates Agentic Media Buying with New Reference Implementation Databricks Blog ·
- Databricks SDK for Python v0.123.0: API changes and breaking updates Databricks Python SDK Releases ·
- Databricks Go SDK v0.167.0 Adds Cloud Provider Auth Fields Databricks Go SDK Releases ·
- Databricks SDK Java v0.138.0 Adds Model Provider Config Fields Databricks Java SDK Releases ·
- Databricks Genie Code Beta: Agentic Converter for SQL Dialect Migration Databricks Blog ·