The Rise of Modern Data Management
In this session, Chad Sanderson, CEO of Gable.ai and author of the upcoming O'Reilly book "Data Contracts," tackles the necessity of modern data management in an age of hyper iteration, experimentation, and AI. He will explore why traditional data management practices fail and how the cloud has fundamentally changed data development.
The talk will cover a modern application of data management best practices, including data change detection, data contracts, observability, and CI/CD tests, and outline the roles of data producers and consumers.
Attendees will leave with a clear understanding of modern data management's components and how to leverage them for better data handling and decision-making.
This talk will be presented remotely.
Lernziele
- Implement Data Contracts: Establish and enforce data contracts between data producers and consumers to ensure data quality and compatibility, facilitating smoother data integration and use across different systems and teams.
- Adopt Observability in Data Systems: Integrate observability tools and practices into your data management strategy to gain real-time insights into your data's health, usage, and performance, enabling proactive issue resolution and optimization.
- Apply CI/CD Practices to Data Development: Utilize Continuous Integration and Continuous Deployment (CI/CD) methodologies for data pipelines and datasets to accelerate updates, improve data accuracy, and enhance collaboration between data teams.