2024
There will be times when you look at the data platform you’ve got and think how great it would be to rip it out and start again.
An effective data platform provides the right tooling and abstractions that allow its users to get things done without the need for constant support from your team.
Data contracts are great for declaratively describing the data and the infrastructure you need to make that data available to others and manage it in line with your governance requirements.
The more autonomy your data platform promotes, the more our users can get done without involving us directly.
Your data contract tooling should be designed for data producers.
While a lot of people associate data contracts with data quality (and I did call my book Driving Data Quality with Data Contracts!
When building a (data) platform you end up thinking a lot about the abstractions you are providing, and the trade-offs they cause.
What key business processes depend on your data?
When building a data platform I’m often thinking about how to reduce friction for my users.
Many data platforms start with a change data capture (CDC) service to extract data from an organisations transactional databases - the source of truth for their most valuable data.