2024
Many of us engineers enjoy building things.
There will be times when you look at the data platform you’ve got and think how great it would be to rip it out and start again.
An effective data platform provides the right tooling and abstractions that allow its users to get things done without the need for constant support from your team.
Data contracts underpin data products.
We spend a lot of our time fixing the symptoms of poor quality data.
Passive data publishing is the norm in most organisations.
As mentioned yesterday, data contracts are best stored with the code that generates the data.
Data contracts should be stored as close as possible to the place the data is generated.
Data contracts are great for declaratively describing the data and the infrastructure you need to make that data available to others and manage it in line with your governance requirements.
The more autonomy your data platform promotes, the more our users can get done without involving us directly.