2024
I wrote earlier this month that data contracts shouldn’t focus on enforcement.
What do you want from your data?
You try your best to work around the poor quality data you’re given.
I enjoyed this post from Nicole Radziwill, PhD on LinkedIn:
If you’re a software engineer, and an upstream dependency is unreliable, then you would speak to the team who owns that dependency.
If you want to improve the quality of the data
Staging layers, medallion architectures, data testing, assigning data stewards, gatekeeping application changes until reviewed by a data team.
In a response to my LinkedIn post on how every data transform is technical debt, Tim Hiebenthal commented:
Data quality can only be improved at the source.
As I wrote yesterday, many data professionals don’t trust the data they are building on.