Good enough SLOs
·1 min
When it comes to defining SLOs, I’m aiming for good enough.
Data Engineering
2024
Why we shift left
If you’re looking at implementing data contracts or moving towards a data mesh you will hear a lot about shifting left.
Learn from your incidents
·1 min
Data engineering is complex, and things will go wrong.
The circuit breaker pattern
·2 mins
In electrical systems, a circuit breaker is a device designed to automatically stop the flow of electricity in a circuit as a safety measure to prevent damage from faults like short circuits or overloads.
Why are you expected to accept unrefined data?
·1 min
Following on from yesterdays mail, when I talked about the language of data engineering, it’s worth asking why you’re asked to accept “unrefined”, poor quality data.
The language of data engineering
·2 mins
The language we use is important.
Limit data divergence
·2 mins
Data is created by various systems and applications owned by various teams.
An ounce of prevention is worth a pound of cure
An ounce of prevention is worth a pound of cure.
Active pulling and pushing of data
·2 mins
I wrote a few weeks ago about the difference between active vs passive data publishing, and how the active publishing of data leads to better outcomes for your organisation.
You have permission not to build
Many of us engineers enjoy building things.
Want great, practical advice on implementing data mesh, data products and data contracts?
In my weekly newsletter I share with you an original post and links to what's new and cool in the world of data mesh, data products, and data contracts.
I also include a little pun, because why not? 😅
Enter your best email here:
(Don’t worry—I hate spam, too, and I’ll NEVER share your email address with anyone!)