Skip to main content

Data incidents are opportunities

Hey 👋 How is it May already?! Here in the UK we have another bank holiday weekend. If you do too, enjoy the time off!

In today’s newsletter I write about the opportunities provided by data incidents.

There’s also links to articles on Data Platform Engineering and data quality.


Data incidents are opportunities

We know things go will wrong when working with data.

Just as with software, it’s inevitable this will happen, because we are working on fast changing complex systems with many upstream dependencies.

It’s how we respond to these data incidents that’s important.

Some data teams try to keep the incidents and the impact of those quiet. They fix (or more likely, work around) the issue as quick as possible, then move on.

Others see data incidents as an opportunity.

They use data incidents as an opportunity to really understand the root causes and consider what can be done to prevent similar incidents from happening again.

They use data incidents to improve their incident response processes, ensuring they work together better and communicate better the next time they have an incident.

Data incidents are also a rare opportunity to get people engaged from across the organisation, from your users downstream to your data producers upstream, and get them together to discuss what can be done to prevent similar incidents in the future.

The downstream consumers provide critical business context on the impact of the incident on their work and key processes.

The upstream data producers likely had no idea their changes can cause data incidents and will start to consider their role in providing data to their rest of the business.

So, the next time you have a data incident, take advantage of the opportunity.


Data Platform Engineering by David Jayatillake

Great article on how data platform engineering and how by investing in the data platform you can empower data/analytics engineers to self-serve and move faster by using standardised tooling.

How to turn Data Quality into Business Value by Charlotte Ledoux

Good tips on measuring data quality and taking actions based on those measurements. Also talks a bit about incidents.


Being punny 😅

Someone has ripped the fifth month out of my calendar. I’m dismayed.


Upcoming workshops


Thanks! If you’d like to support my work…

Thanks for reading this weeks newsletter — always appreciated!

If you’d like to support my work consider buying my book, Driving Data Quality with Data Contracts, or if you have it already please leave a review on Amazon.

Enjoy your weekend.

Andrew


Want great, practical advice on implementing data mesh, data products and data contracts?

In my weekly newsletter I share with you an original post and links to what's new and cool in the world of data mesh, data products, and data contracts.

I also include a little pun, because why not? 😅

(Don’t worry—I hate spam, too, and I’ll NEVER share your email address with anyone!)


Andrew Jones
Author
Andrew Jones
I build data platforms that reduce risk and drive revenue.