Data Engineering

When it comes to defining SLOs, I’m aiming for good enough.

If you’re looking at implementing data contracts or moving towards a data mesh you will hear a lot about shifting left.

Data engineering is complex, and things will go wrong.

In electrical systems, a circuit breaker is a device designed to automatically stop the flow of electricity in a circuit as a safety measure to prevent damage from faults like short circuits or overloads.

Following on from yesterdays mail, when I talked about the language of data engineering, it’s worth asking why you’re asked to accept “unrefined”, poor quality data.

The language we use is important.

Data is created by various systems and applications owned by various teams.

An ounce of prevention is worth a pound of cure.

I wrote a few weeks ago about the difference between active vs passive data publishing, and how the active publishing of data leads to better outcomes for your organisation.

Many of us engineers enjoy building things.