I'm a software engineer with over eight years experience working at ARM in Cambridge, UK.
For the last four years I have been the tech lead on our internal metrics platform, which aims to collect and store ARMs engineering and operations data and prepare it for further analyses. This has exposed me to technologies from the Big Data world, including Apache Spark, Apache Flume, EXASOL, and Tableau.
At home I enjoy occasional baking and beer making, and working on side projects to improve my technical skills. Currently I’m writing an Apple Watch app to track my rowing.
Thinking about how your master dataset is stored and managed is arguably the most important part of architecting a data-driven system. Your master dataset is your source of truth. An issue here, be it hardware failure, human error, or something else, could easily result in irreparable damage to some or all of your data.