Data Contracts: Consensus as Code
Part of the All Things Data! specialist track
Garbage in, garbage out. We all know that, but it's hard to know what to do about it. Documenting everything is well-intentioned, but it's often too detailed or too tedious to be effective. So what's the solution?
Code.
Using code to spell out the expectations between data producers and data teams can help to ensure that everyone is on the same page and that the data is of the highest quality. This approach is ambitious, but it has the potential to change the way we collaborate and instil confidence in our data.
I'll share my experiences with this approach, including the challenges and the wins. I hope you'll join me in exploring this new way of working with data.
See this talk and many more by getting your ticket to PyCon AU now!
I want a ticket!
👨🔧 Boundary spanner between Business and IT concerns. I've lived: Product Management, Consultancy, Iteration Management, Business Analysis, Data Analysis, Software Developer, Quality Assurance, to where it started as IT Support. Everyday I practise a bit of all this to deliver pragmatic and maintainable solutions.
📊 I love the decision journey both as a contributor and a coordinator: from the wrangling, modeling, sampling, digging for insights, and the all important communication of insights and further actions.
👨🏫 I get a kick out of teaching others to fish the many water bodies of data (be they ponds, lakes, or swamps).