LAKE, SWAMP OR PUDDLE: DATA QUALITY AT SCALE

Register here: BRISBANE - 22 AUGMELBOURNE - 23 AUGSYDNEY - 24 AUG

 

Data is a powerful tool. Data-driven systems leveraging modern analytical and predictive techniques can offer significant improvements over static or heuristic driven systems. The question is: how much can you trust your data?

Data collection, processing and aggregation is a challenging task. How do we build confidence in our data? Where did the data come from? How was it generated? What checks have or should be applied? What is affected when it all goes wrong?

This talk looks at the mechanics of maintaining data-quality at scale. Firstly looking at bad-data, what it is and where it comes from. Then diving into the techniques required to detect, avoid and ultimately deal with bad-data. At the end of this talk the audience should come away with an idea of how to design quality data-driven systems that ultimately build confidence and trust rather than inflate expectations.

 

ABOUT THE PRESENTER: MARK HIBBERD

SMark Hibberd

Mark Hibberd spends his time working on large-scale data and machine learning problems for Ambiata. Mark takes software development seriously. Valuing correctness and reliability, he is constantly looking to learn tools and techniques to support these goals.

This approach has led to a history of building teams that utilise purely-functional programming techniques to help deliver robust products.

THANK YOU TO OUR YOW! NIGHT SPONSORS

BRISBANE
YOW! Gold Community Sponsor YOW! Usergroup Partner
thoughtworks Brisbane Data Science UG
MELBOURNE
YOW! Night Venue
and Food Sponsor
YOW! Night Drinks Sponsor YOW! Gold Community Sponsor
Liberty Aconex logo thoughtworks
SYDNEY
YOW! Night Venue
and Food Sponsor
YOW! Usergroup Partner YOW! Gold Community Sponsor
SafetyCulture Sydney Big Data & Analytics UG thoughtworks

Register here: BRISBANE - 22 AUGMELBOURNE - 23 AUGSYDNEY - 24 AUG