Data lineage isn't new, but automation has finally made it accessible and scalable-to a certain extent. In the old days (way back in the mid-2010s), lineage happened through a lot of manual work. This involved identifying data assets, tracking them to their ingestion sources, documenting those sources, mapping the path of data as it moved through various pipelines and stages of … [Read more...] about Data Lineage is Broken – Here Are 5 Solutions To Fix It
data quality
You Can’t Out-Architect Bad Data
Say it with me: bad data is inevitable. It doesn't care about how proactive you are at writing dbt tests, how perfectly your data is modeled, or how robust your architecture is. The possibility of a major data incident (Null value? Errant schema change? Failed model?) that reverberates across the company is always lurking around the corner. That's not to say things like data … [Read more...] about You Can’t Out-Architect Bad Data
Data quality: What and why is it important?
With the internet producing quintillions of readily available information per day, you could be forgiven to think that data is losing its value. Apparently, data is one of those weird commodities that go up in value the more they are available, or perhaps we haven't produced enough to attain the demand-supply equilibrium. Virtually all companies making good in various niches … [Read more...] about Data quality: What and why is it important?
Is “Self-Service” Data’s Biggest Lie?
Data self-service, the ability for stakeholders in the organization to answer their own business questions with data, is a top initiative for nearly every data leader I've spoken to this year. It's so foundational to creating a data-driven organization, that most of the questions surrounding it focus on the "when" rather than the "why." That's why we were surprised to hear it … [Read more...] about Is “Self-Service” Data’s Biggest Lie?
Top 5 Ways Poor Data Quality is Sabotaging Businesses
Information is called the oil of the 21st century. Every business collects data about their customers including their names and addresses, phone numbers, email addresses, order history and preferred payment modes. However, it isn't the amount of data collected that determines its usefulness but the quality of this data. If your data doesn't match high-quality standards, it … [Read more...] about Top 5 Ways Poor Data Quality is Sabotaging Businesses
