Data lineage isn't new, but automation has finally made it accessible and scalable-to a certain extent. In the old days (way back in the mid-2010s), lineage happened through a lot of manual work. This involved identifying data assets, tracking them to their ingestion sources, documenting those sources, mapping the path of data as it moved through various pipelines and stages of … [Read more...] about Data Lineage is Broken – Here Are 5 Solutions To Fix It
big data engineer
Is “Self-Service” Data’s Biggest Lie?
Data self-service, the ability for stakeholders in the organization to answer their own business questions with data, is a top initiative for nearly every data leader I've spoken to this year. It's so foundational to creating a data-driven organization, that most of the questions surrounding it focus on the "when" rather than the "why." That's why we were surprised to hear it … [Read more...] about Is “Self-Service” Data’s Biggest Lie?
6 Crucial Steps For Setting Your Data Team KPIs
As analytics professionals, we deal in data: serving ad-hoc reports on a minute's notice, pulling queries for executives, and generally forecasting company performance across a variety of metrics. But how can we be truly successful if we don't measure our own performance, too? In this article, we discuss six important steps to setting goals for our own data teams, from taking … [Read more...] about 6 Crucial Steps For Setting Your Data Team KPIs
Why Modern Businesses Need Data Engineering Services
Data engineering is one of the most popular IT services for businesses. According to a report by Stitch, more than 6,500 people were still using the term "data engineer" on LinkedIn as of 2016. And now, we will learn why modern businesses need data engineering services? What is Data Engineering? Data engineering involves the design, security, and maintenance of a data … [Read more...] about Why Modern Businesses Need Data Engineering Services
The Right Way to Measure ROI on Data Quality
Last week, I was on a Zoom call with Lina, a Data Product Manager who oversees a data quality program for her organization. Her team is responsible for maintaining 1000s of data pipelines that populate many of the company's most business critical tables. Reliable and trustworthy data is foundational to the success of their product, yet Lina was struggling to find a clear way … [Read more...] about The Right Way to Measure ROI on Data Quality
