Over the past decade, data teams have been simultaneously underwater and riding a wave. We've been building modern data stacks, migrating to Snowflake like our lives depended on it, investing in headless BI, and growing our teams faster than you can say reverse ETL. Yet, much of the time we didn't know whether or not these tools are actually bringing value to the … [Read more...] about The Next Big Crisis for Data Teams
big data quality
Ready or Not. The Post Modern Data Stack Is Coming.
If you don't like change, data engineering is not for you. Little in this space has escaped reinvention. The most prominent, recent examples are Snowflake and Databricks disrupting the concept of the database and ushering in the modern data stack era. As part of this movement, Fivetran and dbt fundamentally altered the data pipeline from ETL to ELT. Hightouch interrupted SaaS … [Read more...] about Ready or Not. The Post Modern Data Stack Is Coming.
12 Data Quality Metrics That ACTUALLY Matter
Why do data quality metrics matter? If you're in data, you're either currently working on a data quality project or you just wrapped one up. It's the law of bad data - there's always more of it. Traditional methods of measuring data quality metrics are often time and resource-intensive, spanning several variables, from accuracy (a no-brainer) and completeness, to validity and … [Read more...] about 12 Data Quality Metrics That ACTUALLY Matter
How BlaBlaCar Built a Practical Data Mesh to Support Self-Service Analytics at Scale
As part of my job, I'm fortunate enough to speak with data leaders far and wide about how they are tackling some of our industry's biggest challenges, from implementing data mesh to scaling self-service analytics. What about both? Enter BlaBlaCar, which has made real progress on tough challenges like self service analytics and data mesh over the past few years, leading to a … [Read more...] about How BlaBlaCar Built a Practical Data Mesh to Support Self-Service Analytics at Scale
Do Data Stewards Have The Worst Seat At The Table?
In his seminal 2017 blog post, The Downfall of the Data Engineer, Maxime Beauchemin wrote that the data engineer had the worst seat at the table. Data technology and teams have changed tremendously since that time, and now the Preset CEO and creator of Apache Airflow and Apache Superset has a brighter outlook on the future of the profession. I have also seen what was once a … [Read more...] about Do Data Stewards Have The Worst Seat At The Table?
