• Skip to main content
  • Skip to secondary menu
  • Skip to primary sidebar
  • Skip to footer
  • Articles
  • News
  • Events
  • Advertize
  • Jobs
  • Courses
  • Contact
  • (0)
  • LoginRegister
    • Facebook
    • LinkedIn
    • RSS
      Articles
      News
      Events
      Job Posts
    • Twitter
Datafloq

Datafloq

Data and Technology Insights

  • Categories
    • Big Data
    • Blockchain
    • Cloud
    • Internet Of Things
    • Metaverse
    • Robotics
    • Cybersecurity
    • Startups
    • Strategy
    • Technical
  • Big Data
  • Blockchain
  • Cloud
  • Metaverse
  • Internet Of Things
  • Robotics
  • Cybersecurity
  • Startups
  • Strategy
  • Technical

Why Data Quality Is of Utmost Importance in Information-Centric Organisations

Dr Mark van Rijmenam / 3 min read.
March 31, 2014
Datafloq AI Score
×

Datafloq AI Score: 85

Datafloq enables anyone to contribute articles, but we value high-quality content. This means that we do not accept SEO link building content, spammy articles, clickbait, articles written by bots and especially not misinformation. Therefore, we have developed an AI, built using multiple built open-source and proprietary tools to instantly define whether an article is written by a human or a bot and determine the level of bias, objectivity, whether it is fact-based or not, sentiment and overall quality.

Articles published on Datafloq need to have a minimum AI score of 60% and we provide this graph to give more detailed information on how we rate this article. Please note that this is a work in progress and if you have any suggestions, feel free to contact us.

floq.to/0ah2g

High quality data will lead to valuable information and insights for your organisation, but obtaining high quality data is easier said than done. Improving your data quality and sustaining a good quality data output should be at the centre of your Big Data Strategy. Last week I was invited to speak at the Asia Pacific Data Quality Conference in Melbourne, Australia and Id like to share some of insights of this event, as proper data governance could set your organisation apart from your competitor.

Data quality starts with the right Master Data Management processes within your organisation, as the Master Data forms the basis of your Big Data analytics. Master Data of the right quality is data that is complete, accurate & consistent, available, time-stamped and industry standards-based. Improving the data will results in reduced costs, improved efficiency, better insights and enables collaboration across verticals.

Complete data means that all relevant data for a customer is linked and entered in the database. Often obtaining complete data records is a challenge for organisations, as the sales people often forget to ask certain information or customers do not see the benefit of providing all required details. The Australian insurer IAG has found a solution for this problem, as they will be launching a so-called data-discount for their customers. This means that IAG will provide their customers with all sorts of discounts (free movie tickets, discounts on their fees, etc.) in return for complete data records.

Accurate and consistent data is all about ensuring that the data entered, is entered correctly, without misspellings, typos and/or random abbreviations. A good example is that the American logistics company US Xpress, when implementing their Big Data Strategy, found 178 different ways of writing Walmart in their database. Of course, if you want to link all data, this should be prevented. IAG also found a solution for this problem, as Ram Kumar, the CIO of IAG explained, they have moved towards quality awards (monthly, quarterly and annually) for their branches to ensure that all data is accurate and consistent. The branch that achieves the highest data quality receives the award. This has resulted in their quality levels shooting up from 65% to 95% within just a few months.

The data of course should be available and easily accessible at all times for users and they should not need to search for it manually. In addition, the data should be time-stamped, which refers to that it is clear when the data was created, changed and/or deleted and by whom as well that it should be sufficiently up-to-date for the task at hand. Finally, it should adhere to industry standards so that it can be exchanged among companies and verticals. Especially for data related to the Internet of Things and the Industrial Internet this will be a challenge to get this arranged in the near future.


Interested in what the future will bring? Download our 2023 Technology Trends eBook for free.

Consent

The Australian Telecom organisation Telstra has created a Data Firewall to ensure the quality of their data. The data quality firewall improves the way their information factory delivers data that is available when required and that the data is complete and error-free. The data quality firewall provides 24×7 automated monitoring of data in Telstras Enterprise Data Warehouse and alerts when data quality issues are detected.

The above may seem obvious and easy to ensure, as there are sufficient technologies and techniques available in the market that could help. However, the problem is not so much the technology, but much more a human problem and that makes it a lot more difficult to solve. After all, creating a single source of truth to ensure the quality of the data is often not achieved because employees fail to meet the set standards. Often small errors or breaches are not a problem, but when they align, the so-called Swiss Cheese Model of Accident Causation, they can eventually lead to a major data breach. So all sources are important and all employees involved with data at any point in time should understand the importance of high quality data.

The best way to selling the issue of data quality to your employees, and management, is therefore to determine the costs involved with wrong data, data breaches, and the amount of lost revenue it could result in. According to IBM, data-quality related problems can results in millions of dollars in lost revenue, unhappy and lost customers, failure to meet regulatory compliance (and eventually corresponding fines) as well as failure of information-intensive projects.

In the end, if data is not managed correctly and the quality is not ensured, your data can become a risky liability instead of a valuable asset. So, within a data-driven, information-centric organisation everyone should be aware of the importance of high quality data to ensure customer engagement and eventually a positive bottom line of the company.

Categories: Big Data
Tags: asset, Big Data, big data quality, big data strategy, data quality, firewall, governance, liability, organisations, strategy

About Dr Mark van Rijmenam

Dr Mark van Rijmenam, CSP, is a leading strategic futurist and innovation keynote speaker who thinks about how technology changes organisations, society and the metaverse. He is known as The Digital Speaker, and he is a 5x author and entrepreneur.

Primary Sidebar

E-mail Newsletter

Sign up to receive email updates daily and to hear what's going on with us!

Publish
AN Article
Submit
a press release
List
AN Event
Create
A Job Post
Host your website with Managed WordPress for $1.00/mo with GoDaddy!

Related Articles

The Advantages of IT Staff Augmentation Over Traditional Hiring

May 4, 2023 By Mukesh Ram

The State of Digital Asset Management in 2023

May 3, 2023 By pimcoremkt

Test Data Management – Implementation Challenges and Tools Available

May 1, 2023 By yash.mehta262

Related Jobs

  • Software Engineer | South Yorkshire, GB - February 07, 2023
  • Software Engineer with C# .net Investment House | London, GB - February 07, 2023
  • Senior Java Developer | London, GB - February 07, 2023
  • Software Engineer – Growing Digital Media Company | London, GB - February 07, 2023
  • LBG Returners – Senior Data Analyst | Chester Moor, GB - February 07, 2023
More Jobs

Tags

AI Amazon analysis analytics app Apple application Artificial Intelligence BI Big Data business CEO China Cloud Companies company content costs court crypto customers Data digital future Google+ government industry information machine learning market mobile Musk news Other public research revenue sales security share social social media strategy technology twitter

Related Events

  • 6th Middle East Banking AI & Analytics Summit 2023 | Riyadh, Saudi Arabia - May 10, 2023
  • Data Science Salon NYC: AI & Machine Learning in Finance & Technology | The Theater Center - December 7, 2022
  • Big Data LDN 2023 | Olympia London - September 20, 2023
More events

Related Online Courses

  • Oracle Cloud Data Management Foundations Workshop
  • Data Science at Scale
  • Statistics with Python
More courses

Footer


Datafloq is the one-stop source for big data, blockchain and artificial intelligence. We offer information, insights and opportunities to drive innovation with emerging technologies.

  • Facebook
  • LinkedIn
  • RSS
  • Twitter

Recent

  • 5 Reasons Why Modern Data Integration Gives You a Competitive Advantage
  • 5 Most Common Database Structures for Small Businesses
  • 6 Ways to Reduce IT Costs Through Observability
  • How is Big Data Analytics Used in Business? These 5 Use Cases Share Valuable Insights
  • How Realistic Are Self-Driving Cars?

Search

Tags

AI Amazon analysis analytics app Apple application Artificial Intelligence BI Big Data business CEO China Cloud Companies company content costs court crypto customers Data digital future Google+ government industry information machine learning market mobile Musk news Other public research revenue sales security share social social media strategy technology twitter

Copyright © 2023 Datafloq
HTML Sitemap| Privacy| Terms| Cookies

  • Facebook
  • Twitter
  • LinkedIn
  • WhatsApp

In order to optimize the website and to continuously improve Datafloq, we use cookies. For more information click here.

Dear visitor,
Thank you for visiting Datafloq. If you find our content interesting, please subscribe to our weekly newsletter:

Did you know that you can publish job posts for free on Datafloq? You can start immediately and find the best candidates for free! Click here to get started.

Not Now Subscribe

Thanks for visiting Datafloq
If you enjoyed our content on emerging technologies, why not subscribe to our weekly newsletter to receive the latest news straight into your mailbox?

Subscribe

No thanks

Privacy Overview

This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.

Necessary Cookies

Strictly Necessary Cookie should be enabled at all times so that we can save your preferences for cookie settings.

If you disable this cookie, we will not be able to save your preferences. This means that every time you visit this website you will need to enable or disable cookies again.

Marketing cookies

This website uses Google Analytics to collect anonymous information such as the number of visitors to the site, and the most popular pages.

Keeping this cookie enabled helps us to improve our website.

Please enable Strictly Necessary Cookies first so that we can save your preferences!