• Skip to main content
  • Skip to secondary menu
  • Skip to primary sidebar
  • Skip to footer
  • Articles
  • News
  • Events
  • Advertize
  • Jobs
  • Courses
  • Contact
  • (0)
  • LoginRegister
    • Facebook
    • LinkedIn
    • RSS
      Articles
      News
      Events
      Job Posts
    • Twitter
Datafloq

Datafloq

Data and Technology Insights

  • Categories
    • Big Data
    • Blockchain
    • Cloud
    • Internet Of Things
    • Metaverse
    • Robotics
    • Cybersecurity
    • Startups
    • Strategy
    • Technical
  • Big Data
  • Blockchain
  • Cloud
  • Metaverse
  • Internet Of Things
  • Robotics
  • Cybersecurity
  • Startups
  • Strategy
  • Technical

How to Balance Analytics Agility and Stability

Bill Franks / 3 min read.
May 18, 2017
Datafloq AI Score
×

Datafloq AI Score: 69

Datafloq enables anyone to contribute articles, but we value high-quality content. This means that we do not accept SEO link building content, spammy articles, clickbait, articles written by bots and especially not misinformation. Therefore, we have developed an AI, built using multiple built open-source and proprietary tools to instantly define whether an article is written by a human or a bot and determine the level of bias, objectivity, whether it is fact-based or not, sentiment and overall quality.

Articles published on Datafloq need to have a minimum AI score of 60% and we provide this graph to give more detailed information on how we rate this article. Please note that this is a work in progress and if you have any suggestions, feel free to contact us.

floq.to/n5FAY

There have been many science fiction stories (as well as video games!) that revolve around the tradeoffs between powerful, strong, hard to harm combatants and those that are small, nimble, but easy to harm. Both have their merits and both can be useful in different situations. However, the same profile doesn’t work best in every situation.

There are situations in a fight where being fast is more important than being strong. There are also cases where being able to stand your ground is more important than speed. The same is true with analytics. At times, agility is more important. At other times, stability is more important. The key is to know when you need which option.

The Flaws Of Targeting Only Stability

Many organizations struggle to progress effectively in their analytics journeys because of too large a focus on stability. During the exploration and discovery process, nearly all the stringent rules applied to a mission-critical production process are enforced from the start. This makes it very difficult to go in new directions and drives costs up much higher than they need to be. After all, if I just want to quickly see if an idea has merit, I don’t need my process to be fully vetted and hardened. The time for that is later.

The Flaws Of Targeting Only Agility

It is entirely possible to go too far the other way. Especially in a smaller organization, it is possible to get into a situation where there are virtually no governance processes or other controls in place. If someone has something they think works, it is deployed with little thought to ongoing support or how stable the process is. This, too, leads to a mess because invariably something will break and a mad scramble to fix it before too much damage is done will ensue.

After years of organizations leaning way too far and too early towards stability, today many analytics teams are over-reacting and leaning too far toward agility.

Learning A Lesson The Hard Way

One of my colleagues worked with an organization recently to assist them in implementing some new analytics. Historically, IT had placed very firm constraints on the client’s team and how it built processes. To compensate, the team deployed an open source data repository and loaded all of the data they used into it so that they would have full control of their own destiny. Up to that point, there is no problem. The problem arose when the team started deploying processes out of the same platform.


Interested in what the future will bring? Download our 2023 Technology Trends eBook for free.

Consent

The client boasted to my colleague about how many new processes they had deployed and how much faster they were deploying. He also mentioned how his latest process required a different format type for some of the data than was currently applied to the data. Luckily, he said, all he had to do was change the data type and he would be off to the races. No pesky IT team telling him he couldn’t change the data type!

My friend then asked the very simple question, So, if you change that data type for this new process, what will happen to all of the previous processes you already built against that data which are expecting the current data type? The client had a blank stare for a few seconds and then had the aha moment that he hadn’t considered. Namely, that all those processes would break. There was a need for some level of stability across processes even while there is a need for agility for his new process.

Striking The Balance

Usually in life, and analytics, you’ll find that if there is a long-standing tradition or rule set then there likely is some reason for it. Perhaps the rules need tweaking or the tradition needs to be updated a bit. But, it is rare that they exist without some logical root reason. The same is true with strict IT process controls.

When deploying processes at an enterprise scale, stability is critically important and thus some rigidity and strict oversight is warranted. At the same time, when discovering new insights and developing new processes, agility is critical in order to validate that the new idea can succeed and to find the best way to do so.

However, it is a fatal flaw to either always enforce stability or always allow agility. There is a time for each. As the client in the above example realized, it can sound great to quickly make changes to data to fit your current needs. But, that can’t be done without considering what else is impacted.

Originally published by the International Institute for Analytics

Categories: Big Data, Strategy
Tags: analytics, Big Data, governance

About Bill Franks

Bill Franks is an internationally recognized chief analytics officer who is a thought leader, speaker, consultant, and author focused on analytics and data science. Franks is also the author of Winning The Room, 97 Things About Ethics Everyone In Data Science Should Know, Taming The Big Data Tidal Wave, and The Analytics Revolution. His work has spanned clients in a variety of industries for companies ranging in size from Fortune 100 companies to small non-profit organizations. You can learn more at https://www.bill-franks.com.

Primary Sidebar

E-mail Newsletter

Sign up to receive email updates daily and to hear what's going on with us!

Publish
AN Article
Submit
a press release
List
AN Event
Create
A Job Post
Host your website with Managed WordPress for $1.00/mo with GoDaddy!

Related Articles

The Advantages of IT Staff Augmentation Over Traditional Hiring

May 4, 2023 By Mukesh Ram

The State of Digital Asset Management in 2023

May 3, 2023 By pimcoremkt

Test Data Management – Implementation Challenges and Tools Available

May 1, 2023 By yash.mehta262

Related Jobs

  • Software Engineer | South Yorkshire, GB - February 07, 2023
  • Software Engineer with C# .net Investment House | London, GB - February 07, 2023
  • Senior Java Developer | London, GB - February 07, 2023
  • Software Engineer – Growing Digital Media Company | London, GB - February 07, 2023
  • LBG Returners – Senior Data Analyst | Chester Moor, GB - February 07, 2023
More Jobs

Tags

AI Amazon analysis analytics app application Artificial Intelligence BI Big Data business China Cloud Companies company costs crypto customers Data design development digital environment experience future Google+ government information learning machine learning market mobile Musk news Other public research sales security share social social media software strategy technology twitter

Related Events

  • 6th Middle East Banking AI & Analytics Summit 2023 | Riyadh, Saudi Arabia - May 10, 2023
  • Data Science Salon NYC: AI & Machine Learning in Finance & Technology | The Theater Center - December 7, 2022
  • Big Data LDN 2023 | Olympia London - September 20, 2023
More events

Related Online Courses

  • Oracle Cloud Data Management Foundations Workshop
  • Data Science at Scale
  • Statistics with Python
More courses

Footer


Datafloq is the one-stop source for big data, blockchain and artificial intelligence. We offer information, insights and opportunities to drive innovation with emerging technologies.

  • Facebook
  • LinkedIn
  • RSS
  • Twitter

Recent

  • 5 Reasons Why Modern Data Integration Gives You a Competitive Advantage
  • 5 Most Common Database Structures for Small Businesses
  • 6 Ways to Reduce IT Costs Through Observability
  • How is Big Data Analytics Used in Business? These 5 Use Cases Share Valuable Insights
  • How Realistic Are Self-Driving Cars?

Search

Tags

AI Amazon analysis analytics app application Artificial Intelligence BI Big Data business China Cloud Companies company costs crypto customers Data design development digital environment experience future Google+ government information learning machine learning market mobile Musk news Other public research sales security share social social media software strategy technology twitter

Copyright © 2023 Datafloq
HTML Sitemap| Privacy| Terms| Cookies

  • Facebook
  • Twitter
  • LinkedIn
  • WhatsApp

In order to optimize the website and to continuously improve Datafloq, we use cookies. For more information click here.

Dear visitor,
Thank you for visiting Datafloq. If you find our content interesting, please subscribe to our weekly newsletter:

Did you know that you can publish job posts for free on Datafloq? You can start immediately and find the best candidates for free! Click here to get started.

Not Now Subscribe

Thanks for visiting Datafloq
If you enjoyed our content on emerging technologies, why not subscribe to our weekly newsletter to receive the latest news straight into your mailbox?

Subscribe

No thanks

Privacy Overview

This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.

Necessary Cookies

Strictly Necessary Cookie should be enabled at all times so that we can save your preferences for cookie settings.

If you disable this cookie, we will not be able to save your preferences. This means that every time you visit this website you will need to enable or disable cookies again.

Marketing cookies

This website uses Google Analytics to collect anonymous information such as the number of visitors to the site, and the most popular pages.

Keeping this cookie enabled helps us to improve our website.

Please enable Strictly Necessary Cookies first so that we can save your preferences!