• Skip to main content
  • Skip to secondary menu
  • Skip to primary sidebar
  • Skip to footer
  • Articles
  • News
  • Events
  • Advertize
  • Jobs
  • Courses
  • Contact
  • (0)
  • LoginRegister
    • Facebook
    • LinkedIn
    • RSS
      Articles
      News
      Events
      Job Posts
    • Twitter
Datafloq

Datafloq

Data and Technology Insights

  • Categories
    • Big Data
    • Blockchain
    • Cloud
    • Internet Of Things
    • Metaverse
    • Robotics
    • Cybersecurity
    • Startups
    • Strategy
    • Technical
  • Big Data
  • Blockchain
  • Cloud
  • Metaverse
  • Internet Of Things
  • Robotics
  • Cybersecurity
  • Startups
  • Strategy
  • Technical

Big Data Strategy (Part III): is Your Company Data-Driven?

Francesco Corea / 7 min read.
March 22, 2017
Datafloq AI Score
×

Datafloq AI Score: 82.67

Datafloq enables anyone to contribute articles, but we value high-quality content. This means that we do not accept SEO link building content, spammy articles, clickbait, articles written by bots and especially not misinformation. Therefore, we have developed an AI, built using multiple built open-source and proprietary tools to instantly define whether an article is written by a human or a bot and determine the level of bias, objectivity, whether it is fact-based or not, sentiment and overall quality.

Articles published on Datafloq need to have a minimum AI score of 60% and we provide this graph to give more detailed information on how we rate this article. Please note that this is a work in progress and if you have any suggestions, feel free to contact us.

floq.to/w0V8p

If you missed the first two parts, I have previously proposed some tips for analyzing corporate data as well as a data maturity map to understand the stage of data development of an organization. Now, in this final article, I want to conclude this mini-series with final food for thoughts and considerations on big data capabilities in a company context.

I. Where is home for big data capabilities?

First of all, I want to spend few more words regarding the organizational home (Pearson and Wegener, 2013) for data analytics. I claimed that the Centre of Excellence is the cutting-edge structure to incorporate and supervise the data functions within a company. Its main task is to coordinate cross-units activities, which include:

  • Maintaining and upgrading the technological infrastructures;
  • Deciding what data have to be gathered and from which department;
  • Helping with the talents recruitment;
  • Planning the insights generation phase and stating the privacy, compliance, and ethics policies.

However, other forms may exist, and it is essential to know them since sometimes they might fit better into preexisting business models.

strategy

Data analytics organizational models

The figure shows different combinations of data analytics independence and business models. It ranges from business units (BUs) that are completely independent one from the other, to independent BUs that join the efforts in some specific projects, to an internal (corporate center) or external (center of excellence) center that coordinate different initiatives.

II. Data Startups vs Data Incumbents

In spite of everything, all the considerations made so far mean different things and provide singular insights depending on the firm’s peculiarities. In particular, the different phase of the company life cycle deeply influences the type of strategy that needs to be implemented.

Although many times smaller companies have structural competitive advantages over bigger players, there is no strong correlation between data maturity and company’s life cycle (e.g., some startups are better than big pharma companies in managing their data and vice-versa). However, startups are obviously more rapid in advancing data maturity steps because they are more agile and because of the different organizational scale.

The important aspect here that I want to highlight is that startups and incumbents need to look at the data problem under two completely different approaches (although with a same final goal). I call these two approaches the retrospective approach and the prospective approach.

The prospective approach concerns mainly startups, i.e., companies that are in business since not that long and that are not producing a huge amount of data (yet). They will produce and gather a lot of data quite soon, though, so it is extremely relevant to set an efficient data strategy from the beginning.

The retrospective approach is instead for existing businesses that are overwhelmed by data, but they do not know how to use them or they may face specific problems (e.g., centralized integration).

The prospective approach (Startups)

A startup is completely free from any predetermined structure, and it can easily establish a strong internal data policy from the beginning adopting a long-term vision, which would prevent most of the data-related future issues. This should not be underestimated, and it requires an initial investment of resources and time: if the firm does it well once, it will get rid of a lot of inconveniences later on.

A well-set data policy would indeed guarantee a lean approach for the startup throughout any following stages. Moreover, young companies are often less regulated, both internally (i.e., internal bureaucracy is lower) and externally (i.e., compliance rules and laws). They do have a different risk appetite, which pushes them to experiment and adopt forefront technologies. Nonetheless, they always have to focus on quality data rather than quantity data to start with.

The retrospective approach (Incumbents)

Bigger companies instead usually face two main issues:

i) They have piles of data and they do not know what to do with them;

ii) They have the data and a specific purpose in mind, but they cannot even start the project because of poor data quality, inadequate data integration, or shortage of skills.

In the first case, they are in the Primitive stage, meaning that they have data but no clue on how extracting any value from them. Since big institutions usually have really tight and demanding job roles, it is sometimes impossible to internally innovate in other words, they are too busy to innovate . Some sector is more affected by this problem (banking/fintech sector for instance) with respect to others (biopharma industry).

I believe a good starting point for this issue is hiring a business idea generator, an experienced high-level individual who becomes a sort of data evangelist and provides valuable insights even without owning a strong technical computer science background. After that, a proper data scientist is essential.

For the second scenario (they have data but cannot use them) I see mainly two solutions:

i) The firm implements from scratch a new data platform/team/culture;


Interested in what the future will bring? Download our 2023 Technology Trends eBook for free.

Consent

ii) The firm outsources the analysis/problem.

The first scenario is, of course, more robust (if succeeds) and revolutionary for the organization but also much more expensive. If the firm goes with implementing from scratch a new platform/team/culture, it needs to consider a simple cost-benefit analysis:

What is the marginal utility of the new data platform/team/culture with respect to the implementation and running costs?

But, most of all, never forget that it is usually a single individual (or small group of people) who takes this decision in an uncertain and unlikely scenario.

I am investing a ton of money in something that can but also cannot with a good probability have a return in five years time .

III. Data Science Outsourcing

This brings us to the second solution: outsourcing.

When it comes to choosing whom to outsource to, universities often represent a preferred avenue for big corporations: universities always need funding and they need data for running their studies (and publishing their works). They cost far less than startups, they have a good pool of brains, time, and willingness to analyze messy datasets.

Startups are instead revenue-generating entities and they will cost more to big incumbents, but they often gather the best minds and talents with good compensation packages and interesting applied research and datasets that universities cannot always provide.

In both cases, the biggest issue is anyway about data security, confidentiality, and privacy: what data the company actually outsources, how the third parties keep the data secured, how do they store them, how the decision-making process is structured ( data-driven vs HiPPO, i.e., highest paid person’s opinion), are few of the most common issues to deal with.

Another relatively new and interesting way for big corporations to get some analysis virtually for free and potentially selecting vendors are meetups and hackathons, window-dressings for the firm but a good way to scout people and experiment pilots.

IV. Other Alternatives

There exists also a middle way between complete outsourcing and in-house development called buy-in mentality, which looks at buying and integrating (horizontally or vertically) anything that the company does not develop in-house. It is definitely more costly than other options, but it solves all the problems related to data privacy and security.

Incubators and accelerators can also offer a substitute way to invest less in more companies of interests and dealing with several useful subjects without fully buying any company. The disadvantage of this fragmented investment business, however, is that new companies have a high-risk of failing and the failing culture’ is not well seen and deeply-rooted within big organizations and companies need to invest in a team dedicated to select and support the on-boarded ventures.

Finally, it is possible to also design hybrid solutions and an example is given by this two-steps approach: in the first phase, universities can be used to run a pilot or the first two to three worthy projects that can drive the business from a Primitive stage to a Bespoke one. Then, the results can be used to persuade management to invest in data analytics and either build a proper internal team or pursue a different acquisition strategy.

V. Why big data projects fail?

Simple answer: a ton of different reasons.

There are though some more commons mistakes made by companies trying to implement data science projects:

  • Lack of business objectives and correct problem framing;
  • Absence of scalability, or project not correctly sized;
  • Absence of C-level or high management sponsorship;
  • Excessive costs and time, especially when people with wrong skill sets are selected (which is more common than you think);
  • Incorrect management of expectations and metrics;
  • Internal barriers (e.g., data silos, poor inter-team communication, infrastructure problems, etc.);
  • Think the work as a one time project rather than a continuous learning;
  • Data governance, privacy and protection.

Reference

Pearson, T., & Wegener, R. (2013). Big data: the organizational challenge . Bain & Company White paper.

Note: the above is an adapted excerpt from my book Big Data Analytics: A Management Perspective (Springer, 2016).

Follow me on Medium

Categories: Big Data
Tags: Artificial Intelligence, Big Data, big data strategy, strategy

About Francesco Corea

Editor at Cyber Tales. Complexity scientist and data strategist, Francesco is a strong supporter of an interdisciplinary research approach, and he wants to foster the interaction of different sciences in order to bring to light hidden connections. He is a former Anthemis Fellow, IPAM Fellow, and a PhD graduate at LUISS University. His topics of interests are big data and AI, and he focuses on fintech, medtech, and energy verticals.

Primary Sidebar

E-mail Newsletter

Sign up to receive email updates daily and to hear what's going on with us!

Publish
AN Article
Submit
a press release
List
AN Event
Create
A Job Post

Related Articles

The Advantages of IT Staff Augmentation Over Traditional Hiring

May 4, 2023 By Mukesh Ram

The State of Digital Asset Management in 2023

May 3, 2023 By pimcoremkt

Test Data Management – Implementation Challenges and Tools Available

May 1, 2023 By yash.mehta262

Related Jobs

  • Software Engineer | South Yorkshire, GB - February 07, 2023
  • Software Engineer with C# .net Investment House | London, GB - February 07, 2023
  • Senior Java Developer | London, GB - February 07, 2023
  • Software Engineer – Growing Digital Media Company | London, GB - February 07, 2023
  • LBG Returners – Senior Data Analyst | Chester Moor, GB - February 07, 2023
More Jobs

Tags

AI Amazon analysis analytics application Artificial Intelligence BI Big Data business China Cloud Companies company crypto customers Data design development digital engineer engineering environment experience future Google+ government Group health information learning machine learning mobile news public research security services share skills social social media software solutions strategy technology

Related Events

  • 6th Middle East Banking AI & Analytics Summit 2023 | Riyadh, Saudi Arabia - May 10, 2023
  • Data Science Salon NYC: AI & Machine Learning in Finance & Technology | The Theater Center - December 7, 2022
  • Big Data LDN 2023 | Olympia London - September 20, 2023
More events

Related Online Courses

  • Oracle Cloud Data Management Foundations Workshop
  • Data Science at Scale
  • Statistics with Python
More courses

Footer


Datafloq is the one-stop source for big data, blockchain and artificial intelligence. We offer information, insights and opportunities to drive innovation with emerging technologies.

  • Facebook
  • LinkedIn
  • RSS
  • Twitter

Recent

  • 5 Reasons Why Modern Data Integration Gives You a Competitive Advantage
  • 5 Most Common Database Structures for Small Businesses
  • 6 Ways to Reduce IT Costs Through Observability
  • How is Big Data Analytics Used in Business? These 5 Use Cases Share Valuable Insights
  • How Realistic Are Self-Driving Cars?

Search

Tags

AI Amazon analysis analytics application Artificial Intelligence BI Big Data business China Cloud Companies company crypto customers Data design development digital engineer engineering environment experience future Google+ government Group health information learning machine learning mobile news public research security services share skills social social media software solutions strategy technology

Copyright © 2023 Datafloq
HTML Sitemap| Privacy| Terms| Cookies

  • Facebook
  • Twitter
  • LinkedIn
  • WhatsApp

In order to optimize the website and to continuously improve Datafloq, we use cookies. For more information click here.

settings

Dear visitor,
Thank you for visiting Datafloq. If you find our content interesting, please subscribe to our weekly newsletter:

Did you know that you can publish job posts for free on Datafloq? You can start immediately and find the best candidates for free! Click here to get started.

Not Now Subscribe

Thanks for visiting Datafloq
If you enjoyed our content on emerging technologies, why not subscribe to our weekly newsletter to receive the latest news straight into your mailbox?

Subscribe

No thanks

Privacy Overview

This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.

Necessary Cookies

Strictly Necessary Cookie should be enabled at all times so that we can save your preferences for cookie settings.

If you disable this cookie, we will not be able to save your preferences. This means that every time you visit this website you will need to enable or disable cookies again.

Marketing cookies

This website uses Google Analytics to collect anonymous information such as the number of visitors to the site, and the most popular pages.

Keeping this cookie enabled helps us to improve our website.

Please enable Strictly Necessary Cookies first so that we can save your preferences!