There are a number of complex and time consuming issues that need to be addressed when embracing a Big Data strategy with data governance and data management being on top of the list.
Without effective data governance and data management, Big Data can become a nightmare to manage for many organizations already struggling with data overflow. That data lake they are building can very easily become a cesspool without appropriate data management practices that are adapted to their new platform. Companies need to actively adapt their data governance and data management capabilities from implementing to ongoing maintenance.
Another key issue to address is dealing with unstructured content management.
Unstructured data has always been a part of business operations, but now that there are better technologies to explore, analyze and infuse this content into business processes and insight work, its critical that we finally take the step to formally include its management. Most companies struggle here and the ability to mine this information has been difficult at best.
I strongly suggest that you dont take the easy route and simply rely on Big Data technology to be your only formal data management process for unstructured data. Over time, as more and more unstructured data is added filtering becomes more mandatory, being clear on what is good, what is bad, where it came from and the decisions it supports consistently become increasingly important. As many of you know I have been pushing the need for all in this space to grasp the role ontology will play in addressing the filtering. I would also suggest that a few folks on your staffs gain expertise with conceptual modeling.
Please feel free to add your thoughts they are more than welcome.
