Data and analytics are buzzwords that hold such promise, it is no surprise that many organizations have increased their investment in this space. According to a joint study by Capgemini and EMC, 70 percent of IT executives consider their organization’s ability to gain value from big data as critical to future growth. In fact, “56 percent believe their investment in big data over the next three years will outstrip past investment in information management.”
"The key is to start small with a real business problem and leverage cloud computing and open source technology to great advantage"
Challenges in Finding the Value
Organizations have built data lakes, consolidated all data to one repository, and created mandates about where and how data from all different business units are to be stored. However, the outcome of these efforts has not consistently resulted in rapid business benefits.
Instead, access to the data lake is often highly controlled, with query request taking a significant amount of time to be completed, and much extra effort required to rebuild the data to follow the format guidelines—all without the guarantee of visible and measurable business benefits.
In their 2015 report of “Big Data and Analytics: Issues, Solutions, and ROI,” Shim and his co-authors pointed out that the “Inexperience of early adopters results in informal project execution with primary goal being the implementation without considering metrics for success.”
Start Small to Win Big
So how should companies overcome these deployment challenges to make their data analytics investment count?
Borrowing some popular, lean startup principles here, I believe it’s critical for organizations to start small with data and analytics, by focusing on a real business problem. Whether it’s the slow-down of customer adoption, or the increasing volume of merchandise returned from on-line purchases, these specific business problems allow organizations to stay focused and lean, while delivering results.
Focusing on a real business problem brings many benefits for an organization, especially one that has high hopes for leveraging data analytics.
First, it is easier to find a sponsor and stakeholder, expediting the resource availability as well as investment prioritizations. Second, a prioritized and focused effort tends to result in shorter time to value, which will serve as a proof point for the future expansion. Third, it is specific enough to establish a baseline, measure the pain point, and thereby demonstrate the ROI (Return on Investment).
Three Important Steps
It’s a tricky balance to start small, yet have the foresight to:
• Build out the infrastructure for reuse
• Plant the seeds early for metrics and measurement; and
• Keep it open and easy to use in order to maximize “user freedom.”
A common infrastructure will make it possible to reuse and expand into multiple use cases with higher investment efficiency. While many large organizations tend to start their data and analytics projects from the common infrastructure, I strongly recommend starting with a real business problem, but then keep in mind the extensibility and flexibility of the architecture so that you can reuse and expand.
Metrics and measurement are everything in terms of ROI, and are also are the key to avoid wasting large exercises of data analytics. Organizations may be inclined to delay the investment in this area, treating this as “internal” or “technical debt.” The reality is just the opposite.
In our discussions with customers and industry analysts, the earlier you can establish and track metrics, the higher chance for a successful project as you now have the ability to measure and to pivot based on the measurement outcome.
Lastly, the fear of losing control is common in organizations, leading to bottlenecks in each step of the data analytics operations. When users can’t easily use the data analytics capability or cannot count on a reasonable turnaround time, they walk away to seek alternatives. This leads to “shadow IT,” reducing the value of the entire data analytics effort across the organization. Better that experts assist users in effectively taking advantage of data analytics.
Speeding Time to Value
With organizations having to identify a real business problem and taking care of infrastructure, metrics and users, they should leverage cloud computing and open source technology to get started, so that they don’t have to create everything from scratch.
In other words, once your organization has identified a specific business problem that needs to be solved via data analytics, focus on the data and the problem statement, not the infrastructure and full-blown production environment. Cloud service gives you the freedom to do this.
These days it’s very cost-efficient to get started, shielding you from the complexity of infrastructure, at least temporarily. Furthermore, you can lean on open source technology in the data analytics space to get to some quick time-to-value, whether it’s an open source visualization tool, or open source machine learning algorithms.
We are now in an exciting time for data analytics indeed. However, the excitement doesn’t come without its associated challenges. The key is to start small with a real business problem and leverage cloud computing and open source technology to great advantage.