Data modernization and the cloud

What is data modernization?

Simply put, data modernization means moving data from legacy databases to modern databases. It is particularly critical for any organization that needs to store unstructured data—images, customer voice audio, social media comments, clinical notes in health care, and so forth. Data modernization offers substantial cost advantages over previously used data management technologies.

Over several years, many large organizations have shifted from a data architecture based on relational enterprise data warehouses to data lakes based on Hadoop and other open-source tools. However, they may not have eliminated warehouses completely—warehouses are still useful for many applications involving structured data—but these companies are deploying modernized platforms for many new business applications.

How prevalent is data modernization? Very much, indeed. Our survey results reveal that the companies we surveyed are already well along in the process of data modernization, with the great majority (84 percent) having already started their journeys toward that goal. Around one-third (34 percent) claim to have such initiatives fully implemented, while half have data modernization initiatives underway. Financial services firms are the most likely to have initiated data modernization. Somewhat surprisingly, technology, media, and telecom firms are the least likely to have started down the path, despite the technical orientation of their products and services. Even then, 81 percent respondents from the sector report having begun modernization initiatives.

While the majority of respondents (62 percent) expect to succeed in their data modernization efforts, such initiatives are not always formalized. Less than half (48 percent) of respondents say they have a specific, formal initiative for data modernization, but many others are modernizing their data storage anyway. Interestingly, the majority of respondents—57 percent—report that they are doing data security planning as part of their data modernization activity, and “data modernization” may even be the primary banner under which they will describe it. Respondent companies are cognizant of the real-world needs of their businesses and consider the tools and technology that are available in the marketplace the third most important reason in their decision-making.

Although there is clearly progress on data modernization, it is not without obstacles. The most common obstacle cited by respondents is “budget/cost concerns overall” (55 percent). The other factors include the lack of understanding of technology (44 percent), the lack of consensus among decision-makers (41 percent), and the absence of clarity on success metrics (40 percent).

What role does the cloud play?

The cloud is both a means to and an important consequence of data modernization. Survey responses indicate that the cloud is already a dominant location for data storage—more than nine in 10 organizations (91 percent) primarily keep their data on cloud platforms. Of the remaining nine percent that primarily keep their data on premise, nearly all plan to migrate to the cloud. What’s more, on average, 57 percent of the surveyed organizations’ businesses are actually operating on the cloud—meaning that all their important applications and data are on it. That’s saying a lot, since many organizations—including the financial services firms in the survey—often have to keep some applications and data on premise for regulatory reasons.

It is possible to pursue only on-premise modernization projects, but given that many firms are moving data to the cloud, they often put it on modernized platforms at the same time. This makes the cloud a non-negotiable part of data modernization. The cloud/modernization connection is strongly apparent to survey respondents —55 percent see data modernization as a key component of or reason for cloud migration. It is second only to security and data protection. The C-level respondents actually rank it the highest as a rationale, with 65 percent overall saying it is a driver of cloud migration.

There are many other reasons for moving to the cloud. Traditional IT architectures and on-premise data centers often come with their own cost concerns, which make cost a key driver of cloud migration. In the survey, 32 percent identified the “general cost and performance of IT operations” as the top-most or second driver for moving to the cloud. Middle-level executives were most worried about this issue, C-level executives somewhat less so. Since companies expect to save money by migrating to the cloud, they could perhaps mitigate some of their concerns about the cost of data modernization by leveraging cloud migration as the primary means to modernize. Other drivers are the availability of cloud-based software and access to external data.

Many companies are discovering that the core capabilities of understanding customer journeys, making “next best offers,” and monitoring customer experiences are difficult or even impossible to achieve with a traditional premise-based analytics footprint. Cloud providers typically have strong capabilities in data management—even including relational data warehouses in the cloud—as well as high-quality algorithms for analytics and AI, and a wide range of external data sources. As such, most cloud providers enable companies to achieve more than on-premise capabilities.

In conclusion: Cloud migration and data modernization go hand in hand

While no survey can identify the next trend in IT and information management, results of our current survey confirm the direction and strength of the existing trends—almost all data management approaches will likely eventually be modernized and almost all data and applications will be in the cloud. Survey results confirm that both cloud migration and data modernization initiatives are well underway in most medium to large organizations in the United States, and both initiatives—whether formalized at the corporate level—are generally successful.

Notably, cloud migration and data modernization are mutually reinforcing trends—they seem to support and overlap each other.

As such, most companies would do well to embrace both trends. If factors within your organization are aligned to only one, then perhaps you can pursue a stealth strategy that also embraces the other. If you are moving to the cloud, consider adopting some data modernization approaches too. If your primary need is to modernize data, you can do that most effectively in conjunction with cloud migration. Since the two trends are overlapping, a “two for one” strategy is eminently reasonable.

More information

For more information about Cloud and Data modernization please contact Michiel Peters via the contact details below or read the complete article on Deloitte Insights!