Despite increased investment and early enthusiasm, data and risk remain key challenges to scaling Generative AI, reveals new Deloitte survey

HANOI, 26 August 2024 — The Deloitte AI Institute™ has unveiled the third quarterly edition of its “State of Generative AI in the Enterprise” report, revealing the current landscape of GenAI adoption and deployment and how organisations are overcoming barriers to create value at scale. “The State of Generative AI in the Enterprise: Now decides Next” is based on a survey of 2,770 director- to C-suite-level respondents across 14 countries. While respondents have a range of self-reported levels of Generative AI expertise, all are experienced with AI and are piloting or implementing Generative AI in their organisations.

“As promising experiments and use cases begin to pay off, it’s clear that we have arrived at a pivotal moment for Generative AI, balancing leaders’ high expectations with challenges such as data quality, investment costs, effective measurement and an evolving regulatory landscape. Our Q3 survey has revealed that now more than ever, change management and deep organisational integration are critical to overcoming barriers, unlocking value and building for the future of GenAI,”said Jim ROWAN, Applied AI Leader and Principal, Deloitte Consulting LLP.

“We are seeing continued enthusiasm for GenAI across organisations, and leaders are deriving the most value from the technology by deeply embedding it into critical business functions and processes. Our research indicates that the top benefits of GenAI are extending beyond improved efficiency, productivity and cost reduction, with more than half pointing to increased innovation, improved products and services, enhanced customer relationships and other types of value. The diversity of these value sources underscores the immense potential and versatility of this transformative technology,” said Costi PERRICOS, Generative AI Leader, Deloitte Global.

Excitement is being tempered by reality — and value-led use cases will lead to successful scaling

Survey respondents say that while their senior executives and board members are still intrigued by GenAI, there are signs of enthusiasm beginning to wane as the “new technology” shine wears off. Interest remains “high” or “very high” among most senior executives (63%) and boards (53%); however, those numbers have declined since the Q1 2024 survey, dropping 11 percentage points and eight percentage points respectively. While selecting and quickly scaling the GenAI projects with the most potential to create value is the goal, many GenAI efforts are still at the pilot or proof-of-concept stage, with a large majority of respondents (68%) saying their organisation has moved 30% or fewer of their GenAI experiments fully into production.

Executives are zeroed in on data lifecycle management as a foundation for GenAI deployments

Data is taking center stage for AI-savvy leaders, with 75% of organisations increasing their technology investments around data management due to GenAI. However, as enterprises look to scale, unforeseen roadblocks were exposed— with data-related issues causing 55% of surveyed organisations to avoid certain GenAI use cases. Solving for data deficiencies has emerged as a crucial step in addressing the GenAI-specific demands of data architectures. To modernise their data-related capabilities, organisations are enhancing data security (54%); improving data quality practices (48%); and updating data governance frameworks and/or developing new data policies (45%).

Struggles with trust and a shifting regulatory landscape are causing many to walk a tightrope — minimising risk without being too risk-averse

Although respondents recognised that managing GenAI risk is critical, three of the top four reported barriers to successful GenAI deployment are risk-related, including worries about regulatory compliance (36%); difficulty managing risks (30%); and lack of a governance model (29%). Likely driving these concerns are risks specific to GenAI, like model bias, hallucinations, novel privacy concerns, trust, and protecting new attack surfaces. To help build trust and ensure responsible use, organisations are working to build new guardrails and oversight capabilities. The top actions organisations are taking include establishing a governance framework for using GenAI tools and applications (51%); monitoring regulatory requirements and ensuring compliance (49%); and conducting internal audits/testing on GenAI tools and applications (43%).

Amid continued experimentation there is a growing need to demonstrate the value of GenAI initiatives

While surveyed organisations are beginning to scale past proof-of-concept, 41% have struggled to define and measure the exact impacts of their GenAI efforts and only 16% have produced regular reports for the CFO about the value being created with GenAI. As applications and use cases mature, leaders will be less inclined to invest based solely on lofty visions and the fear of missing out — making measurement a critical factor in maintaining interest and support from the C-suite and boardroom. To demonstrate value, organisations are using specific KPIs for evaluating GenAI performance (48%); building a framework for evaluating GenAI investments (38%); and tracking changes in employee productivity (38%).

About “The State of Generative AI in the Enterprise”

This is the third in a series of quarterly surveys intended to track the adoption of GenAI in the enterprise. This research builds from Deloitte’s previous “State of AI in the Enterprise” report which has been running for six years. This wave of the survey, conducted between May and June 2024, connected with 2,770 AI-savvy business and technology leaders directly involved in piloting or implementing Generative AI at major organisations across 14 countries and six industries: consumer; energy, resources and industrials; financial services; life sciences and health care; technology, media and telecom; and government and public services.

About Deloitte

Deloitte refers to one or more of Deloitte Touche Tohmatsu Limited (“DTTL”), its global network of member firms, and their related entities (collectively, the “Deloitte organization”). DTTL (also referred to as “Deloitte Global”) and each of its member firms and related entities are legally separate and independent entities, which cannot obligate or bind each other in respect of third parties. DTTL and each DTTL member firm and related entity is liable only for its own acts and omissions, and not those of each other. DTTL does not provide services to clients. Please see www.deloitte.com/about to learn more.

Deloitte Asia Pacific Limited is a company limited by guarantee and a member firm of DTTL. Members of Deloitte Asia Pacific Limited and their related entities, each of which is a separate and independent legal entity, provide services from more than 100 cities across the region, including Auckland, Bangkok, Beijing, Bengaluru, Hanoi, Hong Kong, Jakarta, Kuala Lumpur, Manila, Melbourne, Mumbai, New Delhi, Osaka, Seoul, Shanghai, Singapore, Sydney, Taipei and Tokyo.

This communication contains general information only, and none of Deloitte Touche Tohmatsu Limited (“DTTL”), its global network of member firms or their related entities (collectively, the “Deloitte organization”) is, by means of this communication, rendering professional advice or services. Before making any decision or taking any action that may affect your finances or your business, you should consult a qualified professional adviser.

No representations, warranties or undertakings (express or implied) are given as to the accuracy or completeness of the information in this communication, and none of DTTL, its member firms, related entities, employees or agents shall be liable or responsible for any loss or damage whatsoever arising directly or indirectly in connection with any person relying on this communication. DTTL and each of its member firms, and their related entities, are legally separate and independent entities.

© 2024 Deloitte Southeast Asia Ltd