Deloitte
  • Services

    What's New

    • Ignored to J’ Adored

      How Deloitte helped a large fast food company become a leader in sustainability

    • Deloitte Private

      Connecting you to what matters

    • Compromised to Immune

      An Initial Public Offering can take years. We only had weeks

    • Audit & Assurance

      • IASPlus
      • Assurance Services
      • Accounting & Reporting Advisory
      • Accounting Operations Advisory
      • Disruptive Events Advisory
      • Media & Advertising Assurance
      • Global Public Policy
    • Consulting

      • Strategy, Analytics and M&A
      • Customer and Marketing
      • Core Business Operations
      • Human Capital
      • Enterprise Technology & Performance
    • Risk Advisory

      • Accounting and Internal Controls
      • Cyber and Strategic Risk
      • Regulatory and Legal
      • Sustainability & Climate
    • Financial Advisory

      • Mergers & Acquisitions
      • Turnaround & Restructuring
      • Deloitte Forensic
    • Legal

      • Legal Management Consulting
      • Legal Advisory Services
      • Legal Managed Services
      • Dbriefs Legal
      • Deloitte Legal Around the World
      • The Resilient General Counsel
    • Tax

      • Advisory and Transactions
      • Workforce, Technology, Analytics
      • Outsourced Compliance
      • Technology Consulting
      • Mobility, Payroll, Immigration
      • Reward, Employment Tax, Share Plans
  • Industries

    What's New

    • Connecting for a resilient world

    • Future of Mobility

      Learn how this new reality is coming together and what it will mean for you and your industry.

    • Platforms and Ecosystems

      Enabling the Digital Economy

    • Consumer

      • Automotive
      • Consumer Products
      • Retail, Wholesale & Distribution
      • Transportation, Hospitality & Services
    • Energy, Resources & Industrials

      • Industrial Products & Construction
      • Mining & Metals
      • Oil, Gas & Chemicals
      • Power, Utilities & Renewables
      • The Future of Energy
    • Financial Services

      • Banking & Capital Markets
      • Insurance
      • Investment Management
      • Real Estate
    • Government & Public Services

      • Central Government
      • Defense, Security & Justice
      • Health & Human Services
      • Infrastructure, Transport & Regional Government
    • Life Sciences & Health Care

      • Health Care
      • Life Sciences
    • Technology, Media & Telecommunications

      • Technology
      • Telecommunications, Media & Entertainment
  • Insights

    Deloitte Insights

    What's New

    • Deloitte Insights Magazine

      Explore the latest issue now

    • Deloitte Insights app

      Go straight to smart with daily updates on your mobile device

    • Weekly economic update

      See what's happening this week and the impact on your business

    • Strategy

      • Business Strategy & Growth
      • Digital Transformation
      • Governance & Board
      • Innovation
      • Marketing & Sales
      • Private Enterprise
    • Economy & Society

      • Economy
      • Environmental, Social, & Governance
      • Health Equity
      • Trust
      • Mobility
    • Organization

      • Operations
      • Finance & Tax
      • Risk & Regulation
      • Supply Chain
      • Smart Manufacturing
    • People

      • Leadership
      • Talent & Work
      • Diversity, Equity, & Inclusion
    • Technology

      • Data & Analytics
      • Emerging Technologies
      • Technology Management
    • Industries

      • Consumer
      • Energy, Resources, & Industrials
      • Financial Services
      • Government & Public Services
      • Life Sciences & Health Care
      • Technology, Media, & Telecommunications
    • Spotlight

      • Deloitte Insights Magazine
      • Press Room Podcasts
      • Weekly Economic Update
      • COVID-19
      • Resilience
  • Careers

    What's New

    • WorldImpact

      Living our purpose, reshaping our world, making an impact that matters.

    • 2022 Gen Z and Millennial Survey

      Striving for balance, advocating for change

    • Alumni profiles

      Inspiring leaders

    • Job search

    • Experienced hires

    • Students

    • Life at Deloitte

    • Inclusion at Deloitte

    • Alumni

  • GLOBAL-EN Location: GLOBAL-English  
  • Contact us
  • GLOBAL-EN Location: GLOBAL-English  
  • Contact us

Welcome back

Still not a member? Join My Deloitte

Data management barriers to AI success

by Karthik Ramachandran
  • Save for later
  • Share
    • Share on Facebook
    • Share on Twitter
    • Share on Linkedin
    • Share by email
Deloitte Insights
  • Strategy
    Strategy
    Strategy
    • Business Strategy & Growth
    • Digital Transformation
    • Governance & Board
    • Innovation
    • Marketing & Sales
    • Private Enterprise
  • Economy & Society
    Economy & Society
    Economy & Society
    • Economy
    • Environmental, Social, & Governance
    • Health Equity
    • Trust
    • Mobility
  • Organization
    Organization
    Organization
    • Operations
    • Finance & Tax
    • Risk & Regulation
    • Supply Chain
    • Smart Manufacturing
  • People
    People
    People
    • Leadership
    • Talent & Work
    • Diversity, Equity, & Inclusion
  • Technology
    Technology
    Technology
    • Data & Analytics
    • Emerging Technologies
    • Technology Management
  • Industries
    Industries
    Industries
    • Consumer
    • Energy, Resources, & Industrials
    • Financial Services
    • Government & Public Services
    • Life Sciences & Health Care
    • Tech, Media, & Telecom
  • Spotlight
    Spotlight
    Spotlight
    • Deloitte Insights Magazine
    • Press Room Podcasts
    • Weekly Economic Update
    • COVID-19
    • Resilience
    • GLOBAL-EN Location: GLOBAL-English  
    • Contact us
    3 minute read 07 August 2020

    Data management barriers to AI success Is a holistic data modernization approach the answer?

    3 minute read 07 August 2020
    • Karthik Ramachandran India
    • Save for later
    • Share
      • Share on Facebook
      • Share on Twitter
      • Share on Linkedin
      • Share by email

    Companies are modernizing their data infrastructure as part of AI initiatives to gain competitive advantages. How can technology providers help businesses solve data management challenges?

    2015 global CIO survey

    Businesses are pursuing a range of AI initiatives, and modernizing data infrastructure tops the list. But current data practices are an issue, as several companies haven’t attained a high level of sophistication with crucial data-related aspects. A Deloitte study of AI adopters finds businesses face challenges in critical aspects of data management: preparing and cleaning data, integrating data from diverse sources, training AI models, and ensuring data governance.

    Learn more

    Explore the Thinking Fast series library

    Subscribe and never miss a charticle

    Learn more about Deloitte’s services

    Go straight to smart. Download the Deloitte Insights app

    In Deloitte’s latest State of AI in the Enterprise survey, at least 40% of adopter organizations reported “low” or “medium” level of sophistication across a range of data practices.1 Moreover, nearly a third of executives identified data-related challenges among the top three concerns hampering their company’s AI initiatives.

    Is cleaning data really that difficult? Research suggests that, indeed, cleaning crude and inaccurate data before feeding it into an AI model is a cumbersome process. For instance, companies now routinely spend six to 12 months cleaning the data.2 Cleaning data is vital, as the cost of adjusting poor data rises dramatically later in the process.3

    Data preparation demands persistence and disciplined execution. Data specialists spend a large part of their workweek preparing data for analytics and AI/machine learning (AI/ML) initiatives.4 As more organizations shift their AI workloads to a cloud environment, data integration challenges are intensifying. Some of the most common barriers to access third-party data sources include dealing with disparate data that exists on different systems and merging data from diverse sources.5 For all these efforts, the right talent and expertise can be critical. Often, AI/ML initiatives fail primarily due to lack of expertise, besides other major factors that include unavailability of production-ready data and integrated development environment.6

    To add to these issues, data governance is fast gaining prominence as a problem spot. A 2019 study found that more than half of organizations lacked a formal data governance framework and a dedicated budget to address the issue.7 And even as regulatory scrutiny has intensified worldwide, Deloitte’s State of AI survey finds leaders “highly concerned” about a lack of data policy for personal data use. A shortage of specialists and difficulty in building a comprehensive data strategy are among the top challenges impeding data governance efforts.8

    If these various data management and governance issues are not addressed early on, deeper issues could emerge later to fracture AI initiatives. AI technology providers can play a role in supporting businesses to navigate shortcomings related to data practices by:

    • Aligning data strategy with business outcomes, working with adopter organizations to clearly understand the business needs, the AI business case, and data management needs
    • Bringing a multidisciplinary team comprising AI/technical, business, regulatory, and domain specialists to establish data practices and strategy that align with the customer organization’s business goals and outcomes
    • Building a scalable data-based AI solution, considering all potential end users (employees, customers, business partners) of AI systems, and the overall IT infrastructure (on-premise, cloud, proprietary IT, open-source)

    These steps can enable the adopter organizations to develop a holistic data-based AI strategy that scales with and adapts to their changing needs and demands. As Deloitte LLP US technology sector leader Paul Silvergate notes, “Gleaning information from data—and then a competitive advantage from that information—requires a clear view of where the business is going, coupled with a tight link between the business and IT.”

    Acknowledgments

    Thanks to David Jarvis for his guidance and support with survey data, and to Divya Tewari for her research support.

    Cover image by: Viktor Koen

    Endnotes
      1. Beena Ammanath, Susanne Hupfer, and David Jarvis, Thriving in the era of pervasive AI: Deloitte’s State of AI in the Enterprise, 3rd Edition, Deloitte Insights, July 14, 2020. View in article

      2. David Roe, “Why organizations need to clean their dirty data,” CMS Wire, December 13, 2019. View in article

      3. AI Multiple, “The ultimate guide to data cleaning in 2020,” June 21, 2020. View in article

      4. An online survey conducted by Trifacta covering 600-plus US-based data professionals (from analysts to C-suite levels) revealed that 46% of respondents spent 10-plus hours every week to properly prepare data for analytics and AI/ML initiatives. Some data professionals spent upward of 40 hours a week. See Trifacta, “Obstacles to AI & analytics adoption in the cloud,” January 2020. View in article

      5. Ibid. View in article

      6. In a survey covering more than 2,000 IT and line-of-business decision-makers, IDC noted that 28% of AI/ML initiatives failed due to lack of expertise, unavailability of production-ready data, and absence of integrated development environment. See IDC, “IDC survey finds artificial intelligence adoption being driven by improved customer experience, greater employee efficiency, and accelerated innovation,” June 10, 2020. View in article

      7. Gartner, “Gartner says data and cyber-related risks remain top worries for audit executives,” November 7, 2019. View in article

      8. Business Application Research Center, “How to rule your data world: The role of data governance,” March 2020. View in article

    Show moreShow less

    Topics in this article

    Artificial intelligence (AI) , Technology Industry , Technology , Cognitive technologies

    Technology, Media & Telecommunications

    Deloitte's Technology, Media & Telecommunications (TMT) industry practice brings together one of the world's largest group of specialists respected for helping shape many of the world's most recognized TMT brands—and helping those brands thrive in a digital world.

    Learn more
    Get in touch
    Contact
    • Paul Silverglate
    • US Technology, Media & Telecom Industry Sector Leader
    • Deloitte Risk and Financial Advisory
    • psilverglate@deloitte.com
    • +1 408 704 2475

    Download Subscribe

    Related content

    img Trending

    Increasingly, video streaming doesn’t mean ad-free

    Article
    img Trending

    Will gaming keep growing when the lockdowns end?

    Article 2 years ago
    img Trending

    Can 5G unleash next-generation digital experiences in the home?

    Article 2 years ago
    img Trending

    The most valued technology gadgets of the last decade

    Article 2 years ago

    Explore the Thinking Fast series

    • Can tech companies reach older consumers during the pandemic? Article2 years ago
    • How streaming is changing the music industry Article2 years ago
    • Closing the tech conference gender gap Article2 years ago
    • Why organizations are moving to the cloud Article2 years ago
    • The satellite broadband industry is moving at hyperspeed Article2 years ago
    • The changing face of North America’s tech ecosystem Article2 years ago
    Karthik Ramachandran

    Karthik Ramachandran

    Research Manager | Deloitte Services LP

    Karthik Ramachandran is a senior research manager with Deloitte’s Center for Technology, Media & Telecommunications. He has more than 14 years of experience in performing industry deep-dive analysis, strategic business research, and financial benchmarking. Through his research work, Ramachandran provides pragmatic solutions to help high-tech and telecom companies identify and address long-term issues and growth opportunities. He is based in Hyderabad, India.

    • karramachandran@deloitte.com
    • +1 615 718 2961

    Share article highlights

    See something interesting? Simply select text and choose how to share it:

    Email a customized link that shows your highlighted text.
    Copy a customized link that shows your highlighted text.
    Copy your highlighted text.

    Data management barriers to AI success has been saved

    Data management barriers to AI success has been removed

    An Article Titled Data management barriers to AI success already exists in Saved items

     
    Forgot password

    To stay logged in, change your functional cookie settings.

    OR

    Connect Accounts

    Connect your social accounts

    This is the first time you have logged in with a social network.

    You have previously logged in with a different account. To link your accounts, please re-authenticate.

    Log in with an existing social network:

    To connect with your existing account, please enter your password:

    OR

    Log in with an existing site account:

    To connect with your existing account, please enter your password:

    Forgot password

    Subscribe

    to receive more business insights, analysis, and perspectives from Deloitte Insights
    ✓ Link copied to clipboard
    • Contact us
    • Submit RFP
    • Job search
    Follow Deloitte Insights:
    Office locations
    GLOBAL-EN Location: GLOBAL-English  
    About Deloitte
    • Newsroom
    • Social media
    • Leadership blog
    • Press releases
    • Submit an RFP
    • Job Search
    • Global office directory
    • Contact us
    • About Deloitte
    • Our impact
    Services
    • Audit & Assurance
    • Consulting
    • Risk Advisory
    • Financial Advisory
    • Legal
    • Tax
    Industries
    • Consumer
    • Energy, Resources & Industrials
    • Financial Services
    • Government & Public Services
    • Life Sciences & Health Care
    • Technology, Media & Telecommunications
    Careers
    • Job search
    • Experienced hires
    • Students
    • Life at Deloitte
    • Inclusion at Deloitte
    • Alumni
    • About the Deloitte organization
    • Terms of use
    • Cookies
    • Privacy
    • Privacy Shield
    • Accessibility statement

     

    © 2022. For information, contact Deloitte Touche Tohmatsu Limited.

     

    Deloitte refers to one or more of Deloitte Touche Tohmatsu Limited (“DTTL”), its global network of member firms, and their related entities (collectively, the “Deloitte organization”). DTTL (also referred to as “Deloitte Global”) and each of its member firms and related entities are legally separate and independent entities, which cannot obligate or bind each other in respect of third parties. DTTL and each DTTL member firm and related entity is liable only for its own acts and omissions, and not those of each other. DTTL does not provide services to clients. Please see www.deloitte.com/about to learn more.