Viewing offline content

Limited functionality available

Dismiss
Deloitte Middle East
Annotations
  • Services

    What's New

    • Deloitte175

      Join us for a celebration of 175 years of making an impact that matters.

    • Building the Resilient Organization

      2021 Deloitte Global resilience report

    • 2020 Global Gender Impact Report

      A collection of Butterfly Effect stories highlighting how our Deloitte professionals are positively impacting the lives of women and girls around the world

    • Audit & Assurance

      • Assurance
    • Consulting

      • Strategy, Analytics and M&A
      • Customer and Marketing
      • Business Operations
      • Human Capital
      • Enterprise Technology & Performance
    • Financial Advisory

      • Mergers & Acquisitions
      • Forensic
      • Real Estate
      • Turnaround & Restructuring
    • Risk Advisory

      • Strategic & Reputation Risk
      • Regulatory Risk
      • Financial Risk
      • Operational Risk
      • Cyber Risk
    • Tax

      • Global Business Tax Services
      • Indirect Tax
      • Global Employer Services
    • Deloitte Private

      • Family Enterprise
    • Legal

    • Sustainability

  • Industries

    What's New

    • Deloitte perspectives

      Leadership perspectives from across the globe.

    • Deloitte Insights App

      Our thought leadership and Dow Jones news, now at your fingertips

    • Future of Mobility

      Learn how this new reality is coming together and what it will mean for you and your industry.

    • Consumer

      • Automotive
      • Consumer Products
      • Retail, Wholesale & Distribution
      • Transportation, Hospitality & Services
    • Energy, Resources & Industrials

      • Industrial Products & Construction
      • Mining & Metals
      • Oil, Gas & Chemicals
      • Power, Utilities & Renewables
    • Financial Services

      • Banking & Capital Markets
      • Insurance
      • Investment Management
      • Real Estate
    • Government & Public Services

      • Civil Government
      • Defense, Security & Justice
      • Health & Social Care
      • Transport
    • Life Sciences & Health Care

      • Health Care
      • Life Sciences
    • MENA Sovereign Wealth Funds

    • Technology, Media & Telecommunications

      • Technology
      • Telecommunications, Media & Entertainment
  • Insights

    Deloitte Insights

    What's New

    • Deloitte Insights Magazine

      Explore the latest issue now

    • Deloitte Insights app

      Go straight to smart with daily updates on your mobile device

    • Weekly economic update

      See what's happening this week and the impact on your business

    • Strategy

      • Business Strategy & Growth
      • Digital Transformation
      • Governance & Board
      • Innovation
      • Marketing & Sales
      • Private Enterprise
    • Economy & Society

      • Economy
      • Environmental, Social, & Governance
      • Health Equity
      • Trust
      • Mobility
    • Organization

      • Operations
      • Finance & Tax
      • Risk & Regulation
      • Supply Chain
      • Smart Manufacturing
    • People

      • Leadership
      • Talent & Work
      • Diversity, Equity, & Inclusion
    • Technology

      • Data & Analytics
      • Emerging Technologies
      • Technology Management
    • Industries

      • Consumer
      • Energy, Resources, & Industrials
      • Financial Services
      • Government & Public Services
      • Life Sciences & Health Care
      • Technology, Media, & Telecommunications
    • Spotlight

      • Deloitte Insights Magazine
      • Press Room Podcasts
      • Weekly Economic Update
      • COVID-19
      • Resilience
  • Careers

    What's New

    • Millennial Survey 2022

      Gen Zs and millennials are striving for balance and advocating for change.

    • Candidate Profile

      After applying for a job in this country, you can access/update your candidate profile at any time.

    • Job Search

    • Students

    • Experienced Hires

    • Executives

    • Life at Deloitte

    • Alumni

    • Diversity and Inclusion

  • XE-EN Location: XE-English  
  • Contact us
  • XE-EN Location: XE-English  
  • Contact us
    • Dashboard
    • Saved items
    • Content feed
    • Profile/Interests
    • Account settings

Welcome back

Still not a member? Join My Deloitte

Industrialized analytics

by Tom Davenport
  • Save for later
  • Share
    • Share on Facebook
    • Share on Twitter
    • Share on Linkedin
    • Share by email
Deloitte Insights
  • Strategy
    Strategy
    Strategy
    • Business Strategy & Growth
    • Digital Transformation
    • Governance & Board
    • Innovation
    • Marketing & Sales
    • Private Enterprise
  • Economy & Society
    Economy & Society
    Economy & Society
    • Economy
    • Environmental, Social, & Governance
    • Health Equity
    • Trust
    • Mobility
  • Organization
    Organization
    Organization
    • Operations
    • Finance & Tax
    • Risk & Regulation
    • Supply Chain
    • Smart Manufacturing
  • People
    People
    People
    • Leadership
    • Talent & Work
    • Diversity, Equity, & Inclusion
  • Technology
    Technology
    Technology
    • Data & Analytics
    • Emerging Technologies
    • Technology Management
  • Industries
    Industries
    Industries
    • Consumer
    • Energy, Resources, & Industrials
    • Financial Services
    • Government & Public Services
    • Life Sciences & Health Care
    • Tech, Media, & Telecom
  • Spotlight
    Spotlight
    Spotlight
    • Deloitte Insights Magazine
    • Press Room Podcasts
    • Weekly Economic Update
    • COVID-19
    • Resilience
    • XE-EN Location: XE-English  
    • Contact us
      • Dashboard
      • Saved items
      • Content feed
      • Profile/Interests
      • Account settings
    22 July 2015

    Industrialized analytics Implications of large-scale predictive analytics models

    23 July 2015
    • Tom Davenport United States
    • Tom Davenport United States
    • Save for later
    • Share
      • Share on Facebook
      • Share on Twitter
      • Share on Linkedin
      • Share by email

    Analytics has grown from being a “craft” activity to one that is capable of creating thousands, even millions of predictive models and embedding them within operational processes. But if we’re going to industrialize analytics, we need to figure out quality measures and controls just as the manufacturing sector has done for its products.

    Analytics, for most of its relatively short lifespan, has been a “craft” activity. Decision-makers commissioned analysts to find some data and analyze it, and then report back with results. This batch-oriented process might take weeks or even months. If decision-makers actually used the results, it often resulted in better decisions. But in early days, the time and pace of analytical work hindered its broad acceptance. Business speeded up, but only recently has analytics managed to keep up.

    Today, however, many organizations are “industrializing” analytics, dramatically accelerating their speed and scale. I’ve described this elsewhere as a key aspect of “Analytics 3.0.”1 With technologies like model management, in-database scoring, and machine learning (the use of which was a Deloitte Analytics Trend in 2014),2 they are creating thousands, even millions of models and embedding them within operational systems and processes. Decisions are being made without human intervention—or in some cases, without human comprehension. For the most part this is a good thing, but it means that both analysts and decision-makers will have to change their way of working.

    Take, for example, the networking equipment company Cisco Systems. About a decade ago the company embarked upon the use of “propensity models”—analytical models to predict how likely a customer was to buy Cisco products or services. Knowing a customer’s propensity to buy helped sales people decide where to focus their efforts. A staff of between three and four analysts developed the models, and produced several models per year to cover different Cisco offerings.

    This approach was useful, but it wasn’t up to dealing with the thousands of products and services Cisco offers, and the 170 million potential customers it would like to sell to. So Cisco adopted a more industrialized approach to propensity modeling. It now generates over 60,000 different models for different types of customers and products, and updates them every quarter.3It uses the same three or four people to generate the vastly greater number of models through the “magic” of machine learning.

    IBM takes a similar approach to propensity modeling. The company generates somewhat fewer models than Cisco—around 5,000 per quarter, leading to 11 billion scores for the propensities of particular customer executives. The vendor who created these models for IBM calls the approach a “model factory,” which is consistent with the idea of industrializing analytics.

    For another type of example, take the process of determining what digital ads to show a particular customer on a particular publisher’s website. Current methods allow for targeting ads to customers based on the cookies in their browsers, and “retargeting” based on sites they have recently visited. But matching ads to customers and publishers is no situation for conventional craft-based analytics. It’s a complex calculation involving lots of variables, rapidly changing prices in auctions, and many different publishing alternatives—and it must be made in about 15 milliseconds. The leading “programmatic buying” firms, as this set of techniques is called, generate thousands of new models a week to deal with this level of complexity. Again, machine learning provides the means for such large-scale analytics development.

    More and more of this type of industrialization is going on; it’s a sign that analytics has become so important that it needs to be integrated with daily or real-time operations. As the pace of data creation accelerates (for example, from Internet of Things sensors), we’ll need increasingly industrialized analytics to be able to handle it all at the needed pace.

    All this sounds great, but as I mentioned at the beginning of this essay, there is a downside. Machine learning and (to a lesser degree) model management approaches employ so many variables, and move them in and out of models so rapidly, that it is almost impossible for decision-makers to understand what the models mean. And even skilled analysts may have a difficult time making sense of results. For the most part, given the number of models and results that industrialization creates, they don’t even try. “If it works we don’t try to interpret it,” one digital marketer admitted to me.

    The problem here is that we may not realize that the world has changed quickly enough to modify our approach to modeling. In customer propensity models, for example, we may miss some variables that would affect some customers’ buying behaviors more than others, such as changes in a particular country’s economic status. It’s unlikely that many Greek companies are in the market for a new router now, for example.

    In digital marketing, we also run the risk of missing the forest for the trees. Programmatic buying algorithms may be busily humming away to serve me that Airbnb ad, but they don’t seem conscious of the fact that many “people” who click on them are not actually people. Bots have been created by many shadowy organizations to roboclick on ads; some estimate that half of the impressions of digital ads are fake. With all the supposed precision of the models, that means a very high proportion of advertising spending is wasted.

    Industrialized processes were developed, of course, in manufacturing. They have been refined for decades in that context, and manufacturing managers ultimately insisted that there must be effective quality measures and controls for the manufactured goods. If we’re going to industrialize analytics, we need to figure out the same types of measures and controls of quality for the analytics and the operations that they power.

    Machine learning needs to become more transparent, and the assumptions behind the models it creates need to be clear. Models that drive operations, no matter how many and complex they may be, need to be understandable and understood. We are in the earliest days of understanding how to apply these new tools to business at industrial scale. We need to realize that it’s not how fast we can create models that matters, but how we make sound decisions based on them.

    Credits

    Written by: Tom Davenport

    Endnotes
      1. Thomas S. Davenport, “Analytics 3.0,” Harvard Business Review, December 2013, https://hbr.org/2013/12/analytics-30, accessed 21 July, 2015. View in article
      2. Deloitte, “Analytics Trends 2014,” http://public.deloitte.com/media/analytics-trends/analytics-trends.html, accessed 21 July, 2015. View in article
      3. Alex Woodie, “Inside Cisco’s machine learning model factory,” datanami, January 12, 2015, http://www.datanami.com/2015/01/12/inside-ciscos-machine-learning-model-factory/, accessed July 21, 2015. View in article
    Show moreShow less

    Topics in this article

    Technology Management , Analytics , Emerging technologies , Artificial intelligence (AI) , Cognitive technologies

    Deloitte Consulting

    Learn more
    Download Subscribe

    Related

    img Trending

    Interactive 3 days ago

    Tom Davenport

    Tom Davenport

    Tom Davenport is the President’s Distinguished Professor of Information Technology and Management at Babson College, the co-founder of the International Institute for Analytics, a Fellow of the MIT Center for Digital Business. He is an independent senior advisor to Deloitte Analytics, Deloitte Consulting LLP. He collaborates with Deloitte thought leaders on all things related to business analytics, from the potential of cognitive technologies to industry-focused explorations and outcomes. Covering topics from emerging technologies to innovative business applications, Tom's Deloitte University Press series reveals leading-edge thinking on analytics and cognitive technology. Connect with Tom on LinkedIn and Twitter. 

    • insights@deloitte.com

    Share article highlights

    See something interesting? Simply select text and choose how to share it:

    Email a customized link that shows your highlighted text.
    Copy a customized link that shows your highlighted text.
    Copy your highlighted text.

    Industrialized analytics has been saved

    Industrialized analytics has been removed

    An Article Titled Industrialized analytics already exists in Saved items

     
    Forgot password

    To stay logged in, change your functional cookie settings.

    OR

    Social login not available on Microsoft Edge browser at this time.

    Connect Accounts

    Connect your social accounts

    This is the first time you have logged in with a social network.

    You have previously logged in with a different account. To link your accounts, please re-authenticate.

    Log in with an existing social network:

    To connect with your existing account, please enter your password:

    OR

    Log in with an existing site account:

    To connect with your existing account, please enter your password:

    Forgot password

    Subscribe

    to receive more business insights, analysis, and perspectives from Deloitte Insights
    ✓ Link copied to clipboard
    • Contact us
    • Search Jobs
    • Submit RFP
    Follow Deloitte Insights:
    Global office directory Office locations
    XE-EN Location: XE-English  
    About Deloitte
    • Newsroom
    • Deloitte events
    • Our blog collections
    • Press releases
    • Press contacts
    • Corporate Responsibility & Sustainability
    • Report an ethics complaint
    Services
    • Audit & Assurance
    • Consulting
    • Financial Advisory
    • Risk Advisory
    • Tax
    • Deloitte Private
    • Legal
    • Sustainability
    Industries
    • Consumer
    • Energy, Resources & Industrials
    • Financial Services
    • Government & Public Services
    • Life Sciences & Health Care
    • MENA Sovereign Wealth Funds
    • Technology, Media & Telecommunications
    Careers
    • Job Search
    • Students
    • Experienced Hires
    • Executives
    • Life at Deloitte
    • Alumni
    • Diversity and Inclusion
    • About Deloitte
    • About Deloitte in the Middle East
    • Privacy
    • Terms of use
    • Cookies
    • Avature Privacy

    © 2022. See Terms of Use for more information.

    Deloitte refers to one or more of Deloitte Touche Tohmatsu Limited, a UK private company limited by guarantee (“DTTL”), its network of member firms, and their related entities. DTTL and each of its member firms are legally separate and independent entities. DTTL (also referred to as “Deloitte Global”) does not provide services to clients. Please see About Deloitte to learn more about our global network of member firms.