Viewing offline content

Limited functionality available

Dismiss
United States
Annotations
  • Services

    What's New

    • The Ripple Effect

      Real-world client stories of purpose and impact

    • Register for Dbriefs webcasts

    • We Are Deloitte

      Reimagining how we support our people

    • Tax

      • Global Business Tax Services
      • Global Employer Services
      • Multistate Tax
      • Operations Transformation for Tax
    • Consulting

      • Core Business Operations
      • Customer & Marketing
      • Enterprise Technology & Performance
      • Human Capital
      • Strategy & Analytics
    • Audit & Assurance

      • Audit Innovation
      • Accounting Standards
      • Accounting Events & Transactions
    • Deloitte Private

    • Mergers & Acquisitions

      • Total M&A Solution
      • Post-merger Integration
      • Divestiture & Separation
    • Risk & Financial Advisory

      • Accounting & Internal Controls
      • Cyber & Strategic Risk
      • Regulatory & Legal
      • Transactions and M&A
    • AI & Analytics

    • Cloud

    • Diversity, Equity & Inclusion

  • Industries

    What's New

    • The Ripple Effect

      Real-world client stories of purpose and impact

    • Register for Dbriefs webcasts

    • Industry Outlooks

      Key opportunities, trends, and challenges

    • Consumer

      • Automotive
      • Consumer Products
      • Retail, Wholesale & Distribution
      • Transportation, Hospitality & Services
    • Energy, Resources & Industrials

      • Industrial Products & Construction
      • Mining & Metals
      • Oil, Gas & Chemicals
      • Power, Utilities & Renewables
    • Financial Services

      • Banking & Capital Markets
      • Insurance
      • Investment Management
      • Real Estate
    • Government & Public Services

      • Defense, Security & Justice
      • Federal health
      • Civil
      • State & Local
      • Higher Education
    • Life Sciences & Health Care

      • Health Care
      • Life Sciences
    • Technology, Media & Telecommunications

      • Technology
      • Telecommunications, Media & Entertainment
  • Insights

    Deloitte Insights

    What's New

    • Deloitte Insights Magazine

      Explore the latest issue now

    • Deloitte Insights app

      Go straight to smart with daily updates on your mobile device

    • Weekly economic update

      See what's happening this week and the impact on your business

    • Strategy

      • Business Strategy & Growth
      • Digital Transformation
      • Governance & Board
      • Innovation
      • Marketing & Sales
      • Private Enterprise
    • Economy & Society

      • Economy
      • Environmental, Social, & Governance
      • Health Equity
      • Trust
      • Mobility
    • Organization

      • Operations
      • Finance & Tax
      • Risk & Regulation
      • Supply Chain
      • Smart Manufacturing
    • People

      • Leadership
      • Talent & Work
      • Diversity, Equity, & Inclusion
    • Technology

      • Data & Analytics
      • Emerging Technologies
      • Technology Management
    • Industries

      • Consumer
      • Energy, Resources, & Industrials
      • Financial Services
      • Government & Public Services
      • Life Sciences & Health Care
      • Technology, Media, & Telecommunications
    • Spotlight

      • Deloitte Insights Magazine
      • Press Room Podcasts
      • Weekly Economic Update
      • COVID-19
      • Resilience
  • Careers

    What's New

    • Hybrid workplace model and vaccine updates

      Transforming when, where, and how we work

    • We Are Deloitte

      Reimagining how we support our people

    • The Deloitte University Experience

      Explore Deloitte University like never before through a cinematic movie trailer and films of popular locations throughout Deloitte University.

    • Careers

      • Audit & Assurance
      • Consulting
      • Risk & Financial Advisory
      • Tax
      • Internal Services
      • US Delivery Center
    • Students

      • Undergraduate
      • Advanced Degree
      • Internships
    • Experienced Professionals

      • Additional Opportunities
      • Veterans
      • Industries
      • Executives
    • Job Search

      • Entry Level Jobs
      • Experienced Professional Jobs
      • Recruiting Tips
      • Explore Your Fit
      • Labor Condition Applications
    • Life at Deloitte

      • Life at Deloitte Blog
      • Meet Our People
      • Inclusion
      • Corporate Citizenship
      • Leadership Development
      • Empowered Well-Being
      • Deloitte University
    • Alumni Relations

      • Update Your Information
      • Events
      • Career Development Support
      • Marketplace Jobs Dashboard
      • Alumni Resources
  • US-EN Location: United States-English  
  • Contact us
  • US-EN Location: United States-English  
  • Contact us
    • Dashboard
    • Saved items
    • Content feed
    • Subscriptions
    • Profile/Interests
    • Account settings

Welcome back

Still not a member? Join My Deloitte

Industrialized analytics

by Tom Davenport
  • Save for later
  • Share
    • Share on Facebook
    • Share on Twitter
    • Share on Linkedin
    • Share by email
Deloitte Insights
  • Strategy
    Strategy
    Strategy
    • Business Strategy & Growth
    • Digital Transformation
    • Governance & Board
    • Innovation
    • Marketing & Sales
    • Private Enterprise
  • Economy & Society
    Economy & Society
    Economy & Society
    • Economy
    • Environmental, Social, & Governance
    • Health Equity
    • Trust
    • Mobility
  • Organization
    Organization
    Organization
    • Operations
    • Finance & Tax
    • Risk & Regulation
    • Supply Chain
    • Smart Manufacturing
  • People
    People
    People
    • Leadership
    • Talent & Work
    • Diversity, Equity, & Inclusion
  • Technology
    Technology
    Technology
    • Data & Analytics
    • Emerging Technologies
    • Technology Management
  • Industries
    Industries
    Industries
    • Consumer
    • Energy, Resources, & Industrials
    • Financial Services
    • Government & Public Services
    • Life Sciences & Health Care
    • Tech, Media, & Telecom
  • Spotlight
    Spotlight
    Spotlight
    • Deloitte Insights Magazine
    • Press Room Podcasts
    • Weekly Economic Update
    • COVID-19
    • Resilience
    • US-EN Location: United States-English  
    • Contact us
      • Dashboard
      • Saved items
      • Content feed
      • Subscriptions
      • Profile/Interests
      • Account settings
    22 July 2015

    Industrialized analytics Implications of large-scale predictive analytics models

    23 July 2015
    • Tom Davenport United States
    • Tom Davenport United States
    • Save for later
    • Share
      • Share on Facebook
      • Share on Twitter
      • Share on Linkedin
      • Share by email

    Analytics has grown from being a “craft” activity to one that is capable of creating thousands, even millions of predictive models and embedding them within operational processes. But if we’re going to industrialize analytics, we need to figure out quality measures and controls just as the manufacturing sector has done for its products.

    Analytics, for most of its relatively short lifespan, has been a “craft” activity. Decision-makers commissioned analysts to find some data and analyze it, and then report back with results. This batch-oriented process might take weeks or even months. If decision-makers actually used the results, it often resulted in better decisions. But in early days, the time and pace of analytical work hindered its broad acceptance. Business speeded up, but only recently has analytics managed to keep up.

    Today, however, many organizations are “industrializing” analytics, dramatically accelerating their speed and scale. I’ve described this elsewhere as a key aspect of “Analytics 3.0.”1 With technologies like model management, in-database scoring, and machine learning (the use of which was a Deloitte Analytics Trend in 2014),2 they are creating thousands, even millions of models and embedding them within operational systems and processes. Decisions are being made without human intervention—or in some cases, without human comprehension. For the most part this is a good thing, but it means that both analysts and decision-makers will have to change their way of working.

    Take, for example, the networking equipment company Cisco Systems. About a decade ago the company embarked upon the use of “propensity models”—analytical models to predict how likely a customer was to buy Cisco products or services. Knowing a customer’s propensity to buy helped sales people decide where to focus their efforts. A staff of between three and four analysts developed the models, and produced several models per year to cover different Cisco offerings.

    This approach was useful, but it wasn’t up to dealing with the thousands of products and services Cisco offers, and the 170 million potential customers it would like to sell to. So Cisco adopted a more industrialized approach to propensity modeling. It now generates over 60,000 different models for different types of customers and products, and updates them every quarter.3It uses the same three or four people to generate the vastly greater number of models through the “magic” of machine learning.

    IBM takes a similar approach to propensity modeling. The company generates somewhat fewer models than Cisco—around 5,000 per quarter, leading to 11 billion scores for the propensities of particular customer executives. The vendor who created these models for IBM calls the approach a “model factory,” which is consistent with the idea of industrializing analytics.

    For another type of example, take the process of determining what digital ads to show a particular customer on a particular publisher’s website. Current methods allow for targeting ads to customers based on the cookies in their browsers, and “retargeting” based on sites they have recently visited. But matching ads to customers and publishers is no situation for conventional craft-based analytics. It’s a complex calculation involving lots of variables, rapidly changing prices in auctions, and many different publishing alternatives—and it must be made in about 15 milliseconds. The leading “programmatic buying” firms, as this set of techniques is called, generate thousands of new models a week to deal with this level of complexity. Again, machine learning provides the means for such large-scale analytics development.

    More and more of this type of industrialization is going on; it’s a sign that analytics has become so important that it needs to be integrated with daily or real-time operations. As the pace of data creation accelerates (for example, from Internet of Things sensors), we’ll need increasingly industrialized analytics to be able to handle it all at the needed pace.

    All this sounds great, but as I mentioned at the beginning of this essay, there is a downside. Machine learning and (to a lesser degree) model management approaches employ so many variables, and move them in and out of models so rapidly, that it is almost impossible for decision-makers to understand what the models mean. And even skilled analysts may have a difficult time making sense of results. For the most part, given the number of models and results that industrialization creates, they don’t even try. “If it works we don’t try to interpret it,” one digital marketer admitted to me.

    The problem here is that we may not realize that the world has changed quickly enough to modify our approach to modeling. In customer propensity models, for example, we may miss some variables that would affect some customers’ buying behaviors more than others, such as changes in a particular country’s economic status. It’s unlikely that many Greek companies are in the market for a new router now, for example.

    In digital marketing, we also run the risk of missing the forest for the trees. Programmatic buying algorithms may be busily humming away to serve me that Airbnb ad, but they don’t seem conscious of the fact that many “people” who click on them are not actually people. Bots have been created by many shadowy organizations to roboclick on ads; some estimate that half of the impressions of digital ads are fake. With all the supposed precision of the models, that means a very high proportion of advertising spending is wasted.

    Industrialized processes were developed, of course, in manufacturing. They have been refined for decades in that context, and manufacturing managers ultimately insisted that there must be effective quality measures and controls for the manufactured goods. If we’re going to industrialize analytics, we need to figure out the same types of measures and controls of quality for the analytics and the operations that they power.

    Machine learning needs to become more transparent, and the assumptions behind the models it creates need to be clear. Models that drive operations, no matter how many and complex they may be, need to be understandable and understood. We are in the earliest days of understanding how to apply these new tools to business at industrial scale. We need to realize that it’s not how fast we can create models that matters, but how we make sound decisions based on them.

    Credits

    Written by: Tom Davenport

    Endnotes
      1. Thomas S. Davenport, “Analytics 3.0,” Harvard Business Review, December 2013, https://hbr.org/2013/12/analytics-30, accessed 21 July, 2015. View in article
      2. Deloitte, “Analytics Trends 2014,” http://public.deloitte.com/media/analytics-trends/analytics-trends.html, accessed 21 July, 2015. View in article
      3. Alex Woodie, “Inside Cisco’s machine learning model factory,” datanami, January 12, 2015, http://www.datanami.com/2015/01/12/inside-ciscos-machine-learning-model-factory/, accessed July 21, 2015. View in article
    Show moreShow less

    Topics in this article

    Technology Management , Analytics , Emerging technologies , Artificial intelligence (AI) , Cognitive technologies

    Deloitte Consulting

    Learn more
    Download Subscribe

    Related

    img Trending

    Interactive 3 days ago

    Tom Davenport

    Tom Davenport

    Tom Davenport is the President’s Distinguished Professor of Information Technology and Management at Babson College, the co-founder of the International Institute for Analytics, a Fellow of the MIT Center for Digital Business. He is an independent senior advisor to Deloitte Analytics, Deloitte Consulting LLP. He collaborates with Deloitte thought leaders on all things related to business analytics, from the potential of cognitive technologies to industry-focused explorations and outcomes. Covering topics from emerging technologies to innovative business applications, Tom's Deloitte University Press series reveals leading-edge thinking on analytics and cognitive technology. Connect with Tom on LinkedIn and Twitter. 

    • insights@deloitte.com

    Share article highlights

    See something interesting? Simply select text and choose how to share it:

    Email a customized link that shows your highlighted text.
    Copy a customized link that shows your highlighted text.
    Copy your highlighted text.

    Industrialized analytics has been saved

    Industrialized analytics has been removed

    An Article Titled Industrialized analytics already exists in Saved items

    Invalid special characters found 
    Forgot password

    To stay logged in, change your functional cookie settings.

    OR

    Social login not available on Microsoft Edge browser at this time.

    Connect Accounts

    Connect your social accounts

    This is the first time you have logged in with a social network.

    You have previously logged in with a different account. To link your accounts, please re-authenticate.

    Log in with an existing social network:

    To connect with your existing account, please enter your password:

    OR

    Log in with an existing site account:

    To connect with your existing account, please enter your password:

    Forgot password

    Subscribe

    to receive more business insights, analysis, and perspectives from Deloitte Insights
    ✓ Link copied to clipboard
    • Contact us
    • Search jobs
    • Submit RFP
    • Subscribe to Deloitte Insights
    Follow Deloitte Insights:
    Global office directory US office locations
    US-EN Location: United States-English  
    About Deloitte
    • About Deloitte
    • Client stories
    • My Deloitte
    • Deloitte Insights
    • Email subscriptions
    • Press releases
    • Submit RFP
    • US office locations
    • Alumni
    • Global office directory
    • Newsroom
    • Dbriefs webcasts
    • Contact us
    Services
    • Tax
    • Consulting
    • Audit & Assurance
    • Deloitte Private
    • Mergers & Acquisitions
    • Risk & Financial Advisory
    • AI & Analytics
    • Cloud
    • Diversity, Equity & Inclusion
    Industries
    • Consumer
    • Energy, Resources & Industrials
    • Financial Services
    • Government & Public Services
    • Life Sciences & Health Care
    • Technology, Media & Telecommunications
    Careers
    • Careers
    • Students
    • Experienced Professionals
    • Job Search
    • Life at Deloitte
    • Alumni Relations
    • About Deloitte
    • Terms of Use
    • Privacy
    • Privacy Shield
    • Cookies
    • Cookie Settings
    • Legal Information for Job Seekers
    • Labor Condition Applications
    • Do Not Sell My Personal Information

    © 2022. See Terms of Use for more information.

    Deloitte refers to one or more of Deloitte Touche Tohmatsu Limited, a UK private company limited by guarantee ("DTTL"), its network of member firms, and their related entities. DTTL and each of its member firms are legally separate and independent entities. DTTL (also referred to as "Deloitte Global") does not provide services to clients. In the United States, Deloitte refers to one or more of the US member firms of DTTL, their related entities that operate using the "Deloitte" name in the United States and their respective affiliates. Certain services may not be available to attest clients under the rules and regulations of public accounting. Please see www.deloitte.com/about to learn more about our global network of member firms.

    Learn more about Deloitte's work for the US Olympic Committee