Automated machine learning and predictive insights | Deloitte Insights
Deloitte
  • Services
    What's New
    • 2019 Global Human Capital Trends

      Leading the social enterprise: Reinvent with human focus

    • Deloitte Reimagine Platform

      Tapping the power of SAP® Leonardo to launch the digital enterprise

    • Future of Work

      Disruption lies ahead

    Audit & Assurance
    • IASPlus
    Consulting
    • Strategy, Analytics and M&A
    • Customer and Marketing
    • Core Business Operations
    • Human Capital
    • Enterprise Technology & Performance
    Risk Advisory
    • Strategic & Reputation Risk
    • Regulatory Risk
    • Financial Risk
    • Operational Risk
    • Cyber Risk
    Financial Advisory
    • Mergers & Acquisitions
    • Restructuring Services
    • Deloitte Forensic
    Legal
    • Deloitte Legal around the world
    • Dbriefs Legal
    • Deloitte Legal services
    Tax
    • Global Business Tax
    • Global Employer Services
    • Global Tax Reset
    • Tax Automation and AI
  • Industries
    What's New
    • Deloitte perspectives

      Leadership perspectives from across the globe.

    • Future of Mobility

      Learn how this new reality is coming together and what it will mean for you and your industry.

    • Platforms and Ecosystems

      Enabling the Digital Economy

    Consumer
    • Automotive
    • Consumer Products
    • Retail, Wholesale & Distribution
    • Transportation, Hospitality & Services
    Energy, Resources & Industrials
    • Industrial Products & Construction
    • Mining & Metals
    • Oil, Gas & Chemicals
    • Power & Utilities
    • Future of Energy
    Financial Services
    • Banking & Capital Markets
    • Insurance
    • Investment Management
    • Real Estate
    Government & Public Services
    • Civil Government
    • Defense, Security & Justice
    • Health & Social Care
    • International Donor Organizations
    • Transport
    Life Sciences & Health Care
    • Health Care
    • Life Sciences
    Technology, Media & Telecommunications
    • Technology
    • Telecommunications, Media & Entertainment
  • Insights

    Deloitte Insights
    What's New
    • Daily executive briefing

      Timely insights to inform your agenda.

    • Deloitte Review

      Looking ahead, staying ahead

    • Deloitte Insights app

      Get daily updates on your mobile device

    By topic
    • AI & cognitive technologies
    • Analytics
    • Blockchain
    • Digital transformation
    • Diversity & inclusion
    • Economics
    • Human capital
    • Innovation
    • Leadership
    • Private companies
    • Risk management
    • Strategy
    By sector
    • Automotive
    • Consumer products & retail
    • Financial services
    • Government & public services
    • Health care
    • Industrial products
    • Life sciences
    • Oil, gas & chemicals
    • Power & utilities
    • Technology
    • Telecom, media & entertainment
    • Transportation & hospitality
    Spotlight
    • Daily Executive Briefing
    • Deloitte Review
    • Economic weekly update
    • Future of mobility
    • Future of work
    • Industry 4.0
    • Internet of Things
    • Smart cities
  • Careers
    What's New
    • Millennial Survey 2019

      Optimism and trust reach troubling low levels

    • Alumni profiles

      Inspiring leaders

    Job search
    Experienced hires
    Students
    Life at Deloitte
    Alumni
  • GLOBAL-EN Location: GLOBAL-English  
    • Contact us
    • GLOBAL-EN Location: GLOBAL-English  
      • Contact us

      Automated machine learning and the democratization of insights

      By Tom Davenport, Dave Kuder
      • Add to my bookmarks
      • Highlight
      • Download
      • Share
        • Share on Facebook
        • Share on Twitter
        • Share on Linkedin
        • Share by email
      Deloitte Insights
      • By topic
        By topic
        By topic
        • AI & cognitive technologies
        • Analytics
        • Blockchain
        • Digital transformation
        • Diversity & inclusion
        • Economics
        • Human capital
        • Innovation
        • Leadership
        • Private companies
        • Risk management
        • Strategy
      • By sector
        By sector
        By sector
        • Automotive
        • Consumer products & retail
        • Financial services
        • Government & public services
        • Health care
        • Industrial products
        • Life sciences
        • Oil, gas & chemicals
        • Power & utilities
        • Technology
        • Telecom, media & entertainment
        • Transportation & hospitality
      • Spotlight
        Spotlight
        Spotlight
        • Daily Executive Briefing
        • Deloitte Review
        • Economic weekly update
        • Future of mobility
        • Future of work
        • Industry 4.0
        • Internet of Things
        • Smart cities
      • GLOBAL-EN Location: GLOBAL-English  
        • Contact us
        6 minute read 25 March 2019

        Automated machine learning and the democratization of insights

        6 minute read 25 March 2019
        • Tom Davenport United States
        • Dave Kuder United States
        • Add to my bookmarks
        • Highlight
        • Download
        • Share
          • Share on Facebook
          • Share on Twitter
          • Share on Linkedin
          • Share by email
        • The role of automated machine learning
        • Democratizing machine learning beyond data scientists

        The predictive insights organizations can gain from the oceans of data they generate are currently limited by the availability of experts who can crunch this data. Automation may change that.

        As data proliferates in organizations, there is an increasing need to understand its implications through the generation of insights. Insight generation through business intelligence and analytics has been available for almost half a century, but it typically required the help of trained analysts. The insights needed by decision-makers within an organization were constrained by the number of analysts, and without easy access to analytics, these analysts were often forced to rely on experience and intuition. To make matters worse, difficult-to-use technologies made it challenging for most business people to find and analyze the data they needed to generate insights.

        Learn More

        Explore the Analytics collection

        Visit the AI and cognitive technologies collection

        Subscribe to receive related content

        Over the past several decades, multiple technologies have been used to democratize the creation of insights, including interactive statistical packages, spreadsheets, easy-to-use visual analytics tools, and the like. But we don’t think they are enough for today’s complex technology and data environment.

        The rapid increase in the amount of data and the power of sophisticated algorithms to analyze it means that new interventions are required to deliver new levels of insight. Previous democratization technologies were mostly capable of generating descriptive analytics insights about the past. Companies increasingly want to generate predictive models that provide insights about what might happen to their businesses in the future and prescriptive analytics that guide employees and customers to take actions that drive business results. Achieving these goals requires a level of statistical and data science sophistication that is still relatively rare within organizations, and that limits the number of useful insights that a company can produce.

        The role of automated machine learning

        Or at least it used to be a limiting factor. Predictive analytics—which is the same as more straightforward forms of statistical machine learning—can now be performed largely on an automated basis. Many of the key tasks required for machine learning—including data preparation, “feature engineering” or variable transformation, trying out different algorithm types, creation of program code or APIs for model deployment, and even creation of explanations of what factors are particularly important in a model—can increasingly be done by machines. Automated machine learning software is now available from AI-oriented firms such as Google, established analytics firms such as SAS, and startups such as DataRobot and H2O.ai.

        Automated machine learning (often called AutoML) can certainly enhance the work of professional analysts and data scientists by automating workflow and dramatically increasing the speed with which a variety of overall hypotheses and individual model attributes can be tested. The rise of analytics and big data has led to many new or rediscovered algorithms. Most statistical analyses in the past relied heavily on linear regression analysis. More recently, logistic regression has become much more popular for making predictions of binary outcomes that are frequently used to drive day-to-day business activities. Now, a wide range of algorithms is available to the machine learning modeler. Data and algorithms are expanding rapidly, but human capabilities—even those of quantitative professionals—are not. AutoML is a way to enhance the productivity and effectiveness of even the best-trained analytical professional or data scientist.

        At a large US property and casualty insurance company, for example, modeling productivity for data scientists was the primary objective in adopting AutoML. Thus far, notes the head of data science support, “It has been a very helpful throughput tool.” The insurance giant uses AutoML to get a quick reading on the ROI of alternative machine learning projects. “We get some data, turn DataRobot (an AutoML tool from a Boston-based startup) loose on it, and see what the prediction accuracy is for the model. It’s so quick that we can figure out the value of an analysis without taking a lot of time to assess it,” notes the manager. The company can learn what the key parameters of the model are, what algorithm is best-suited to the problem, and what the likely ceiling is on model accuracy. If it seems to be a promising analysis, the company will take it further—typically using nonautomated machine learning tools—and perhaps put it into production.

        At Sumitomo Mitsui Card Company (SMCC), the largest credit card company in Japan, AutoML has been applied both to risk modeling and customer insight/marketing applications. In the risk modeling area, some analysts and data scientists were doing machine learning manually, but it could take up to half a year to build and validate a model. The use of AutoML cut that time to hours or a few days. Hiroki Shiraishi, who leads a group providing machine learning infrastructure to SMCC’s business units, notes that the company wanted to accelerate the process of analyzing credit card data, and there were not enough skilled analysts to meet the need. Therefore, increasing modeling productivity was a key objective.

        Democratizing machine learning beyond data scientists

        The greatest benefits in expanding insights, however, can come from broadening the population that can perform sophisticated machine learning analyses.1 Data scientists are typically difficult to hire and retain, and can be a limiting factor to insight generation even with greater productivity. In addition, business analysts with only moderate quantitative skills often understand the business and customer needs better than many data scientists. For these reasons, companies are attempting to expand the population of users of machine learning beyond data scientists. While some AutoML tools, such as Google’s Cloud AutoML and H2O.ai’s Driverless AI, are more oriented to more traditional data scientists (that is, individuals with PhDs in statistics and/or computer science), there are several platforms (such as DataRobot’s AutoML tools) that are oriented to both data scientists and quantitatively oriented business analysts.

        For example, at 84.51, a subsidiary of Kroger that performs sophisticated data and analytics work for the grocer, the initial focus for AutoML was improving the productivity of data scientists. But the group has also used the automated tools to expand the number of people who can do machine learning. 84.51 has been growing its data science function to meet demand for modeling and analytics to solve complex business problems. It has been a challenge to find data scientists with the array of skills needed to work with business partners to engineer solutions and to develop and deploy models using current best methods. 84.51° employs tools such as DataRobot to “expand the bench.” Some experienced data scientists were concerned that they were moving to a world in which knowledge of algorithms and methods had no currency—a common issue with AutoML—but the company’s leaders emphasized that the new tools empowered people to get things done more efficiently, and there is now no pushback. 84.51 now regularly hires “insights”-focused data scientists—people who don’t have as much experience with machine learning, but who are skilled at communicating and presenting results, and who have high business acumen. Aided by AutoML, a substantial number of use cases and steps within traditional model development (such as use case identification and exploratory analyses) fit within their capabilities.

        There is an even stronger focus on expanding the user base with AutoML at Royal Bank of Canada (RBC). It is investing in artificial intelligence and machine learning, currently employing over 200 data scientists working across the bank. Samer Nusier, the bank’s director of portfolio management and credit strategy, explained that many of the bank’s serious data scientists prefer to develop and tune their models using traditional methods. He, however, is an advocate of the “citizen data scientist” supported by AutoML. He notes that of the three traditional data science skills—math, computer science, and business domain knowledge—the math and computer science work are increasingly being done by tools like AutoML. When business analysts who understand the data and customer behavior create the models, they can be as useful as models created by data scientists. “It gives them superpowers,” he notes. Nusier feels that “purple people”—those who understand both some analytics and are business experts—can be equally valuable if supported by AutoML.

        The proliferation of roles that can perform advanced analytics means that companies will need to clarify who does what and establish a governance model that balances capabilities, benefits, and risks. It probably wouldn’t be feasible, for example—at least at the moment—for a business analyst to employ a deep learning neural network model for image or speech recognition. Providing secure access to the volumes of appropriately cleansed and frequently updated data required for analyses is often another initial step. However, for straightforward machine learning models involving regression-oriented tools, there may no longer be any need to employ a data scientist. Automated machine learning tools, which will undoubtedly continue to advance in capability, can make possible the generation of advanced analytical insights at a much faster and broader level than ever before. The ability of an organization to take advantage of the curiosity, talent, and ingenuity at all levels of the company to increase performance is the underlying business driver and will be a central tenet to establishing and maintaining a competitive advantage going forward.

        Acknowledgments

        Cover image by: Kevin Weier

        Endnotes
          1. David Schatsky, Rameeta Chauhan, Craig Muraskin, Democratizing data science to bridge the talent gap, Deloitte Insights, December 13, 2018. View in article

        Show moreShow less

        Topics in this article

        Technology , Analytics , Automation , Cognitive technologies , Emerging technologies

        ​Deloitte Analytics and AI

        Reveal smarter insights. Achieve stronger outcomes.

        Achieving your business outcomes, whether a small-scale program or an enterprise-wide initiative, demands ever-smarter insights—delivered faster than ever before. Doing that in today's complex, connected world requires the ability to combine a high-performance blend of humans with machines, automation with intelligence, and business analytics with data science. Welcome to the Age of With, where Deloitte translates the science of analytics—through our services, solutions, and capabilities—into reality for your business.

        Learn more
        Get in touch
        Contact
        • Dave Kuder
        • US Cognitive Insights & Engagement leader, DC principal
        • Deloitte Consulting LLP
        • dkuder@deloitte.com
        • +1 585 451 3877

        Download Subscribe

        Related content

        img Trending

        Pump your own data

        Article 9 months ago
        img Trending

        How third-party information can enhance data analytics

        Article 9 months ago
        img Trending

        Artificial intelligence: From expert-only to everywhere

        Article 11 months ago
        img Trending

        Pervasive intelligence

        Podcast 9 months ago

        Explore the Analytics collection

        • Network analysis and organizational redesigns Article9 months ago
        • Investigative analytics Article9 months ago
        • Democratizing data science to bridge the talent gap Article11 months ago
        • Modernize management of big data Article1 year ago

        Share article highlights

        See something interesting? Simply select text and choose how to share it:

        Email a customized link that shows your highlighted text.
        Copy a customized link that shows your highlighted text.
        Copy your highlighted text.

        Automated machine learning and the democratization of insights has been added to your bookmarks.

        Automated machine learning and the democratization of insights has been removed from your bookmarks.

        An article titled Automated machine learning and the democratization of insights already exists in the bookmark library

         

        Connect Accounts

        Connect your social accounts

        This is the first time you have logged in with a social network.

        You have previously logged in with a different account. To link your accounts, please re-authenticate.

        Log in with an existing social network:

        To connect with your existing account, please enter your password:

        OR

        Log in with an existing site account:

        To connect with your existing account, please enter your password:

        Forgot password

        Subscribe

        to receive more business insights, analysis, and perspectives from Deloitte Insights
        ✓ Link copied to clipboard
        • Contact us
        • Submit RFP
        • Job search
        Follow Deloitte Insights:
        Global Office Directory
        Office Locations
        Location: GLOBAL-EN GLOBAL-English  
          About Deloitte
          • Newsroom
          • Social media
          • Leadership blog
          • Press releases
          • Submit an RFP
          • Job Search
          • Global office directory
          • Contact us

          Services

          • Audit & Assurance
          • Consulting
          • Risk Advisory
          • Financial Advisory
          • Legal
          • Tax

          Industries

          • Consumer
          • Energy, Resources & Industrials
          • Financial Services
          • Government & Public Services
          • Life Sciences & Health Care
          • Technology, Media & Telecommunications

          Careers

          • Job search
          • Experienced hires
          • Students
          • Life at Deloitte
          • Alumni
          • About Deloitte
          • Terms of use
          • Cookies
          • Privacy
          • Privacy Shield
          • Accessibility statement

           

          © 2019. For information, contact Deloitte Touche Tohmatsu Limited.

           

          Deloitte refers to one or more of Deloitte Touche Tohmatsu Limited (“DTTL”), its global network of member firms, and their related entities. DTTL (also referred to as “Deloitte Global”) and each of its member firms are legally separate and independent entities. DTTL does not provide services to clients. Please see www.deloitte.com/about to learn more.