Special Edition ${secondary-label-icon} ${secondary-label-text}
Faster iteration or tighter governance? An innovative AI/ML platform supports both.
Deloitte helped Thomson Reuters enable a stream of AI/ML capabilities within a single user interface.
AS AI/ML MODELSGROW MORE COMPLEX, CAN MONITORING THEM BECOME SIMPLER?
The Situation
Customers look to Thomson Reuters as a trusted source of content and technology. And with that understanding, the company has invested heavily in the use of automation to extract timely and important data that can help legal, tax, compliance, government, and media professionals make more confident decisions. These artificial intelligence/machine learning (AI/ML) models have been implemented across Thomson Reuters' enterprise and are driven by complex machine learning models that leverage state-of-the-art industry algorithms.
Maria Apazoglou, Thomson Reuters’ VP AI/ML & BI Platforms, had a deep understanding of the evolving AI/ML landscape and how she could apply it to help with customer success. She knew data science models can become vulnerable to performance issues (due to concept drift and data drift over time) and how imperative it becomes to assess model ethics like bias detection.
Businesses often combat this with performance modeling that requires individual data scientists to track the deterioration of models in production and then liaise with the relevant model governance teams to adjust. The number of models has grown significantly, as has the complexity of the problem statements they’re solving. That growth can increase business exposure and risk.
“As customers advance on the AI maturity curve, Deloitte observes that MLOps, ethics, explainable AI, and traceability for root-cause corrective action become focal areas for AI platform enhancements. The services we developed in collaboration with Thomson Reuters are significant steps in that direction,” noted Omer Sohail, principal, Deloitte Consulting LLP.
Apazoglou envisioned a single platform that could intentionally balance speed and governance, a platform where data scientists from across the enterprise could register specific models but leave performance tracking to an AI/ML monitoring system. The goal, she says, was to create a platform "flexible enough to accommodate different user personas, workflows, use cases, and types of models and at the same time standardize some core capabilities that then enable us to improve the way we govern, view, and trust our models."
THE SOLVE
A PLATFORM IS MORE USEFUL WHEN IT’S BUILT WITH USERS IN MIND.
The Impact
Model governance is essential for any AI/ML model, and the fully customized monitoring application enables a smoother, more efficient process while also providing immediate visibility into how models are performing.
Thomson Reuters' data model and governance team has augmented its ability to track changes in data and identify bias in a continuous manner, and data science and product teams are better positioned for tracking performance and deterioration over time.
This can mitigate potential risks by identifying potential issues earlier and empowering timely decisions around retraining the models. For model owners and business owners, the model registry can serve as a single source of truth and a reliable resource when it comes to audit, traceability, model lift, and implications of bias and (in the future) explainability.
“Machine learning and AI can help us serve our customers while optimizing performance,” says Glenda Crisp, head of data and analytics at Thomson Reuters. “This is a key part of our strategic vision for the future.”
The initial focus for the platform has been on models used within Thomson Reuters' legal content capabilities, such as those built around classifying documents and decisions.
Apazoglou's team is moving forward with monitoring more complex models that can enable summarization of legal documents, and there are plans to expand the platform to models used internally to study customer churn and financial forecasting.
Thomson Reuters has been a pioneer in the wide adoption of responsible and trustworthy AI across its businesses, and Apazoglou is committed to continuing that practice.
“We embed AI in a lot of our products; we have AI that's quite complicated,” she noted. “Being able to iterate as fast as possible is really key for us to be able to continue to have a competitive advantage when it comes to external-facing products.”
The People
Meet the team behind the work.
Discover how their unique skills and collective efforts have created lasting impact.
OMER’S CONTRIBUTION
As the primary point of contact for client stakeholders, Omer facilitated effective, candid communication and collaboration between diverse teams, ensuring alignment with the client's goals.
He made sure to prioritize adaptability since he knew the client's needs and priorities might change and evolve. Overall, Omer's approach to this project was based on three key components: trustworthy communications, fit-for-purpose problem solving, and assembling a very talented team.
It's these principles that have made a substantial impact on the work and the relationships he's built with clients.
Omer Sohail
Principal
Deloitte Consulting LLP
Let's connect
