TruEra Launches First Automated Test Harness for ML Models with TruEra Diagnostics 2.0 Release

Major update of the TruEra Diagnostics solution helps enterprises test AI models at scale, improving quality, accelerating development timeframes, and lessening model risk


REDWOOD CITY, Calif., Oct. 25, 2022 (GLOBE NEWSWIRE) -- TruEra, which provides the first suite of AI Quality management solutions for managing model performance, explainability, and societal impact, today launched TruEra Diagnostics 2.0, a major update to its TruEra Diagnostics solution, incorporating the first-ever automated test harness for AI models that includes root cause analysis. The new systematic testing features in TruEra Diagnostics 2.0 help enterprises to get models into production faster by providing comprehensive model evaluation that promotes quality and transparency, accelerating model development and approval. 

TruEra Diagnostics 2.0 allows enterprises deploying AI models to:

  • Ensure high-quality models via systematic testing
  • Identify high-impact problems and then debug and optimize models quickly
  • Achieve model transparency with best-in-class explainability, to gain buy-in from key stakeholders more quickly and easily

Each year, billions of dollars are spent on the development of AI and ML models globally but most never make it to production due to quality concerns or lack of explainability. A rapidly growing number of models are in development, yet it is challenging for data scientists and ML engineers to track their experiments, evaluate them, and retrain models quickly and effectively. Model development is often siloed across departments with varying testing methodology that involves a lot of trial and error guesswork for the same use case. Until now, no general automated test harness has existed for ML.

“We are seeing huge demand from enterprises for comprehensive AI Quality management solutions,” said Will Uppington, co-founder and CEO of TruEra. “AI development is where enterprise software was in the early days of its adoption, before automated testing was ubiquitous. We strongly believe that better testing and monitoring for AI models will increase their impact and accelerate their adoption, just as it sped the adoption of enterprise software years ago. There’s a clear need for better and more systematic AI model testing and debugging, and we’re proud to be first to market with these capabilities.”

HaystaqDNA, a TruEra Diagnostics customer, pioneered the use of predictive analytics in political campaigns, helping the Obama presidential campaign achieve a historic victory in 2008, and its team has nearly two decades of experience helping companies and political campaigns accurately target their communications and marketing. HaystaqDNA also has many enterprise clients, helping Fortune 500 and Global 1000 companies achieve new market and customer insights that help to reach new customers and grow ROI.

“HaystaqDNA customers rely upon our ML models for critical market decisions that can determine the outcomes of elections or the success of a major marketing initiative,” said Blake Silberberg, Vice President of Media Analytics at HaystaqDNA. “TruEra Diagnostics helps us to ensure that our models are accurate, robust, and high performing, as well as fair. We work with a large number of high volume models, so having automated testing to ensure model quality across all of our models is of critical importance to us.”

The new major capabilities in TruEra Diagnostics 2.0 include:

  • Automated Test Harness
    Systemic testing for evaluating models across a broad array of critical model metrics
  • Automated Error Analysis
    Ability to evaluate certain segments of a model with high error issues
  • Model Leaderboard and Model Summary Dashboards
    The cross-model leaderboard quickly shows status across multiple models. The detailed model summary dashboard provides critical details about model performance of an individual model.
  • Enhanced Data Quality Analytics
    Tool that analyzes data inputs to check for data integrity weaknesses that might be impacting the model

TruEra has been selected as the preferred vendor by multiple Fortune 1000 companies. In March 2022, the company was named to the Fast Company World Changing Ideas list for the second year in a row. In June 2021, TruEra was named a “Cool Vendor” by expert analysts at Gartner, Inc in the report, “Cool Vendors in AI Governance and Responsible AI.”  Members of the company also serve on advisory boards for the Bank of England and the Monetary Authority of Singapore, among other government agencies.

To learn more about TruEra Diagnostics, visit https://truera.com/diagnostics/.

About TruEra
TruEra helps companies to build and maintain better ML models, faster. TruEra provides the first suite of AI Quality solutions that help enterprises analyze machine learning, improve and monitor model quality, and build trust. Powered by enterprise-class Artificial Intelligence (AI) Explainability technology based on six years of research at Carnegie Mellon University, the TruEra platform helps eliminate the black box surrounding widely used AI and ML technologies. This visibility leads to higher quality, explainable models that sustainably achieve measurable business results, address unfair bias, and ensure governance and compliance. To learn more, visit truera.com.

Media contact:
Michelle Faulkner
Big Swing
617-510-6998
michelle@big-swing.com 

A photo accompanying this announcement is available at https://www.globenewswire.com/NewsRoom/AttachmentNg/ec58b51a-739d-4392-baa0-14e3596fb2e0


truera_diagnostics_2_modelsummary_1280x960_v_3_720