Verify
Back to search

Algorithm Reproducibility Process

Company:

UL Solutions

Verify ID:

A194205

Expiration date:

September 09, 2020 - September 08, 2026

Verification Mark

Process Information

Establishing the trustworthiness of an algorithm (especially machine learning-based algorithms) that claims to accurately predict an outcome based on certain inputs is important and yet challenging as there are currently no clearly defined standards.  The algorithm reproducibility process claim Verification program is the first independent assessment designed to help support the deployment of trustworthy algorithms.  The algorithm reproducibility process claim verification follows the same general practice for peer-reviewed scientific claims.  The process requires full access to all data, data-processing, model details, deployment plans and personnel so that the reproducibility can be demonstrated by an independent reviewer.  Though reproducibility is only a necessary condition for trustworthiness, it is an important first step.

Click here to learn more about Predictive Modeling and Simulation at UL

Applicable To:

This program is available to any company that has created an algorithm that is a critical component in determining the performance of a manufactured hardware product or system.

Marketing Claim Verified by UL Solutions

-Algorithm Name- Algorithm Reproducibility Process Verified

Verification Method

The reproducibility offering of the UL Trustworthiness program demonstrates the openness of the product (algorithm) developer to allow full access to product requirements, data, and expert explanations to assess the entire product development and deployment processes for products where algorithms (machine learning or rule-based) are responsible for critical functions. The assessment is based on a complete review of all aspects of the algorithm building and deployment processes: detailed scoping of the application, description of the dataset, appropriateness of performance metrics, controls implemented in deployment, tracking of algorithm performance in production, all grounded on best-practices in predictive modeling and UL specific learnings. The full trustworthiness assessment includes technical analyses based on evidence to support the manufacturer’s claims about the algorithm’s performance, for when the product is deployed for its intended purpose. UL does not provide any representation or guarantee that the product cannot be misused or exhibit unexpected failure modes during deployment.

What is UL Verification?

UL Verification is an objective, science-based assessment that confirms the accuracy of marketing claims. Our independent assessment process scrutinizes the validity of specific advertising or promotional statements, giving you a way to separate verified fact from fiction.

Support