Publication related to RSI or an RSI staff member

A value of information framework for assessing the trade-offs associated with uncertainty, duration, and cost of chemical toxicity testing.

A number of investigators have explored the use of value of information (VOI) analysis to evaluate alternative information collection procedures in diverse decision-making contexts. This paper presents an analytic framework for determining the value of toxicity information used in risk-based decision making. The framework is specifically designed to explore the trade-offs between cost, timeliness, and uncertainty reduction associated with different toxicity-testing methodologies. The use of the proposed framework is demonstrated by two illustrative applications which, although based on simplified assumptions, show the insights that can be obtained through the use of VOI analysis. Specifically, these results suggest that timeliness of information collection has a significant impact on estimates of the VOI of chemical toxicity tests, even in the presence of smaller reductions in uncertainty. The framework introduces the concept of the expected value of delayed sample information, as an extension to the usual expected value of sample information, to accommodate the reductions in value resulting from delayed decision making. Our analysis also suggests that lower cost and higher throughput testing also may be beneficial in terms of public health benefits by increasing the number of substances that can be evaluated within a given budget. When the relative value is expressed in terms of return-on-investment per testing strategy, the differences can be substantial.

Authors

  • Hagiwara, Shintaro, Hagiwara S, Risk Sciences International, Ottawa, Canada.; School of Mathematics and Statistics, Carleton University, Ottawa, Canada.

  • Paoli, Greg M, Paoli GM, Risk Sciences International, Ottawa, Canada.

  • Price, Paul S, Price PS, Center for Compuational Toxicology and Exposure, Office of Research and Development, US Environmental Protection Agency, Research Triangle Park, North Carolina, USA.

  • Gwinn, Maureen R, Gwinn MR, Office of Research and Development, US Environmental Protection Agency, Research Triangle Park, North Carolina, USA.

  • Guiseppi-Elie, Annette, Guiseppi-Elie A, Center for Compuational Toxicology and Exposure, Office of Research and Development, US Environmental Protection Agency, Research Triangle Park, North Carolina, USA.

  • Farrell, Patrick J, Farrell PJ, School of Mathematics and Statistics, Carleton University, Ottawa, Canada.

  • Hubbell, Bryan J, Hubbell BJ, Air, Climate, and Energy Research Program, Office of Research and Development, US Environmental Protection Agency, Research Triangle Park, North Carolina, USA.

  • Krewski, Daniel, Krewski D, Risk Sciences International, Ottawa, Canada.; McLaughlin Centre for Population Health Risk Assessment, University of Ottawa, Ottawa, Canada.

  • Thomas, Russell S, Thomas RS, Center for Compuational Toxicology and Exposure, Office of Research and Development, US Environmental Protection Agency, Research Triangle Park, North Carolina, USA.

YEAR OF PUBLICATION: 2023
SOURCE: Risk Anal. 2023 Mar;43(3):498-515. doi: 10.1111/risa.13931. Epub 2022 Apr 22.
JOURNAL TITLE ABBREVIATION: Risk Anal
JOURNAL TITLE: Risk analysis : an official publication of the Society for Risk Analysis
ISSN: 1539-6924 (Electronic) 0272-4332 (Print) 0272-4332 (Linking)
VOLUME: 43
ISSUE: 3
PAGES: 498-515
PLACE OF PUBLICATION: United States
ABSTRACT:
A number of investigators have explored the use of value of information (VOI) analysis to evaluate alternative information collection procedures in diverse decision-making contexts. This paper presents an analytic framework for determining the value of toxicity information used in risk-based decision making. The framework is specifically designed to explore the trade-offs between cost, timeliness, and uncertainty reduction associated with different toxicity-testing methodologies. The use of the proposed framework is demonstrated by two illustrative applications which, although based on simplified assumptions, show the insights that can be obtained through the use of VOI analysis. Specifically, these results suggest that timeliness of information collection has a significant impact on estimates of the VOI of chemical toxicity tests, even in the presence of smaller reductions in uncertainty. The framework introduces the concept of the expected value of delayed sample information, as an extension to the usual expected value of sample information, to accommodate the reductions in value resulting from delayed decision making. Our analysis also suggests that lower cost and higher throughput testing also may be beneficial in terms of public health benefits by increasing the number of substances that can be evaluated within a given budget. When the relative value is expressed in terms of return-on-investment per testing strategy, the differences can be substantial.
COPYRIGHT INFORMATION: (c) 2022 Risk Sciences International. Risk Analysis published by Wiley Periodicals||LLC on behalf of Society for Risk Analysis. This article has been contributed to||by U.S. Government employees and their work is in the public domain in the USA.
LANGUAGE: eng
DATE OF PUBLICATION: 2023 Mar
DATE OF ELECTRONIC PUBLICATION: 20220422
DATE COMPLETED: 20230321
DATE REVISED: 20250530
MESH DATE: 2023/03/22 06:00
EDAT: 2022/04/24 06:00
STATUS: MEDLINE
PUBLICATION STATUS: ppublish
LOCATION IDENTIFIER: 10.1111/risa.13931 [doi]
MANUSCRIPT IDENTIFIER: NIHMS1894119
OWNER: NLM

Related RSI Experts

Greg Paoli

CEO, Principal Risk Scientist

Greg Paoli is the CEO and Principal Risk Scientist at Risk Sciences International (RSI), a firm he co-founded in 2006 following the integration of his earlier consultancy, Decisionalysis Risk Consultants, with the consulting activities of the McLaughlin Centre for Population...
Read More about Greg Paoli

Daniel Krewski

Chief Risk Scientist

Dr. Daniel Krewski is Chief Risk Scientist and co-founder of Risk Sciences International (RSI), a firm established in 2006 to bring evidence-based, multidisciplinary expertise to the challenge of understanding, managing, and communicating risk. As RSI’s inaugural CEO and long-time scientific...
Read More about Daniel Krewski

Paul Price

Senior Analyst

Dr. Paul Price is a Senior Analyst at Risk Sciences International (RSI), bringing over four decades of experience as a pioneer in exposure science and chemical risk assessment. Since joining RSI in 2019, Dr. Price has focused on advancing mixture...
Read More about Paul Price

Shintaro Hagiwara

Risk Analyst, Statistician

Dr. Shintaro Hagiwara is a Risk Analyst and Statistician at Risk Sciences International (RSI), where he contributes cutting-edge statistical insight to risk assessments, particularly in chemical safety and public health. Since joining RSI’s technical team in 2018 and transitioning to...
Read More about Shintaro Hagiwara