A Risk Sciences International Case Study

Methodology for Developing Risk Significance Insights

Machine learning

Client: Canadian Nuclear Safety Commission

Listing of the client in no way affirms the client's support, sponsorship, or validation in any form of Risk Sciences International or the RSI staff member(s) who conducted this project during their stay with RSI or prior to joining the company. This case study is displayed for informative purposes only to demonstrate the capacity of RSI staff members. This case study reveals no proprietary information or information deemed sensitive.

Project description:

Methodology for Developing Risk Significance Insights

The project centered on supporting the development of a methodology that could eventually be implemented as an Artificial Intelligence (AI) or Machine Learning (ML) process. The objective was to help formalize and potentially automate how professional judgment is applied when determining the risk significance of non-compliant findings within the Canadian nuclear regulatory framework. Specifically, the work aimed to capture the rationale and reasoning used by technical staff when applying risk significance rankings, particularly for findings that contribute to the annual Regulatory Oversight Report.

The requested methodology needed to identify and structure elements of professional thought processes—such as expert judgment, experience, and contextual factors—that are typically used to assess safety significance across various safety and control areas. Furthermore, the methodology was expected to facilitate more granular and consistent rankings of safety significance. It was also designed to be adaptive, improving over time as more data became available.

The deliverables were designed to lay the groundwork for a future digital solution that could support staff assessments and potentially improve internal consistency and transparency.

Start: 2023

End: 2023

Experts related to this case study

Greg Paoli

CEO, Principal Risk Scientist

Greg Paoli is the CEO and Principal Risk Scientist at Risk Sciences International (RSI), a firm he co-founded in 2006 following the integration of his earlier consultancy, Decisionalysis Risk Consultants, with the consulting activities of the McLaughlin Centre for Population...
Read More about Greg Paoli

More RSI Case Studies

RSI presents a very small selection of case studies to highlight some of its key work.

Pickering Nuclear Facility Re‑licensing

The client sought support to finalize a Commission Member Document (CMD) for the re‑licensing of a nuclear facility. Recognizing the complexity and sensitivity of reactor re‑licensing, they requested assistance in crafting communication materials that were both technically comprehensive and accessible...
Read More about Pickering Nuclear Facility Re‑licensing

Risk Assessment of the Impact of Lethality Standards on Salmonellosis from Ready-to-Eat (RTE) Meat and Poultry Products

To support regulatory decision-making, a comprehensive risk assessment was conducted to evaluate how varying lethality performance standards would impact the public health burden of salmonellosis associated with Ready-to-Eat (RTE) meat and poultry products. The primary objective was to quantify the...
Read More about Risk Assessment of the Impact of Lethality Standards on Salmonellosis from Ready-to-Eat (RTE) Meat and Poultry Products

International newspaper rethink

The International Herald Tribune (IHT) sought guidance at a time of profound change in the media landscape. With the World Wide Web emerging and competition intensifying from global and regional editions of established outlets such as The Economist, The Wall...
Read More about International newspaper rethink

External Peer Consultation of the Inorganic – Late Biomonitoring Approach Draft Screening Assessment Report

To support the Chemicals Management Plan under the Canadian Environmental Protection Act (CEPA), Health Canada sought expert peer consultation for a draft screening assessment report (DSAR) evaluating 47 inorganic substances identified as priorities. The client required independent scientific and technical...
Read More about External Peer Consultation of the Inorganic – Late Biomonitoring Approach Draft Screening Assessment Report

Analysis in Support of Risk-Based Decision-Making for the Alberta Safety Codes Council

An independent regulatory organization responsible for oversight of Alberta’s safety codes system sought to strengthen its capacity for risk-based decision-making. The organization aimed to ensure that regulatory actions—particularly in the area of petroleum storage tanks—were guided by clear, evidence-based prioritization...
Read More about Analysis in Support of Risk-Based Decision-Making for the Alberta Safety Codes Council

Update of WHO Guidance on Food Defense

To support international efforts in mitigating deliberate threats to the food system, the World Health Organization commissioned an update to its earlier guidance titled Terrorist Threats to Food. The revision aimed to broaden the original scope by addressing not only...
Read More about Update of WHO Guidance on Food Defense

Environmental Health Factors, Chronic Diseases, and Pandemic Resilience

To support more effective health policy and pandemic preparedness, this project examined how environmental health factors intersect with chronic disease and influence pandemic resilience. The client sought evidence to clarify how exposures to contaminants in air, water, and soil contribute...
Read More about Environmental Health Factors, Chronic Diseases, and Pandemic Resilience

Applying New Assessment Methods (NAMs) for Assessing Semi-Volatile Organic Compounds (SVOCs) in Indoor Residential Environments

Health Canada sought expert support in advancing its efforts to develop screening values for semi-volatile organic compounds (SVOCs) commonly found in residential indoor environments. Previous work on indoor air contaminants had focused on volatile organic compounds (VOCs), where screening values...
Read More about Applying New Assessment Methods (NAMs) for Assessing Semi-Volatile Organic Compounds (SVOCs) in Indoor Residential Environments

Evaluation of Toxicological Data on Experior

To support the evaluation of a new veterinary pharmaceutical product intended for use in bovines, a scientific review was requested of submitted toxicological data related to the active compound LY488756. This compound, proposed under the product name Experior, had been...
Read More about Evaluation of Toxicological Data on Experior

Airport traffic flow and signage review

An international airport authority sought a comprehensive assessment of passenger and vehicle traffic flow after receiving complaints of confusion and safety concerns. Reports indicated that passengers were struggling to interpret signage, often stopping too long to process graphics, which caused...
Read More about Airport traffic flow and signage review

Evaluation of Health Product Risk Communication Tools

To enhance the effectiveness of health product risk communications, a systematic evaluation was requested to assess the performance of key instruments used to disseminate safety and efficacy information. The aim was to support efforts under the Evaluating the Effectiveness of...
Read More about Evaluation of Health Product Risk Communication Tools

Systematic Review of Artificial Sweeteners and Health Risks

A comprehensive systematic review was undertaken to assess experimental evidence regarding the potential health risks associated with artificial sweeteners, specifically focusing on cancer and pre-term delivery. The client sought a rigorous analysis of both in vivo and in vitro experimental...
Read More about Systematic Review of Artificial Sweeteners and Health Risks

Risk-based decision making framework

The Alliance of Blood Operators (ABO) sought to move its members toward a consistent, transparent approach to risk-based decision-making. Having worked through the development of a framework, the organization now wanted formal adoption, external validation, and practical application to real-world...
Read More about Risk-based decision making framework

Finalization of Risk Assessment on Secure Opioid Dispensing Devices

To support decision-making around modifications to opioid agonist treatment delivery, a detailed risk assessment was requested to evaluate the integration of secure dispensing devices for direct patient access to hydromorphone. Building on a previously conducted preliminary assessment, the work required...
Read More about Finalization of Risk Assessment on Secure Opioid Dispensing Devices

Wildfire and residential smoke risk communication

Government authorities faced recurring challenges in communicating health risks from smoke caused by both wildfires and residential burning. While these events were becoming more frequent and more severe, the public health messages often failed to resonate with affected communities or...
Read More about Wildfire and residential smoke risk communication

Characterizing uncertainty in MAF values estimated using the KEMI MAF

The client sought to improve understanding of uncertainties surrounding the application of mixture assessment factors (MAFs) for aquatic receptors, specifically those estimated using the KEMI methodology. While the KEMI MAF approach is considered technically robust, its assumptions—particularly about chemical-specific controls,...
Read More about Characterizing uncertainty in MAF values estimated using the KEMI MAF

Institutional & communications assessment

In the mid-1990s the International Organization for Migration (IOM) faced one of the most pivotal moments in its history. Though it counted 76 member states, it remained outside the United Nations system, and its work was increasingly perceived to overlap...
Read More about Institutional & communications assessment

Risk-Based Decision Making (RBDM) Compliance and Enforcement

Innovation, Science and Economic Development Canada (ISED), through its Spectrum Management Innovation Directorate, sought support in applying risk-based decision making (RBDM) across its compliance and enforcement responsibilities. The department was looking for a structured and data-driven approach to prioritize regulatory...
Read More about Risk-Based Decision Making (RBDM) Compliance and Enforcement