A Risk Sciences International Case Study

Methodology for Developing Risk Significance Insights

Machine learning

Client: Canadian Nuclear Safety Commission

Listing of the client in no way affirms the client's support, sponsorship, or validation in any form of Risk Sciences International or the RSI staff member(s) who conducted this project during their stay with RSI or prior to joining the company. This case study is displayed for informative purposes only to demonstrate the capacity of RSI staff members. This case study reveals no proprietary information or information deemed sensitive.

Project description:

Methodology for Developing Risk Significance Insights

The project centered on supporting the development of a methodology that could eventually be implemented as an Artificial Intelligence (AI) or Machine Learning (ML) process. The objective was to help formalize and potentially automate how professional judgment is applied when determining the risk significance of non-compliant findings within the Canadian nuclear regulatory framework. Specifically, the work aimed to capture the rationale and reasoning used by technical staff when applying risk significance rankings, particularly for findings that contribute to the annual Regulatory Oversight Report.

The requested methodology needed to identify and structure elements of professional thought processes—such as expert judgment, experience, and contextual factors—that are typically used to assess safety significance across various safety and control areas. Furthermore, the methodology was expected to facilitate more granular and consistent rankings of safety significance. It was also designed to be adaptive, improving over time as more data became available.

The deliverables were designed to lay the groundwork for a future digital solution that could support staff assessments and potentially improve internal consistency and transparency.

Start: 2023

End: 2023

Experts related to this case study

Greg Paoli

CEO, Principal Risk Scientist

Greg Paoli is the CEO and Principal Risk Scientist at Risk Sciences International (RSI), a firm he co-founded in 2006 following the integration of his earlier consultancy, Decisionalysis Risk Consultants, with the consulting activities of the McLaughlin Centre for Population...
Read More about Greg Paoli

More RSI Case Studies

RSI presents a very small selection of case studies to highlight some of its key work.

Environmental Health Factors, Chronic Diseases, and Pandemic Resilience

To support more effective health policy and pandemic preparedness, this project examined how environmental health factors intersect with chronic disease and influence pandemic resilience. The client sought evidence to clarify how exposures to contaminants in air, water, and soil contribute...
Read More about Environmental Health Factors, Chronic Diseases, and Pandemic Resilience

Update of WHO Guidance on Food Defense

To support international efforts in mitigating deliberate threats to the food system, the World Health Organization commissioned an update to its earlier guidance titled Terrorist Threats to Food. The revision aimed to broaden the original scope by addressing not only...
Read More about Update of WHO Guidance on Food Defense

Food Inspection Scientific Analysis & Risk Modelling

In support of ongoing efforts to modernize Canada's food inspection system, a request was issued for scientific and analytical expertise to enhance two critical risk-based decision tools: the Establishment-based Risk Assessment (ERA) and Importer Risk Assessment (IRA) models. These models...
Read More about Food Inspection Scientific Analysis & Risk Modelling

Validation and Optimization of the Computational Tool for the Microbial Risk Assessment Framework (MRAF)

To support more consistent and quantitative assessments of new micro-organisms under the Canadian Environmental Protection Act, Health Canada's New Substances Program (NSP) sought to refine the tools and processes within its Microbial Risk Assessment Framework (MRAF). The NSP had previously...
Read More about Validation and Optimization of the Computational Tool for the Microbial Risk Assessment Framework (MRAF)

Measuring impact of zoonotic animal diseases in Canada

The Canadian Food Inspection Agency sought RSI’s support in exploring how human health impacts from zoonotic diseases could be compared consistently with other public health risks. Traditionally, animal disease control decisions relied on veterinary and economic measures, but there was...
Read More about Measuring impact of zoonotic animal diseases in Canada

Risk-Based Decision-Making (RBDM) Support for Plasma Supply / Sufficiency

Facing renewed challenges in securing a reliable domestic plasma supply, Canadian Blood Services sought support to apply a Risk-Based Decision-Making (RBDM) framework. The objective was to assess the value and implications of expanding domestic plasma collection and processing capacity in...
Read More about Risk-Based Decision-Making (RBDM) Support for Plasma Supply / Sufficiency

Characterizing uncertainty in MAF values estimated using the KEMI MAF

The client sought to improve understanding of uncertainties surrounding the application of mixture assessment factors (MAFs) for aquatic receptors, specifically those estimated using the KEMI methodology. While the KEMI MAF approach is considered technically robust, its assumptions—particularly about chemical-specific controls,...
Read More about Characterizing uncertainty in MAF values estimated using the KEMI MAF

Drinking Water Guidelines for Manganese

Establishing science-based drinking water guidelines for manganese requires integrating diverse regulatory approaches, emerging modeling tools, and evolving toxicological evidence. The client commissioned this project to systematically assess existing manganese drinking water guidelines and the scientific foundations upon which they are...
Read More about Drinking Water Guidelines for Manganese

Risk Assessment of the Impact of Lethality Standards on Salmonellosis from Ready-to-Eat (RTE) Meat and Poultry Products

To support regulatory decision-making, a comprehensive risk assessment was conducted to evaluate how varying lethality performance standards would impact the public health burden of salmonellosis associated with Ready-to-Eat (RTE) meat and poultry products. The primary objective was to quantify the...
Read More about Risk Assessment of the Impact of Lethality Standards on Salmonellosis from Ready-to-Eat (RTE) Meat and Poultry Products

Risk-based decision making framework

The Alliance of Blood Operators (ABO) sought to move its members toward a consistent, transparent approach to risk-based decision-making. Having worked through the development of a framework, the organization now wanted formal adoption, external validation, and practical application to real-world...
Read More about Risk-based decision making framework

Institutional & communications assessment

In the mid-1990s the International Organization for Migration (IOM) faced one of the most pivotal moments in its history. Though it counted 76 member states, it remained outside the United Nations system, and its work was increasingly perceived to overlap...
Read More about Institutional & communications assessment

Environmental Public Health Approach (EPHA) to Chemicals Expert Workshop

To advance the Government of Canada’s Chemicals Management Plan (CMP), a virtual expert workshop was planned and hosted to refine and evaluate a Canadian framework for the Environmental Public Health Approach (EPHA) to chemicals. The initiative focused on developing case...
Read More about Environmental Public Health Approach (EPHA) to Chemicals Expert Workshop

Contraceptive recall review

Health Canada requested an external review following significant public criticism of its handling of a pharmaceutical recall. The case involved a contraceptive drug that was withdrawn due to packaging errors, and the department faced questions about whether it had acted...
Read More about Contraceptive recall review

Wildfire and residential smoke risk communication

Government authorities faced recurring challenges in communicating health risks from smoke caused by both wildfires and residential burning. While these events were becoming more frequent and more severe, the public health messages often failed to resonate with affected communities or...
Read More about Wildfire and residential smoke risk communication

Risk-Based Decision Making (RBDM) Compliance and Enforcement

Innovation, Science and Economic Development Canada (ISED), through its Spectrum Management Innovation Directorate, sought support in applying risk-based decision making (RBDM) across its compliance and enforcement responsibilities. The department was looking for a structured and data-driven approach to prioritize regulatory...
Read More about Risk-Based Decision Making (RBDM) Compliance and Enforcement

Evaluation of Drug Recall Communication and Risk Determination Processes

In response to public and ministerial concerns about the timeliness and adequacy of information shared during a major prescription drug recall, Health Canada commissioned an independent review to assess its response to the event. The situation involved a recall of...
Read More about Evaluation of Drug Recall Communication and Risk Determination Processes

EFSA Framework for Problem Formulation

To enhance the methodological rigour of its scientific assessments, EFSA sought to develop a standardised framework for problem formulation (PF) within its non-application scientific assessment protocols. The goal was to support the planning phase of these assessments by establishing a...
Read More about EFSA Framework for Problem Formulation