A Risk Sciences International Case Study

Methodology for Developing Risk Significance Insights

Machine learning

Client: Canadian Nuclear Safety Commission

Listing of the client in no way affirms the client's support, sponsorship, or validation in any form of Risk Sciences International or the RSI staff member(s) who conducted this project during their stay with RSI or prior to joining the company. This case study is displayed for informative purposes only to demonstrate the capacity of RSI staff members. This case study reveals no proprietary information or information deemed sensitive.

Project description:

Methodology for Developing Risk Significance Insights

The project centered on supporting the development of a methodology that could eventually be implemented as an Artificial Intelligence (AI) or Machine Learning (ML) process. The objective was to help formalize and potentially automate how professional judgment is applied when determining the risk significance of non-compliant findings within the Canadian nuclear regulatory framework. Specifically, the work aimed to capture the rationale and reasoning used by technical staff when applying risk significance rankings, particularly for findings that contribute to the annual Regulatory Oversight Report.

The requested methodology needed to identify and structure elements of professional thought processes—such as expert judgment, experience, and contextual factors—that are typically used to assess safety significance across various safety and control areas. Furthermore, the methodology was expected to facilitate more granular and consistent rankings of safety significance. It was also designed to be adaptive, improving over time as more data became available.

The deliverables were designed to lay the groundwork for a future digital solution that could support staff assessments and potentially improve internal consistency and transparency.

Start: 2023

End: 2023

Experts related to this case study

Greg Paoli

CEO, Principal Risk Scientist

Greg Paoli is the CEO and Principal Risk Scientist at Risk Sciences International (RSI), a firm he co-founded in 2006 following the integration of his earlier consultancy, Decisionalysis Risk Consultants, with the consulting activities of the McLaughlin Centre for Population...
Read More about Greg Paoli

More RSI Case Studies

RSI presents a very small selection of case studies to highlight some of its key work.

Institutional & communications assessment

In the mid-1990s the International Organization for Migration (IOM) faced one of the most pivotal moments in its history. Though it counted 76 member states, it remained outside the United Nations system, and its work was increasingly perceived to overlap...
Read More about Institutional & communications assessment

Risk Communication on McIntyre Powder

In response to increasing public concern about the historical use of McIntyre Powder—an aluminum-based substance once administered to miners in Ontario to prevent silicosis—the client sought expert guidance on managing risk communication related to potential health implications. Widespread media coverage...
Read More about Risk Communication on McIntyre Powder

Age-Related Cognitive Decline: Systematic Review and Meta-Analysis

The College of Physicians & Surgeons of Alberta (CPSA) commissioned a systematic review and meta-analysis to support evidence-informed decision-making around age-related cognitive decline among practicing physicians. The initiative was led by CPSA’s Physician Health Monitoring Program (PHMP), which sought to...
Read More about Age-Related Cognitive Decline: Systematic Review and Meta-Analysis

Pickering Nuclear Facility Re‑licensing

The client sought support to finalize a Commission Member Document (CMD) for the re‑licensing of a nuclear facility. Recognizing the complexity and sensitivity of reactor re‑licensing, they requested assistance in crafting communication materials that were both technically comprehensive and accessible...
Read More about Pickering Nuclear Facility Re‑licensing

Technical Support for Risk-Based Decision Making (RBDM)

To enhance the oversight of cannabis production under its regulatory mandate, the Cannabis Directorate sought expert support in developing a risk-based decision-making framework tailored to its compliance and enforcement responsibilities. The directorate aimed to better assess and respond to non-conformance...
Read More about Technical Support for Risk-Based Decision Making (RBDM)

Communication material on lithium in drinking water and health risks

To support public communication around emerging drinking water concerns, RSI was engaged to develop accessible, scientifically grounded materials on lithium exposure and its potential health effects. The work focused on equipping stakeholders with clear, credible information that could inform both...
Read More about Communication material on lithium in drinking water and health risks

Marine Planning and Conservation National Ecological Risk Guidance: Risk Communication Expertise

To support the refinement and implementation of its ecological risk guidance, a federal department responsible for marine conservation engaged expert assistance in risk communication. The primary objective was to ensure that the national guidance for ecological risk assessment—developed as part...
Read More about Marine Planning and Conservation National Ecological Risk Guidance: Risk Communication Expertise

Risk-Based Decision-Making (RBDM) Support for Plasma Supply / Sufficiency

Facing renewed challenges in securing a reliable domestic plasma supply, Canadian Blood Services sought support to apply a Risk-Based Decision-Making (RBDM) framework. The objective was to assess the value and implications of expanding domestic plasma collection and processing capacity in...
Read More about Risk-Based Decision-Making (RBDM) Support for Plasma Supply / Sufficiency

Validation and Optimization of the Computational Tool for the Microbial Risk Assessment Framework (MRAF)

To support more consistent and quantitative assessments of new micro-organisms under the Canadian Environmental Protection Act, Health Canada's New Substances Program (NSP) sought to refine the tools and processes within its Microbial Risk Assessment Framework (MRAF). The NSP had previously...
Read More about Validation and Optimization of the Computational Tool for the Microbial Risk Assessment Framework (MRAF)

Systematic Review of Artificial Sweeteners and Health Risks

A comprehensive systematic review was undertaken to assess experimental evidence regarding the potential health risks associated with artificial sweeteners, specifically focusing on cancer and pre-term delivery. The client sought a rigorous analysis of both in vivo and in vitro experimental...
Read More about Systematic Review of Artificial Sweeteners and Health Risks

Development of a National Food Safety Information System and Risk Assessment Capacity in Vietnam

Authorities in Vietnam sought targeted expertise to strengthen the country’s ability to detect, assess, and respond to food safety threats. This initiative had two linked objectives: building a comprehensive, transparent, and reliable national food safety information system, and enhancing risk...
Read More about Development of a National Food Safety Information System and Risk Assessment Capacity in Vietnam

Update of WHO Guidance on Food Defense

To support international efforts in mitigating deliberate threats to the food system, the World Health Organization commissioned an update to its earlier guidance titled Terrorist Threats to Food. The revision aimed to broaden the original scope by addressing not only...
Read More about Update of WHO Guidance on Food Defense

Food safety risk analysis tools

The World Health Organization and the Food and Agriculture Organization of the United Nations asked RSI to develop a suite of online tools to support food regulators and the food industry in applying risk-based approaches to food safety. These organizations...
Read More about Food safety risk analysis tools

Risk-based decision making framework

The Alliance of Blood Operators (ABO) sought to move its members toward a consistent, transparent approach to risk-based decision-making. Having worked through the development of a framework, the organization now wanted formal adoption, external validation, and practical application to real-world...
Read More about Risk-based decision making framework

External Peer Consultation of the Inorganic – Late Biomonitoring Approach Draft Screening Assessment Report

To support the Chemicals Management Plan under the Canadian Environmental Protection Act (CEPA), Health Canada sought expert peer consultation for a draft screening assessment report (DSAR) evaluating 47 inorganic substances identified as priorities. The client required independent scientific and technical...
Read More about External Peer Consultation of the Inorganic – Late Biomonitoring Approach Draft Screening Assessment Report

Expansion of the Stochastic Health Canada Quantitative Microbial Risk Assessment Tool

Health Canada sought to enhance its Quantitative Microbial Risk Assessment (QMRA) tool, originally developed over 15 years ago for stakeholders responsible for drinking water systems. With advancements in probabilistic modeling and microbial risk assessment, the client required updates to reflect...
Read More about Expansion of the Stochastic Health Canada Quantitative Microbial Risk Assessment Tool

Finalization of Risk Assessment on Secure Opioid Dispensing Devices

To support decision-making around modifications to opioid agonist treatment delivery, a detailed risk assessment was requested to evaluate the integration of secure dispensing devices for direct patient access to hydromorphone. Building on a previously conducted preliminary assessment, the work required...
Read More about Finalization of Risk Assessment on Secure Opioid Dispensing Devices