A Risk Sciences International Case Study

Methodology for Developing Risk Significance Insights

Machine learning

Client: Canadian Nuclear Safety Commission

Listing of the client in no way affirms the client's support, sponsorship, or validation in any form of Risk Sciences International or the RSI staff member(s) who conducted this project during their stay with RSI or prior to joining the company. This case study is displayed for informative purposes only to demonstrate the capacity of RSI staff members. This case study reveals no proprietary information or information deemed sensitive.

Project description:

Methodology for Developing Risk Significance Insights

The project centered on supporting the development of a methodology that could eventually be implemented as an Artificial Intelligence (AI) or Machine Learning (ML) process. The objective was to help formalize and potentially automate how professional judgment is applied when determining the risk significance of non-compliant findings within the Canadian nuclear regulatory framework. Specifically, the work aimed to capture the rationale and reasoning used by technical staff when applying risk significance rankings, particularly for findings that contribute to the annual Regulatory Oversight Report.

The requested methodology needed to identify and structure elements of professional thought processes—such as expert judgment, experience, and contextual factors—that are typically used to assess safety significance across various safety and control areas. Furthermore, the methodology was expected to facilitate more granular and consistent rankings of safety significance. It was also designed to be adaptive, improving over time as more data became available.

The deliverables were designed to lay the groundwork for a future digital solution that could support staff assessments and potentially improve internal consistency and transparency.

Start: 2023

End: 2023

Experts related to this case study

Greg Paoli

CEO, Principal Risk Scientist

Greg Paoli is the CEO and Principal Risk Scientist at Risk Sciences International (RSI), a firm he co-founded in 2006 following the integration of his earlier consultancy, Decisionalysis Risk Consultants, with the consulting activities of the McLaughlin Centre for Population...
Read More about Greg Paoli

More RSI Case Studies

RSI presents a very small selection of case studies to highlight some of its key work.

Risk-Based Optimization of Enforcement Activities

A federal agency required scientific support to enhance the effectiveness of its environmental enforcement activities. This involved identifying and analyzing the risk factors—both environmental and human health-related—that contribute to the likelihood and impact of regulatory offences. The objective was to...
Read More about Risk-Based Optimization of Enforcement Activities

Contraceptive recall review

Health Canada requested an external review following significant public criticism of its handling of a pharmaceutical recall. The case involved a contraceptive drug that was withdrawn due to packaging errors, and the department faced questions about whether it had acted...
Read More about Contraceptive recall review

Food safety risk analysis tools

The World Health Organization and the Food and Agriculture Organization of the United Nations asked RSI to develop a suite of online tools to support food regulators and the food industry in applying risk-based approaches to food safety. These organizations...
Read More about Food safety risk analysis tools

Technical Support for Risk-Based Decision Making (RBDM)

To enhance the oversight of cannabis production under its regulatory mandate, the Cannabis Directorate sought expert support in developing a risk-based decision-making framework tailored to its compliance and enforcement responsibilities. The directorate aimed to better assess and respond to non-conformance...
Read More about Technical Support for Risk-Based Decision Making (RBDM)

International newspaper rethink

The International Herald Tribune (IHT) sought guidance at a time of profound change in the media landscape. With the World Wide Web emerging and competition intensifying from global and regional editions of established outlets such as The Economist, The Wall...
Read More about International newspaper rethink

Risk-Based Decision-Making (RBDM) Support for Plasma Supply / Sufficiency

Facing renewed challenges in securing a reliable domestic plasma supply, Canadian Blood Services sought support to apply a Risk-Based Decision-Making (RBDM) framework. The objective was to assess the value and implications of expanding domestic plasma collection and processing capacity in...
Read More about Risk-Based Decision-Making (RBDM) Support for Plasma Supply / Sufficiency

Update of WHO Guidance on Food Defense

To support international efforts in mitigating deliberate threats to the food system, the World Health Organization commissioned an update to its earlier guidance titled Terrorist Threats to Food. The revision aimed to broaden the original scope by addressing not only...
Read More about Update of WHO Guidance on Food Defense

Risk Communication on McIntyre Powder

In response to increasing public concern about the historical use of McIntyre Powder—an aluminum-based substance once administered to miners in Ontario to prevent silicosis—the client sought expert guidance on managing risk communication related to potential health implications. Widespread media coverage...
Read More about Risk Communication on McIntyre Powder

Evaluation of Drug Recall Communication and Risk Determination Processes

In response to public and ministerial concerns about the timeliness and adequacy of information shared during a major prescription drug recall, Health Canada commissioned an independent review to assess its response to the event. The situation involved a recall of...
Read More about Evaluation of Drug Recall Communication and Risk Determination Processes

Assessing the Impact of Interstudy Variation in LOAELs on Findings of Low-Dose Additivity in In Vivo Studies of Mixtures

Demonstrating the safe use of chemical mixtures remains a critical challenge in toxicological science. In recent years, studies have suggested that chemicals can exhibit dose additivity—causing a combined effect—even when each chemical individually is below its effect threshold. This project...
Read More about Assessing the Impact of Interstudy Variation in LOAELs on Findings of Low-Dose Additivity in In Vivo Studies of Mixtures

Evaluation of Health Product Risk Communication Tools

To enhance the effectiveness of health product risk communications, a systematic evaluation was requested to assess the performance of key instruments used to disseminate safety and efficacy information. The aim was to support efforts under the Evaluating the Effectiveness of...
Read More about Evaluation of Health Product Risk Communication Tools

Institutional & communications assessment

In the mid-1990s the International Organization for Migration (IOM) faced one of the most pivotal moments in its history. Though it counted 76 member states, it remained outside the United Nations system, and its work was increasingly perceived to overlap...
Read More about Institutional & communications assessment

Food Inspection Scientific Analysis & Risk Modelling

In support of ongoing efforts to modernize Canada's food inspection system, a request was issued for scientific and analytical expertise to enhance two critical risk-based decision tools: the Establishment-based Risk Assessment (ERA) and Importer Risk Assessment (IRA) models. These models...
Read More about Food Inspection Scientific Analysis & Risk Modelling

Validation and Optimization of the Computational Tool for the Microbial Risk Assessment Framework (MRAF)

To support more consistent and quantitative assessments of new micro-organisms under the Canadian Environmental Protection Act, Health Canada's New Substances Program (NSP) sought to refine the tools and processes within its Microbial Risk Assessment Framework (MRAF). The NSP had previously...
Read More about Validation and Optimization of the Computational Tool for the Microbial Risk Assessment Framework (MRAF)

Developing a Risk-Based Compliance Framework for Digital Service Delivery

The Financial Consumer Agency of Canada (FCAC) engaged Risk Sciences International to provide strategic advisory services aimed at enhancing its regulatory compliance model through risk-based methodologies. FCAC’s objective was to explore new approaches that would integrate digital tools and data-driven...
Read More about Developing a Risk-Based Compliance Framework for Digital Service Delivery

Risk Model Framework for Foodborne Campylobacteriosis via Poultry Meat Pathway

To support national public health goals, RSI was tasked with developing a quantitative microbiological risk assessment (QMRA) model to estimate the human health risks associated with the consumption of chicken in New Zealand. The core objective was to quantify the...
Read More about Risk Model Framework for Foodborne Campylobacteriosis via Poultry Meat Pathway

Communication material on lithium in drinking water and health risks

To support public communication around emerging drinking water concerns, RSI was engaged to develop accessible, scientifically grounded materials on lithium exposure and its potential health effects. The work focused on equipping stakeholders with clear, credible information that could inform both...
Read More about Communication material on lithium in drinking water and health risks