The Guide for assessing research involving Artificial Intelligence, Machine Learning and Large Language Model Technology (collectively “AI”) has been developed by the Australian Health Ethics Committee for use by researchers and ethics review bodies when developing and assessing proposals for research involving AI.
This document includes guidance and a question-based tool to assist researchers in thinking through how they are integrating the use of AI into all phases of their research proposal from discovery to publication. Ethics review bodies will then be able to assess whether the information provided by researchers adequately captures the researchers’ use of AI and the relevant ethical considerations that are associated with those uses.
In the context of an overall focus on assessment of risk, both to individuals and to the community, the guide highlights the need for researchers and reviewers to consider 6 areas of concern:
- human agency/oversight
- transparency/explainability
- bias/representativeness
- technical robustness/safety
- data reliability
- data governance/security
Researchers and reviewers are then directed to focus on how AI will be used in the research and at what stages of research. The tool proposes 7 broad questions for consideration accompanied by prompts to provide more detailed information.
The guide is intended to facilitate a reflective process and a spirit of mindfulness as the use of AI becomes central to the conduct of human research and raises novel and challenging ethical issues.
From the guide:
The transformational nature of the advent of AI in research will require all its users to be mindful of the potentially far-reaching impact of decisions about AI use on our societies. It requires us to reflect on what we are doing with AI, be responsible for what we do with it, and be diligent about maintaining the standards that are established for its use, including relevant institutional policies and procedures.
As the use of AI will become increasingly normalised, NHMRC anticipates that this guide will need amendment to reflect developments in research involving AI and invites feedback from users about its usefulness and currency.
For further information, please contact the Ethics and Integrity section at ethics@nhmrc.gov.au