Clinical trials are critical to understanding the benefits of new treatments and medical therapies, but researchers say people who design and run clinical trials need to lift their game when it comes to recording and reporting harms.
In a Medical Journal of Australia article, the researchers examined how inadequate reporting may over or underestimate harms of treatments.
The article also includes recommendations on how clinical trial protocol and reporting guidelines can be improved. A more consistent and transparent way of reporting harms is important to help patients, clinicians and policy makers have the best possible data to base their decisions on.
“There are many benefits to being involved in clinical trials – they are an invaluable part of the development of new medical treatments and therapies,” says lead author Dr Christina Abdel Shaheed from Sydney Musculoskeletal Health at the University of Sydney.
“Improvements in the reporting of harms are important to give participants more confidence in their involvement. It also creates more transparent evidence to guide safe and effective use of treatments for both the scientific community and for the public.”
In the medical field, harms can be classified as either ‘adverse events’ or ‘adverse reactions’. Both terms describe untoward medical occurrences in a trial, but the second term is reserved for events possibly caused by the treatment.
Adverse events vary widely and can range from mild, such as headaches, to serious adverse events that result in hospitalisation, disability, increasing the length of hospitalisation, birth anomaly or death.
A key problem is that information on harms is absent or reported inconsistently in many clinical trials, warranting efforts to strengthen reporting of harms globally. This includes no universal definition of ‘harms’ that applies to all treatments.
Another under-recognised problem is the lack of harms reporting in clinical trials that do not involve medicines. This problem is common in physical, psychological and behavioural trials. Examples include physiotherapy trials for back pain or behavioural therapy trials for attention-deficit/hyperactivity disorder.
Inconsistent reporting of harms in clinical trials creates an incomplete picture of a treatment’s risks, which has a downstream effect to researchers, clinicians and the public, when reviewing the available evidence on potential treatments.
The current reporting guideline in place for randomised controlled trials is the CONSORT checklist. While this encourages the reporting of harms in clinical trials, reporting practices are inconsistent globally. Details of the type of harms, and cause of serious harms is absent or inconsistent in published trial reports.
The researchers say a possible contributor to the problem is that policy documents, for example from the National Health and Medical Research Council (NHMRC), define adverse events with regard to administering a medicine or medical device. There is need for a broader definition of harms that applies to all treatments, not just medicines and medical devices.
The gaps in reporting of harms have been highlighted by recent large reviews, which reveal there are significant problems measuring and reporting adverse events in non-drug trials.
In 2021, a review of 249 trials evaluating exercise for chronic low back pain found that only 12 trials measured any adverse events in a consistent way.
In a 2022 review of psychological interventions for chronic back pain, only about 20 percent of the 97 trials included reported adverse events, and most reported that no adverse events occurred. Some researchers cite the ‘low risk’ nature of the treatment as the reason for not collecting information on harms.
“This needs to change as it can help perpetuate a belief that non-drug treatments are generally ‘safe’. We don’t actually know what the risks are if information on harms is not being collected and reported,” said Dr Abdel Shaheed.
“Improvements in the reporting of harms are important to give participants more confidence in their involvement…”
Change to guidelines need to start at the beginning
The researchers say change is needed from the very beginning, when planning a clinical trial not when the clinical trial has finished and is being reported.
“There is a need to improve transparency in clinical trial reporting, beginning from the trial design, registration and protocol development stages through to providing the summary of results and other trial materials,” said co-author Professor Andrew McLachlan, Head of School and Dean of Pharmacy at the University of Sydney.
“Clearer guidelines will support researchers to report the benefits and harms of new treatments in a balanced and authentic manner.”
The researchers have provided a list of recommendations on the reporting of harms in clinical trials to standardise reporting across all types of treatments being tested.
These include:
- Standard reporting strategy for all trials evaluating:
- medicines or medical devices (including complementary, alternative medicines)
- psychological or behavioural interventions (including digital – therapeutics)
- surgical procedures
- physical therapies
- Proportion of people experiencing, and frequency of, serious and non-serious adverse events that occur during and after the therapy or medication has been administered.
- Attribute the cause of severe adverse events..
- Where feasible, identify cause of non-serious adverse events.
- Correctly labelling adverse events or serious adverse events caused by the treatment as an adverse reaction or serious adverse reaction.
Declaration: The authors declare no competing interests.