By David Tuller, DrPH
Last week, I wrote about a troubling press release issued by King’s College London regarding a major study of cognitive behavioural therapy as a treatment for so-called dissociative seizures. On Friday, I sent a letter to the two communications people listed on the press release about the study, as well as to the corresponding author.
I have also written some recent posts about BMJ’s methodologically and ethically challenged pediatric study of CBT plus music therapy–here, here and here. Two weeks ago, several colleagues and I wrote a letter of concern to Professor Imti Choonara, editor-in-chief of BMJ Paediatrics Open, and Dr Fiona Godlee, editorial director of BMJ. We have not received a reply, so this morning I sent a follow-up nudge.
Both letters are posted below.
**********
Subject: Misleading press release about CODES trial
Dear Mr Booth and Ms Rianjongdee–
I am a journalist and academic fellow at the School of Public Health at the University of California, Berkeley. I frequently write about research in the domains of so-called medically unexplained symptoms. Much of my work appears on Virology Blog, a science site hosted by Professor Vincent Racaniello, a microbiologist at Columbia University. (I have cc’d Professor Racaniello on this e-mail.)
I am writing because of concern that a recent press release–about findings from the CODES trial of cognitive behavioural therapy for dissociative seizures–has presented a misleading picture of the research. Lancet Psychiatry published the study last month. The press release about the trial was posted on the Maudsley Biomedical Research Centre site on May 21st and reposted on June 3 on the KCL news site.
I wrote about troubling discrepancies between the trial results and the press release on Virology Blog this week: https://www.virology.ws/2020/06/11/trial-by-error-a-kings-college-london-press-release-hides-the-bad-news/
In a clinical trial, the primary outcome is the primary outcome for a reason–it is the outcome designated by the investigators as the most significant indicator of treatment efficacy. Secondary outcomes are just that–of secondary importance.
In CODES, the primary outcome was seizure frequency–a salient fact not disclosed in the press release, presumably because the intervention did not produce positive results for this measure. These null results for seizure frequency were mentioned in passing in the bottom half of the press release–but the status of seizure frequency as the primary outcome was not. At the same time, the modest reported improvements in some secondary indicators–out of a selection of more than a dozen–were hailed as proof of effectiveness, including in a statement from Professor Trudie Chalder, one of the co-investigators.
I plan to write more about this matter soon. To that end, here are a few questions:
1) Why did the press release not disclose that seizure frequency at 12 months after randomization was the primary outcome?
2) Why did the press release not disclose that all the reported benefits were from secondary outcomes and not the primary outcome?
3) Did the lead investigators review the press release for accuracy before it was posted?
4) Does KCL believe it is appropriate to disseminate information about clinical trial results without disclosing which outcome was designated as most significant by the investigators before they started the study?
5) In KCL’s view, does the decision to withhold key information about the primary outcome from the press release represent a commitment to core academic values, such as transparency and integrity, or a violation of them?
Thanks. I look forward to hearing from you. In addition to Professor Racaniello, I have cc’d Professor Goldstein, the corresponding author of the CODES study. For full transparency, I plan to post this letter on Virology Blog.
Best–David Tuller
David Tuller, DrPH
Senior Fellow in Public Health and Journalism
Center for Global Public Health
School of Public Health
University of California, Berkeley
**********
Subject: Awaiting response to letter of concern about CBT-music therapy paper
Dear Professor Choonara and Dr Godlee,
Two weeks ago, several colleagues and I wrote about serious methodological and ethical concerns involving a recent study in BMJ Paediatrics Open on cognitive behavioural therapy plus music therapy as a treatment for adolescents with chronic fatigue following acute EBV infection.
Since we haven’t heard back, I am following up. As we noted in our May 31st letter, the paper should be withdrawn pending a re-review and then retracted if our concerns are confirmed. Children with serious health issues, an extremely vulnerable group, deserve at least that much consideration.
(I have cc’d my colleagues: Vincent Racaniello and Mady Hornig from Columbia, John Swartzberg from Berkeley, and Jonathan Edwards from University College London.)
The science site Virology Blog, hosted by Professor Racaniello, has published three posts I have written that are critical of the paper–here, here and here. A cogent and meticulously argued comment that has been posted under the article itself raises many related points.
It is not acceptable to publish a fully powered trial that failed to meet expectations as if it were designed from the start to be a feasibility study seeking data to support a fully powered trial, as seems to have happened in this case. The other issues we raised include the following:
*The addition of a key outcome measure, post-exertional malaise, not mentioned in the trial protocol and statistical analysis plan
*The construction of a definition of “recovery” that excluded the objectively measured primary outcome, average steps taken, and relied solely on a subjective secondary outcome
*The omission in the conclusion of any mention of the poor results for the primary outcome, with both groups taking fewer steps after the trial and the intervention group performing even worse than the comparison group
*The acknowledgement by one reviewer that he had not read €œbeyond the abstract€
Again, I urge you to treat this matter with the seriousness it deserves. Decisions about children’s medical care must be based on sound and robust research–not studies marred by the kinds of flaws documented here.
For full transparency, I will post this letter on Virology Blog.
Best–David
David Tuller, DrPH
Senior Fellow in Public Health and Journalism
Center for Global Public Health
School of Public Health
University of California, Berkeley
Comments are closed.