Ioannidis’ old news and bad idea

Earlier this morning I put a link to press release by Stanford University relating a new paper by John Ioannnidis and Shanil Ebrahim, published yesterday at JAMA. I did not read the paper yet, but I am concerned with what was communicated in the PR, and hope that te message in the paper is different.

The PR title says that “Re-analysis of clinical trial data can change conclusions“, and these are old news. It is true for any data: analyze it using a different statistical method, get a different result. A really nasty and evil statistician can even introduce many sources of bias to get whatever results he wants to present.

Ioannidis’ solution: release the clinical data to the public so anyone will be able to analyze it. And I add to that: so everyone will be able to tweak analyses and introduce any bias they like in order to present any result they want.

There is a reason why the statistical methods for a clinical trial are set in the trial’s protocol, before the first subject is even screened. Protocols also include sensitivity analyses, and all the results, including the data are eventually reviewed by the regulatory authorities, who perform they own sensitivity analyses. To my opinion, this is sufficient to maintain the integrity of the trial results. Letting everyone to introduce bias will just harm the credibility of clinical trials and science.

Advertisements

A world without statistics

Andrew Gelman thinks that a world without statistics wouldn’t be much different from the world we have now. I disagree. Such a world could be one in which Germany and Japan won WWII. In terms of scientific and technological progress, lots of progress would have been missing. It would be a world with less medications and vaccines, and more diseases. It would be a world in which risk can’t be managed. It would be a really different world, and not for the better. What do you think?
A world without statistics

What Is Statistics? Some answers by Stephen E. Fienberg

“What is Statistics” may look like a simple question, but everyone familiar with the discipline knows the complications, and Steve Fienberg Is off course aware to the difficulties that many scholars faced in the past when trying to get an answer. In a recently published paper at The Annual Review of Statistics and Its Application, Fienberg captures the essence of some of these efforts and puts them in historical context. In the process, he focuses on the cross-disciplinary nature of much modern statistical research.
What Is Statistics? Some answers by Stephen E. Fienberg