Welcome to the Nexus of Ethics, Psychology, Morality, Philosophy and Health Care

Welcome to the nexus of ethics, psychology, morality, technology, health care, and philosophy
Showing posts with label Pseudo-studies. Show all posts
Showing posts with label Pseudo-studies. Show all posts

Wednesday, June 10, 2015

I Fooled Millions Into Thinking Chocolate Helps Weight Loss. Here's How.

By John Bohannon
i09
Originally published May 27, 2015

Here is an excerpt:

Here’s a dirty little science secret: If you measure a large number of things about a small number of people, you are almost guaranteed to get a “statistically significant” result. Our study included 18 different measurements—weight, cholesterol, sodium, blood protein levels, sleep quality, well-being, etc.—from 15 people. (One subject was dropped.) That study design is a recipe for false positives.

Think of the measurements as lottery tickets. Each one has a small chance of paying off in the form of a “significant” result that we can spin a story around and sell to the media. The more tickets you buy, the more likely you are to win. We didn’t know exactly what would pan out—the headline could have been that chocolate improves sleep or lowers blood pressure—but we knew our chances of getting at least one “statistically significant” result were pretty good.

Whenever you hear that phrase, it means that some result has a small p value. The letter p seems to have totemic power, but it’s just a way to gauge the signal-to-noise ratio in the data. The conventional cutoff for being “significant” is 0.05, which means that there is just a 5 percent chance that your result is a random fluctuation. The more lottery tickets, the better your chances of getting a false positive. So how many tickets do you need to buy?

The whole article on the scam research that fooled millions is here.

Wednesday, April 16, 2014

The strange phenomenon of the cult of facts: three case studies

By Masimo Pigliucci
Scientia Salon
Originally published March 30, 2014

Here is an excerpt:

Moreover, as a fellow Bayesian, Silver ought to know that his own analogy is ironically flawed: in Bayesian analysis you always begin with priors, and the whole point is to revise those priors as new data comes in. That is, embedded in the very fabric of the Bayesian approach [4] is that you start with beliefs, you add data (collected on the basis of your beliefs!), and end up with (likely modified) beliefs. You just can’t take the belief components out of the analysis, it’s integral to it, and it’s both affected by the data one gathers and determines which bits of information “out there” actually get to count as data.

As Wieseltier astutely observes, “Silver wishes to impugn not only the quality of opinion journalism, he wishes to impugn also its legitimacy. The new technology, which produces numbers the way plants produce oxygen, has inspired a new positivism, and he is one of its princes. He dignifies only facts … He does not recognize the calling of, or grasp the need for, public reason.”

The entire story is here.

Monday, October 28, 2013

The Dangers of Pseudoscience

By MASSIMO PIGLIUCCI and MAARTEN BOUDRY
The New York Times - Opinionator
Originally published October 10, 2013

Philosophers of science have been preoccupied for a while with what they call the “demarcation problem,” the issue of what separates good science from bad science and pseudoscience (and everything in between). The problem is relevant for at least three reasons.

The first is philosophical: Demarcation is crucial to our pursuit of knowledge; its issues go to the core of debates on epistemology and of the nature of truth and discovery. The second reason is civic: our society spends billions of tax dollars on scientific research, so it is important that we also have a good grasp of what constitutes money well spent in this regard. Should the National Institutes of Health finance research on “alternative medicine”? Should the Department of Defense fund studies on telepathy? Third, as an ethical matter, pseudoscience is not — contrary to popular belief — merely a harmless pastime of the gullible; it often threatens people’s welfare, sometimes fatally so. For instance, millions of people worldwide have died of AIDS because they (or, in some cases, their governments) refuse to accept basic scientific findings about the disease, entrusting their fates to folk remedies and “snake oil” therapies.

The entire article is here.

Friday, April 19, 2013

Scientific Articles Accepted (Personal Checks, Too)

By GINA KOLATA
The New York Times
Published: April 7, 2013

The scientists who were recruited to appear at a conference called Entomology-2013 thought they had been selected to make a presentation to the leading professional association of scientists who study insects.

But they found out the hard way that they were wrong. The prestigious, academically sanctioned conference they had in mind has a slightly different name: Entomology 2013 (without the hyphen). The one they had signed up for featured speakers who were recruited by e-mail, not vetted by leading academics. Those who agreed to appear were later charged a hefty fee for the privilege, and pretty much anyone who paid got a spot on the podium that could be used to pad a résumé.

“I think we were duped,” one of the scientists wrote in an e-mail to the Entomological Society.

Those scientists had stumbled into a parallel world of pseudo-academia, complete with prestigiously titled conferences and journals that sponsor them. Many of the journals and meetings have names that are nearly identical to those of established, well-known publications and events.

Steven Goodman, a dean and professor of medicine at Stanford and the editor of the journal Clinical Trials, which has its own imitators, called this phenomenon “the dark side of open access,” the movement to make scholarly publications freely available.

The entire story is here.

Wednesday, September 12, 2012

Anti-Gay Bias or Academic Freedom?

By Scott Jaschik
Inside Higher Ed
Originally published September 4, 2012

The gay alumni group at Franciscan University of Steubenville last week tried to draw attention to a course it views as anti-gay, and ended up embroiled in disputes not only over that course but over the group's right to link itself to the university in a public way.

Franciscan is a university that prides itself on strict adherence to Roman Catholic teachings, and the alumni group has no official connection to the university. But it has called itself, based on its members and their affiliations, Franciscan University Gay Alumni and Allies. Under that name, the group last week issued a news release questioning why the university offers a course that links homosexuality with forms of deviant behavior.

The course description, pulled from the university's catalog, states: "DEVIANT BEHAVIOR focuses on the sociological theories of deviant behavior such as strain theory, differential association theory, labeling theory, and phenomenological theory. The behaviors that are primarily examined are murder, rape, robbery, prostitution, homosexuality, mental illness, and drug use. The course focuses on structural conditions in society that potentially play a role in influencing deviant behavior."

The entire story is here.

Saturday, August 13, 2011

Useless Studies, Real Harm

By Carl Elliot
The New York Times

LAST month, the Archives of Internal Medicine published a scathing reassessment of a 12-year-old research study of Neurontin, a seizure drug made by Pfizer. The study, which had included more than 2,700 subjects and was carried out by Parke-Davis (now part of Pfizer), was notable for how poorly it was conducted. The investigators were inexperienced and untrained, and the design of the study was so flawed it generated few if any useful conclusions. Even more alarming, 11 patients in the study died and 73 more experienced “serious adverse events.” Yet there have been few headlines, no demands for sanctions or apologies, no national bioethics commissions pledging to investigate. Why not?
One reason is that the study was not quite what it seemed. It looked like a clinical trial, but as litigation documents have shown, it was actually a marketing device known as a “seeding trial.” The purpose of seeding trials is not to advance research but to make doctors familiar with a new drug.
In a typical seeding trial, a pharmaceutical company will identify several hundred doctors and invite them to take part in a research study. Often the doctors are paid for each subject they recruit. As the trial proceeds, the doctors gradually get to know the drug, making them more likely to prescribe it later.
In an age of for-profit clinical research, this is the new face of scandal. Pharmaceutical companies promote their drugs with pseudo-studies that have little if any scientific merit, and patients naïvely sign up, unaware of the ways in which they are being used. Nobody really knows how often companies conduct such trials, but they appear with alarming regularity in pharmaceutical marketing documents. In the marketing plan for the antidepressant Lexapro for the 2004 fiscal year, Forest Laboratories described 102 Phase IV trials — the classification under which seeding trials fall — in a section labeled “Marketing Tactics.”
Oversight bodies like the Food and Drug Administration generally don’t view seeding trials as research scandals: seeding trials are not illegal, and the drugs in question have already received F.D.A. approval. But even after particularly egregious seeding trials have been exposed, the F.D.A. has not issued sanctions. Take the notorious Advantage study, a seeding trial of the pain reliever Vioxx conducted by Merck. According to a 2008 report in the Annals of Internal Medicine, litigation documents show that the Advantage study was conceived and managed by Merck’s marketing department. Three subjects died in the Advantage trial; five more subjects experienced heart attacks. Oversight bodies should treat the Advantage study as a violation of research ethics.
The entire story can be read here.