|
||
|
||
|
1 9 - 0 9 - 2 0 0 7 Scientists do the numbers
Coffee is good for you -- no, it's bad. Epidemiological studies can come up with some crazy results, causing some critics to wonder if they're really worthwhile
By Andreas von Bubnoff SAGITTARIANS are 38% more likely to break a leg than people of other star signs -- and Leos are 15% more likely to suffer from internal bleeding. So says a 2006 Canadian study that looked at the reasons residents of Ontario province had unplanned stays in the hospital.
Leos, Sagittarians: There's no need to worry. Even the study's authors don't believe their results. They're illustrating a point -- that a scientific approach used in many human studies often leads to findings that are flat-out wrong. Such studies make headlines every day, and often, as the public knows too well, they contradict each other. One week we may hear that pets are good for your health, the next week that they aren't. One month, cellphone use causes brain cancer; the next month, it doesn't.
"It's the cure of the week or the killer of the week, the danger of the week," says Dr. Barry Kramer, associate director for disease prevention at the National Institutes of Health in Bethesda, Md. It's like treating people to an endless regimen of whiplash, he says.
Take the case of just one item: coffee. Drinking two or three cups per day can triple the risk of pancreatic cancer, according to a 1981 study. Not so, concluded a larger follow-up study published in 2001. Coffee reduces the risk of colorectal cancer, found a 1998 study. Not so, according to one published later, in 2005.
"I've seen so many contradictory studies with coffee that I've come to ignore them all," says Donald Berry, chair of the department of biostatistics at the University of Texas MD Anderson Cancer Center in Houston.
"What about the man on the street?" asks Stan Young, a statistician at the National Institute of Statistical Sciences in Research Triangle Park, N.C. "He reads about coffee causing and not causing cancer -- so many contradictory findings he begins to think, 'I don't trust anything these scientists are saying.' "
These critics say the reason this keeps happening is simple: Far too many of these epidemiological studies -- in which the habits and other factors of large populations of people are tracked, sometimes for years -- are wrong and should be ignored. In fact, some of these critics say, more than half of all epidemiological studies are incorrect. The studies can be influential. Often, in response to them, members of the public will go out and dose themselves with this vitamin or that foodstuff.
And the studies also influence medical practice -- doctors, the critics note, encouraged women to take hormones after menopause long before their effects were tested in randomized clinical trials, the gold standard of medical research.
Some of epidemiology's critics are calling for stricter standards before such studies get reported in medical journals or in the popular press. Young, one of the foremost critics, argues that epidemiological studies are so often wrong that they are coming close to being worthless. "We spend a lot of money and we could make claims just as valid as a random number generator," he says.
Epidemiology's defenders say such criticisms are hugely overblown. They are "quite simplistic and exaggerated," says Dr. Meir Stampfer, a professor of epidemiology and nutrition at the Harvard School of Public Health and a professor of medicine at Harvard Medical School. What's more, some things simply cannot be tested in randomized clinical trials. In certain cases, to do so would be unethical. (Care to assign half the people in a trial to smoke cigarettes?)
In other cases, a trial of adequate size and duration -- say, to test whether coffee drinking raises or lowers the risk of Parkinson's disease -- would have to control the habits of huge numbers of people for decades. That would not only be hugely expensive but also virtually impossible.
Stampfer cites examples of findings of epidemiology that, he says, have stood the test of time: smoking's link to lung cancer, to name the most notable. Watching for clues In epidemiological studies (also called observational studies), scientists observe what's going on -- they don't try to change it. From what they observe, they reach conclusions -- for example, about the risk of developing a certain disease from being exposed to something in the environment, lifestyle or a health intervention.
There are different ways to do this. Cohort studies follow a healthy group of people (with different intakes of, say, coffee) over time and look at who gets a disease. They're considered the strongest type of epidemiological study.
Case-control or retrospective studies examine people with and without a certain disease and compare their prior life -- for how much coffee they drank, for example -- and see if people who got the disease drank more coffee in their past than those who didn't.
Cross-sectional studies compare people's present lifestyle (how much coffee they drink now) with their present health status. Epidemiological studies have several advantages: They are relatively inexpensive, and they can ethically be done for exposures to factors such as alcohol that are considered harmful, because the people under study chose their exposure themselves. But epidemiological studies have their minuses too, some of which are very well known. Suppose a study finds that coffee drinkers are more likely to get a certain disease. That doesn't mean coffee caused the disease. Other, perhaps unknown, factors (called "confounders" in the trade) that are unrelated to the coffee may cause it -- and if coffee drinkers are more likely to do this other thing, coffee may appear, incorrectly, to be the smoking gun.
A much clearer picture of the role of coffee on disease could be found, in theory, via a randomized clinical trial. One would divide a population into two, put one group on coffee and the other not, then follow both groups for years or decades to see which group got certain diseases and which didn't.
The problem, however, is that such a study is very expensive and takes a long time, and it can be difficult to control people's lives for that length of time.
Despite their shortcomings, epidemiological studies are often taken seriously, so much so that they can change medical practice. Such was the case after dozens of epidemiological studies, including one large, frequently cited one that came out of Harvard in 1991, had shown that taking estrogen after menopause reduces the risk of women getting cardiovascular disease.
"There was such a belief," even with the medical community, that hormone replacement became part of standard medical practice, says Dr. Lisa Schwartz, associate professor of medicine at Dartmouth Medical School in Hanover, N.H., even in the face of an increased potential risk of breast cancer. In fact, some scientists and doctors said it would be unethical to do a randomized clinical trial to check if the hormone effect was real.
But in the hormone epidemiological studies, women choosing to take hormones may well have been healthier in other ways, Kramer says. And that fact -- that they were healthier -- could explain the lower risk of heart disease, not the hormones.
"To get hormone therapy, you have to go to a doctor and have to have insurance," Kramer says. "That means you are in the upper strata of society."
Eventually, a randomized clinical trial was conducted, as part of the so-called Women's Health Initiative. Findings published in 2002 not only found no protection to the heart but actually reported some harm. Epidemiology's detractors say they have no trouble finding other cases than hormones where frequently cited and sometimes influential epidemiology studies have later turned out to be wrong or exaggerated. In 1993, Harvard University scientists published two cohort studies reporting that vitamin E protected people from coronary heart disease.One, the Nurses Health Study, followed over 87,000 middle-aged female nurses without heart disease for up to eight years. It found that the 20% of nurses with the highest vitamin E intake had a 34% lower risk of major coronary disease than those with the lowest fifth of intake.
The other study followed almost 40,000 male health professionals without heart disease for four years -- and found a 36% lower risk of coronary disease in those men taking more than 60 IU of vitamin E per day compared with those consuming less than 7.5 IU.
|
|
|