Analysis does not overturn positive findings from prior evidence reviews; negative conclusions stem from inclusion of a flawed trial in angina patients 03/07/2006
Headline-hunting editors at news outlets worldwide have done their readers a major disservice.
If you’re thinking, in frustration, “say it ain’t so”, please rest easy, because it simply isn’t so.
US and UK health authorities, and expert observers, agree that this misleading review changes almost nothing: the vast preponderance of evidence still favors omega-3s for heart attack and stroke protection.
The new review (Hooper L 2006), reported last week by a team of British researchers, does not overturn the extensive record of positive research.
In fact, the new UK review merely highlights two things.
The authors of a recent clinical trial (Burr MI 2003)—one of the studies included in this evidence review—reported inexplicably negative results. Their odd findings skewed the results of the new evidence review, which otherwise would have echoed the unambiguously positive findings of other recent evidence reviews (e.g., Bucher 2002, Wang 2004). As we’ll show (see “Weakness # 2”, below), expert commentators are criticizing this seriously flawed study and deploring the reviewer’s decision to include it (it violated their own inclusion criteria) and give it the weight they did.
We need more large, well-controlled clinical trials designed to pinpoint the precise cardio-prevention effects of varying dietary intake and tissue levels of omega-3s, over varying periods of time.
We obtained a copy of the full report and subjected it to careful scrutiny by ourselves and our world-renowned science advisor, Professor William E. Lands, Ph.D.
The UK team analyzed 89 human studies—48 randomized controlled trials (RCTs) and 41 “cohort” studies—to assess the evidence regarding likely health effects of omega-3 fatty acids on the risk of heart attacks, cancer, and strokes, and overall death rates.
(See our “Untangling Study Terms” sidebar describing the various types of scientific studies.)
Most of them involved a treatment (omega-3) group and a control (placebo) group and all of the studies followed participants for at least six months. Differences in study design were taken into account when the reviewers weighted the significance of each one.
The authors concluded that the studies they selected, when analyzed as a group, did not show clear evidence of that omega-3s protect against cancer, strokes, or heart attacks.
As they said, “It is not clear that dietary or supplemental omega 3 fats alter total mortality, combined cardiovascular events or cancers in people with, or at high risk of, cardiovascular disease or in the general population. There is no evidence we should advise people to stop taking rich sources of omega 3 fats, but further high quality trials are needed to confirm suggestions of a protective effect of omega 3 fats on cardiovascular health.”
But, when we analyzed the new review we quickly discovered several big elephants in the room.
Unfortunately most media reports missed or ignored these perfectly conspicuous, highly problematic pachyderms, to the probable detriment of public health.
Specifically, scientific experts who’ve commented on the new review have identified five major areas of weakness that fatally undermine its largely negative findings:
|Untangling Study Terms: Clinical, Cohort, Case-Control, or Population?
Today, consumers of health news need to understand the differences between types of studies scientists can conduct.
Randomized Controlled Trials (RCTs) are often referred to as the “gold standard” of human health research. Their exaggerated reputation for definitiveness stems in large part from the fact that researchers use RCTs to determine the safety and efficacy of synthetic drugs seeking FDA approval.
In fact, unlike many cohort and population studies, many RCTs do not last long enough or involve enough people (due to their high cost) to be considered definitive. Nor are RCTs particularly well-suited to detecting relationships between diet and disease.
Here’s our pocket primer on types of research studies:
Clinical Trial: Any investigation that studies people in a controlled setting.
Randomized Controlled Trial: Subjects are divided into an “active” group, who receive the drug or nutrient being tested for its therapeutic or preventive effects, and a “control” group, who receive an identical-looking/tasting placebo (inactive) drug or nutrient. The most reliable controlled trials are “double-blind”, which means that neither the researchers nor the subjects know which subjects are getting the treatment being tested. RCTS are best suited to determining the short-term effects of drugs or nutrients with strong, fast-impact health effects.
Cohort Study: Researchers follow a group of participants prospectively over a set period of time, collecting data on possible disease-promoting and -preventing factors (diet, lifestyle, etc.) within the group and the rates at which people in it develop the disease being studied. These can detect the likely long-term effects of drugs or nutrients with suspected health effects.
Case-Control Study: Researchers collect data on a group of patients and look for unusual diet or other lifestyle patterns, in comparison with a group of healthy but otherwise similar people. These can detect the possible relationships between various factors (diet, lifestyle, drugs) and specific diseases.
Population (Epidemiological) Study: Using questionnaires, researchers collect information on a large population group, looking for correlations between diet or other lifestyle factors and rates of one of more diseases.
Experimental (“in vivo”) Study: Studies involving animals.
Laboratory (“in vitro”) Study: Studies involving isolated cells (human or animal) in test tubes.
They were referring to a similar review of the clinical evidence, published by a Swiss team in 2002 (Bucher HC et al), which came to the opposite (i.e., positive) conclusion concerning the ability of omega-3s to reduce heart-related health risks.
The Swiss authors of the 2002 evidence review came to a positive conclusion: “This meta-analysis suggests that dietary and non-dietary intake of n-3 polyunsaturated fatty acids reduces overall mortality, mortality due to myocardial infarction, and sudden death in patients with coronary heart disease.”
Since this prior analysis of data from RCTs and cohort studies already existed, why did the authors of the new review bother to perform their meta-analysis?
The chief reason that they wanted to repeat the 2002 evidence review was that a large trial in male angina patients had been published after the Swiss review appeared.
However, the 2003 angina-patient trial—led by Michael Burr, M.D. of Britain’s Cardiff University—featured some very serious flaws.
Indeed, the only major difference between the 2002 evidence review from Switzerland and the new one from Britain is that the latter included the anomalous results of Dr. Burr’s 2003 study.
And, significantly, the inexplicably negative findings of Dr. Burr’s angina-patient trial account for unjustifiably negative conclusions of the authors of the new evidence review, with regard to the ability of fish and fish oil to reduce cardiac risks.
As we will demonstrate, this is not just our opinion. Scientists expert in the field are already criticizing the decision to include Dr. Burr’s angina-patient trial.
With the exception of Dr. Burr’s 2003 trial—which is the only one ever conducted in men with angina (chest pain caused by clogged arteries)—all of the larger trials included in the review demonstrated that omega-3s reduce the risk of death from cardiovascular causes.
But US researchers who wrote a 2004 evidence review for the federal government rated both the Burr angina trial and another one conducted by the same research team (Burr ML 1989) as “poor quality studies”.
While Dr. Burr’s anomalous 2003 study indicates that high intake of omega-3s might present risks to substantially heart-sick men suffering from angina, it is not credible to find—as the authors of the deplorably flawed new evidence review did—that its unusual, inexplicable findings outweigh the predominantly positive findings of all other studies on omega-3s and heart health.
In Dr. Burr’s 2003 British angina trial, 3,114 men under 70 with angina were randomly assigned to four groups: (1) advised to eat two portions of oily fish each week, or to take three fish oil capsules daily; (2) advised to eat more fruit, vegetables and oats; (3) given both the above types of advice; and (4) given no specific dietary advice. Rates of death among each group were ascertained after 3-9 years of the study.
Risk of death was not reduced in any of the groups, while the risk of cardiac death was significantly higher among subjects in the fish-or-fish-oil group, with the excess risk occurring predominantly among the subgroup who took fish oil capsules instead of eating fish.
As Dr. Burr’s team concluded, “Men advised to eat oily fish, and particularly those supplied with fish oil capsules, had a higher risk of cardiac death. This result is unexplained; it may arise from risk compensation or some other effect on patients' or doctors' behaviour.”
When they said “The result is unexplained …” they were referring to the fact that an overwhelming preponderance of prior clinical evidence indicates that consuming substantial amounts of fish or fish oil supplements can reduce the risk of cardiac death.
And by “risk compensation” the authors meant the well-known phenomena in which people on heart medication(s) continue or resume eating and behaving in unhealthy ways, believing that the drug(s)—or in this case, fish oil—frees them from the need to lead a heart-smart life.
Actually, we can think of another explanation for the uniquely negative results of this trial, which is that these were relatively sick men. After all, angina—the chest pain or discomfort that occurs when your heart muscle does not get enough blood—is a sign of advanced cardiovascular disease.
We cannot be sure how sick they were, because the authors did not say how many participants had each of three classifications of “angina”, which range from cautionary to serious or very critical.
If, for example, a substantial number suffered from “unstable angina”, it would mean that they were at high risk of dying from a heart attack, and that no amount of fish or fish oil would be likely reduce their risk of early death.
In their discussion, the authors of Dr. Burr’s 2003 angina-patient trial acknowledged that they could not explain why the men who took supplemental fish oil suffered a very substantial increase in risk of sudden cardiac death, despite the large body of prior research showing that omega-3s reduce sudden cardiac death rates.
They also made an unwarranted assertion—“There was no evidence that it was due to interactions with medication”—that has no apparent scientific basis. The authors of Dr. Burr’s trial did not autopsy the men who died, and even if they had, it is medically unlikely that they would have found physical evidence of fatal drug-nutrient interactions.
Several scientists have already written to the British Medical Journal, which published the new evidence review, to criticize its authors’ decision to include Dr. Burr’s angina patient trial and give it such undue weight. (To read all of the “rapid responses” posted at the BMJ Web site, click here.)
These are two of the letters that critiqued Dr. Burr’s angina patient trial and the reviewer’s inexplicable decision to give it such great, unwarranted weight:
Eiliv Lund, Professor of epidemiology at the University of Tromsø, Norway:
“Dear Editor, in their paper Hooper et al. describe the method for selecting papers for the systematic review of risk and benefits of omega 3 fats given mainly as dietary supplements. They conclude in the review that omega 3 fats have no effect on total mortality, cancer or cardiovascular events. The findings of no effect are mainly due to the inclusion of the study by Burr et al , and differ from most previous reviews which have concluded with an positive effect on cardiovascular conditions. However, the inclusion of the clinical trial by Burr et al. violates their own inclusion criteria twice. First, the Burr article was published one year after the date of the last systematic search of relevant articles (February 2002). Secondly, they stated that all studies with multifactorial interventions were excluded. The Burr trial was in fact multifactorial having a 2X2 design including both fish or fish oil and fruit. In addition, it was stopped and then restarted with another design.
- Dr. Johanna M Geleijnse and colleagues at Holland’s Wageningen University:
“As Hooper et al [the authors of the new evidence review] stated in their discussion, the trial by Burr et al in patients with angina pectoris had a major impact on the pooled risk estimate for overall and cardiovascular mortality. “Data from many epidemiological studies and the GISSI-P trial suggest that omega 3 fats from fish protect against heart disease. Although the trial by Burr et al in angina patients should not be ignored, it is hard to interpret these adverse findings in light of previous studies. “A different conclusion would be derived from the review by Hooper et al if these data are omitted, favoring a cardioprotective effect of omega 3 fats from fish. The pooled relative risk … [a 27 percent reduction in risk] … that would then be obtained is in line with the meta-analysis of Bucher et al. “In conclusion, the majority of epidemiological studies and randomized controlled trials indicate a protective effect of omega 3 fatty acids from fish against fatal cardiovascular events. The advice for healthy people and myocardial infarction patients to consume oily fish on a regular basis does not confer adverse risks to health and is fully justified on the basis of current scientific evidence.”
Note: Last year, Dr. Geleijnse and a group of Harvard University researchers published a meta-analysis (Mozaffarian D 2005) of randomized controlled trials testing the ability of fish oil to moderate heart rate in ways that reduce the risk of heart attacks. Their review came to an unambiguously positive conclusion
Epidemiological evidence: Dozens of large epidemiological (population) studies demonstrate a strong correlation between higher consumption of fish or marine omega-3s and lower risk of heart attacks and stroke.
Tissue-level trials: The new review did not include studies that actually measured levels of omega-3s in people’s blood or adipose (fatty) tissue, in addition to asking people how much fish they ate, which is a notoriously unreliable way to judge the effect of any nutrient. As we heard Drs. William Lands and Joseph Hibbeln of the National Institutes of Health say many times at last year’s Seafood & Health conference—“The tissue is the issue”. Almost without exception, whenever researchers have compared blood or tissue levels of omega-3s with rates of heart attack, they’ve found that higher body levels of omega-3s correlate with a reduced risk of heart attack (e.g., Lemaitre RN 2003, Guallar E 2003, Albert CM 2002, Siscovick DS 1995, Simon JA 1995).
Laboratory evidence: Hundreds of laboratory experiments demonstrate that omega-3s exert physiological effects known to help prevent heart attacks, stroke, and cancer.
Why did the authors of the new evidence review decide to ignore the many epidemiological (population) studies, when these provide the biggest body of evidence indicating that fish and fish oil help prevent heart attacks and strokes?
Presumably, the reason was that randomized controlled trials (RCTs) and cohort studies—if they include enough people, last long enough, and are sufficiently well-controlled—permit conclusions firmer than those possible from population studies.
Their potential for scientific superiority stems in part from the fact that RCTs and cohort studies can, hypothetically, allow researchers to eliminate or adjust for diet and lifestyle factors that could muddy the waters.
But, as with all scientific studies, the devil is in the details. An RCT or cohort study whose design is deficient, or whose size or duration is insufficient, will be no better able to deliver definitive results than would a series of well-designed, carefully conducted population studies backed by solid case-control and laboratory studies.
Vital Choice science advisor William Lands, Ph.D. told us that it was a serious scientific mistake for the authors to exclude evidence from population and laboratory studies, and to lend excessive weight to Dr. Burr’s angina-patient trial and a few trials whose design parameters were somewhat superior to the larger trials included in the review, but whose small size could not permit statistically powerful conclusions.
As a result, Dr. Lands found the authors’ sweeping, negative conclusions insupportable.
Another “rapid response” letter to the British Medical Journal echoed Dr. Lands’ viewpoint. It came from nutritionist Evelyn Tribole, R.D. a former nutrition expert for ABC's "Good Morning America” and national spokesperson for the American Dietetic Association, and we’ve excerpted her key points here:
“Conducting a meta-analysis study on the effectiveness of omega-3 fats for mortality, cardiovascular disease and cancer, without considering the impact of excess omega-6 fat in the diet, is akin to reviewing the efficacy of a healthy diet without factoring the effects of smoking.
“Excess omega-6 fats interfere with the health benefits of omega-3 fats because they compete for the same rate-limiting enzymes. A high proportion of omega-6 to omega-3 fat in the diet shifts the physiological state of the body toward the pathogenesis of many diseases: prothrombotic [clot-promoting], proinflammatory and proconstrictive [artery-narrowing].
“Chronic excessive production of omega-6 eicosanoids [metabolic products of dietary omega-6 fats] is associated with heart attacks, thrombotic stroke, arrhythmia, arthritis, osteoporosis, inflammation and cancer. Furthermore, coronary heart disease mortality has been demonstrated to be proportional to plasma [blood] levels of long chain omega-6 fat.
“Prior to industrialization, no population has been exposed to the current high levels of omega-6 polyunsaturated fats in westernized diets. Today we eat fat that did not exist 100 years ago, such as cottonseed oil. Humans evolved on a diet with a balanced ratio of omega-6 to omega-3 fats of about 1:1. Today, that ratio in westernized countries is near 17:1.”
By including trials using plant-drreived omega-3s, the authors only muddied the picture further, to the detriment of marine omega-3s.
Dr. Lands served as Professor of Biochemistry at the University of Michigan (1955-1980) and the University of Illinois (1980-1991) and authored over 250 research papers and the book, Fish and Human Health (AOCS Press 2005).
After retiring from teaching, he directed the basic research program at the National Institute on Alcohol Abuse and Alcoholism (1990-1997) and served as Senior Scientific Advisor to the Director (1997-2002).
Dr. Lands spoke more with bemusement than annoyance concerning the misleading conclusions of the review’s authors, but expressed some concern that the researchers’ narrowly-based conclusions and the media’s oversimplified characterizations might discourage dietary decisions—that is, consuming more fish and fewer omega-6 fats—that are clearly good for peoples’ heart health.
And it sounds as if he'd foreseen the current flawed review when he composed these comments on the subjects of scientific myopia in a 2003 paper published in the journal Nutrition, Metabolism, and Cardiovascular Diseases (key points underlined for emphasis):
“Essential fatty acids in the foods we eat have a subtle but powerful influence on hundreds of different processes in the life and death of humans, understanding of which has been delayed by two attitudes in the biomedical community. One involves a bias towards expensive curative/treatment interventions that neglect prevention of initial nutritional causes of disease and death, and the other involves careless logic in interpreting evidence of causes of disease and death.
“Both attitudes interfere with translation of published science of essential fatty acids into effective prevention of cardiovascular deaths, a situation made worse by a widespread wish for simple descriptions of complex interactions in disease.
“Death from coronary heart disease comes from acute ischemia [drop in blood flow to the heart muscles] and arrhythmia [irregular heart beat], often following long-term chronic inflammatory vascular damage that predisposes to acute fatal thrombosis [artery-blocking blood clots] and arrhythmia.
“Readily corrected nutritional imbalances in … omega-3/omega-6 essential fatty acids are causal risk factors with plausible mechanisms contributing to fatal [coronary] events which can be prevented.”
In conclusion, the new evidence review does not even come close to overturning the vast body of evidence indicating that the omega-3 fats in fish and fish oil help prevent heart attacks and stroke, and are likely to inhibit growth of cancers.
Hooper L, Thompson RL, Harrison RA, Summerbell CD, Moore H, Worthington HV, Durrington PN, Ness AR, Capps NE, Davey Smith G, Riemersma RA, Ebrahim SB. Risks and benefits of omega 3 fats for mortality, cardiovascular disease, and cancer: systematic review. BMJ, doi:10.1136/bmj.38755.366331.2F (published 24 March 2006)
Hooper L, Thompson RL, Harrison RA, Summerbell CD, Moore H, Worthington HV, Durrington PN, Ness AR, Capps NE, Davey Smith G, Riemersma RA, Ebrahim SB. Omega 3 fatty acids for prevention and treatment of cardiovascular disease. Cochrane Database Syst Rev. 2004 Oct 18;(4):CD003177. Review.
Bucher HC, Hengstler P, Schindler C, Meier G. N-3 polyunsaturated fatty acids in coronary heart disease: a meta-analysis of randomized controlled trials. Am J Med. 2002 Mar;112(4):298-304.
Albert CM, Campos H, Stampfer MJ, Ridker PM, Manson JE, Willett WC, Ma J. Blood levels of long-chain n-3 fatty acids and the risk of sudden death. N Engl J Med. 2002 Apr 11;346(15):1113-8.
Siscovick DS, Raghunathan TE, King I, Weinmann S, Wicklund KG, Albright J, Bovbjerg V, Arbogast P, Smith H, Kushi LH, et al. Dietary intake and cell membrane levels of long-chain n-3 polyunsaturated fatty acids and the risk of primary cardiac arrest. JAMA. 1995 Nov 1;274(17):1363-7.
Guallar E, Hennekens CH, Sacks FM, Willett WC, Stampfer MJ. A prospective study of plasma fish oil levels and incidence of myocardial infarction in U.S. male physicians. J Am Coll Cardiol. 1995 Feb;25(2):387-94.
Lemaitre RN, King IB, Mozaffarian D, Kuller LH, Tracy RP, Siscovick DS. n-3 Polyunsaturated fatty acids, fatal ischemic heart disease, and nonfatal myocardial infarction in older adults: the Cardiovascular Health Study. Am J Clin Nutr. 2003 Feb;77(2):319-25.
Simon JA, Hodgkins ML, Browner WS, Neuhaus JM, Bernert JT Jr, Hulley SB. Serum fatty acids and the risk of coronary heart disease. Am J Epidemiol. 1995 Sep 1;142(5):469-76.
Wang C, Chung M, Balk E, Kupelnick B, DeVine D, Lawrence A, et al. Effects of omega-3 fatty acids on cardiovascular disease. Rockville,MD, USA: Agency for Healthcare Researchand Quality, 2004. Evidence Report/Technology Assessment 94. Accessed online March 26, 2006 at www.ncbi.nlm.nih.gov/books/bv.fcgi?rid = hstat1a.chapter.38290.
Burr ML, Ashfield-Watt PA, Dunstan FD, Fehily AM, Breay P, Ashton T, Zotos PC, Haboubi NA, Elwood PC. Lack of benefit of dietary advice to men with angina: results of a controlled trial. Eur J Clin Nutr. 2003 Feb;57(2):193-200.
Leng GC, Lee AJ, Fowkes FG, et al. Randomized controlled trial of gamma-linolenic acid and eicosapentaenoic acid in peripheral arterial disease. Clinical Nutrition 1998. 17(6):265-271. (PubMed)
Marchioli R, Barzi F, Bomba E, et al. Early protection against sudden death by n-3 polyunsaturated fatty acids after myocardial infarction: time-course analysis of the results of the Gruppo Italiano per lo Studio della Sopravvivenza nell'Infarto Miocardico (GISSI)-Prevenzione. [see comments.] Circulation 2002. 105(16):1897-1903. (PubMed)
Nilsen DW, Albrektsen G, Landmark K, et al. Effects of a high-dose concentrate of n-3 fatty acids or corn oil introduced early after an acute myocardial infarction on serum triacylglycerol and HDL cholesterol. Am J Clin Nutr 2001. 74(1):50-56. (PubMed)
Sacks FM, Stone PH, Gibson CM, et al. Controlled trial of fish oil for regression of human coronary atherosclerosis. HARP Research Group. Journal of the American College of Cardiology 1995. 25(7):1492-1498. (PubMed)
Lands WE. Primary prevention in cardiovascular disease: moving out of the shadows of the truth about death. Nutr Metab Cardiovasc Dis. 2003 Jun;13(3):154-64. Review.
Simopoulus, AP and Cleland LG. Omega-6/Omega-3 Essential Fatty acid ratio: the scientific evidence. World Review of Nutrition and Dietetics. (2003): 92:1-174.
Lands EM. Dietary fat and health: the evidence and the politics of prevention. Annal New York Academy of Sciences (2005). 1055:179-192.
Cordain L et al. Origins and evolution of the Western diet: health implications for the 21st century. American Journal of Clinical Nutrition (2005).81:341-354.
De Lorgeril et al. Mediterranean diet, traditional risk factors, and the rate of cardiovascular complications after myocardial infarction; final report of the Lyon Diet Heart Study. Circulation (1999)99;779-785.
Okuyama H et al. Dietary fatty acids—the n-6/n-3 balance and chronic elderly diseases: excess linoleic acic and relative n-3 deficiency syndrome seen in Japan Prog Lipid. Res (1997); 35(4):409-457.
Dubnov G, Berry EM. Omega-6/omega-3 fatty acid ratio: The Israeli Paradox. World Review of Nutrition and Dietetics. (2003):92:81-91.
Simopoulos AP, Leaf A, Salem Jr N. Workshop statement on the essentiality of and recommended dietary intakes for omega-6 and omega-3 fatty acids. Prostaglandins, Leukot Essential Fatty Acids (2000) 63:119-121.