Showing posts with label evidence-based medicine. Show all posts
Showing posts with label evidence-based medicine. Show all posts

Friday, August 12, 2011

Greed, corruption and medical procedures: ignoring or suppressing the evidence?


One of the challenges for physicians who seek to advocate for patients by championing cost-effective, evidence-based medicine is opposition from the medical community itself. Physicians and other health care providers, as individuals, may practice evidence-free medicine, continuing to do things that have been shown not to work, to cost more than treatments that are equally effective, and sometimes to do harm. Sometimes this comes from ignorance of the evidence, because it may seem to be too hard to keep up. Sometimes it is because practitioners have “always” done it this way”, taught years or decades ago by their teachers. Or they may think that “their” patients are different from the ones who were studied; that “their” practice has shown them what works; that there is an “art” of medicine separate from the science. Maybe they are sometimes right, but usually they are wrong.

Yes, many important studies from which evidence-based guidelines are derived do not include all types of patients. For years poor and minority people were the main substrate for research (see “Tuskeegee”). More recently, perhaps in overcompensation, poor and minority people have been left out of research trials, which funders interested in health disparities (including the National Institutes of Health, NIH) are trying to change. But the fact that the patients you take care of were not included in these studies is not sufficient evidence for the results not applying to them. And, importantly, providers caring for exactly the population of patients who were studied are no less likely to ignore the results.

It is good to learn from your teachers. Hey, I’m a teacher. But new evidence emerges, and your patients count on you to be aware of it, to use it, to be on top of the knowledge that they cannot be. Does it take time? Sure. But that is the job. And for doctors that is one of the reasons that they are well-paid. To keep up. But what about one’s own personal experience? Experience is a good guide, in the absence of other evidence, but rarely does one provider have sufficient experience to have stronger evidence than large clinical trials. Moreover, “anecdotal” experience (“I once had a patient who X treatment didn’t work for”, or more likely “I once had a patient where Y treatment worked great”) has its own pitfalls. Mainly, it is usually wrong, even in the context of that individual provider’s practice. We have a tendency to remember the unusual, and to remember that for use in our future practice rather than the usual. I remember, while working in an urgent care center before the advent of “rapid step tests”, I had to  review yesterday’s throat culture results. I would see a positive result and say “Ha! I knew that patient had strep!”, but not consider all the negative tests on patients for whom I may have thought the same thing.  This is why we do large clinical trials. The “art” of medicine is important, especially in areas where there is no, or insufficient, evidence, and in translating that evidence into what the patient should do. The art of medicine is not, however, in ignoring the evidence.

Much more serious, however, is when greed causes physicians refuse to abide by the evidence because it shows that something that they are doing, which makes them money, is not indicated. This too can be subconscious, because if you have been doing a procedure for a long time believing it works, it is hard to suddenly change your mind because of new evidence. It is easy for your subconscious to deny that this resistance has anything to do with your own economic benefit, and is rather the result of your knowing it works. But when large groups of physicians, professional societies, get involved, it is no longer subconscious. It is financial protectionism pure and simple.

A good example of this is the recent opposition to recommendations by the Institute of Medicine (IOM) suggesting how the Food and Drug Administration should make rules governing the use of medical devices. Some manufacturers and physician groups  began to criticize them before they were even published (“Study of medical device rules is attacked, unseen”, Barry Meier, NY Times, July 28, 2011). The failure of many medical devices currently on the market, including artificial joints and defibrillators, was the impetus for this report. The IOM, a group of independent physicians and scholars convened by the National Academy of Sciences, are tasked with making recommendations on a wide variety of medical issues. Many of their most well-known reports focus on quality and patient safety, such as “To Err is Human: building a safer health system”. As Meier reports, a business group representing many of the device manufacturers went for the old “the best defense is a good offense” strategy and attacked the rules before they were promulgated. It is self-serving, but not surprising: “With millions of dollars of product sales at stake, the experts said, it is not surprising that the device industry and others would want to avert what they see as potentially restrictive new rules. Still, the lobbying has taken on a tone akin to Washington infighting over an issue like bank regulation, rather than patient health, they said.” Guess what? With millions of dollars at stake, it is exactly like attacking new bank regulations rather than focusing on patient health!  (For those who are interested, the actual IOM recommendations on medical devices, Medical Devices and the Public’s Health: The FDA 510(k) Clearance Process at 35 Years  is available on line.)

Of greater concern than these actions by the Washington Legal Foundation (additional information available in Wikipedia), a “pro-business group”, representing the self-interest of manufacturers, is the involvement of physicians. WLF’s attorney, Richard Samp, “… said his organization took action after the issue was brought to its attention by a lawyer who works at a firm that represents device makers. Shortly after filing its petition, the legal foundation was contacted by an official of the American Academy of Orthopaedic Surgeons, which represents doctors who perform joint replacements, who congratulated it for ‘taking the bull by the horns,’ Mr. Samp said.”

This is not the first time that orthopedics organizations (which for some reason choose to use the British-style diphthong “orthopaedics” despite being Americans who do not make a practice of using other medical diphthongs such as haemorrhage, oesophagus, anaemia or oedema) have chosen to attack evidence-based rules by political means. When, back in 1995, the Agency for Healthcare Policy and Research (now the Agency for Health Quality and Research, AHRQ) issued evidence based guidelines that recommended that certain popular (and remunerative) surgeries for back pain were not very effective, the orthopedic groups were able to convince Rep. Henry Bonilla (San Antonio) to introduce legislation to de-fund the agency! (“Agency’s report provokes a revolt”, by Neil A. Lewis, NY Times September 14, 1995).That’s playing hardball! However, the procedure, vertebroplasty, was overused, usually didn’t work and often caused harm. Interestingly, mounting evidence of its inutility continues to this day, recently for vertebral fracture in the British Medical Journal[1] [2], the results of which summarized by the editors of Journal Watch General Medicine.[3]

I don’t want to pick especially upon orthopedists (or orthopaedists), although as high-income procedural specialists, they have been involved in more than their share of these issues. Many of the IOM’s recommendations involve procedures done by other specialists, including cardiologists. Indeed, we need to applaud the work of the academic cardiologists who have done the studies that show that many of these procedures that constitute a major source of income for their practicing colleagues (the pâté and vichyssoise if not the bread and butter) are not indicated.

The researchers doing this work are some of the true heroes of medicine. Those who hold on to evidence-free procedures because they make a lot of money from them need to be careful that they do not join the villains.

 

[3] “The results do not support routine use of vertebroplasty in patients with vertebral compression fractures, including those with recent-onset pain or severe pain at baseline. Strengths of this meta-analysis include its use of individual patient data and the blinding of patients to vertebroplasty or sham procedures. As noted by the authors, lack of blinding overestimates treatment benefit, which casts doubt on the results of a recent nonblinded randomized trial that suggested vertebroplasty is superior to conservative treatment (JW Gen Med Sep 2 2010).

Wednesday, November 25, 2009

Breast Cancer Screening and Evidence-based Medicine

.

In case you’ve been in a coma for a while, the US Preventive Services Task Force (USPSTF), a federally-funded-but-independent group of scientists who evaluates the evidence regarding preventive care, has announced new guidelines on screening for breast cancer. It has generated an amazing amount of comment, from physicians, patients, advocacy groups, politicians, and journalists. Every possible position on the issue, from thoughtful and balanced to alarmist and opportunist, has been taken and published by someone. For a quick review of articles just in the New York Times in the last few days we have:

November 17:
Panel Urges Mammograms at 50, Not 40”
November 18:
New Mammogram Advice Finds a Skeptical Audience”,
Many Doctors to Stay Course on Breast Exams for Now”
November 19:
Screening Policy Won’t Change, U.S. Officials Say
Columnist Gail Collins: “Breast Brouhaha
November 20:
Kevin Sack, News Analysis: “Medical Science and Practice in Conflict
Mammogram Debate Took Group by Surprise

Therefore, the wise course might be for me to stop here, let you read everyone else, and not get involved. Of course, I won’t. Let me start by discussing the discovery, use, and application of evidence in medicine, and in particular with the USPSTF.

Disclaimer: I don’t work for, or have any relationship, financial or otherwise, with USPSTF, but I do believe that the responsible practice of medicine requires keeping up with the evidence and changing practices as new information becomes known; it should not be a “faith-based” effort.

Medical evidence for anything, including appropriate preventive services, gathers slowly. Studies are first done on high-risk populations, then later on average or low risk. Depending on the variables looked at, and the population studied, different information can emerge. Rarely (but sometimes) is the data from one good study on the same population directly opposite that of previous studies; more likely it will be similar, but might be of a greater or lesser degree of magnitude. Or just different enough to tip the risk/benefit balance. Because virtually never is anything – a treatment, a diagnostic test, a preventive activity – all good or all bad. There are benefits, real or potential, and risks, of varying degree. As new evidence accumulates, it tends to move the scales, or the seesaw, more down or up on one side or the other. Usually not enough to drop one end to the ground, but sometimes enough to tip the balance. And new studies are being done all the time, and it is not only hard to keep up, it is hard to assess the changes in risk. But it must be assessed, because it would be wrong to just keep doing what you were doing when the evidence changes.

That is the incredibly valuable service that the USPSTF has been providing since it was first convened in 1984. Evaluating, the existing studies and making recommendations – to clinicians – on what they should discuss with their patients. They are not really for patients, although this seems to be where much of the confusion is. Much of the coverage is about individual women trying to decide what to do – or reacting “against” the recommendations. The Times article cited above, “Many Doctors to Stay Course on Breast Exams for Now”, includes this: “Patients are already trying to figure out what the recommendations mean.” It means they should discuss them with their health care provider.

USPSTF assigns both a grade and a level of certainty to its recommendations. The grades are A, B, C, D, and I, and the levels of certainty are high, moderate, and low, and are described at the USPSTF website, at http://www.ahrq.gov/clinic/uspstf/grades.htm. When the grade is A or B, the procedure is recommended to clinicians in practice; when the grade is C it is generally not recommended, but there may be individuals or situations in which the benefit would exceed the risk; when it is D, it is not recommended. A grade of I means there is insufficient evidence to assess whether there is net benefit.

USPSTF is not the only group that makes recommendations. Many medical professional organizations and advocacy groups (such as the American Cancer Society and the American Heart Association) also make recommendations. However, the USPSTF is independent and has no “dog in the fight”, no financial or emotional attachment to an outcome. For example, after these recent recommendations were announced, suggesting most women start receiving mammograms later, and have them less often, the American College of Radiology (ACR) announced its disagreement with them. I’m sorry, but the fact that radiologists have an obvious financial stake in doing more mammograms has to make their opinion more suspect.

Certainly doing fewer mammograms will save money for insurers (including the government, for Medicare patients). In the current climate of our debate on health reform, some have seen these recommendations as an effort by these insurers to save money, and others have noted that, because of this, the timing of the announcement was “unfortunate”. However, unlike the ACR, the members of the USPSTF have no financial stake in their truly independent recommendations. I, for one, absolutely consider them to be the most valid source of independent analysis and advice.

What about these specific recommendations? They make sense to me, and are supported by the evidence. The recommendation that mammography begin at 40, rather than 50, only dates back to 2002, and was controversial at that time.
“In 2002…,” reports the Times in Panel Urges Mammograms at 50, Not 40, “When the group recommended mammograms for women in their 40s, some charged the report was politically motivated. But Dr. Alfred Berg of the University of Washington, who was the task force chairman at the time, said ‘there was absolutely zero political influence on what the task force did.’ It was still a tough call to make, Dr. Berg said, adding that ‘we pointed out that the benefit will be quite small.’ In fact, he added, even though mammograms are of greater benefit to older women, they still prevent only a small fraction of breast cancer deaths.” In the last 7 years more studies have come out, which have weakened the relative benefit to risk ratio for women between 40 and 50 who are at average risk for breast cancer.

In addition, the body of evidence does not suggest that there is significant additional benefit to screening every year rather than every two years. It also recommends against teaching self-breast examination (not against women doing it) – a “D” recommendation -- because there is good evidence from large population studies that it offers no advantage death or morbidity from breast cancer. Continuing screening of women over the age of 74, and doing clinical breast examination (by a physician or other clinician) in addition to mammography get “I” – insufficient evidence recommendations.

In the news analysis cited above, “Medical Science and Practice in Conflict
Mammogram Debate Took Group by Surprise”, Kevin Sack notes that “The backers of science-driven medicine, with its dual focus on risks and benefits, have cheered the elevation of data in the setting of standards. But many patients — and organizations of doctors and disease specialists — find themselves unready to accept the counterintuitive notion that more testing can be bad for your health.” But it certainly can be.

More, it should be obvious, is not always better, not only with fatty foods and salt, but with screening. The risks of unnecessary (read: too often for the risk level of the woman under consideration) mammograms is more than anxiety for false positives. It is also biopsy for false positives. And sometimes complications. And radiation exposure, which is not insignificant, and is, as we know, linked to causing cancer. Think: men get breast cancer also, but not at the rate that women do (about 1%). We do not screen men, because the risk/benefit ratio is way over to risk. Let me make clear that all of this discussion is about screening; by definition, someone who has NO symptoms. No lump, no discharge, no skin dimpling. They are not about diagnostic mammograms – examining someone with symptoms or physical findings, or a previous abnormal mammogram, and certainly do not apply to follow-up of people who have had breast cancer.

In “Many Doctors to Stay Course on Breast Exams for Now”, Dr. Annekathryn Goodman, director of the fellowship program in gynecological oncology at Massachusetts General Hospital, says “It’s kind of hard to suggest that we should stop examining our patients and screening them….I would be cautious about changing a practice that seems to work.” I hope that is not what she meant. What “seems to work”, while intuitively attractive, is not always correct. That is why we have independent bodies such as USPSTF continually examining the evidence.
.