The Meaning of "Guideline Directed"
The Study of the Week explores one of the most important meta-analyses in cardiology today
We can all agree that evidence from clinical trials should guide practice. But. But. There are snags.
One problem with evidence-based practice is that it’s harder than many experts would admit. Today I will use an example in the heart failure space.
Many heart failure experts vigorously advocate for rapid and complete use of the four classes of drugs that have yielded positive results in trials.
This aggressive advocacy has led professional organizations and hospitals to create incentives to use these drugs. Sticks more than carrots.
If an electronic record in a hospitalized patient sees anywhere the words “heart failure” the doctor is sent big red boxes to fill out about the prescription of these “evidence-based medicines.”
These bright red prompts are to minimize penalties the hospital might receive if they are practicing low quality care.
I will show you a super-important study published nearly a decade ago that highlights the problem with robotic application of “quality” care.
Dr Dipak Kotecha and colleagues in the UK decided to look at one common condition that may modify the benefit of a drug class in heart failure. The drug class is beta-blockers. The condition atrial fibrillation.
It’s an important topic because the two (common) conditions share both association and causation. Namely, AF can associate with heart failure and AF can cause heart failure. The reverse is likely true as well. Heart failure can cause AF.
Another piece of background: beta-blockers have been shown to reduce mortality in patients with heart failure due to weak pump. We now call this HFrEF or heart failure with reduced ejection fraction.
The majority of patients enrolled in beta-blocker trials were in regular sinus rhythm.
The authors searched the literature for large low-bias trials of beta-blockers in patients with heart failure due to low ejection fraction. They found 11 trials. They were able to obtain the individual level patient data.
This meta-analysis included more than 18,000 patients. Most (76%) had sinus rhythm at baseline. About 17% had AF at baseline, and the others had a smattering of other rhythms, such as pacing.
They then analyzed the two groups—SR vs AF—for a primary endpoint of total mortality. The graph shows the clear results:
For patients with SR at baseline, beta-blocker use reduced the risk of death by a whopping 27%. The hazard ratio was 0.73, with tight 95% confidence intervals ranging from 0.67-0.80. You can also see steady separation of the curves. That is, the longer the therapy, the more the benefit.
But. But.
For patients in AF, use of beta-blocker had no effect. The curves are nearly identical.
The authors saw the same pattern in admissions to the hospital for cardiac reasons. Benefit when in SR. No benefit from beta-blockers in AF.
The authors also took the AF group and did subgroup analyses looking for signals based on age, sex, EF, heart rate, use of other meds, such as digoxin. They found no subgroup of patients with AF at baseline that benefited from beta-blocker.
Comments and Take Homes
One criticism I hope you are thinking of is the matter of subgroups and power. Trials are powered to detect differences in the entire population. Here we compare a group of patients in SR (N ≈ 14,000) to much smaller group in AF (N ≈ 3000). Perhaps, you wonder, maybe there weren’t enough events in the smaller group to detect a difference?
Well, the authors write that in the AF group, they had more than 633 deaths=-enough to detect a signal if there was one.
The next question you might have is plausibility. I would offer a few reasons this is plausible. One is that AF increases the risk of heart failure. Anytime you deal with higher risk, the equation between primary-outcome risk vs competing risk changes. The other change at higher risk is the balance between treatment benefit and treatment harm. See the figure from Andrew Foy.
Another reason for the differing effects of beta-blockers is heart rate. Slowing the rate in AF may not confer the same benefits that it does in SR. There are also structural and cellular consequences of AF that may alter the effect of blocker.
The authors nicely summarize the major lesson from this paper.
The results of our analysis suggest that the substantial benefit identified in patients with sinus rhythm should not be extrapolated to patients with atrial fibrillation.
I highlight this paper because the nuance of applying evidence from trials to patients in real life is widely under-rated.
While this paper does not argue that beta-blockers cause harm in patients with AF and heart failure, it strongly suggests that algorithms promoting beta-blocker use in all patients labeled with a diagnosis of heart failure are fatally flawed.
This means that when patients present with heart failure and AF, clinicians should be free to use drugs that they see fit. This may or may not include beta-blocker. We should not receive a penalty for deviating from evidence-based practice.
I advocate for the use of evidence in the strongest terms. But this does not equate to blindly following overly simplistic algorithms, especially when tied to financial incentives. These are a blight on the evidence-based practice movement.
As always, we welcome your comments. Thanks for your support. Sensible Medicine is a user-supported site. It remains free of advertising. JMM
Excellent "springboard"(Caution: Buzzword alert) for thinking about the often-ignored issue of having a test with power appropriately built in to detect outcome X in huge Groups of patients as opposed to detecting X in arbitrarily chosen, small Subgroups during the almost traditional post-trial deep massage of data, with or without incense burning in the massage parlor.
No guideline fits all patients, in fact no guideline fits any individual patient perfectly. Flexibility is not just desirable, it's mandatory. This is where physician training, insight, and expert judgment is required. Brent James taught me this many years ago. His work is worth revisiting. Reward and punishment tied to top-down metrics is a bad idea in the practice of medicine. Want more? See Don Berwick's "The Toxicity of Pay for Performance" D.M. Berwick. Qual Manag Health Care. 1995 Fall.