18 Comments

“Treating people is not like fixing machines. We are complicated. Treatments often lead to unintended consequences.” Great quote. This applies to public health too.

Expand full comment

Thanks John. SCIENCE is how our species can move beyond "common sense" and "conventional wisdom" which are often ... what's the word ... WRONG! But there are many forces (cognitive, financial, reputational) opposing that methodology of progress. Sad.

Expand full comment

Great article that should be required reading in every medical school class and post graduate medical training program. I took my cardiology fellowship during the 1970s when coronary artery surgery was being increasingly recommended for practically anyone who demonstrable disease. There were a few people who questioned whether there should be some randomized trials that showed some real benefits before widespread acceptance of the procedure. Of course they were ridiculed because the procedure "obviously made sense." Although I accepted the consensus the scientist in me still had some lingering doubts. Now long retired I still don't know if any study was ever done to answer this question.

Expand full comment

Hopefully we will soon see an RCT of impella in CS as well. So far the biological plausibility-rubber has hit the evidence based-road in the form of a faceplant, and yet this still is used regularly. One wonders why…🤔

Expand full comment
author

Coming soon.

Expand full comment

ECLS-SHOCK wasn't actually done on the most dire of patients (from the point of view of intensivists like me), rather it was done on patients in cardiogenic shock who could be stabilized by best medical therapy. Those who could not (in the control group) were put on ECMO. Thus this was actually a trial of ECMO before reaching dire straits versus waiting until the patient is in dire straits and then putting him on. This has been done in multiple ECMO trials and they consistently come back negative. The trial does not inform us whether or not to use ECMO on patients who have failed best medical therapy and I doubt such a trial will ever be run - though it probably should be

Expand full comment
Sep 11, 2023Liked by John Mandrola

"Does not work"? "No difference in outcomes" ? Since when does p > 0.05 allow these interpretations? What were the most favorable confidence limits?

Expand full comment
author

Professor — when I get my new sound system working, I’d love to do a podcast with you. Because in this case the p value is 0.81. I need to better understand your comment, and, exactly how tight do CI have to be.

Expand full comment

I'd love to John. Think of if this way: If N=2 patients were randomized P=1.0 but we haven't learned anything.

Expand full comment

One would hope the study actually changes practices. The financial incentives are a strong counterforce. And the "more is better " cultural bias. I'll believe it when it happens.

Expand full comment

Thank you.

I am compelled to ask the question: how did medicine get here, such that we are dependent on the "curiosity and courage" of Thiele, et al?

Is the history of ECMO observational studies in 70s (I guess 🤷‍♂️) what lead medicine astray in this instance?

Did ECMO RCTs Zapol, et al (1979), Morris, et al (1994), CESAR (2009), EOLIA (2014) contribute to "bio-plausibility" claims?

What exactly is the scientific threshold for "bio-plausibility"?

I do not know the history, but were there actual RCTs in animals that actually supported so-called "human bio-plausibility"?

The same curiosity and courage that fueled Thiele, et al arguable fueled the use in the first place!

So maybe curiosity and courage are being rewarded in the wrong ways too. Maybe the virtue we see here is really the preexisting vice. Curiosity and courage may in the big picture be the problem?

Expand full comment

I was a respiratory therapist in the 80's, when ECMO was arriving on the scene. We thought it was the answer to many, cardio-pulmonary diseases and it bypasses injured lungs, to perfuse the cells and keep the body from deterioration while the lungs heal. Then came DRG's, HMOs, insurance groups, etc. I left the field in 1990 and could already see the writing on the wall. Health "care" had become a health business with ill patients being necessary commodities for growth. Curing was no longer the goal. Maintenance was, as it was much more lucrative.

Expand full comment

I concur that professional courage was required to perform the study and publish it. I'm not optimistic that such courage is contagious to the field of drug interventions. While I respect Dr Mandorla and would like to be under his care (actually), it's no longer close to uniformly true that something must be proven as true to continue its application or use.

Expand full comment

Having read your substack, I am not confident things will change. "In medicine, you have to show something works to reduce an important outcome in real patients.

If Professor Thiele and his colleagues had not been curious and brave, we would be doing this invasive costly procedure for years. And. We would be harming patients and not knowing it."

If it makes money for the hospital, will they stop based on this new data? Maybe once insurance says they will no longer pay?

Expand full comment

"If it makes money for the hospital, will they stop based on this new data?"

No. US healthcare is replete with examples where the lack of evidence has had no impact on providers' willingness to continue to sell a product or service. The key priority is whether it makes money, not whether it helps patients.

Expand full comment

That is what I was saying...if you can bill it and get paid, they will keep doing it even if the evidence says it is not effective. I think we are saying the same thing?

Expand full comment

Yes, we are. It reflects the sad state of US healthcare that this is the case.

Expand full comment