Hyperthermia as an Antidepressant? (Updated)

By Neuroskeptic | May 15, 2016 7:07 am

Getting warm has a dramatic antidepressant effect, according to a new report published in the prestigious journal JAMA Psychiatry. But is it hot science or a hot mess?

The researchers, led by Clemens Janssen of the University of Wisconsin-Madison, studied 29 people with depression who were not receiving any other treatments. Half were randomized to receive whole-body hyperthermia (WBH), using a setup which raised their core body temperature to 38.5 degrees (37 degrees is normal).

hyperthermiaThe other half of the patients were the control group who received a ‘sham’ treatment. They spent time in the hot-box as well, but on a much lower setting: their core temperature only rose to 37.7 degrees. This mild treatment was intended to make the placebo patients think that they really had received an active treatment, to generate the same placebo effect in both groups.

What happened? Although both groups became less depressed following the treatment (which was just one session, lasting 2-3 hours), the active WBH group improved much more than the sham group on the HDRS depression rating scale over subsequent weeks:

janssen_hyperthermiaThe difference between the two groups is dramatic. At week 1, the WBH group improved by 6 more HAMD points than the sham, and the Cohen’s d effect size is stated as 2.23. This is a spectacular Cohen’s d score – given that 0.5 is considered ‘medium’ and 0.8 is considered a ‘large’ effect! For comparison, the average antidepressant medication causes improvement of about 3-4 HAMD points vs. placebo, with a Cohen’s d of around 0.35.

Quite frankly I don’t believe that WBH has an effect size of 2.23 vs. sham. Has something gone wrong with the calculations?

Yes, it looks like it has. Look again at that figure – the error bars, indicating the data standard deviation, are tiny. I believe that in the figure, Janssen et al. have confused the standard error (SE) for the standard deviation (SD). The SE is always smaller than the SD. Indeed, in Table 2, we see the means and SD for these measures and it’s obvious that the SD is much higher than in the graph.

UntitledJanssen et al. appear to have mixed up the SD and SE for the Cohen’s d calculation as well. Based on Table 2 I calculate the true Week 1 Cohen’s d as 1.35 in favor of WBH. This is still extraordinarily high, but not quite as spectacular as 2.23. I’m still not sure what to make of it.

(Edit 16.5.2016: on further investigation I’m not sure that SD/SE confusion is the whole story. Figure 1 seemingly does show SE, rather than SD as the caption says – a typo? However, this can’t explain the d=2.23 result. Rather, it seems that the graph and the d=2.23 result might be the output of a statistical model – the hierarchical linear mixed-effects model Janssen et al. used – whereas Table 2 gives the raw data. Thanks to Jon Roiser for input on this point.)

Another issue here is the placebo effect. To their credit Janssen et al. did go to lengths to ensure that the sham treatment was a believable one (i.e. it did involve some body heating) in order to  prevent unblinding. However, it’s not clear they were successful: “10 of 14 participants [71.4%] randomized to sham believed they had received active hyperthermia immediately on completion of the procedure (compared with 15 of 16 [93.8%] receiving active WBH).” Note the possible ceiling effect in the active group. So the active group may have been more likely to expect to improve.

I would have liked to see a more powerful sham condition. Why not tell participants that the study is of “changing body temperature to treat depression”, and then use body cooling as the control condition? This way, both groups would get a bona fide temperature modification.

As to how hyperthermia could have an antidepressant effect, Janssen et al. speculate that it’s all about the brain regions:

In humans, exposure to cutaneous heating (41°C) activates the mid orbitofrontal cortex, the pregenual anterior cingulate cortex,and the ventral striatum, with the degree of activation being associated with subjective pleasantness ratings made in response to the warm temperature. Importantly, these and other brain regions most implicated in registering – and reacting to – pleasant thermal signals show decreased activity in patients with MDD [major depressive disorder]… Based on these considerations, we conducted animal studies demonstrating that whole-body heating activated subdivisions of the dorsal raphe nucleus implicated in mood regulation an antidepressant-like responses, whil notactivating other dorsal raphe subregions, including those implicated in the facilitation of anxiety states…

h/t Bernard Carroll

Edit 19.5.2016: Chuck Raison, the senior author of the paper, has made the fellowing response:

We did not mix up standard deviations and standard errors. As suspected in Dr. Carroll’s piece, the effect sizes we reported were those delivered by the linear mixed model used to evaluate differences between groups. The LMM delivered larger effect sizes than would be calculated from the raw data that we reported in Table 2 in the paper. For consistency, working with JAMA Psychiatry, we are amending the effect sizes as those that would be calculated from the raw data presented in Table 2. This reduces the effect sizes, but they remain large, as will be apparent in the modified paper.

The Figure in the online version inadvertently shows standard errors due to a mix-up in the editorial process. This will also be corrected. I think the important point to note here is that the effect sizes do not speak as much to the antidepressant power of active hyperthermia as to the fact that the change in depressive symptoms observed in the active group are not likely explained by a number of non-specific aspects of the intervention captured by the sham condition. The sham condition did not produce a very robust effect. The idea of a cold comparator is intriguing but has its own issues–the conditions would likely be quite different so it would be a bit of an apples to oranges comparison, and it may well be that hypothermia may also have some promise as an antidepressant.

Some of the other folks making comments on this study might be interested to know that in the first version of the paper we did in fact report stats on the secondary variables we reported in the supplemental file, but were asked to remove these on revision. In fact, we did see evidence that hyperthermia improved self-reported depressive symptoms at one week post-treatment and saw improvements in function and quality of life over the first couple of weeks that had dissipated by week 6. The important point about hyperthermia is not that chronic heat makes people feel better–it doesn’t generally–but that an acute exposure to intense heat may regulate thermoregulatory pathways linked to mood modulation.

Frankly we did not expect the effect of a single treatment to persist out to six weeks and we note that the sham group remained slightly improved at six weeks, so I am not convinced that this protracted effect is entirely explained by the active treatment. Rather examining the response curves it seems to me that there is an active effect apparent over the first two weeks post-treatment that then is maintained in the treatment group.

ResearchBlogging.orgJanssen CW, Lowry CA, Mehl MR, Allen JJ, Kelly KL, Gartner DE, Medrano A, Begay TK, Rentscher K, White JJ, Fridman A, Roberts LJ, Robbins ML, Hanusch KU, Cole SP, & Raison CL (2016). Whole-Body Hyperthermia for the Treatment of Major Depressive Disorder: A Randomized Clinical Trial. JAMA Psychiatry PMID: 27172277

ADVERTISEMENT
  • Bernard Carroll

    Good catch on the effect size error. They also declared 3 secondary outcome measures, but none of those was significant between sham and active hyperthermia groups. The authors were not up front in stating the lack of significance for those measures. Disingenuously, they tried to palm it off to a Table in the eSupplement, with no analyses given. From eTable 2, I computed for the self-rated depression scale IDS-SR at 6 weeks, p = 0.09; for Sheehan Disability Scale at 6 weeks, p = 0.2346; for Q-LES-Q (Quality of Life Enjoyment and Satisfaction Questionnaire) at 6 weeks, p = 0.4161. These are not reassuring as to the robustness of their claim. We should also note that the patients had extraordinarily long illness episode durations (8-10 YEARS). Makes you wonder… At the least those patients aren’t typical of the general clinical population of major depressed subjects.

    • http://blogs.discovermagazine.com/neuroskeptic/ Neuroskeptic

      Good point!

    • Eiko Fried

      Hi Barney,

      I come up with a different result for the IDS-SR at 6 weeks (p=0.6240), based on a unpaired t-test:
      N WBH = 15
      N sham = 11
      mean (SD) WBH = 23.87 (10.16)
      mean (SD) sham = 32.50 (14.87)

      Could you help me clarify why our results differ? Thank you


      Intermediate values used in calculations:
      t = 0.4966
      df = 24
      standard error of difference = 17.379

      • Bernard Carroll

        Hi Eiko. I re-ran the unpaired t test using your data shown above and I still get p=0.0909. I don’t know why we are getting different answers, but anyway both are non-significant. Best, Barney.

  • Pingback: IFM 5/15 – Disruptive Paradigm()

  • Joanne Williams

    16 authors and not one of them spot that they’re using the standard error…

  • The Truth Hurts

    I find this study to be ridiculous. Hyperthermia is not good for many people’s body. I call sham and pseudoscience and some other things that I shouldn’t type. This seems like such a placebo to me.

  • neuraxon77

    Either way, I’m going back to my warm bed.

  • Pingback: Markierungen 05/16/2016 - Snippets()

  • polistra24

    Probably true for some people. Inverse for me and many others.

  • reasonsformoving

    What a small sample size too.

    It’s amazing what gets published in what used to be known as Archives – psychiatry’s most prestigious journal.

    • http://blogs.discovermagazine.com/neuroskeptic/ Neuroskeptic

      It’s a very small sample, especially size given that ‘extraordinary claims require extraordinary evidence’ and what this paper is claiming is truly extraordinary!

  • http://www.mazepath.com/uncleal/qz4.htm Uncle Al

    The entire US southwest baking in summer and fall would then be a hotbed of happiness, ditto folks with influenza. How happy is Arabia? Obamacare must mandate therapeutic hot tubs staffed with hunks and bimbettes (community college AA degrees – for free!) for everybody with indeterminate happiness states.

    In the real world burning hot Santa Ana wind, haboob, foehn, khamsin show increases in rates of suicide, homicide, employment sick days, crimes, and traffic accidents.

    • Bernard Carroll

      Don’t confuse ambient temperature with brain temperature.

      • http://www.mazepath.com/uncleal/qz4.htm Uncle Al

        Explain how desert-resident brains are not potentially temperature-boosted compared to those in Nunavut. Are overheated athletes anomalously happy compared to themselves after cool down? No retia mirabilia here!

  • benkz1

    check out:

    Koltyn, K. F., Robins, H. I., Schmitt, C. L., Cohen, J. D. & Morgan, W. P. Changes in mood state following whole-body hyperthermia. International journal of hyperthermia : the official journal of European Society for Hyperthermic Oncology, North American Hyperthermia Group 8, 305-307 (1992).

    Christman, J. V. & Gisolfi, C. V. Heat acclimation: role of norepinephrine in the anterior hypothalamus. J Appl Physiol (1985) 58, 1923-1928 (1985).

  • benkz1

    Check out:

    Koltyn, K. F., Robins, H. I., Schmitt, C. L., Cohen, J. D. & Morgan, W. P. Changes in mood state following whole-body hyperthermia. International journal of hyperthermia : the official journal of European Society for Hyperthermic Oncology, North American Hyperthermia Group 8, 305-307 (1992).

    Christman, J. V. & Gisolfi, C. V. Heat acclimation: role of norepinephrine in the anterior hypothalamus. J Appl Physiol (1985) 58, 1923-1928 (1985).

    Kukkonen-Harjula, K. et al. Haemodynamic and hormonal responses to heat exposure in a Finnish sauna bath. European journal of applied physiology and occupational physiology 58, 543-550 (1989).

    • http://blogs.discovermagazine.com/neuroskeptic/ Neuroskeptic

      Thanks for these interesting references! I love the sauna study.

  • Pingback: Could Hyperthermia Make a Comeback?()

  • Pingback: Could Inducing Brief, Mild 'Fever' Help Ease Depression? – Medicine Minutes()

  • ohwilleke

    Interesting study. One nice aspect of it is that the nature of the treatment makes it unlikely to cause serious long term harm. Another is that the treatment should be pretty cheap and seems to be fast acting relative to lots of anti-depressant drug regimes so it might be useful as a bridge treatment until drugs take effect. And, of course, while it would be nice to know why it works, it doesn’t really matter if it can be replicated in studies with more participants. A face value it seems like the effect is similar to rebooting a computer.

    Of course, flukes can easily crop up in studies with 14 controls and 15 test subjects for all manner of reasons impossible to determine on the face of the study (or even by the researchers). But, if it replicates in a study with 300 test subjects – awesome. Certainly, the approach described in the study deserves a follow up study even if the statistics in the original version of the article aren’t perfect.

    It would also be interesting to see if there is any literature on depression symptoms being affected by fevers from seasonal flu.

  • Buzzy Kerbox

    Hypothermia/cold adaptation is the go, creates an incredible sense of mindfullness through exposing any unhelpful habits/muscle memory in the physiology/neurology. I am generalising a bit but this done over time forces the whole physiology and biology to adapt to a real stress, leaving minor/moderate stresses in its wake. Scientifically this is explained at length in some videos with Wim Hof and Dr Rhonda Patrick which can be easily found, as are the experiments done in Wim himself; Rhonda also talks about heat shock/sauna therapy in other talks. It all puts a much different perspective on Scandinavians use of Sauna’s then jumping into ice lakes. Having spent over a decade with ‘chronic fatigue syndrome’, a totally shot nervous system I can not express enough how powerful these therapies are.

  • Pingback: Hyperthermia as depression treatment | Eiko Fried()

  • Pingback: Warm thoughts? Treating depression with whole body hyperthermia – Daily Medical News()

NEW ON DISCOVER
OPEN
CITIZEN SCIENCE
ADVERTISEMENT

Neuroskeptic

No brain. No gain.

About Neuroskeptic

Neuroskeptic is a British neuroscientist who takes a skeptical look at his own field, and beyond. His blog offers a look at the latest developments in neuroscience, psychiatry and psychology through a critical lens.

ADVERTISEMENT

See More

@Neuro_Skeptic on Twitter

ADVERTISEMENT

Discover's Newsletter

Sign up to get the latest science news delivered weekly right to your inbox!

Collapse bottom bar
+