Just a quick post to give my review of the latest addition to imaging and mindfulness research. A new article by Kozasa et al, slated to appear in Neuroimage, investigates the neural correlates of attention processing in a standard color-word stroop task. A quick overview of the article reveals it is all quite standard; two groups matched for age, gender, and years of education are administered a standard RT-based (i.e. speeded) fMRI paradigm. One group has an average of 9 years “meditation experience” which is described as “a variety of OM (open monitoring) or FA (focused attention) practices such as “zazen”, mantra meditation, mindfulness of breathing, among others”. We’ll delve into why this description should give us pause for thought in a moment, for now let’s look at the results.
In a nutshell, the authors find that meditation-practitioners show faster reaction times with reduced BOLD-signal for the incongruent (compared to congruent and neutral) condition only. The regions found to be more active for non-meditators compared to meditators are the (right) “lentiform nucleus, medial frontal gyrus, and pre-central gyrus” . As this is not accompanied by any difference in accuracy, the authors interpret the finding as demonstrating that “meditators may have maintained the focus in naming the colour with less interference of reading the word and consequently have to exert less effort to monitor the conflict and less adjustment in the motor control of the impulses to choose the correct colour button.” The authors in the conclusion review related findings and mention that differences in age could have contributed to the effect.
So, what are we to make of these findings? As is my usual style, I’ll give a bulleted review of the problems that immediately stand out, and then some explanation afterwards. I’ll preface my critique by thanking the authors for their hard work; my comments are intended only for the good of our research community.
- Sensible findings; increases in reaction time and decreases in bold are demonstrated in areas previously implicated in meditation research
- Solid, easy to understand behavioral paradigm
- Relatively strong main findings ( P< .0001)
- A simple replication. We like replications!
- Appears to report uncorrected p-values
- Study claims to “match samples for age” yet no statistical test demonstrating no difference is shown. Qualitatively, the ages seem different enough to be cause for worry (77.8% vs 65% college graduates). Always be suspicious when a test is not given!
- Extremely sparse description of style of practice, no estimate of daily practice hours given.
- Reaction-time based task with no active control
I’ll preface my conclusion with something Sara Lazar, a meditation researcher and neuroimaging expert at the Harvard MGH told me last summer; we need to stop going for the “low hanging fruit of meditation research”. There are now over 20 published cross-sectional reaction-time based fMRI studies of “meditators” and “non-meditators”. Compare that to the incredibly sparse number of longitudinal, active controlled studies, and it is clear that we need to stop replicating these findings and start determining what they actually tell us. Why do we need to active control our meditation studies? For one thing, we know that reaction-time based tests are heavily based by the amount of effort one expends on the task. Effort is in turn influenced by task-demands (e.g. how you treat your participants, expectations surrounding the experiment). To give one in-press example, my colleagues Christian Gaden Jensen at the Copenhagen Neurobiology Research recently conducted a study demonstrating just how strong this confounding effect can be.
To briefly summarize, Christian recruited over 150 people for randomization to four experimental groups: mindfulness-based stress reduction (MBSR), non-mindfulness stress reduction (NMSR), wait-listed controls, and financially-motivated wait-listed controls. This last group is the truly interesting one; they were told that if they had top performance on the experimental tasks (a battery of classical reaction-time based and unspeeded perceptual threshold tasks) they’d receive a reward of approximately 100$. When Christian analyzed the data, he found that the financial incentive eliminated all reaction-time based differences between the MBSR, NMSR, and financially motivated groups! It’s important to note that this study, fully randomized and longitudinal, showed something not reflected in the bulk of published studies: that meditation may actually train more basic perceptual sensitivities rather than top-down control. This is exactly why we need to stop pursuing the low-hanging fruit of uncontrolled experimental design; it’s not telling us anything new! Meditation research is no longer exploratory.
In addition to these issues, there is another issue a bit more specific to meditation research. That is the totally sparse description of the practice- less than one sentence total, with no quantitative data! In this study we are not even told what the daily practice actually consists of, or its quality or length. These practitioners report an average of 8 years practice, yet that could be 1 hour per week of mantra meditation or 12 hours a week of non-dual zazen! These are not identical processes and our lack of knowledge for this sample severely limits our ability to assess the meaning of these findings. For the past two years (and probably longer) of the Mind & Life Summer Research Institute, Richard Davidson and others have repeatedly stated that we must move beyond studying meditation as “a loose practice of FA and OM practices including x, y, z, & and other things”. Willoughby Britton suggested at a panel discussion that all meditation papers need to have at least one contemplative scholar on them or risk rejection. It’s clear that this study was most likely not reviewed by anyone with any serious academic background in meditation research.
My supervisor Antoine Lutz and his colleague John Dunne, authors of the paper that launched the “FA/OM” distinction, have since stated emphatically that we must go beyond these general labels and start investigating effects of specific meditation practices. To quote John, we need to stop treating meditation like a “black box” if we ever want to understand the actual mechanisms behind it. While I thank the authors of this paper for their earnest contribution, we need to take this moment to be seriously skeptical. We can only start to understand processes like meditation from a scientific point of view if we are willing to hold them to the highest of scientific standards. It’s time for us to start opening the black box and looking inside.