Brain Image Biomarkers for Pain: Why should we?

Indulge me for a moment. Let’s say you just arrived at your physician’s office with a troubling symptom. She says “Hold on, I need to put you in the MRI to see if this symptom is pain, or if you are a pain patient.”

There have been a number of scientific papers and popular press releases that suggest we need to replace self-report of pain because it is flawed, and we need to employ brain imaging as a “biomarker” or “objective” measure of pain.

The basic assumption is that self-report is “unreliable” or otherwise flawed. That’s a claim often made in these papers despite a large body of evidence that self-report of pain is 1) quite reliable, 2) sensitive to treatment change, and 3) predictable[1]. If it were unreliable (full of error), it could not be predicted, and it would not be sensitive to any sort of treatment effect. As we know from our own experience, pain varies. Variability is not necessarily error. And finally, brain imaging of pain was originally, and continues to be, validated by correlations with…. wait…. SELF–REPORT!!

Whenever I bring this up, someone is quick to point out the exception in one of their patients, or relatives, or friend’s pain report that didn’t make sense, or they had trouble using the scale. Of course, there are exceptions, but the empirical data are quite clear. Self-report works. There is not a compelling reason to replace it.

Back to the doc’s office: Didn’t you go to her office because you were already pretty sure something hurt?

Why do we have this quest for a “biomarker” for pain? Here is my speculation. Our treatments, particularly pharmacological, don’t work very well. The people making them are heavily invested in producing successful outcomes in order to continue making and selling them, and believe in them. Rather than the depressing admission that the drugs themselves lack efficacy, they conclude there must be something wrong with the patients. “That lousy self-report is too variable to show our drug works. A biomarker would demonstrate that our treatment works.”

Back to the doc’s office: “Mr O’Mahoney, despite your self-rated 8/10 pain level, the MRI clearly shows that this treatment is working.”

Let’s indulge those folks who want to find the brain biomarker. Shouldn’t the brain biomarker be subjected to the same standards that they claim (erroneously) is lacking in self-report? At the time we wrote the original paper [1], I was surprised to find virtually no information available on the reliability of brain imaging of pain used to derive “biomarkers”.

So, we took data from our lab and put the brain biomarker business to the test. In the first study, we looked at reliability of functional magnetic resonance imaging (fMRI) and self-report, obtained at the same time. Self-report was highly reliable. fMRI was statistically reliable, but only at a modest level. The reliability of the fMRI suggests it’s good enough for investigating how the brain works, but certainly not high enough for any diagnostic test currently used in hospitals[2].

The paper that prompted this blog entry was the 3rd step in this line of investigation[3]. We simply took data from another one of our projects and applied the impressively sophisticated mathematical algorithms that others have employed to classify people with chronic pain to both the neuroimaging data and the self-report data. The message from this paper is quite simple. Self-report was nearly perfect in classifying patients vs non-patients on the basis of single item pain or mood scores. We employed over 50 brain regions to replicate what other authors report as their significant classification rates. The self-report algorithms significantly outperformed the “brain biomarker” algorithms. The self-report classification rates were excellent (90-100%). The best “brain biomarker” classification was in the 70-percent range. There is a certain irony in these reports: “Our brain biomarker is 70-percent as good as that self-report that is so lousy we want to replace it?” What?!!

Back to your doc’s office: Which do you want to use, your self-report or the MRI scan?

There are philosophical and ethical considerations to be grappled with. I have employed brain imaging in my own work on pain perception for many years. I will continue to do so. There is a very important place for brain imaging in the investigation of pain. But, which should take precedent: your report of your pain, or the scan of your brain? What if they differ? Which should be believed? Which one is “correct” and which is in “error”? Who should use these data, your doctor, your insurance company, or your lawyer? Is it worth putting an MRI scanner in every office?

The measurement will improve, and perhaps the classification rates will begin to approach that of self-report. I’m certain of that because the technology improves rapidly, and people will do the appropriate studies to adequately test reliability and validity. The philosophical and ethical considerations will not be adequately answered at the same pace.

About Michael Robinson

Dr Robinson is a Professor of Clinical and Health Psychology, Anesthesiology, and Physical Therapy at the University of Florida. He is the Director of the Center for Pain Research and Behavioral Health at the University of Florida.

 References

  1. Robinson, M.E., R. Staud, and D.D. Price, Pain measurement and brain activity: will neuroimages replace pain ratings? The Journal of Pain, 2013. 14(4): p. 323-327.
  2. Letzen, J.E., et al., Test-Retest Reliability of Pain-Related Brain Activity in Healthy Controls Undergoing Experimental Thermal Pain. The Journal of Pain, 2014. 15(10): p. 1008-1014.
  3. Robinson, M.E., et al., Comparison of Machine Classification Algorithms for Fibromyalgia: Neuroimages Versus Self-Report. The Journal of Pain, 2015. 16(5): p. 472-477.

Comments

  1. Oh look. Why worry about chronic pain anymore? (Tongue in cheek)

    http://www.foxnews.com/health/2015/06/18/researchers-may-have-found-cure-for-chronic-pain/

    Once one gets bitten by the Moseley/Butler bug all other reasons for pain just fade into the distance. Tough to take anything other than “Explain Pain” seriously. When will folks “get it?”

  2. Thanks for the article Michael. I think at least part of this comes part to the widely held view that objective measures = good, and subjective measures = bad. (I have a view regarding the extent to which this is a real dichotomy, but that is perhaps for another day). When it comes to pain this is compounded by the idea that some people will report higher pain levels for secondary gain in certain situations.

    In my opinion there are a couple of problems , one, you give a nice example of the fact that empirical evidence definitely does not support the contention that objective measures are necessarily more reliable and valid than objective measures.

    Two, and of particular relevance to pain; at some level most (many?) would accept that a person’s pain experience is inherently a subjective phenomenon. We accept that the experience is influenced by all sorts of inputs; somatic, neurological, psychological, contextual, social etc which are processed by the individual in a complex manner. Perhaps there is an argument that a subjective phenomenon is just plain and simple better assessed via a subjective measure.

  3. Doc Anonymous says:

    Great information and insight! I would like to comment on the reason behind the push for “neuroimaging” and the quest for “objective” measurements of pain. Based on my experience in private practice, the biggest push for objective measurement comes from 2 sources: 1. Insurance companies and 2. Regulators especially the DEA.

    The pus for Objective measure comes not from a real desire for objective measure but rather from the absolute RREJECTION of complaints that are not supported by objective measurement. In short the argument goes that if there is no objective measure then it cannot be proven and the insurance companies will do anything they can to deny payment for anything that has no “objective” proof.

    Taking it one step further, the insurance companies consider it “fraud” for doctors and/or patients to use their (insurance company) money to pay for diseases that are not “objectively proven.” Especially the workers comp carriers will deny payment for any test that might serve to “prove” the legitimacy of a potentially subjective complaint.

    And since the insurance companies consider it “fraud” to use their money to pay for such potentially fabricated complaints as pain, they use the investigatory powers that they have to investigate the doctors and patients and to enlist the governmental police agencies as their allies. After all, the Feds do pay a lot of money for disability benefits and medical care for people with those complaints.

    Doctors in general are either scared stiff of providing compassionate care based on SELF REPORT, or they are bewildered by how to survive in the current medico-legal-insurance climate.

    And the business people who run clinics and offices have one goal: maximize practice income. That most often means avoiding providing patients with problems like “Self Reported” chronic pain. After all “THOSE” people take enormous time resources of all staff, with extremely low reimbursement.

    Finally, the treatment that is based on self report has at its very heart and soul a true fiduciary relationship between the doctor and patient, one that is based on total trust both ways. The current climate has served to destroy the trust that used to exist between the doctor and the self reporting pain patient. That is the ultimate sin of the blind quest for “Objective” pain measures.

    Just my personal observations

  4. Great, great, great piece! Thank you for writing and sharing the message that also has often crossed my mind. You did not mention this specifically but I feel that your message goes way beyond the field of pain to several psychological phenomena that are currently investigated in a biological framework using imaging methods to find “neural correlates”, with the implicit assumption that these are somehow more objective or true compared to behavior and / or self-report. That this assumption is, at the very least, premature is definitely important and worthwhile to point out. Thank you for that!