Multisite reliability of cognitive BOLD data

Publication: Research - peer-reviewJournal article – Annual report year: 2011

Without internal affiliation

  • Author: Brown, Gregory G.

    VA San Diego Healthcare System

  • Author: Mathalon, Daniel H.

    University of California

  • Author: Stern, Hal

    University of California

  • Author: Ford, Judith

    University of California

  • Author: Mueller, Bryon

    University of Minnesota

  • Author: Greve, Douglas N.

    Massachusetts General Hospital

  • Author: McCarthy, Gregory

    Yale University

  • Author: Voyvodic, James

    Duke University

  • Author: Glover, Gary

    Stanford University

  • Author: Diaz, Michele

    Duke University

  • Author: Yetter, Elizabeth

    University of California

  • Author: Ozyurt, I. Burak

    University of California

  • Author: Jørgensen, Kasper Winther

    University of California

  • Author: Wible, Cynthia G.

    Harvard Medical School

  • Author: Turner, Jessica A.

    University of California, Irvine

  • Author: Thompson, Wesley K.

    University of California

  • Author: Potkin, Steven G.

    University of California, Irvine

View graph of relations

Investigators perform multi-site functional magnetic resonance imaging studies to increase statistical power, to enhance generalizability, and to improve the likelihood of sampling relevant subgroups. Yet undesired site variation in imaging methods could off-set these potential advantages. We used variance components analysis to investigate sources of variation in the blood oxygen level-dependent (BOLD) signal across four 3-T magnets in voxelwise and region-of-interest (ROI) analyses. Eighteen participants traveled to four magnet sites to complete eight runs of a working memory task involving emotional or neutral distraction. Person variance was more than 10 times larger than site variance for five of six ROIs studied. Person-by-site interactions, however, contributed sizable unwanted variance to the total. Averaging over runs increased between-site reliability, with many voxels showing good to excellent between-site reliability when eight runs were averaged and regions of interest showing fair to good reliability. Between-site reliability depended on the specific functional contrast analyzed in addition to the number of runs averaged. Although median effect size was correlated with between-site reliability, dissociations were observed for many voxels. Brain regions where the pooled effect size was large but between-site reliability was poor were associated with reduced individual differences. Brain regions where the pooled effect size was small but between-site reliability was excellent were associated with a balance of participants who displayed consistently positive or consistently negative BOLD responses. Although between-site reliability of BOLD data can be good to excellent, acquiring highly reliable data requires robust activation paradigms, ongoing quality assurance, and careful experimental control.
Original languageEnglish
Issue number3
Pages (from-to)2163-2175
StatePublished - 2011
Externally publishedYes
CitationsWeb of Science® Times Cited: 40
Download as:
Download as PDF
Select render style:
Download as HTML
Select render style:
Download as Word
Select render style:

ID: 6284239