Multisite reliability of cognitive BOLD data

Publication: Research - peer-reviewJournal article – Annual report year: 2011

Without internal affiliation

  • Author: Brown, Gregory G.

    VA San Diego Healthcare System

  • Author: Mathalon, Daniel H.

    University of California, Department of Psychiatry

  • Author: Stern, Hal

    University of California, Department of Statistics

  • Author: Ford, Judith

    University of California, Department of Psychiatry

  • Author: Mueller, Bryon

    University of Minnesota, Department of Psychiatry

  • Author: Greve, Douglas N.

    Massachusetts General Hospital, Department of Radiology

  • Author: McCarthy, Gregory

    Yale University, Department of Psychology

  • Author: Voyvodic, James

    Duke University

  • Author: Glover, Gary

    Stanford University

  • Author: Diaz, Michele

    Duke University

  • Author: Yetter, Elizabeth

    University of California, Department of Psychiatry

  • Author: Ozyurt, I. Burak

    University of California, Department of Psychiatry

  • Author: Jørgensen, Kasper Winther

    Unknown

  • Author: Wible, Cynthia G.

    Harvard Medical School and Brockton VAMC, Department of Psychiatry

  • Author: Turner, Jessica A.

    University of California Irvine, Department of Psychiatry

  • Author: Thompson, Wesley K.

    University of California, Department of Psychiatry

  • Author: Potkin, Steven G.

    University of California Irvine, Department of Psychiatry

View graph of relations

Investigators perform multi-site functional magnetic resonance imaging studies to increase statistical power, to enhance generalizability, and to improve the likelihood of sampling relevant subgroups. Yet undesired site variation in imaging methods could off-set these potential advantages. We used variance components analysis to investigate sources of variation in the blood oxygen level-dependent (BOLD) signal across four 3-T magnets in voxelwise and region-of-interest (ROI) analyses. Eighteen participants traveled to four magnet sites to complete eight runs of a working memory task involving emotional or neutral distraction. Person variance was more than 10 times larger than site variance for five of six ROIs studied. Person-by-site interactions, however, contributed sizable unwanted variance to the total. Averaging over runs increased between-site reliability, with many voxels showing good to excellent between-site reliability when eight runs were averaged and regions of interest showing fair to good reliability. Between-site reliability depended on the specific functional contrast analyzed in addition to the number of runs averaged. Although median effect size was correlated with between-site reliability, dissociations were observed for many voxels. Brain regions where the pooled effect size was large but between-site reliability was poor were associated with reduced individual differences. Brain regions where the pooled effect size was small but between-site reliability was excellent were associated with a balance of participants who displayed consistently positive or consistently negative BOLD responses. Although between-site reliability of BOLD data can be good to excellent, acquiring highly reliable data requires robust activation paradigms, ongoing quality assurance, and careful experimental control.
Original languageEnglish
JournalNeuroimage
Publication date2011
Volume54
Issue3
Pages2163-2175
ISSN1053-8119
DOIs
StatePublished
CitationsWeb of Science® Times Cited: 17
Download as:
Download as PDF
Select render style:
APAAuthorCBEHarvardMLAStandardVancouverShortLong
PDF
Download as HTML
Select render style:
APAAuthorCBEHarvardMLAStandardVancouverShortLong
HTML
Download as Word
Select render style:
APAAuthorCBEHarvardMLAStandardVancouverShortLong
Word

ID: 6284239