Multisite reliability of cognitive BOLD data

Gregory G. Brown, Daniel H. Mathalon, Hal Stern, Judith Ford, Bryon Mueller, Douglas N. Greve, Gregory McCarthy, James Voyvodic, Gary Glover, Michele Diaz, Elizabeth Yetter, I. Burak Ozyurt, Kasper Winther Jørgensen, Cynthia G. Wible, Jessica A. Turner, Wesley K. Thompson, Steven G. Potkin

Research output: Contribution to journalJournal articleResearchpeer-review


Investigators perform multi-site functional magnetic resonance imaging studies to increase statistical power, to enhance generalizability, and to improve the likelihood of sampling relevant subgroups. Yet undesired site variation in imaging methods could off-set these potential advantages. We used variance components analysis to investigate sources of variation in the blood oxygen level-dependent (BOLD) signal across four 3-T magnets in voxelwise and region-of-interest (ROI) analyses. Eighteen participants traveled to four magnet sites to complete eight runs of a working memory task involving emotional or neutral distraction. Person variance was more than 10 times larger than site variance for five of six ROIs studied. Person-by-site interactions, however, contributed sizable unwanted variance to the total. Averaging over runs increased between-site reliability, with many voxels showing good to excellent between-site reliability when eight runs were averaged and regions of interest showing fair to good reliability. Between-site reliability depended on the specific functional contrast analyzed in addition to the number of runs averaged. Although median effect size was correlated with between-site reliability, dissociations were observed for many voxels. Brain regions where the pooled effect size was large but between-site reliability was poor were associated with reduced individual differences. Brain regions where the pooled effect size was small but between-site reliability was excellent were associated with a balance of participants who displayed consistently positive or consistently negative BOLD responses. Although between-site reliability of BOLD data can be good to excellent, acquiring highly reliable data requires robust activation paradigms, ongoing quality assurance, and careful experimental control.
Original languageEnglish
Issue number3
Pages (from-to)2163-2175
Publication statusPublished - 2011
Externally publishedYes


Dive into the research topics of 'Multisite reliability of cognitive BOLD data'. Together they form a unique fingerprint.

Cite this