Exposing and Overcoming the Fixed Effect Fallacy Through Crowd Science

Cyrus-Lai, W., Tierney, W., Schweinsberg, M., & Uhlmann, E.L. (2022). Exposing and overcoming the fixed effect fallacy through crowd science. Comment. Behavioral and Brain Sciences, 45, E8.


By organizing crowds of scientists to independently tackle the same research questions, we can collectively overcome the generalizability crisis. Strategies to draw inferences from a heterogeneous set of research approaches include aggregation, for instance meta-analyzing the effect sizes obtained by different investigators, and parsing, attempting to identify theoretically meaningful moderators that explain the variability in results.

Subscribe to Martin's newsletter