Investigating variation in replicability: A 'many labs' replication project

Richard A. Klein , Kate A. Ratliff , Michelangelo Vianello , Reginald B. Jr. Adams , Stepan Bahnik , Michael J. Bernstein , Konrad Bocian , Mark J. Brandt , Beach Brooks , Claudia Chloe Brumbaugh , Zeynep Cemalcilar , Jesse Chandler , Winnee Cheong , William E. Davis , Thierry Devos , Matthew Eisner , Natalia Frankowska , David Furrow , Elisa Maria Galliani , Fred Hasselman , Joshua A. Hicks , James F. Hovermale , S. Jane Hunt , Jeffrey R. Huntsinger , Hans IJzerman , Melissa-Sue John , Jennifer A. Joy-Gaba , Heather Barry Kappes , Lacy E. Krueger , Jaime Kurtz , Carmel A. Levitan , Robyn K. Mallett , Wendy L. Morris , Anthony J. Nelson , Jason A. Nier , Grant Packard , Ronaldo Pilati , Abraham M. Rutchick , Kathleen Schmidt , Jeanine L. Skorinko , Robert Smith , Troy G. Steiner , Justin Storbeck , Lyn M. Van Swol , Donna Thompson , A. E. Veer


Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the replicability of 13 classic and contemporary effects across 36 independent samples totaling 6,344 participants. In the aggregate, 10 effects replicated consistently. One effect�imagined contact reducing prejudice�showed weak support for replicability. And two effects�flag priming influencing conservatism and currency priming influencing system justification�did not replicate. We compared whether the conditions such as lab versus online or US versus international sample predicted effect magnitudes. By and large they did not. The results of this small sample of effects suggest that replicability is more dependent on the effect itself than on the sample and setting used to investigate the effect. (PsycINFO Database Record (c) 2016 APA, all rights reserved)
Author Richard A. Klein
Richard A. Klein,,
, Kate A. Ratliff
Kate A. Ratliff,,
, Michelangelo Vianello
Michelangelo Vianello,,
, Reginald B. Jr. Adams
Reginald B. Jr. Adams,,
, Stepan Bahnik
Stepan Bahnik,,
, Michael J. Bernstein
Michael J. Bernstein,,
, Konrad Bocian (Wydział Zamiejscowy w Sopocie)
Konrad Bocian,,
- Wydział Zamiejscowy w Sopocie
, Mark J. Brandt
Mark J. Brandt,,
, Beach Brooks
Beach Brooks,,
, Claudia Chloe Brumbaugh
Claudia Chloe Brumbaugh,,
et al.`
Journal seriesSocial Psychology, [Zeitschrift für Sozialpsychologie], ISSN 1864-9335, e-ISSN 2151-2590, (A 20 pkt)
Issue year2014
Pages142 - 152
Publication size in sheets0.5
Keywords in Englishcross-cultural, generalizability, replication, reproducibility, variation, 2014, Cross Cultural Differences, Experimental Replication, 2014
ASJC Classification3200 General Psychology; 3312 Sociology and Political Science; 1201 Arts and Humanities (miscellaneous); 3207 Social Psychology
Languageen angielski
ContentServer.pdf 638.36 KB
Score (nominal)25
Publication indicators Scopus SNIP (Source Normalised Impact per Paper): 2014 = 0.789; WoS Impact Factor: 2014 = 1.662 (2) - 2014=1.736 (5)
Citation count*
Share Share

Get link to the record

* presented citation count is obtained through Internet information analysis and it is close to the number calculated by the Publish or Perish system.
Are you sure?