TY - JOUR
T1 - Gender differences in peer reviews of grant applications : a substantive-methodological synergy in support of the null hypothesis model
AU - Marsh, Herbert W.
AU - Jayasinghe, Upali W.
AU - Bond, Nigel W.
PY - 2011
Y1 - 2011
N2 - Peer review serves a gatekeeper role, the final arbiter of what is valued in academia, but is widely criticized in terms of potential biases-particularly in relation to gender. In this substantive-methodological synergy, we demonstrate methodological and multilevel statistical approaches to testing a null hypothesis model in relation to the effect of researcher gender on peer reviews of grant proposals, based on 10,023 reviews by 6233 external assessors of 2331 proposals from social science, humanities, and science disciplines. Utilizing multilevel cross-classified models, we show that support for the null hypothesis model positing researcher gender has no significant effect on proposal outcomes. Furthermore, these non-effects of gender generalize over assessor gender (contrary to a matching hypothesis), discipline, assessors chosen by the researchers themselves compared to those chosen by the funding agency, and country of the assessor. Given the large, diverse sample, the powerful statistical analyses, and support for generalizability, these results -coupled with findings from previous research - offer strong support for the null hypothesis model of no gender differences in peer reviews of grant proposals.
AB - Peer review serves a gatekeeper role, the final arbiter of what is valued in academia, but is widely criticized in terms of potential biases-particularly in relation to gender. In this substantive-methodological synergy, we demonstrate methodological and multilevel statistical approaches to testing a null hypothesis model in relation to the effect of researcher gender on peer reviews of grant proposals, based on 10,023 reviews by 6233 external assessors of 2331 proposals from social science, humanities, and science disciplines. Utilizing multilevel cross-classified models, we show that support for the null hypothesis model positing researcher gender has no significant effect on proposal outcomes. Furthermore, these non-effects of gender generalize over assessor gender (contrary to a matching hypothesis), discipline, assessors chosen by the researchers themselves compared to those chosen by the funding agency, and country of the assessor. Given the large, diverse sample, the powerful statistical analyses, and support for generalizability, these results -coupled with findings from previous research - offer strong support for the null hypothesis model of no gender differences in peer reviews of grant proposals.
UR - http://handle.uws.edu.au:8081/1959.7/536307
U2 - 10.1016/j.joi.2010.10.004
DO - 10.1016/j.joi.2010.10.004
M3 - Article
SN - 1751-1577
VL - 5
SP - 167
EP - 180
JO - Journal of Informetrics
JF - Journal of Informetrics
IS - 1
ER -