As some (hopefully many) of you know, several years ago I started an effort to systematically replicate diverse results from the experimental philosophy literature. That work produced two papers (link to paper on gender and link to paper on ethnicity) and for the SSRN versions, see paper on gender and paper on ethnicity. Others who became interested in this kind of work carried out similar replications and verified my original findings (link 1 and link 2).
In one of my papers (paper on ethnicity) I attempted replication of the influential article by Weinberg, Nichols and Stich (2001) that in large part gave rise to the experimental philosophy movement. None of the findings of the original paper were reproducible.
I wanted to post a quick note on a related study I conducted recently. I will not be submitting this for publication and so wanted to share the results via this blog post.
The data for the exact replication of Weinberg et al. (2001) surveyed individuals of East and South Asian backgrounds living and studying in the West (as the original paper by Weinberg and colleagues also surveyed individuals from different ethnic background living and/or studying in the West).
I had previously considered collecting data from East and South Asians living in their respective regions and a referee made a similar suggestion. My response to the referee was that individuals of different ethnic backgrounds living in their native regions were not the concern of Weinberg and colleagues’ study, and hence it was beyond the scope of my exact replication.
Since then I collected data on Indians living in India and the findings again show that there are no cross-cultural differences in epistemic intuitions. Unfortunately, I could not collect data for East Asians living in East Asia as Amazon’s Mechanical Turk seems to have changed it's policies and does not allow survey/task distribution internationally. I did manage to collect data from South Asia and the findings are presented in the research note uploaded to SSRN. I will try to update this post with a link to the raw data.
I also checked the data set for differences based on gender and age (since there have been reports on differences based on these variables) and here again there were no significant differences.