HCI Peer Review Faces Scrutiny for Bias Against Global South Scholarship

The hallowed halls of Human-Computer Interaction (HCI) scholarship are facing a reckoning. A new study exposes systemic biases within the peer review process, specifically targeting research originating from the Global South. The findings raise serious questions about whose knowledge is legitimized and whose is marginalized in this influential field.

Unveiling the 'WEIRD' Bias

The paper, published on arXiv, directly confronts the lack of systemic inquiry into how biases affect underrepresented Global South (GS) scholarship within HCI. The authors highlight that peer review, the gatekeeper of academic legitimacy, often disadvantages scholarship that diverges from the norm. This "norm," the study suggests, is often rooted in Western, Educated, Industrialized, Rich, and Democratic (WEIRD) perspectives, inadvertently creating barriers for researchers from different cultural and socioeconomic backgrounds.

The research team conducted four focus groups with 16 HCI researchers studying the Global South. Participants detailed experiences with reviews that pigeonholed their work into development research, dismissed their theoretical contributions, and challenged the validity of situated knowledge derived from Global South communities. This epistemic oppression, as the study frames it, places an undue burden on GS researchers to constantly justify the relevance and importance of their work.

Tokenism and the Hidden Curriculum

Beyond biased evaluations, the study also sheds light on other subtle yet significant obstacles. GS researchers reported being tokenized as "cultural experts" when assigned to review papers, implying a limited scope of expertise. Furthermore, the "hidden curriculum" of writing HCI papers – the unwritten rules and expectations – often serves as a gatekeeper, hindering the acceptance of GS scholarship. According to the researchers, this creates a cycle of exclusion, where marginalized voices struggle to gain recognition within the field. The research suggests that the subtle nuances of academic writing, often assumed and unstated, inadvertently penalize those unfamiliar with WEIRD academic norms.

This isn't just about fairness; it's about the integrity and comprehensiveness of HCI research. By marginalizing Global South perspectives, the field risks developing solutions and technologies that are inherently biased and ill-suited for a significant portion of the world's population. The study concludes with a call to action, outlining actionable strategies for nurturing equitable epistemological evaluation of HCI scholarship. These strategies include raising awareness of biases, promoting diverse review panels, and critically examining the underlying assumptions within the peer review process. The future of HCI depends on its ability to embrace diverse perspectives and ensure that all voices are heard and valued.