Publication: HARK No More: On the Preregistration of CHI Experiments

Experimental preregistration is required for publication in many scientific disciplines and venues. When experimental intentions are preregistered, reviewers and readers can be confident that experimental evidence in support of reported hypotheses is not the result of HARKing, which stands for Hypothesising After the Results are Known. We review the motivation and outcomes of experimental preregistration across a variety of disciplines, as well as previous work commenting on the role of evaluation in HCI research. We then discuss how experimental preregistration could be adapted to the distinctive characteristics of Human-Computer Interaction empirical research, to the betterment of the discipline.

Downloads

PDF

Participants

Andy Cockburn
University of Canterbury
Carl Gutwin
University of Saskatchewan
Alan Dix

Citation

Cockburn, A., Gutwin, C., Dix, A. 2018. HARK No More: On the Preregistration of CHI Experiments. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI 2018), Montreal QC, Canada. 12. DOI=10.1145/3173574.3173715.

BibTeX

@inproceedings {529-HARK,
author= {Andy Cockburn and Carl Gutwin and Alan Dix},
title= {HARK No More: On the Preregistration of CHI Experiments},
booktitle= {Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI 2018)},
year= {2018},
address= {Montreal QC, Canada},
pages= {12}
}