Publication: A Survey of Groupware Evaluations

A better understanding of how groupware systems have been evaluated in the past can help to frame the discussion of what methods and techniques should be considered for future evaluations. We reviewed all papers from the ACM CSCW conference (1990-1998) that introduced or evaluated a groupware system. Forty-five papers were included in the review. The main findings are that almost one-third of the groupware systems were not evaluated in any formal way, that only about one-quarter of the articles included evaluations in a real-world setting, and that a wide variety of evaluation techniques are in use. Our main conclusions from the review are that more attention must be paid to evaluating groupware systems and that there is room for additional evaluation techniques that are simple and low in cost.

Downloads

PDF

Participants

David Pinelle
College of Medicine, University of Saskatchewan
Carl Gutwin
University of Saskatchewan

Projects

Evaluating Groupware Usability
Many organizations, particularly in the design and manufacturing sectors, are becoming increasingly distributed.

Citation

Pinelle, D., Gutwin, C. 2000. A Survey of Groupware Evaluations. In Proceedings of 9th IEEE Workshop on Enabling Technologies - Infrastructure for Collaborative Enterprises, 110-115.

BibTeX

@inproceedings {eval-survey-wetice00,
author= {David Pinelle and Carl Gutwin},
title= {A Survey of Groupware Evaluations},
booktitle= {Proceedings of 9th IEEE Workshop on Enabling Technologies - Infrastructure for Collaborative Enterprises},
year= {2000},
pages= {110-115}
}