Selecting users for participation in IT projects: Trading a representative sample for advocates and champions?

Abstract

The selection of users for participation in IT projects involves trade-offs between multiple criteria, one of which is selecting a representative cross-section of users. This criterion is basic because trading it for other criteria means basing designs on information biased toward some user groups at the expense of others. Based on interviews in development and customer organizations we find that their criteria for user selection favor persons who can contribute to the progress of the IT project over persons who are representative of the full range of users. A highly valued contribution from participating users is the ability to advocate a vision for the system and champion its organizational implementation. A survey in one customer organization shows that respondents’ personal traits explain up to 31% of the variation in their experience of aspects of the usability of a recently introduced system. Thus, unless participating users are representative as to these personal traits, IT projects may, inadvertently, bring about systems that will fail to satisfy many users.