Evaluating Creativity Support Tools in HCI Research

TY - GEN

T1 - Evaluating Creativity Support Tools in HCI Research

AU - Remy, Christian

AU - Macdonald Vermeulen, Lindsay

AU - Frich Pedersen, Jonas

AU - Biskjaer, Michael Mose

AU - Dalsgaard, Peter

PY - 2020/7/3

Y1 - 2020/7/3

N2 - The design and development of Creativity Support Tools (CSTs) is of growing interest in research at the intersection of creativity and Human-Computer Interaction, and has been identified as a 'grand challenge for HCI'. While creativity research and HCI each have had long-standing discussions about - -and rich toolboxes of - -evaluation methodologies, the nascent field of CST evaluation has so far received little attention. We contribute a survey of 113 research papers that present and evaluate CSTs, and we offer recommendations for future CST evaluation. We center our discussion around six major points that researchers might consider: 1) Clearly define the goal of the CST; 2) link to theory to further understanding of usage of CSTs; 3) recruit domain experts, if applicable and feasible; 4) consider longitudinal, in-situ studies; 5) distinguish and decide whether to evaluate usability or creativity; and 6) as a community, help develop a toolbox for CST evaluation.

AB - The design and development of Creativity Support Tools (CSTs) is of growing interest in research at the intersection of creativity and Human-Computer Interaction, and has been identified as a 'grand challenge for HCI'. While creativity research and HCI each have had long-standing discussions about - -and rich toolboxes of - -evaluation methodologies, the nascent field of CST evaluation has so far received little attention. We contribute a survey of 113 research papers that present and evaluate CSTs, and we offer recommendations for future CST evaluation. We center our discussion around six major points that researchers might consider: 1) Clearly define the goal of the CST; 2) link to theory to further understanding of usage of CSTs; 3) recruit domain experts, if applicable and feasible; 4) consider longitudinal, in-situ studies; 5) distinguish and decide whether to evaluate usability or creativity; and 6) as a community, help develop a toolbox for CST evaluation.

KW - Creativity

KW - Creativity metrics

KW - Creativity support tools

KW - Csts

KW - Evaluation

KW - Literature survey

UR - http://www.scopus.com/inward/record.url?scp=85090494787&partnerID=8YFLogxK

M3 - Article in proceedings

SP - 457

EP - 476

BT - DIS 2020 - Proceedings of the 2020 ACM Designing Interactive Systems Conference

PB - Association for Computing Machinery

T2 - ACM conference on Designing Interactive Systems (DIS)

Y2 - 6 July 2020 through 10 July 2020

ER -