What are We Measuring Anyway? A Literature Survey of Questionnaires Used in Studies Reported in the Intelligent Virtual Agent Conferences
We open a discussion about methodological issues that exist in the field of human-computer interaction (HCI) related to end-user evaluations. We focus on the replication crisis. In a literature study we found unexpectedly little repeated use of questionnaires as the vast majority of questionnaires (more than 76%) were only reported in a single paper. We invite other researchers to join our efforts in an Open Science Framework work group.e.
Merijn has an MSc in Psychology and a PhD in Computer Science. His research focuses on the creation and evaluation of artificial social entities such as social robots, virtual agents, and chatbots. In his research he collaborates with partners from education, law enforcement, health, and gastronomy.