Human-in-the-loop design cycles – A process framework that integrates design sprints, agile processes, and machine learning with humans

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

Demands on more transparency of the backbox nature of machine learning models have led to the recent rise of human-in-the-loop in machine learning, i.e. processes that integrate humans in the training and application of machine learning models. The present work argues that this process requirement does not represent an obstacle but an opportunity to optimize the design process. Hence, this work proposes a new process framework, Human-in-the-loop Design Cycles – a design process that integrates the structural elements of agile and design thinking process, and controls the training of a machine learning model by the human in the loop. The Human-in-the-loop Design Cycles process replaces the qualitative user testing by a quantitative psychometric measurement instrument for design perception. The generated user feedback serves to train a machine learning model and to instruct the subsequent design cycle along four design dimensions (novelty, energy, simplicity, tool). Mapping the four-dimensional user feedback into user stories and priorities, the design sprint thus transforms the user feedback directly into the implementation process. The human in the loop is a quality engineer who scrutinizes the collected user feedback to prevent invalid data to enter machine learning model training.

Original languageEnglish
Title of host publicationArtificial Intelligence in HCI - 1st International Conference, AI-HCI 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Proceedings
EditorsHelmut Degen, Lauren Reinerman-Jones
PublisherSpringer
Pages136-145
Number of pages10
ISBN (Print)9783030503338
DOIs
Publication statusPublished - 2020
Event1st International Conference on Artificial Intelligence in HCI, AI-HCI 2020, held as part of the 22nd International Conference on Human-Computer Interaction, HCII 2020 - Copenhagen, Denmark
Duration: 2020 Jul 192020 Jul 24

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12217 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference1st International Conference on Artificial Intelligence in HCI, AI-HCI 2020, held as part of the 22nd International Conference on Human-Computer Interaction, HCII 2020
Country/TerritoryDenmark
CityCopenhagen
Period20/7/1920/7/24

Bibliographical note

Publisher Copyright:
© Springer Nature Switzerland AG 2020.

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Human-in-the-loop design cycles – A process framework that integrates design sprints, agile processes, and machine learning with humans'. Together they form a unique fingerprint.

Cite this