AR Pen and Hand Gestures: A New Tool for Pen Drawings

Hark Joon Kim, Hayoung Kim, Tack Don Han, Jonghoon Seo, Seungho Chae

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Citations (Scopus)


This paper explores the interaction possibilities when artists use their non-dominant hand, while drawing with a pen in their dominant hand. We propose a new interactive AR-based pen tool which can overlay virtual images onto a physical drawing in real time. This system allows artists to control the augmented images with gestures of a non-dominant hand while drawing. By interacting with the visually augmented contents using hand gestures and a pen bimanually, artists can draw pictures more creatively. We also made a standalone pen system integrated with a pico-projector and a camera, and suggest a set of useful scenarios for the conventional pen-and-paper drawing.

Original languageEnglish
Title of host publicationCHI EA 2013 - Extended Abstracts on Human Factors in Computing Systems
Subtitle of host publicationChanging Perspectives
EditorsMichel Beaudouin-Lafon, Patrick Baudisch, Wendy E. Mackay
PublisherAssociation for Computing Machinery
Number of pages6
ISBN (Electronic)9781450318990
Publication statusPublished - 2013 Apr 27
Event31st Annual CHI Conference on Human Factors in Computing Systems:, CHI EA 2013 - Paris, France
Duration: 2013 Apr 272013 May 2

Publication series

NameConference on Human Factors in Computing Systems - Proceedings


Other31st Annual CHI Conference on Human Factors in Computing Systems:, CHI EA 2013

Bibliographical note

Funding Information:
We would like to thank all members of media system laboratory in Yonsei University and UX center of Samsung Electronics for all their help. We also thank our study participants, Dr. Eisung Sohn, Kuk-Hyun Han, Sunah Kim, Taik Heon Rhee, Say Jang, and Hyun-Jin Kim for their feedback.

All Science Journal Classification (ASJC) codes

  • Software
  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design


Dive into the research topics of 'AR Pen and Hand Gestures: A New Tool for Pen Drawings'. Together they form a unique fingerprint.

Cite this