Data Formulator: AI-Powered Concept-Driven Visualization Authoring

Chenglong Wang, John Thompson, Bongshin Lee

Research output: Contribution to journalArticlepeer-review

6 Citations (Scopus)

Abstract

With most modern visualization tools, authors need to transform their data into tidy formats to create visualizations they want. Because this requires experience with programming or separate data processing tools, data transformation remains a barrier in visualization authoring. To address this challenge, we present a new visualization paradigm, concept binding, that separates high-level visualization intents and low-level data transformation steps, leveraging an AI agent. We realize this paradigm in Data Formulator, an interactive visualization authoring tool. With Data Formulator, authors first define data concepts they plan to visualize using natural languages or examples, and then bind them to visual channels. Data Formulator then dispatches its AI-agent to automatically transform the input data to surface these concepts and generate desired visualizations. When presenting the results (transformed table and output visualizations) from the AI agent, Data Formulator provides feedback to help authors inspect and understand them. A user study with 10 participants shows that participants could learn and use Data Formulator to create visualizations that involve challenging data transformations, and presents interesting future research directions.

Original languageEnglish
Pages (from-to)1128-1138
Number of pages11
JournalIEEE Transactions on Visualization and Computer Graphics
Volume30
Issue number1
DOIs
Publication statusPublished - 2024 Jan 1

Bibliographical note

Publisher Copyright:
© 1995-2012 IEEE.

All Science Journal Classification (ASJC) codes

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design

Fingerprint

Dive into the research topics of 'Data Formulator: AI-Powered Concept-Driven Visualization Authoring'. Together they form a unique fingerprint.

Cite this