Accelerating Conversational Agents Built with Off-the-Shelf Modularized Services

Jinho Lee; Inseok Hwang; Thomas S. Hubregtsen; Anne E. Gattiker; Christopher M. Durham

doi:10.1109/MPRV.2019.2907004

Accelerating Conversational Agents Built with Off-the-Shelf Modularized Services

Jinho Lee, Inseok Hwang, Thomas S. Hubregtsen, Anne E. Gattiker, Christopher M. Durham

College of Computing

Research output: Contribution to journal › Article › peer-review

3 Citations (Scopus)

Abstract

Today's common practice in developing conversational agents is pipelining off-the-shelf modularized services as ready-made building blocks. However, the discrete and sequential nature of the modules yields long response latency. We introduce Sci-Fii, a speculative inference framework accelerating conversational agent systems built with off-the-shelf modules, while keeping the modules unchanged.

Original language	English
Article number	8794690
Pages (from-to)	47-57
Number of pages	11
Journal	IEEE Pervasive Computing
Volume	18
Issue number	2
DOIs	https://doi.org/10.1109/MPRV.2019.2907004
Publication status	Published - 2019 Apr 1

Bibliographical note

Publisher Copyright:
© 2002-2012 IEEE.

All Science Journal Classification (ASJC) codes

Software
Computer Science Applications
Computational Theory and Mathematics

Access to Document

10.1109/MPRV.2019.2907004

Cite this

@article{6606f41ebd084bb691a70f8fa80bff0e,

title = "Accelerating Conversational Agents Built with Off-the-Shelf Modularized Services",

abstract = "Today's common practice in developing conversational agents is pipelining off-the-shelf modularized services as ready-made building blocks. However, the discrete and sequential nature of the modules yields long response latency. We introduce Sci-Fii, a speculative inference framework accelerating conversational agent systems built with off-the-shelf modules, while keeping the modules unchanged.",

author = "Jinho Lee and Inseok Hwang and Hubregtsen, {Thomas S.} and Gattiker, {Anne E.} and Durham, {Christopher M.}",

note = "Publisher Copyright: {\textcopyright} 2002-2012 IEEE.",

year = "2019",

month = apr,

day = "1",

doi = "10.1109/MPRV.2019.2907004",

language = "English",

volume = "18",

pages = "47--57",

journal = "IEEE Pervasive Computing",

issn = "1536-1268",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

number = "2",

}

TY - JOUR

T1 - Accelerating Conversational Agents Built with Off-the-Shelf Modularized Services

AU - Lee, Jinho

AU - Hwang, Inseok

AU - Hubregtsen, Thomas S.

AU - Gattiker, Anne E.

AU - Durham, Christopher M.

PY - 2019/4/1

Y1 - 2019/4/1

N2 - Today's common practice in developing conversational agents is pipelining off-the-shelf modularized services as ready-made building blocks. However, the discrete and sequential nature of the modules yields long response latency. We introduce Sci-Fii, a speculative inference framework accelerating conversational agent systems built with off-the-shelf modules, while keeping the modules unchanged.

AB - Today's common practice in developing conversational agents is pipelining off-the-shelf modularized services as ready-made building blocks. However, the discrete and sequential nature of the modules yields long response latency. We introduce Sci-Fii, a speculative inference framework accelerating conversational agent systems built with off-the-shelf modules, while keeping the modules unchanged.

UR - http://www.scopus.com/inward/record.url?scp=85069161423&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85069161423&partnerID=8YFLogxK

U2 - 10.1109/MPRV.2019.2907004

DO - 10.1109/MPRV.2019.2907004

M3 - Article

AN - SCOPUS:85069161423

SN - 1536-1268

VL - 18

SP - 47

EP - 57

JO - IEEE Pervasive Computing

JF - IEEE Pervasive Computing

IS - 2

M1 - 8794690

ER -

Accelerating Conversational Agents Built with Off-the-Shelf Modularized Services

Abstract

Bibliographical note

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this