Instructional Video Summarization Using Attentive Knowledge Grounding

Kyungho Kim; Kyungjae Lee; Seung won Hwang

doi:10.1007/978-3-030-67670-4_40

Instructional Video Summarization Using Attentive Knowledge Grounding

Kyungho Kim, Kyungjae Lee, Seung won Hwang

College of Computing

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

This demonstration considers the scenario of summarizing an instructional video, for query such as “how to cook galbi”, to efficiently obtain a skillset. Specifically, we use the query to retrieve both the relevant video and the external procedural knowledge, such as a recipe document, and show summarization is more effective with such augmentation.

Original language	English
Title of host publication	Machine Learning and Knowledge Discovery in Databases. Applied Data Science and Demo Track - European Conference, ECML PKDD 2020, Proceedings
Editors	Yuxiao Dong, Dunja Mladenic, Craig Saunders
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	565-569
Number of pages	5
ISBN (Print)	9783030676698
DOIs	https://doi.org/10.1007/978-3-030-67670-4_40
Publication status	Published - 2021
Event	European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2020 - Virtual, Online Duration: 2020 Sept 14 → 2020 Sept 18

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	12461 LNAI
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2020
City	Virtual, Online
Period	20/9/14 → 20/9/18

Bibliographical note

Funding Information:
Microsoft Research Asia and Artificial Intelligence Graduate School Program (2020-0-01361).

Publisher Copyright:
© 2021, Springer Nature Switzerland AG.

All Science Journal Classification (ASJC) codes

Theoretical Computer Science
Computer Science(all)

Access to Document

10.1007/978-3-030-67670-4_40

Cite this

Kim, K., Lee, K., & Hwang, S. W. (2021). Instructional Video Summarization Using Attentive Knowledge Grounding. In Y. Dong, D. Mladenic, & C. Saunders (Eds.), Machine Learning and Knowledge Discovery in Databases. Applied Data Science and Demo Track - European Conference, ECML PKDD 2020, Proceedings (pp. 565-569). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12461 LNAI). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-030-67670-4_40

Kim, Kyungho ; Lee, Kyungjae ; Hwang, Seung won. / Instructional Video Summarization Using Attentive Knowledge Grounding. Machine Learning and Knowledge Discovery in Databases. Applied Data Science and Demo Track - European Conference, ECML PKDD 2020, Proceedings. editor / Yuxiao Dong ; Dunja Mladenic ; Craig Saunders. Springer Science and Business Media Deutschland GmbH, 2021. pp. 565-569 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{cade13af71884c089a56a8c5df4698fe,

title = "Instructional Video Summarization Using Attentive Knowledge Grounding",

abstract = "This demonstration considers the scenario of summarizing an instructional video, for query such as “how to cook galbi”, to efficiently obtain a skillset. Specifically, we use the query to retrieve both the relevant video and the external procedural knowledge, such as a recipe document, and show summarization is more effective with such augmentation.",

author = "Kyungho Kim and Kyungjae Lee and Hwang, {Seung won}",

note = "Funding Information: Microsoft Research Asia and Artificial Intelligence Graduate School Program (2020-0-01361). Publisher Copyright: {\textcopyright} 2021, Springer Nature Switzerland AG.; European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2020 ; Conference date: 14-09-2020 Through 18-09-2020",

year = "2021",

doi = "10.1007/978-3-030-67670-4_40",

language = "English",

isbn = "9783030676698",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "565--569",

editor = "Yuxiao Dong and Dunja Mladenic and Craig Saunders",

booktitle = "Machine Learning and Knowledge Discovery in Databases. Applied Data Science and Demo Track - European Conference, ECML PKDD 2020, Proceedings",

address = "Germany",

}

Kim, K, Lee, K & Hwang, SW 2021, Instructional Video Summarization Using Attentive Knowledge Grounding. in Y Dong, D Mladenic & C Saunders (eds), Machine Learning and Knowledge Discovery in Databases. Applied Data Science and Demo Track - European Conference, ECML PKDD 2020, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 12461 LNAI, Springer Science and Business Media Deutschland GmbH, pp. 565-569, European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2020, Virtual, Online, 20/9/14. https://doi.org/10.1007/978-3-030-67670-4_40

Instructional Video Summarization Using Attentive Knowledge Grounding. / Kim, Kyungho; Lee, Kyungjae; Hwang, Seung won.
Machine Learning and Knowledge Discovery in Databases. Applied Data Science and Demo Track - European Conference, ECML PKDD 2020, Proceedings. ed. / Yuxiao Dong; Dunja Mladenic; Craig Saunders. Springer Science and Business Media Deutschland GmbH, 2021. p. 565-569 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12461 LNAI).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Instructional Video Summarization Using Attentive Knowledge Grounding

AU - Kim, Kyungho

AU - Lee, Kyungjae

AU - Hwang, Seung won

PY - 2021

Y1 - 2021

N2 - This demonstration considers the scenario of summarizing an instructional video, for query such as “how to cook galbi”, to efficiently obtain a skillset. Specifically, we use the query to retrieve both the relevant video and the external procedural knowledge, such as a recipe document, and show summarization is more effective with such augmentation.

AB - This demonstration considers the scenario of summarizing an instructional video, for query such as “how to cook galbi”, to efficiently obtain a skillset. Specifically, we use the query to retrieve both the relevant video and the external procedural knowledge, such as a recipe document, and show summarization is more effective with such augmentation.

UR - http://www.scopus.com/inward/record.url?scp=85103262149&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85103262149&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-67670-4_40

DO - 10.1007/978-3-030-67670-4_40

M3 - Conference contribution

AN - SCOPUS:85103262149

SN - 9783030676698

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 565

EP - 569

BT - Machine Learning and Knowledge Discovery in Databases. Applied Data Science and Demo Track - European Conference, ECML PKDD 2020, Proceedings

A2 - Dong, Yuxiao

A2 - Mladenic, Dunja

A2 - Saunders, Craig

PB - Springer Science and Business Media Deutschland GmbH

T2 - European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2020

Y2 - 14 September 2020 through 18 September 2020

ER -

Kim K, Lee K, Hwang SW. Instructional Video Summarization Using Attentive Knowledge Grounding. In Dong Y, Mladenic D, Saunders C, editors, Machine Learning and Knowledge Discovery in Databases. Applied Data Science and Demo Track - European Conference, ECML PKDD 2020, Proceedings. Springer Science and Business Media Deutschland GmbH. 2021. p. 565-569. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-67670-4_40

Instructional Video Summarization Using Attentive Knowledge Grounding

Abstract

Publication series

Conference

Bibliographical note

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this