Effective data structure for smart big data systems applying an expectation-maximization algorithm

Younghwan Shin; Yunyeong Goh; Changsung Lee; Jong Moon Chung

doi:10.1109/WorldS4.2019.8903976

Effective data structure for smart big data systems applying an expectation-maximization algorithm

Younghwan Shin, Yunyeong Goh, Changsung Lee, Jong Moon Chung

Department of Electrical and Electronic Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

In a general big data system there are two major factors that contribute to the processing delay. The total execution time consists of communication time and computation time. In most cases, modern big data systems offload to cloud computing systems to complete their job when too high of a computation load is being processed on the current task assigned systems. However, the adoption of cloud computing can cause the communication delay to increase. As big data analysis is used in more and more real-time systems, reducing the communication delay is one of the major challenges in big data research. This paper presents the application of an expectation-maximization algorithm for a big data system structure in order to reduce the communication time significantly. The fact that a decrease in the communication time in related to the gain of the information entropy is also revealed in this paper.

Original language	English
Title of host publication	Proceedings of the 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019
Editors	Xin-She Yang, Nilanjan Dey, Amit Joshi
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	136-140
Number of pages	5
ISBN (Electronic)	9781728137803
DOIs	https://doi.org/10.1109/WorldS4.2019.8903976
Publication status	Published - 2019 Jul
Event	3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019 - London, United Kingdom Duration: 2019 Jul 30 → 2019 Jul 31

Publication series

Name	Proceedings of the 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019

Conference

Conference	3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019
Country/Territory	United Kingdom
City	London
Period	19/7/30 → 19/7/31

Bibliographical note

Funding Information:
ACKNOWLEDGMENT This research was supported by the Ministry of Science and ICT (MSIT), Korea, under the Information Technology Research Center (ITRC) support program (IITP-2018-2018-0-01799) supervised by the Institute for Information & communications Technology Promotion (IITP) and the Institute of BioMed-IT, Energy-IT, and Smart-IT Technology (BEST), a Brain Korea 21 plus program, Yonsei University, and the Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIT) (No. 2017-0-00282, The Development of Adaptive Network Technology with Multi-Media Multi-Path).

Publisher Copyright:
© 2019 IEEE.

All Science Journal Classification (ASJC) codes

Artificial Intelligence
Computer Networks and Communications
Information Systems and Management
Renewable Energy, Sustainability and the Environment
Safety, Risk, Reliability and Quality
Education

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1109/WorldS4.2019.8903976

Cite this

Shin, Y., Goh, Y., Lee, C., & Chung, J. M. (2019). Effective data structure for smart big data systems applying an expectation-maximization algorithm. In X-S. Yang, N. Dey, & A. Joshi (Eds.), Proceedings of the 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019 (pp. 136-140). Article 8903976 (Proceedings of the 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/WorldS4.2019.8903976

Shin, Younghwan ; Goh, Yunyeong ; Lee, Changsung et al. / Effective data structure for smart big data systems applying an expectation-maximization algorithm. Proceedings of the 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019. editor / Xin-She Yang ; Nilanjan Dey ; Amit Joshi. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 136-140 (Proceedings of the 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019).

@inproceedings{2729c188218447e883752f647d1712b9,

title = "Effective data structure for smart big data systems applying an expectation-maximization algorithm",

abstract = "In a general big data system there are two major factors that contribute to the processing delay. The total execution time consists of communication time and computation time. In most cases, modern big data systems offload to cloud computing systems to complete their job when too high of a computation load is being processed on the current task assigned systems. However, the adoption of cloud computing can cause the communication delay to increase. As big data analysis is used in more and more real-time systems, reducing the communication delay is one of the major challenges in big data research. This paper presents the application of an expectation-maximization algorithm for a big data system structure in order to reduce the communication time significantly. The fact that a decrease in the communication time in related to the gain of the information entropy is also revealed in this paper.",

author = "Younghwan Shin and Yunyeong Goh and Changsung Lee and Chung, {Jong Moon}",

note = "Funding Information: ACKNOWLEDGMENT This research was supported by the Ministry of Science and ICT (MSIT), Korea, under the Information Technology Research Center (ITRC) support program (IITP-2018-2018-0-01799) supervised by the Institute for Information & communications Technology Promotion (IITP) and the Institute of BioMed-IT, Energy-IT, and Smart-IT Technology (BEST), a Brain Korea 21 plus program, Yonsei University, and the Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIT) (No. 2017-0-00282, The Development of Adaptive Network Technology with Multi-Media Multi-Path). Publisher Copyright: {\textcopyright} 2019 IEEE.; 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019 ; Conference date: 30-07-2019 Through 31-07-2019",

year = "2019",

month = jul,

doi = "10.1109/WorldS4.2019.8903976",

language = "English",

series = "Proceedings of the 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "136--140",

editor = "Xin-She Yang and Nilanjan Dey and Amit Joshi",

booktitle = "Proceedings of the 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019",

address = "United States",

}

Shin, Y, Goh, Y, Lee, C & Chung, JM 2019, Effective data structure for smart big data systems applying an expectation-maximization algorithm. in X-S Yang, N Dey & A Joshi (eds), Proceedings of the 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019., 8903976, Proceedings of the 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019, Institute of Electrical and Electronics Engineers Inc., pp. 136-140, 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019, London, United Kingdom, 19/7/30. https://doi.org/10.1109/WorldS4.2019.8903976

Effective data structure for smart big data systems applying an expectation-maximization algorithm. / Shin, Younghwan; Goh, Yunyeong; Lee, Changsung et al.
Proceedings of the 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019. ed. / Xin-She Yang; Nilanjan Dey; Amit Joshi. Institute of Electrical and Electronics Engineers Inc., 2019. p. 136-140 8903976 (Proceedings of the 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Effective data structure for smart big data systems applying an expectation-maximization algorithm

AU - Shin, Younghwan

AU - Goh, Yunyeong

AU - Lee, Changsung

AU - Chung, Jong Moon

N1 - Funding Information: ACKNOWLEDGMENT This research was supported by the Ministry of Science and ICT (MSIT), Korea, under the Information Technology Research Center (ITRC) support program (IITP-2018-2018-0-01799) supervised by the Institute for Information & communications Technology Promotion (IITP) and the Institute of BioMed-IT, Energy-IT, and Smart-IT Technology (BEST), a Brain Korea 21 plus program, Yonsei University, and the Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIT) (No. 2017-0-00282, The Development of Adaptive Network Technology with Multi-Media Multi-Path). Publisher Copyright: © 2019 IEEE.

PY - 2019/7

Y1 - 2019/7

N2 - In a general big data system there are two major factors that contribute to the processing delay. The total execution time consists of communication time and computation time. In most cases, modern big data systems offload to cloud computing systems to complete their job when too high of a computation load is being processed on the current task assigned systems. However, the adoption of cloud computing can cause the communication delay to increase. As big data analysis is used in more and more real-time systems, reducing the communication delay is one of the major challenges in big data research. This paper presents the application of an expectation-maximization algorithm for a big data system structure in order to reduce the communication time significantly. The fact that a decrease in the communication time in related to the gain of the information entropy is also revealed in this paper.

AB - In a general big data system there are two major factors that contribute to the processing delay. The total execution time consists of communication time and computation time. In most cases, modern big data systems offload to cloud computing systems to complete their job when too high of a computation load is being processed on the current task assigned systems. However, the adoption of cloud computing can cause the communication delay to increase. As big data analysis is used in more and more real-time systems, reducing the communication delay is one of the major challenges in big data research. This paper presents the application of an expectation-maximization algorithm for a big data system structure in order to reduce the communication time significantly. The fact that a decrease in the communication time in related to the gain of the information entropy is also revealed in this paper.

UR - http://www.scopus.com/inward/record.url?scp=85075875947&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85075875947&partnerID=8YFLogxK

U2 - 10.1109/WorldS4.2019.8903976

DO - 10.1109/WorldS4.2019.8903976

M3 - Conference contribution

AN - SCOPUS:85075875947

T3 - Proceedings of the 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019

SP - 136

EP - 140

BT - Proceedings of the 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019

A2 - Yang, Xin-She

A2 - Dey, Nilanjan

A2 - Joshi, Amit

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019

Y2 - 30 July 2019 through 31 July 2019

ER -

Shin Y, Goh Y, Lee C, Chung JM. Effective data structure for smart big data systems applying an expectation-maximization algorithm. In Yang X-S, Dey N, Joshi A, editors, Proceedings of the 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019. Institute of Electrical and Electronics Engineers Inc. 2019. p. 136-140. 8903976. (Proceedings of the 3rd World Conference on Smart Trends in Systems, Security and Sustainability, WorldS4 2019). doi: 10.1109/WorldS4.2019.8903976

Effective data structure for smart big data systems applying an expectation-maximization algorithm

Abstract

Publication series

Conference

Bibliographical note

All Science Journal Classification (ASJC) codes

UN SDGs

Access to Document

Other files and links

Fingerprint

Cite this