Vision-based nonintrusive context documentation for earthmoving productivity simulation

Hongjo Kim, Youngjib Ham, Wontae Kim, Somin Park, Hyoungkwan Kim

Research output: Contribution to journalArticlepeer-review

39 Citations (Scopus)


Although video surveillance systems have shown potential for analyzing jobsite contexts, the necessity of a complex multi-camera surveillance system or workers’ privacy issues remain as substantive hurdles to adopt such systems in practice. To address such issues, this study presents a non-intrusive earthmoving productivity analysis method using imaging and simulation. The site access log of dump trucks is used to infer earthmoving contexts, which is produced by analyzing videos recorded at the entrance and the exit of a construction site. An algorithm for license plate detection and recognition in an uncontrolled environment is developed to automatically produce the site access log, by leveraging video deinterlacing, a deep convolutional network, and rule-based post-processing. The experimental results show the effectiveness of the proposed method for producing the site access log. Based on the site access log, simulation-based productivity analysis is conducted to produce a daily productivity report, which can provide the basis for earthmoving resource planning. It is expected that the resulting daily productivity report promotes data-driven decision-making for earthmoving resource allocation, thereby improving potential for saving cost and time for earthworks with an updated resource allocation plan.

Original languageEnglish
Pages (from-to)135-147
Number of pages13
JournalAutomation in Construction
Publication statusPublished - 2019 Jun

Bibliographical note

Funding Information:
This work was supported by Yonsei University Research Fund (Yonsei Frontier Lab. Young Researcher Supporting Program) of 2018 and the National Research Foundation of Korea (NRF) grant funded by the Korea government—the Ministry of Education (No. 2018R1A6A1A08025348 ) and the Ministry of Science, ICT and Future Planning (No. 2018R1A2B2008600 ).

Publisher Copyright:
© 2019

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Civil and Structural Engineering
  • Building and Construction


Dive into the research topics of 'Vision-based nonintrusive context documentation for earthmoving productivity simulation'. Together they form a unique fingerprint.

Cite this