Detecting Construction Equipment Using a Region-Based Fully Convolutional Network and Transfer Learning

Research output: Contribution to journalArticlepeer-review

139 Citations (Scopus)


For proper construction site management and plan revisions during construction, it is necessary to understand a construction site's status in real time. Many vision-based construction site-monitoring methods exist, but current technology has not achieved the accuracy required to robustly recognize objects such as construction equipment, workers, and materials in actual jobsite images. To address this issue, this paper proposes a deep convolutional network-based construction object-detection method to accurately recognize construction equipment. A deep convolutional network can achieve high performance in various visual tasks, but is not easy to be applied in the construction industry where there is not enough publicly available data for training. This problem is solved by transfer learning, which trains a model for the construction industry by transferring the knowledge of models trained in other domains with a large amount of training data. To evaluate the proposed method, a benchmark data set is created for five classes: a dump truck, excavator, loader, concrete mixer truck, and road roller. This benchmark data set includes various shapes and poses for each class to evaluate the generalization performance of the proposed construction equipment detection model. Experimental results show that the proposed method performs remarkably well, achieving 96.33% mean average precision. In the future, the proposed model can be used to infer the context of construction operations for producing managerial information such as progress, productivity, and safety.

Original languageEnglish
Article number04017082
JournalJournal of Computing in Civil Engineering
Issue number2
Publication statusPublished - 2018 Mar 1

Bibliographical note

Funding Information:
The authors would like to thank Inhae Ha and Seongdeok Bang for helping with image data annotation. The authors appreciate the anonymous reviewers for their valuable comments and suggestions that helped improve this paper. This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government [Ministry of Science, ICT and Future Planning (MSIP), No. 2011-0030040] and the Korea Agency for Infrastructure Technology Advancement (KAIA, No. 17CTAP-C133290-01). This research was partially supported by the Graduate School of Yonsei University Research Scholarship Grants in 2017.

Publisher Copyright:
© 2017 American Society of Civil Engineers.

All Science Journal Classification (ASJC) codes

  • Civil and Structural Engineering
  • Computer Science Applications


Dive into the research topics of 'Detecting Construction Equipment Using a Region-Based Fully Convolutional Network and Transfer Learning'. Together they form a unique fingerprint.

Cite this