A deep learning-based approach to facilitate the as-built state recognition of indoor construction works

Ekanayake, B; Ahmadian Fard Fini, A; Wong, J K W and Smith, P (2024) A deep learning-based approach to facilitate the as-built state recognition of indoor construction works. Construction Innovation, 24(4), pp. 933-949. ISSN 1471-4175

Abstract

Purpose: Recognising the as-built state of construction elements is crucial for construction progress monitoring. Construction scholars have used computer vision-based algorithms to automate this process. Robust object recognition from indoor site images has been inhibited by technical challenges related to indoor objects, lighting conditions and camera positioning. Compared with traditional machine learning algorithms, one-stage detector deep learning (DL) algorithms can prioritise the inference speed, enable real-time accurate object detection and classification. This study aims to present a DL-based approach to facilitate the as-built state recognition of indoor construction works. Design/methodology/approach: The one-stage DL-based approach was built upon YOLO version 4 (YOLOv4) algorithm using transfer learning with few hyperparameters customised and trained in the Google Colab virtual machine. The process of framing, insulation and drywall installation of indoor partitions was selected as the as-built scenario. For training, images were captured from two indoor sites with publicly available online images. Findings: The DL model reported a best-trained weight with a mean average precision of 92% and an average loss of 0.83. Compared to previous studies, the automation level of this study is high due to the use of fixed time-lapse cameras for data collection and zero manual intervention from the pre-processing algorithms to enhance visual quality of indoor images. Originality/value: This study extends the application of DL models for recognising as-built state of indoor construction works upon providing training images. Presenting a workflow on training DL models in a virtual machine platform by reducing the computational complexities associated with DL models is also materialised.

Item Type: Article
Uncontrolled Keywords: as-built state; deep learning; google colab; indoor construction progress monitoring; virtual machine; yolov4
Index terms: platform, object recognition, deep learning, construction work, insulation, automation, computer vision, framing, progress monitoring, methodology, complexity, object detection, workflow, machine learning
Subjects: systems engineering, project controls, automation and robotics, computer vision, digital design, management, research methods, artificial intelligence, conceptual models, operations management, building materials
Topics: Research Practice, Project Management, Engineering Principles, Business Strategy, Design Practice, Digital Applications, Time Control
Descriptive scope: 3 PCT

N.B. Descriptive scope is a count of how many of the five facets of empirical research are indicated by the words used in title, abstract and keywords. It is not intended as a judgement on the research; merely a count of the kind of word we would expect to indicate Phenomenon, Concepts, Theoretical framing, Empirical techniques, Analytical techniques. If all five are present, then a code of “5 PCTEA” will indicate this. If you feel the coding for this record is questionable, we welcome discussion around the terms we matched or the way we categorized them. The facet you would expect may not be coded, or a facet may be coded inappropriately. This can also bear on a larger question, of which facets should be treated as defining in construction management research. Please get in touch, and we will look at it. More details here