Material recognition for construction quality monitoring using deep learning methods

Purpose: This paper aims to propose a new deep learning technique to detect the type of material to improve automated construction quality monitoring. Design/methodology/approach: A new data augmentation approach that has improved the model robustness against different illumination conditions and overfitting is proposed. This study uses data augmentation at test time and adds outlier samples to training set to prevent over-fitted network training. For data augmentation at test time, five segments are extracted from each sample image and fed to the network. For these images, the network outputting average values is used as the final prediction. Then, the proposed approach is evaluated on multiple deep networks used as material classifiers. The fully connected layers are removed from the end of the networks, and only convolutional layers are retained. Findings: The proposed method is evaluated on recognizing 11 types of building materials which include 1,231 images taken from several construction sites. Each image resolution is 4,000 × 3,000. The images are captured with different illumination and camera positions. Different illumination conditions lead to trained networks that are more robust against various environmental conditions. Using VGG16 model, an accuracy of 97.35% is achieved outperforming existing approaches. Practical implications: It is believed that the proposed method presents a new and robust tool for detecting and classifying different material types. The automated detection of material will aid to monitor the quality and see whether the right type of material has been used in the project based on contract specifications. In addition, the proposed model can be used as a guideline for performing quality control (QC) in construction projects based on project quality plan. It can also be used as an input for automated progress monitoring because the material type detection will provide a critical input for object detection. Originality/value: Several studies have been conducted to perform quality management, but there are some issues that need to be addressed. In most previous studies, a very limited number of material types were examined. In addition, although some studies have reported high accuracy to detect material types (Bunrit et al., 2020), their accuracy is dramatically reduced when they are used to detect materials with similar texture and color. In this research, the authors propose a new method to solve the mentioned shortcomings.