Improved vision-based method for detection of unauthorized intrusion by construction sites workers

Wan, H P; Zhang, W J; Ge, H B; Luo, Y and Todd, M D (2023) Improved vision-based method for detection of unauthorized intrusion by construction sites workers. Journal of Construction Engineering and Management, 149(7): 04023040, ISSN 0733-9364

Abstract

The construction site environment is quite complex with many dangerous hazards (e.g., foundation pits, holes). To avoid injuries, workers must wear helmets that are color-coded for the specific type of work, which is helpful to identify whether workers are in permitted areas. Therefore, it is possible to identify unauthorized intrusion by classifying the safety helmets. This study proposes a vision-based method called Helmet-Yolov5 to automatically detect unauthorized intrusions by workers on construction sites. Multiple improvement measures are made to enhance the model performance. First, the attention mechanism is used to enhance the weights of object regions in the image, which makes the detection of small objects more effective. Second, atrous spatial pyramid pooling is adopted to preserve the detail information of the image. Third, the universal upsampling operator is introduced to fuse image features at different scales. To verify the effectiveness of the improved model, images collected from a real construction site are used to build a large-scale image dataset of safety helmets for model testing. It shows that the proposed Helmet-Yolov5 model is more accurate than the original Yolov5 model, also with high inference speed. Compared to other state-of-the-art models (e.g., Yolov4), the Helmet-Yolov5 model has considerable advantages in term of high detection accuracy and efficiency.

Item Type: Article
Uncontrolled Keywords: construction sites; deep learning; safety helmet; unauthorized intrusion; yolov5
Index terms: injury, model testing, accuracy, construction site, state of the art, dataset, efficiency, deep learning, effectiveness
Subjects: professional development, performance management, health conditions and diseases, data management, reliability engineering, research dissemination and communication, artificial intelligence, work location
Topics: Site Management, Quality Management, Digital Applications, Information Management, Engineering Principles, Research Practice, Health and Safety
Descriptive scope: 2 PC

N.B. Descriptive scope is a count of how many of the five facets of empirical research are indicated by the words used in title, abstract and keywords. It is not intended as a judgement on the research; merely a count of the kind of word we would expect to indicate Phenomenon, Concepts, Theoretical framing, Empirical techniques, Analytical techniques. If all five are present, then a code of “5 PCTEA” will indicate this. If you feel the coding for this record is questionable, we welcome discussion around the terms we matched or the way we categorized them. The facet you would expect may not be coded, or a facet may be coded inappropriately. This can also bear on a larger question, of which facets should be treated as defining in construction management research. Please get in touch, and we will look at it. More details here