Identification and categorization of defects in construction specifications utilizing natural language processing

Madenli, O; Atasoy, G and Dikmen, I (2026) Identification and categorization of defects in construction specifications utilizing natural language processing. Journal of Construction Engineering and Management, 152(5): 04026044, ISSN 0733-9364

Abstract

Defective specification statements cause not only a faulty outcome but also disputes among project stakeholders, claims for project budget and time, project disruptions, and even litigation. Identifying defects in technical sections of construction specifications is challenging. This research aims to develop a structured defect framework and implement supervised natural language processing methods for identifying and categorizing defects in specifications. The dataset includes 175 specifications related to 21 different architectural works collected from 16 construction projects. Eight machine learning (ML) models, ranging from shallow to transformer-based, were trained and tested with combinations of different text representation techniques. Subsequently, a study using ChatGPT-4o, a GenAI tool, was conducted. The pretrained RoBERTa model outperformed the recognition of defects in construction specifications with a macro F1 score of 91.2% and 98% accuracy. This research offers a data-driven methodology with practical tools to enhance the quality of specifications and decrease disputes by reducing the defective specification statements during design, bidding, and preconstruction.

Item Type: Article
Uncontrolled Keywords: construction specification; defect; deficiency; generative pretrained transformer; machine learning; natural language processing; text classification
Index terms: litigation, dispute, project stakeholder, methodology, construction project, bidding, machine learning, dataset, specification, accuracy
Subjects: data management, sociology, contractual condition, professional development, artificial intelligence, dispute resolution, research methods, production management, bidding
Topics: Procurement, Project Management, Legal Issues, Stakeholder Management, Information Management, Research Practice, Contract Administration, Digital Applications
Descriptive scope: 3 PCT

N.B. Descriptive scope is a count of how many of the five facets of empirical research are indicated by the words used in title, abstract and keywords. It is not intended as a judgement on the research; merely a count of the kind of word we would expect to indicate Phenomenon, Concepts, Theoretical framing, Empirical techniques, Analytical techniques. If all five are present, then a code of “5 PCTEA” will indicate this. If you feel the coding for this record is questionable, we welcome discussion around the terms we matched or the way we categorized them. The facet you would expect may not be coded, or a facet may be coded inappropriately. This can also bear on a larger question, of which facets should be treated as defining in construction management research. Please get in touch, and we will look at it. More details here