Lin Htet, N.; Peansupap, V. and Kaewmoracharoen, M. (2026) Influence of material attribute context and document layout variability on large language model performance in construction material specification. International Journal of Construction Management, 26(8), pp. 1669-1689. ISSN 1562-3599
Abstract
Construction material specifications are crucial for procurement, but their varied and unstructured presentation in PDF datasheets hinders traditional information extraction. Pre-trained large language models (LLMs) offer new opportunities to automate this process, through retrieval-augmented generation (RAG) with natural language-based instruction prompts. However, an unclear understanding of document characteristics in material specifications may hinder the LLM's application in the construction material technical comparison process. This research aims to identify the influence of material attribute context and document layout variability on large language model performance in construction material specification extraction framework. The research method applied an LLM-based framework to automate the extraction of construction material specifications from PDF-based technical datasheets. The performance evaluations conducted across four different construction material types revealed the influence of document layout variability and material attributes on extraction accuracy. Attributes lacking clear identifiers and varying terminologies showed low performance (∼23.7%), whereas clearly defined terminologies achieved high accuracy (∼96.2%). Additionally, complex multi-column layouts hindered performance, causing a 30 percentage-point drop in accuracy compared to single-column formats. Among the models, Anthropic Claude 3 Haiku achieved the highest accuracy and showed strong robustness to complex layouts, highlighting the value of standardized, clearly labelled datasheets for improved machine-readability in the construction industry.
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | automation; information extraction; large language model; material selection; procurement; retrieval augmented generation |
| Index terms: | variability, automation, construction industry, construction material, performance evaluation, column, accuracy, large language model, specification |
| Subjects: | performance measurement, contractual condition, professional development, industry analysis, statistical analysis, building materials, data science, structural engineering, automation and robotics |
| Topics: | Contract Administration, Digital Applications, Research Practice, Information Management, Quality Management, Engineering Principles |
| Descriptive scope: | 3 PCT |
N.B. Descriptive scope is a count of how many of the five facets of empirical research are indicated by the words used in title, abstract and keywords. It is not intended as a judgement on the research; merely a count of the kind of word we would expect to indicate Phenomenon, Concepts, Theoretical framing, Empirical techniques, Analytical techniques. If all five are present, then a code of “5 PCTEA” will indicate this. If you feel the coding for this record is questionable, we welcome discussion around the terms we matched or the way we categorized them. The facet you would expect may not be coded, or a facet may be coded inappropriately. This can also bear on a larger question, of which facets should be treated as defining in construction management research. Please get in touch, and we will look at it. More details here