Liu, C; González, V A; Lee, G; Davies, R; Cabrera-Guerrero, G and Zou, Y (2025) Assessing an immersive virtual reality-based simulation game capability to study the social mechanisms enabled by the Last Planner system in projects. Journal of Construction Engineering and Management, 151(9): 04025111, ISSN 0733-9364
Abstract
In recent years, research has found that the effectiveness of the Last Planner System (LPS) can be significantly enhanced by identifying and effectively managing the missing social mechanisms that LPS introduced within project teams. To investigate these mechanisms, we have developed an experimental tool called the multiuser immersive virtual reality-based LPS simulation game (MILPS). Prior research shows its feasibility in creating an experimental environment to investigate LPS-specific social mechanisms by assessing usability, perceived presence, and task performance. However, how similar the social mechanisms obtained from MILPS are to the real world (i.e., ecological validity) has yet to be studied, reducing its potential in future studies. To address this gap, this paper assessed the ecological validity of MILPS by comparing findings from the virtual world with empirical findings from the real world. We employed MILPS to conduct a two-round experiment consisting of both non-Lean and LPS-based project planning, and working tasks to study the key social mechanisms associated with LPS. Participants' behavioral (i.e., communications), cognitive, and affective responses (i.e., shared understanding and stress levels) were measured with video recordings, physiological sensors, and questionnaires during and after these tasks. Results indicate that MILPS captured the key social mechanisms associated with LPS (e.g., improved shared understanding, communication patterns, and reduced stress levels), which established the ecological validity of using MILPS for studying the LPS-associated social mechanisms. The contributions of this study are twofold: (1) providing insights into designing and conducting group IVR experiments that collect behaviors and psychological and physiological data and (2) sharing an innovative and ecologically valid experimental tool that can be used to study the LPS within the Lean community.
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | communication; ecological validity; immersive virtual reality; last planner system; physiological arousal; shared understanding; social mechanism; stress |
| Index terms: | project planning, questionnaire, last planner system, experiment, usability, future study, project team, presence, effectiveness, virtual reality, validity |
| Subjects: | evaluation and assessment methods, environmental science, control systems, virtual reality, user-centered design, research design and methodology, data collection methods, project delivery, performance management, project controls |
| Topics: | Quality Management, Sustainability, Project Management, Time Control, Design Practice, Digital Applications, Research Practice |
| Descriptive scope: | 4 PCEA |
N.B. Descriptive scope is a count of how many of the five facets of empirical research are indicated by the words used in title, abstract and keywords. It is not intended as a judgement on the research; merely a count of the kind of word we would expect to indicate Phenomenon, Concepts, Theoretical framing, Empirical techniques, Analytical techniques. If all five are present, then a code of “5 PCTEA” will indicate this. If you feel the coding for this record is questionable, we welcome discussion around the terms we matched or the way we categorized them. The facet you would expect may not be coded, or a facet may be coded inappropriately. This can also bear on a larger question, of which facets should be treated as defining in construction management research. Please get in touch, and we will look at it. More details here