Development and validation of BIM-based natural user interfaces for non-geometrical information management

Innovation and the adoption of new processes are transversal phenomena across industry sectors. As technology progresses, current paradigms adjust, which may disrupt more traditional approaches and processes. In particular, the Architecture, Engineering, Construction and Operations (AECO) sector is not immune to the change of technological cannons and paradigm shifts. Such changes can be illustrated by the gradual uptake of Building Information Modelling (BIM), although reportedly slower than originally expected. Indeed, and despite the known advantages of the adoption of BIM (e. g. , enhanced visualisation and access to information, benefits to management of costs and deadlines, as well as maintenance, among many others), the AECO sector still faces the absence of a full-fledged acceptance of the BIM methodology, providing the opportunity for further developments in the way of interacting, accessing and exchanging project-related information. Therefore, to promote more generalised access to BIM and an enhanced understanding of the methodology by a wider range of AECO professionals, further research on innovative interfaces attuned to the tasks, requirements, and working environments of AECO professionals is in need. Considering the positive impacts of Natural User Interfaces (NUIs) in the AECO sector verified in recent applications, especially those based on Virtual Reality (VR) or Augmented Reality (AR), the present thesis aims to explore the relationships between these technologies and BIM. Additionally, this thesis intends to provide a clear overview of the applications of BIM-based VR and AR interfaces and develop more natural approaches to interact, manage and enrich BIM models information. Moreover, this study aims at shedding light on recommendations and guidelines for a usability methodology to assess the suitability of the proposed solutions. The research developed comprises three systematic reviews addressing the core body of knowledge related to the acceptance and usability of innovative interfaces and the management of non-geometric information. In particular, two systematic literature reviews on the impacts, best practices, and current knowledge on the application of BIM-based VR and AR, and a literature review of the developments concerning Semantic Enrichment (SE) and BIM. Additionally, two immersive interfaces were developed to provide access to BIM information through task-driven applications suitable for users with different backgrounds and levels of expertise. In detail, the workflow and laboratory assessment of a proof of concept coupling VR and laser scanning is presented. To overcome the obstacle to proper communication between project-related entities. This preliminary interface provided a starting point for developing more complex systems for the semantic enrichment of BIM models. The developing stages of a second VR interface for semantic enrichment are described. These include the presentation of a straightforward open BIM approach to import BIM models into a game engine while maintaining the models semantics and geometry and the possibility of validation through Information Delivery Specifications (IDS). A thorough usability assessment is detailed, including formative and summative evaluations, as well as the feedback gathered from 62 interviews with 31 AECO professionals. The results show that users with no previous knowledge can interact with BIM models, even those lacking a deep understanding of BIM methodology or experience with BIM authoring tools (83,9% of participants). Indeed, most participants were able to manage BIM information naturally in the VR environment, reaching a usage close to that expected from a more experienced user. Additionally, perceived satisfaction demonstrates a general liking and consent for applying the proposed approach to facility management tasks, even amongst participants with no previous VR and/or BIM experience.