Ex post project risk assessment: Method and empirical study

Erfani, A; Ma, Z; Cui, Q and Baecher, G B (2023) Ex post project risk assessment: Method and empirical study. Journal of Construction Engineering and Management, 149(2): 04022174, ISSN 0733-9364

Abstract

Project risk is an important part of managing large projects of any sort. This study contributes to the state of knowledge in project risk management by introducing a data-driven approach to measure risk identification performance using historical data. In the early phases of a project, the identification and assessment of risk is based largely on experience and expert judgment. As a project moves through its life cycle, these identified risks and the assessment of them evolve. Some risks become issues, some are mitigated, and some are retired as no longer important. This study investigated the quality of early risk registers and risk assessments on large transportation projects and compared them to how the identified risks evolved on historical projects. The investigation involved the use of textual analysis of archival risk register documents. Finite-state automation methods akin to Markov chain models were used to track the changes in risk attributes on large infrastructure projects as the projects matured. The objective was to be better able to anticipate how project risks will change as projects move forward and to be better able to forecast changes to the risk register from ex ante to ex post conditions. Results from 11 major US transportation projects suggested that, on average, fewer than 65% of ex ante identified risks ultimately occurred in projects and were mitigated, while more than 35% did not occur and were retired. In addition, more than half of the risks emerged during project execution when new information became available. Based on the categorization of risk management styles, we find that identifying risks early in the project life cycle is necessary, but not sufficient to ensure successful project delivery. A project team with positive doer behavior (i.e., actively monitoring and identifying risks during project execution) performed better in delivering projects on time and within budget.

Item Type: Article
Uncontrolled Keywords: data analytics; ex post risk assessment; risk register; transportation projects
Index terms: documents, risk register, transportation project, risk identification, large infrastructure project, automation, project team, project delivery, risk assessment, monitoring, empirical study, risk management, investigation, life cycle, project risk management, Markov chain, judgment
Subjects: professional development, infrastructure engineering, financial risk, automation and robotics, research methods, infrastructure and transport systems, control systems, value management, dispute resolution, mathematical modelling, data collection methods, risk assessment, project delivery
Topics: Risk Management, Procurement, Cost Management, Engineering Principles, Information Management, Research Practice, Project Management, Site Management, Digital Applications, Legal Issues
Descriptive scope: 3 PCA

N.B. Descriptive scope is a count of how many of the five facets of empirical research are indicated by the words used in title, abstract and keywords. It is not intended as a judgement on the research; merely a count of the kind of word we would expect to indicate Phenomenon, Concepts, Theoretical framing, Empirical techniques, Analytical techniques. If all five are present, then a code of “5 PCTEA” will indicate this. If you feel the coding for this record is questionable, we welcome discussion around the terms we matched or the way we categorized them. The facet you would expect may not be coded, or a facet may be coded inappropriately. This can also bear on a larger question, of which facets should be treated as defining in construction management research. Please get in touch, and we will look at it. More details here