Zhao, J. and Xu, Z. (2026) A generalizable deep reinforcement learning-based algorithm for priority rule scheduling in stochastic resource-constrained project scheduling. Journal of Construction Engineering and Management, 152(9): 04026156, ISSN 0733-9364
Abstract
In practical construction project scheduling, deterministic project information is available at the planning stage, and uncertainty arises during project execution. For the stochastic resource-constrained project scheduling problem (SRCPSP), existing approaches typically infer probability distributions from historical data or expert judgment during planning. However, accurately estimating such distributions is often difficult in practice. Accordingly, this study proposes a deep reinforcement learning (DRL)-based framework for online solution of the SRCPSP. The scheduling process is formulated as a Markov decision problem, and a multi-instance trained DRL agent is developed to dynamically select priority rules (PRs) during execution, based on deterministic information available at the planning stage and stochastic realizations encountered during execution. The computational experiments on a project scheduling problem library (PSPLIB) and a real-world case study show that the proposed method outperforms all traditional PR-based methods for the SRCPSP under five different distributions, validating its effectiveness, practicality and generalizability.
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | deep reinforcement learning; priority rules; resource-constrained project scheduling problem; stochastic resource-constrained project scheduling problem |
| Index terms: | reinforcement, case study, estimating, effectiveness, probability distribution, experiment, agent, scheduling, judgment, project scheduling, construction project |
| Subjects: | production management, statistical analysis, project controls, dispute resolution, performance management, financial and cost management, data collection methods, building materials, operations research, practitioner |
| Topics: | Roles and Professions, Cost Management, Quality Management, Legal Issues, Research Practice, Time Control, Project Management, Construction Materials |
| Descriptive scope: | 4 PCEA |
N.B. Descriptive scope is a count of how many of the five facets of empirical research are indicated by the words used in title, abstract and keywords. It is not intended as a judgement on the research; merely a count of the kind of word we would expect to indicate Phenomenon, Concepts, Theoretical framing, Empirical techniques, Analytical techniques. If all five are present, then a code of “5 PCTEA” will indicate this. If you feel the coding for this record is questionable, we welcome discussion around the terms we matched or the way we categorized them. The facet you would expect may not be coded, or a facet may be coded inappropriately. This can also bear on a larger question, of which facets should be treated as defining in construction management research. Please get in touch, and we will look at it. More details here