Automated action recognition using an accelerometer-embedded wristband-type activity tracker

Ryu, J; Seo, J; Jebelli, H and Lee, S (2019) Automated action recognition using an accelerometer-embedded wristband-type activity tracker. Journal of Construction Engineering and Management, 145(1): 04018114, ISSN 0733-9364

Abstract

Automated worker action recognition helps to understand the state of workers' actions, enabling effective management of work performance in terms of productivity, safety, and health issues. A wristband equipped with an accelerometer (e.g., activity tracker) allows to collect the data related to workers' hand activities without interfering with their ongoing work. Considering that many construction activities involve unique hand movements, the use of acceleration data from a wristband has great potential for action recognition of construction activities. In this context, the authors examine the feasibility of the wrist-worn accelerometer-embedded activity tracker for automated action recognition. Specifically, masonry work was conducted to collect acceleration data in a laboratory. The classification accuracy of four classifiers - the k-nearest neighbor, multilayer perceptron, decision tree, and multiclass support vector machine - was analyzed with different window sizes to investigate classification performance. It was found that the multiclass support vector machine with a 4-s window size showed the best accuracy (88.1%) to classify four different subtasks of masonry work. The present study makes noteworthy contributions to the current body of knowledge. First, the study allows for automatic construction action recognition using a single wrist-worn sensor without interfering with workers' ongoing work, which can be widely deployed to construction sites. The use of a single sensor also greatly reduces the burden to carry multiple sensors while also reducing computational cost and memory. Second, influences associated with the variability of movement between subject and experience group were examined; thus, a consideration of data acquisition that reflects the characteristics of workers' actions is suggested.

Item Type: Article
Uncontrolled Keywords: accelerometer; action recognition; automation; data analysis; machine learning; wearable device; worker
Index terms: window, body of knowledge, machine learning, data analysis, movement, laboratory, accuracy, construction site, decision tree, work performance, data acquisition, acceleration, variability, automation, wearable device, productivity, construction activity, multilayer
Subjects: project controls, research management, decision analysis, statistical analysis, management, architectural elements, specialized materials and systems, automation and robotics, professional development, digital technology, operations management, work location, construction operations, data analysis and analytics, knowledge management, artificial intelligence, data collection methods, health behaviours and lifestyles
Topics: Risk Management, Project Management, Research Practice, Construction Materials, Information Management, Business Strategy, Site Management, Time Control, Design Practice, Digital Applications
Descriptive scope: 4 PCEA

N.B. Descriptive scope is a count of how many of the five facets of empirical research are indicated by the words used in title, abstract and keywords. It is not intended as a judgement on the research; merely a count of the kind of word we would expect to indicate Phenomenon, Concepts, Theoretical framing, Empirical techniques, Analytical techniques. If all five are present, then a code of “5 PCTEA” will indicate this. If you feel the coding for this record is questionable, we welcome discussion around the terms we matched or the way we categorized them. The facet you would expect may not be coded, or a facet may be coded inappropriately. This can also bear on a larger question, of which facets should be treated as defining in construction management research. Please get in touch, and we will look at it. More details here