Server-customer interaction tracker: Computer vision-based system to estimate dirt-loading cycles

Rezazadeh Azar, E; Dickinson, S and McCabe, B (2013) Server-customer interaction tracker: Computer vision-based system to estimate dirt-loading cycles. Journal of Construction Engineering and Management, 139(7), pp. 785-794. ISSN 0733-9364

Abstract

Real-time monitoring of heavy equipment can help practitioners improve machine-intensive and cyclic earthmoving operations. It can also provide reliable data for future planning. Surface earthmoving job sites are among the best candidates for vision-based systems due to relatively clear sightlines and recognizable equipment. Several cutting-edge computer vision algorithms are integrated with spatiotemporal information, and background knowledge to develop a framework, called server-customer interaction tracker (SCIT), which recognizes and measures the dirt loading cycles. The SCIT system detects dirt loading plants, including excavator and dump trucks, tracks them, and then uses captured spatiotemporal data to recognize loading cycles. A novel hybrid tracking algorithm is developed for the SCIT system to track dump trucks under visually noisy conditions of loading zones. The developed framework was evaluated using videos taken under various conditions. The SCIT system with novel hybrid tracking engine demonstrated reliable performance as the comparison of the machine-generated and ground truth data showed high accuracy.

Item Type: Article
Uncontrolled Keywords: automatic identification systems; construction equipment; data collection; earthmoving; imaging techniques
Index terms: monitoring, interaction, estimate, earthmoving, loading, construction equipment, practitioner, computer vision, accuracy
Subjects: behavioral psychology, professional development, construction equipment, computer vision, financial and cost management, construction operations, practitioner, control systems
Topics: Research Practice, Information Management, Cost Management, Plant and Equipment, Roles and Professions, Digital Applications, Site Management
Descriptive scope: 2 PC

N.B. Descriptive scope is a count of how many of the five facets of empirical research are indicated by the words used in title, abstract and keywords. It is not intended as a judgement on the research; merely a count of the kind of word we would expect to indicate Phenomenon, Concepts, Theoretical framing, Empirical techniques, Analytical techniques. If all five are present, then a code of “5 PCTEA” will indicate this. If you feel the coding for this record is questionable, we welcome discussion around the terms we matched or the way we categorized them. The facet you would expect may not be coded, or a facet may be coded inappropriately. This can also bear on a larger question, of which facets should be treated as defining in construction management research. Please get in touch, and we will look at it. More details here