Heavy Equipment Productivity

About this solution

The AI locates heavy equipment on the construction site, mine or port — excavators, backhoes, wheel loaders, crawler dozers, rollers, cranes and trucks — and classifies, second by second, whether each one is operating (arm, boom or bucket working, or maneuvering back and forth with a load), traveling (moving without working) or idle. The result is each machine's real utilization, idle time, number of work cycles and an equivalent hour meter — without installing anything on the machines.

1. 1Open-vocabulary detection (YOLO-World): machines are found by text description, without specific training; each one's type is confirmed by a CLIP classifier on the crop and decided by voting during the first few seconds.
2. 2Camera movement (drone, swaying pole, zoom) is estimated from the scene background and discounted; only the machines' real movement is analyzed. Residual shake sets an adaptive noise floor.
3. 3Within each machine, movement is split into translation (the whole machine moving) and articulation (arm, boom, bucket or upper-structure swing moving differently from the body).
4. 4Operating = sustained articulation or back-and-forth maneuvers (wheel loaders, rollers, dozers); a stationary truck being loaded or dumping also counts as operating. Traveling = moving without articulating. Idle = no relevant movement, even with the engine running.
5. 53 s windows, hysteresis and a minimum dwell of 1.5 s in each state keep camera shake or dust from becoming 'operating'; people are detected and their movement is discounted. Pauses of up to 5 s between cycles (filling or emptying the bucket) still count as operating.
6. 6Cycles: for excavators and backhoes, each round trip of the arm between digging and dumping counts as one cycle; for wheel loaders, each back-and-forth round trip.
7. 7Alerts: machine idle beyond the configured time and fleet utilization below target.