This paper presents a framework to classify work poses among groups of masons during the building of a standard wall of concrete masonry units. The experience of the group composed of masonry instructors and master masons averaged five times that of the other groups, their productivity was highest, and the loads on their joints were the lowest. Thus, they were deemed experts in this paper. Inertial measurement units (IMU) and video cameras were used to collect kinematic data of the masons, from which pose clusters were identified.