Measuring the effectiveness of enterprise application training: a comparative analysis of dynamic and integrated instruction

The purpose of this study was to investigate the impacts of three types of instructional presentation methods on learning, efficiency, cognitive load, and learner attitude. A total of 67 employees of a large southwestern university working in the field of research administration were randomly assigned to one of three conditions. Each condition presented instructional materials using a different method, namely dynamic integrated, dynamic non-integrated, or non-dynamic non-integrated. Participants completed a short survey, pre-test, cognitive load questions, learner attitude questions, and a post-test during their experience. The results reveal that users of the dynamic integrated condition treatment showed significant improvement in both learning and efficiency. The dynamic non-integrated participants had a faster mean time to complete an assigned task, however, they also had significantly lower average test scores. There were no other significant findings in terms of cognitive load or learner attitude. Limitations, implications and future studies are discussed.