A rapid, mixed‑methods evaluation found a short video was the most suitable format for delivering a particular online training to Australian public servants.
Purpose
Online training for professionals can be delivered in various formats. This evaluation tested the effectiveness of 3 different formats for short, introductory training:
- 3‑minute video
- 15‑minute podcast
- 30‑minute e‑learning module
Methods
This rapid evaluation used a ‘randomised trial’, a short survey and focus groups. For the former, over 750 public servants were randomly assigned to receive training in 1 of the 3 different formats. The training participants were then asked several questions. These questions were used to create a ‘training effectiveness index’.
Key results
- The randomised trial found video and module were equally effective, and both outperformed the podcast
- The survey found that 52 per cent of people preferred video and only 9 per cent preferred podcast
- Focus groups also favoured video
Conclusion
The trial had some limitations. However, the ACE judged that the evidence from the evaluation – and the lower cost of the video format – meant video was the most suitable format for their purposes. The study’s limitations and purpose should be borne in mind before applying the results elsewhere.
Downloads
Pre-analysis Plan [PDF 506 kB]