Developing, Implementing and Scoring Valid Job Simulations

Workshop Presented by:
Suzanne Tsacoumis, HumRRO

This session will provide a comprehensive overview of the development and use of job simulations as assessment tools.  Simulations such as role-play, analysis, and in-basket exercises can be very informative, powerful methods for evaluating general, as well as, technical job competencies.  This workshop will cover how to follow a content-oriented strategy to develop valid simulations and rating scales and to identify the appropriate weights for each component of the assessment process.  Various delivery options will be discussed, as well as implementation and logistical issues.  The presenter will address the strengths and weaknesses of this type of assessment method, contrasting it with other commonly used approaches.  This workshop also will include a discussion of different response formats and the implications of using video-based simulations, both in terms of implementation issues as well as in terms of validity evidence.  This will be an interactive session to ensure participants understand all relevant principles.

Learning objectives include:

• Create job simulations that possess high levels so psychological and physical fidelity by following a content oriented development strategy
• Compare the benefits associated with different job simulations and alternative assessment strategies
• Assess the different response formats and the implications of using computer-based delivery mode.