Presentation
Applying a Multi-Dimensional Assessment Framework to Complex Military Team Performance
SessionWednesday Poster Session
DescriptionAssessing team performance is a complex challenge, largely due to the dynamic and interdependent nature of teamwork and evaluation. We developed a four-pronged assessment plan based on a generalized framework that spans individual and team, process and outcome dimensions, and evaluated whether these measures provided a coherent representation of team performance by examining their relationship with simulation-based indicators of team outcomes in a military environment. Assessments included Mission Rating, a four-point Likert scale to measure how well the team met their overall objectives, Individual Ratings, four-point Likert scales to measure each team member’s effectiveness, TOM (Team Observation Measure), a scale with 11 items that measured teamwork skills, and TARGETs (Targeted Acceptable Responses to Generated Events or Tasks), a checklist of expected tasks for each team member. All four assessments showed strong, positive correlations with one another (all p < .001), indicating substantial convergence across assessments for gauging team performance. Each assessment also significantly correlated with at least one simulation-based performance variable, particularly one measuring the percentage of targets hit during the mission. The observed convergence across outcome- and process-based assessments suggests that the framework provided a coherent representation of team performance suitable for use as criterion data in modeling efforts.
Event Type
Poster
TimeWednesday, October 21st5:30pm - 6:30pm PDT
Location
Similar Presentations