Introduction / Rationale: Assessing competency acquisition in occupational therapy (OT) students is essential for standardized education. The Test of Competencies (TeCo), derived from the Progress Test (PT), is a 190-item multiple-choice exam covering ten macro-areas, including basic sciences, OT frameworks, evidence-based rehabilitation, and healthcare management. It was administered to 734 students from various Italian universities.
Objectives: This study aimed to evaluate the psychometric properties of the TeCo, focusing on reliability and validity to ensure its effectiveness in tracking competency development.
Methods / Approach: TeCo was administered at three academic stages: enrollment, second year, and before graduation. Psychometric analyses included internal consistency (Cronbach’s α), test-retest reliability (ICC), facility index, and point-biserial correlation.
Results / Practice Implications: Data from 543 Sapienza University students (updated to 2024) were analyzed. The TeCo, later administered to 340 additional OT students, showed excellent internal consistency (Cronbach’s α = 0.90) and high test-retest reliability (ICC = 0.90–1.00). The highest score achieved was 126/190, confirming its difficulty level. Discriminant validity was strong, with AUC values of 0.95 for first-year, 0.92 for second-year, and 0.81 for third-year students, proving its ability to measure competency growth.
Conclusion / Significance to the OT Profession: A validated, standardized competency assessment is crucial for ensuring OT students acquire essential skills for clinical practice. TeCo provides an objective measure of learning, supports curriculum improvements, and aligns with World Federation of Occupational Therapists (WFOT) standards. Integrating structured evaluations into OT programs enhances student preparation, fostering a competent workforce for evidence-based interventions.