Introduction/Rationale:
Innovative approaches like coaching can be delivered with good quality and reliability if the intervention is delivered with fidelity. To measure fidelity with a standard measure is needed for large studies or widespread clinical implementation of group coaching. We defined fidelity in this study as the ability to adhere to the principles of coaching.
Objectives:
To examine the content validity and inter-rater agreement of the items on the group coaching fidelity measure. The benchmark for this preliminary study was 80% for completion of items, percent agreement, and content validity survey endorsement.
Methods/ Approach:
The fidelity measure items of individual coaching were available from prior work by our team. Ten group coaching sessions were rated with 5 undergraduate students and 5 individuals with spinal cord injury. The coach completed a self-assessment, and rater rated the recorded session. Both also completed a content validity survey with six COSMIN framework-based questions on relevance, comprehensiveness, and comprehensibility. Data was analyzed descriptively. A panel of eight experts met for data review, item revisions, and development of new items.
Results/ Practice implications:
Overall, good usability was indicated by a 95% completion rate. Between the two raters, there was 80% percent agreement (range=20-100%) across the items on the measure. Rater endorsement for content validity survey items was 78.33 % (range=66.67-100%) across sessions. Thus, changes were made to the measure for 4 items and 3 new items were added, yielding a total of 39 items.
Conclusion/ Significance to the Occupational Therapy Profession:
Preliminary results indicate adequate content validity for the items of the fidelity measure of group coaching.