The Diagnostic Arthroscopy Skill Score (DASS): a reliable and suitable assessment tool for arthroscopic skill training
| Author | Anetzberger H, Becker R, Eickhoff H, Seibert FJ, Döring B, Haasters F, Mohr M, Reppenhagen S. |
|---|
Purpose
To develop and validate a novel score to more objectively assess the performance of diagnostic knee arthroscopy using a simulator.
Method
A Diagnostic Arthroscopy Skill Score (DASS) was developed by ten AGA (AGA-Society for Arthroscopy and Joint-Surgery) instructors for the assessment of arthroscopic skills. DASS consists of two parts: the evaluation of standardized diagnostic knee arthroscopy (DASSpart1) and the evaluation of manual dexterity, including ambidexterity and triangulation, using objective measurement parameters (DASSpart2). Content validity was determined by the Delphi method. One hundred and eleven videos of diagnostic knee arthroscopies were recorded during simulator training courses and evaluated by six specially trained instructors using DASS. Construct validity, measurement error calculated by the minimum detectable change (MDC), internal consistency using Cronbach’s alpha and interrater and intrarater reliability were assessed. The Bland–Altman method was used to calculate the intrarater agreement.
Results
Six skill domains were identified and evaluated for each knee compartment. DASS, DASSpart1, and DASSpart2 showed construct validity, with experts achieving significantly higher scores than competents and novices. MDC was 4.5 ± 1.7 points for DASSpart1. There was high internal consistency for all domains in each compartment from 0.78 to 0.86. The interrater reliability showed high agreement between the six raters (ICC = 0.94). The evaluation of intrarater reliability demonstrated good and excellent agreement for five raters (ICC > 0.80) and moderate agreement for one rater (ICC = 0.68). The Bland–Altman comparison showed no difference between the first and second evaluations in five out of six raters. Precision, estimated by the regression analysis and comparison with the method of Bland and Altman, was excellent for four raters and moderate for two raters.
Conclusions
The results of this study indicate good validity and reliability of DASS for the assessment of the surgical performance of diagnostic knee arthroscopy during simulator training. Standardized training is recommended before arthroscopy surgery is considered in patients.
Level of evidence
II