Introduction
There are no objective performance metrics for basic endoscopic skills to guide training and career trajectory. The fidelity of endoscopic tip manipulation is a key skill akin to hand steadiness in surgery. Two recent studies using ex-vivo1 and in-vivo2 models of snare tip soft coagulation (STSC) applied to a polypectomy defect margin reliably stratified endoscopists by interventional profile, number, and complexity of polypectomies performed.
Aims & Methods
Tip-control of endoscopists with varied expertise was assessed using a STSC model containing 3D-printed figures constructed from 1-4 perfect intersecting circles (radius=17.2mm) (shape 1=1 circle, shape 4=4 circles) printed onto the centre of a single piece of cooked ham. The study consisted of two assessments (=all 4 shapes, maximum 5 minutes/shape), 1 initial, two sessions of training on the model, and a second final after the training. Videos of assessments were rated via a web application for accuracy and speed (=correct hits/second) by 6 blinded raters in a random order using a web application. Each video was rated three times by three different raters. Accuracy and speed were determined and mutated into a composite-score (TIP-score) using Z-score normalization (score-mean/sd), added together with the addition of 5 to the result removing negative values.
Results
13 endoscopists participated (1 expert, 7 endoscopy fellows, 5 trainees) performing 8 procedures each. 312 assessments of 104 STSC videos were performed. Overall median speed [pre 0.25 vs. post 0.34 correct hits/sec; P<0.001] and TIP-score [pre 4.6 vs. post 5.4; P<0.001] were significantly increased after training but accuracy was not [pre 93.8% vs. post 94.7; P=0.1].
Fellows had an overall accuracy of 94.2% (vs. 97.6% expert [P <0.001], vs. 94.1% trainees [P <0.31]), a speed of 0.29 correct hits/sec (vs. 0.55 expert [P <0.001], vs. 0.27 trainees [P <0.001]), and a TIP-score of 5.05 (vs. 7.1% expert [P <0.001], vs. 4.9% trainees [P <0.02]). The expert showed worse accuracy (P=.006), and no change in speed (P=.1) or TIP-score (P=.9) post-training.
Fellows and trainees showed no change in accuracy (P=.06, .10) but significantly increased speed (both P<.001) and TIP-score (both P<.001) post-training. Compared to trainees and fellows the expert was more accurate than fellows and trainees pre-training (P<.001) but not post- (P=.40).
Expert speed and TIP-scores were significantly superior to trainees (all P<.001) and fellows (all P<.001) in both pre- and post-training. Fellows were significantly superior to trainees in speed pre+post (P=.03 & <.001) and TIP-score only post-training (P=.05). The expert showed a significant decrease in accuracy pre- vs post- readings indicating that performance can vary in a single individual at different time points.
| PRE | POST |
| PRE | POST |
| PRE | post |
|
| | ACCURACY
% (IQR) | ACCURACY
% (IQR) | P | SPEED
correct hits/s (IQR) | SPEED
correct hits/s (IQR) | P | TIP-score (IQR) | TIP-score (IQR) | P |
| Overall | 93.8 (6.4) | 94.7 (4.9) | .10 | .25 (.10) | .34 (.16) | <.001 | 4.6
(1.7) | 5.4 (1.7) | <.001 |
Expert | 99.1 (1.9) | 95.4 (3.1) | .006 | .53 (.14) | .56 (.29) | .10 | 7.3 (1.3) | 7.1 (1.6) | .90 |
Fellow | 93.7
(6.5) | 94.6 (5.8) | .06 | .26 (.08) | .36 (.18) | <.001 | 4.7 (1.3) | 5.4 (1.8) | <.001 |
Trainee | 92.9 (5.1) | 95.2 (5.5) | .10 | .23 (.08) | .30 (.08) | <.001 | 4.3 (1.3) | 5.2 (1.1) | <.001 |
Conclusion
An ex-vivo model to assess tip-control was found to stratify endoscopists by expertise. Furthermore, performing two structured training sessions using the model led to a significant increase in the tip-control of fellows, and trainees but not experts. These results have implications for standardising the assessment of endoscopic competency, benchmarking progress during training, and allowing expedited acquisition of complex endoscopic skills in an ex vivo setting.
References
1 L.K. Debels, S. Smeets, P. Poortmans, V. Lala, C. Jorissen, T. Lamiroy, L. Desomer, R. Valori, J. Anderson, D.J. Tate. ENDOSCOPIC TIP CONTROL - A SIMPLE, EX-VIVO MODEL WITH POTENTIAL FOR ENDOSCOPIST BENCHMARKING AND TRACKING OF PROGRESS OVER TIME. UEG Week 2023; United European Gastroenterology Journal 2023; 11 (Supplement 8)
2 L. Debels, S. Smeets, P.J. Poortmans, C. Jorissen, V. Lala, T. Lamiroy, R.Valori, L.Desomer, J. Anderson, D.J.Tate. (2023). THE ACCURACY OF SNARE TIP SOFT COAGULATION APPLIED TO THE MARGIN OF POST ENDOSCOPIC MUCOSAL RESECTION DEFECTS CORRELATES WITH ENDOSCOPIST POLYPECTOMY EXPERIENCE AND PROCEDURAL DIFFICULTY. Gastrointestinal Endoscopy. 97. AB211-AB212. 10.1016/j.gie.2023.04.354.
Disclosure
DJT: Pentax medical, Fujifilm, and Olympus research support and consulting.