Marcus Cezillo*¹ and Renata Bandini Vieira Guglielmi²

¹Department of Trauma and Acute Care Surgery, Hospital Municipal Antônio Giglio, Brazil
²Hospital Municipal do Campo Limpo, Brazil

*Corresponding Author: Marcus Cezillo, Department of Trauma and Acute Care Surgery, Hospital Municipal Antônio Giglio, Brazil.

Received: June 26, 2023; Published: August 16, 2023

Abstract

The acquisition of competencies in surgery is still the main objective of the professional who seeks independence in a safe and optimized way. However, this task requires the development of assessment tools so that there is quantification and comparison, necessary for the acquisition of competencies. The objective is to review the methods of assessing technical and cognitive skills in general surgery and identify tools and methodologies best applicable in each training context and situation. A scope review was conducted, given the heterogeneous nature of the evidence. A systematic search was performed in the databases MEDLINE, EMBASE, LILACS, Web of Science and Scopus and studies related to the evaluation of technical and cognitive skills in surgery were included after careful selection of the reviewers. With the 21 selected studies it was possible to create a table with information whose observation revealed a great heterogeneity in the evaluation methodology regarding the tool used and comparative method. In addition, most of the time the number of individuals evaluated is low, reflecting the difficulty of conducting this type of clinical research dependent on the commitment of the resident with his teaching and of the preceptor and institution, divided between the care and educational activity organized from the local policy. The limitations that make it difficult to standardize the variables and the comparisons between the different assessment tools are still the subject of study. The review of the current state of the main assessment instruments and their characteristics can provide input for rational and practical use in the face of each reality and need.

 Keywords: Instruments; Assessment; Cognitive Skills; Surgery; Scope

References

1. J Frank., et al. “Competency-based medical education: theory to practice”. Medical Teacher 8. (2010): 638-645.
2. J Shalhoub., et al. “What evidence is there for the use of workplace-based assessment in surgical training?” Journal of Surgical Education 6. (2014): 906-915.
3. J Wagner., et al. “Use of entrustable professional activities in the assessment of surgical resident competency”. JAMA Surgery 4. (2018): 335-343.
4. J Weller., et al. “Systematic review and narrative synthesis of competency- based medical education in anaesthesia”. British Journal of Anaesthesia 6. (2020): 748-760.
5. A Ponton-Carss., et al. “Assessment of technical and nontechnical skills in surgical residents”. The American Journal of Surgery 5. (2016): 1011-1019.
6. Gaunt A., et al. “Exploring the Role of Self-Motives in Postgraduate Trainees' Feedback-Seeking Behavior in the Clinical Workplace: A Multicenter Study of Workplace-Based Assessments From the United Kingdom”. Academic Medicine 10 (2018): 1576-1583.
7. Shackelford S and Bowyer M. “Modern Metrics for Evaluating Surgical Technical Skills”. Current Surgery Reports 5 (2017) 24.
8. Barreira MA., et al. “Evaluation tool for a gastroenterostomy simulated training1”. Acta Cirúrgica Brasileira 3 (2019): e201900308.
9. Tricco AC., et al. “PRISMA extension for scoping reviews (PRISMA- ScR): checklist and explanation”. Annals of Internal Medicine 7 (2018): 467-473.
10. McGowan J., et al. “PRESS Peer Review of Electronic Search Strategies: 2015 Guideline Statement”. Journal of Clinical Epidemiology 75 (2016): 40-46.
11. Mourad Ouzzani., et al. “Rayyan-a web and mobile app for systematic reviews”. Systematic Reviews 5 (2016): 210.
12. Niitsu H., et al. “Using the Objective Structured Assessment of Technical Skills (OSATS) global rating scale to evaluate the skills of surgical trainees in the operating room”. Surgery Today 3 (2013): 271-275.
13. Gofton WT., et al. “The Ottawa Surgical Competency Operating Room Evaluation (O-SCORE): a tool to assess surgical competence”. Academic Medicine 10 (2012): 1401-1407.
14. Chevallay M., et al. “Implementation and validation of a competency assessment tool for laparoscopic cholecystectomy”. Surgical Endoscopy 11 (2022): 8261-8269.
15. Larson JL., et al. “Feasibility, reliability and validity of an operative performance rating system for evaluating surgery residents”. Surgery 4 (2005): 640-647.
16. Williams RG., et al. “A controlled study to determine measurement conditions necessary for a reliable and valid operative performance assessment: a controlled prospective observational study”. Annals of Surgery 1 (2012): 177-187.
17. C-SATS virtual platform (2023).
18. Cox ML., et al. “Validation of the Omni: A Novel, Multimodality, and Longitudinal Surgical Skills Assessment”. Journal of Surgical Education 6 (2018): e218-e228.
19. Vassiliou MC., et al. “A global assessment tool for evaluation of intraoperative laparoscopic skills”. The American Journal of Surgery 1 (2005): 107-113.
20. Harriman D., et al. “The Resident Report Card: A Tool for Operative Feedback and Evaluation of Technical Skills”. Journal of Surgical Research 239 (2019): 261-268.
21. Bohnen JD., et al. Procedural Learning and Safety Collaborative (PLSC). “The Feasibility of Real-Time Intraoperative Performance Assessment With SIMPL (System for Improving and Measuring Procedural Learning): Early Experience From a Multi-institutional Trial”. Journal of Surgical Education 6 (2016): e118-e130.
22. Wilson AB., et al. “Clinical Assessment and Management Examination--Outpatient (CAMEO): its validity and use in a surgical milestones paradigm”. Journal of Surgical Education 1 (2015): 33-40.
23. Steiman J., et al. “Measuring Competence in Surgical Training through Assessment of Surgical Entrustable Professional Activities”. Journal of Surgical Education 6 (2018): 1452-1462.
24. Yule S., et al. “Development of a rating system for surgeons' non-technical skills”. Medical Education 11 (2006): 1098-1104.
25. Glarner CE., et al. “Utilizing a novel tool for the comprehensive assessment of resident operative performance”. Journal of Surgical Education 6 (2013): 813-820.
26. Jung JJ., et al. “Nontechnical Skill Assessment of the Collective Surgical Team Using the Non-Technical Skills for Surgeons (NOTSS) System”. Annals of Surgery 6 (2020): 1158-1163.
27. Toprak A., et al. “Validation of a novel intraoperative assessment tool: The Surgical Procedure Feedback Rubric”. The American Journal of Surgery 2 (2016): 369-376.
28. IC McManus., et al. “Assessment of examiner leniency and stringency (‘hawk-dove effect’) in the MRCP (UK) clinical examination (PACES) using multi-facet Rasch modelling”. BMC Medical Education 6 (2006): 42.

Citation

Citation: Marcus Cezillo and Renata Bandini Vieira Guglielmi. “Instruments for the Assessment of Technical and Cognitive Skills in Surgery: A Review Of Scope". Acta Scientific Gastrointestinal Disorders 6.9 (2023): 29-40.

Copyright

Copyright: © 2023 Marcus Cezillo and Renata Bandini Vieira Guglielmi. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.