Indian Journal of Ophthalmology

EDITORIAL
Year
: 2017  |  Volume : 65  |  Issue : 9  |  Page : 777--778

How good a surgeon are you? - Standardized formative assessment of surgical competence for ophthalmology residents in training


Santosh G Honavar 
 Editor, Indian Journal of Ophthalmology, Editorial Office: Centre for Sight, Road No 2, Banjara Hills, Hyderabad - 500 034, Telangana, India

Correspondence Address:
Santosh G Honavar
Editor, Indian Journal of Ophthalmology, Editorial Office: Centre for Sight, Road No 2, Banjara Hills, Hyderabad - 500 034, Telangana
India




How to cite this article:
Honavar SG. How good a surgeon are you? - Standardized formative assessment of surgical competence for ophthalmology residents in training.Indian J Ophthalmol 2017;65:777-778


How to cite this URL:
Honavar SG. How good a surgeon are you? - Standardized formative assessment of surgical competence for ophthalmology residents in training. Indian J Ophthalmol [serial online] 2017 [cited 2024 Mar 28 ];65:777-778
Available from: https://journals.lww.com/ijo/pages/default.aspx/text.asp?2017/65/9/777/214662


Full Text

The making of a trainee resident into a competent surgeon is challenging. The Accreditation Council for Graduate Medical Education in the United States mandates six core competencies for residents in training patient care, medical knowledge, practice-based learning and improvement, interpersonal and communication skills, professionalism, and systems-based practice.[1] Although surgical competence is just one part of the vast skill set an ophthalmology resident is expected to acquire, it is unarguably the most important attribute that has a direct impact on patient outcome.

In several countries, ophthalmology residency programs mandate a minimum number for supervised and independent cataract and other ophthalmic surgeries (quantity), but more often than not, there are no specified standard measures to assess how well the surgeries are performed (quality). Ophthalmic surgical training in India is traditionally based on an apprenticeship model. Residents undertake 2–3 years of training and are awarded a postgraduate degree on the basis of an exit examination. However, the surgical skills are not formally assessed and do not form a prerequisite to exit residency. Furthermore, the surgical training grossly varies among different states and universities. There is an obvious lack of standardization in surgical training and objectivity in assessment and feedback.[2],[3],[4],[5],[6],[7]

The aim of assessment is to demonstrate learning (assessment of learning or summative assessment) or to facilitate learning (assessment for learning or formative assessment).[8] The goal of summative assessment is to evaluate learning at the end of an instructional unit, typically a residency exit examination, whereas the goal of a formative assessment is to provide ongoing feedback to improve learning.[8] Formative assessment helps the trainees identify their strengths and weaknesses and allows them to focus on skills that need enhancement.[8] Moreover, it helps the faculty recognize suboptimal performance and take remedial measures. An ideal system of surgical training must adopt an objective, transparent, and valid formative assessment that gives continuous feedback to the trainees.

There are several proposed methods of formative assessment of surgical skills. Cremers et al. developed the “Objective Assessment of Skills in Intraocular Surgery” to assess the residents' skills in cataract surgery, where an evaluator observes and provides an objective assessment of the surgical steps.[9] This can be used in conjunction with the “Global Rating Assessment of Skills in Intraocular Surgery” that allows the evaluator to assign scores based on a rubric.[10] Saleh described the “Objective Structured Assessment of Cataract Surgical Skill” (OSACSS) which stratifies phacoemulsification into twenty steps that are scored on a 5-point Likert scale.[11] The International Council of Ophthalmology (ICO) modified OSACSS to include a Dreyfus-inspired model of skill acquisition.[12] The ICO's Ophthalmology Surgical Competency Assessment Rubric (ICO-OSCAR) is designed by a panel of international experts to facilitate assessment and acquisition of surgical skills. Surgical procedures are described in individual steps; each step is evaluated on a scale based on competence, graded as a novice, a beginner, an advanced beginner, or a competent surgeon. The requirement for the level of performance to achieve each grade in each step is clearly described. The assessor scores the observed performance either manually or electronically. The completed OSCAR is then discussed with the trainee at the end of the surgery to provide timely, structured, and specific feedback.[12],[13],[14]

This type of assessment tool serves three distinct purposes (1) It minimizes subjectivity by clearly defining the skills that must be observed at each level of proficiency; (2) The rubric clearly states what is expected of the trainee to attain competence at each level and thus can be used for both assessment and teaching; and (3) Self-assessment by reflective practice is possible when the trainees' surgical procedures are recorded.[13],[14],[15] Currently, assessment tools are available for phacoemulsification, extracapsular cataract surgery, small incision cataract surgery, lateral tarsal strip surgery, strabismus surgery, trabeculectomy, and pediatric cataract surgery.[2],[12],[15],[16],[17],[18],[19] Similar tools are being developed for other ophthalmic procedures including panretinal photocoagulation, corneal transplant, and vitrectomy. These tools are subject to constant evolution, and one such example is the modified OSCAR by Farooqui and associates that can be used in a wetlab situation, the results of which are reported in the current issue of Indian Journal of Ophthalmology.[20]

Irrespective of whether or not the formative assessment of surgical skills becomes an integral part of our formal residency training framework, it would be in the interest of our trainees and trainers that we adopt the OSCAR tools to train and assess our residents. If adequately developed to cover the spectrum of other commonly performed subspecialty surgical procedures, such tools can add immense value to our fellowship surgical training as well and possibly help create a generation of objectively trained surgeons.

References

1ACGME Common Program Requirements. Available from: http://www.acgme.org/Portals/0/PFAssets/ProgramRequirements/CPRs_07012016.pdf. [Last accessed on 2017 Sep 10].
2ICO OSCAR Tools. Available from: http://www.icoph.org/resources/230/Surgical-Assessment-Tool-ICO-OSCAR-in-English-and-Spanish.html. [Last accessed on 2017 Sep 10].
3Grover AK. Postgraduate ophthalmic education in India: Are we on the right track? Indian J Ophthalmol 2008;56:3-4.
4Ajay K, Krishnaprasad R. Feedback of final year ophthalmology postgraduates about their residency ophthalmology training in South India. Indian J Ophthalmol 2014;62:814-7.
5Ajay K, Krishnaprasad R, Divya DS. Ophthalmic surgical training in Karnataka and Southern India: Present status and future interests from a survey of final-year residents. Indian J Ophthalmol 2015;63:306-11.
6Gogate P, Biswas P, Natarajan S, Ramamurthy D, Bhattacharya D, Golnik K, et al. Residency evaluation and adherence design study: Young ophthalmologists' perception of their residency programs - Clinical and surgical skills. Indian J Ophthalmol 2017;65:452-60.
7Honavar SG. Ophthalmology residency training in India: Quo vadis? Indian J Ophthalmol 2017;65:427-8.
8SFormative and Summative Assessment. Available from: https://www.cmu.edu/teaching/assessment/basics/formative-summative.html. [Last accessed on 2017 Sep 10].
9Cremers SL, Ciolino JB, Ferrufino-Ponce ZK, Henderson BA. Objective assessment of skills in intraocular surgery (OASIS). Ophthalmology 2005;112:1236-41.
10Cremers SL, Lora AN, Ferrufino-Ponce ZK. Global rating assessment of skills in intraocular surgery (GRASIS). Ophthalmology 2005;112:1655-60.
11Saleh GM, Gauba V, Mitra A, Litwin AS, Chung AK, Benjamin L, et al. Objective structured assessment of cataract surgical skill. Arch Ophthalmol 2007;125:363-6.
12Golnik KC, Beaver H, Gauba V, Lee AG, Mayorga E, Palis G, et al. Cataract surgical skill assessment. Ophthalmology 2011;118:427.
13Golnik C, Beaver H, Gauba V, Lee AG, Mayorga E, Palis G, et al. Development of a new valid, reliable, and internationally applicable assessment tool of residents' competence in ophthalmic surgery (an American Ophthalmological Society Thesis). Trans Am Ophthalmol Soc 2013;111:24-33.
14Golnik KC. Resident competence assessment: Best practices. J Curr Ophthalmol 2016;28:53-4.
15Green CM, Salim S, Edward DP, Mudumbai RC, Golnik K. The ophthalmology surgical competency assessment rubric for trabeculectomy. J Glaucoma 2017;26:805-9.
16Golnik KC, Haripriya A, Beaver H, Gauba V, Lee AG, Mayorga E, et al. Cataract surgery skill assessment. Ophthalmology 2011;118:2094.
17Golnik KC, Gauba V, Saleh GM, Collin R, Naik MN, Devoto M, et al. The ophthalmology surgical competency assessment rubric for lateral tarsal strip surgery. Ophthal Plast Reconstr Surg 2012;28:350-4.
18Golnik KC, Motley WW, Atilla H, Pilling R, Reddy A, Sharma P, et al. The ophthalmology surgical competency assessment rubric for strabismus surgery. J AAPOS 2012;16:318-21.
19Swaminathan M, Ramasubramanian S, Pilling R, Li J, Golnik K. ICO-OSCAR for pediatric cataract surgical skill assessment. J AAPOS 2016;20:364-5.
20Farooqui JH, Jaramillo A, Sharma M, Gomaa A. Use of modified international council of ophthalmology- ophthalmology surgical competency assessment rubric (ICO- OSCAR) for phacoemulsification- wet lab training in residency program. Indian J Ophthalmol 2017;65:898-9.