• Users Online: 77831
  • Home
  • Print this page
  • Email this page

   Table of Contents      
EXPEDITED PUBLICATION - ORIGINAL ARTICLE
Year : 2021  |  Volume : 69  |  Issue : 2  |  Page : 400-405

A validated audio-visual educational module on examination skills in ophthalmology for undergraduate medical students in the COVID-19 season - An observational longitudinal study


Department of Ophthalmology, Christian Medical College, Vellore, Tamil Nadu, India

Date of Submission29-Jun-2020
Date of Acceptance16-Oct-2020
Date of Web Publication29-Dec-2020

Correspondence Address:
Dr. Sharmili Lalgudi
Department of Ophthalmology, Schell Eye Hospital, Christian Medical College, Vellore - 632 001, Tamil Nadu
India
Login to access the Email id

Source of Support: None, Conflict of Interest: None


DOI: 10.4103/ijo.IJO_2054_20

Rights and Permissions
  Abstract 


Purpose: The aim of this study was to assess the impact of an audio visual (AV) teaching module on basic torchlight examination of the eye and direct ophthalmoscopy for undergraduate medical students. Methods: This observational longitudinal study was done on 33 consecutive medical interns during their Ophthalmology posting from December 2019 to March 2020 at a medical college in South-India. An AV-module was created using animation graphics, narratives, demonstrations on normal individuals and on patients with positive signs. All interns had a pretest consisting of Multiple-choice questions, (MCQs) and an Objective Structured Clinical Examination (OSCE) on torchlight examination and direct ophthalmoscopy (DO). They were then shown the 20-minute AV-module. A posttest was performed immediately and after one week. Results: The mean pretest MCQ score was 5.84 ± 1.98. It improved to 8.81 ± 1.15 in the immediate posttest and 8.87 ± 1.66 in the one-week posttest. The mean pretest OSCE score was 12.21 ± 3.39. It improved to 23.21 ± 3.39 in the immediate posttest and 23.90 ± 3.7 in the one-week posttest. Using Generalized Estimating Equation, MCQ score improved by 2.97 units and 3.03 units and the OSCE score improved by 11 units and 11.69 units in the immediate posttest and one-week posttest respectively when compared to the pretest corresponding to the MCQ score and OSCE score (p < 0.001). Conclusion: AV teaching modules-for torchlight examination and DO has a significant benefit in improving knowledge and skill in undergraduate medical students. These significant results have the great translatory capacity in the current COVID-19 pandemic, where physical demonstrations involving close proximity and groups of students are highly risk prone.

Keywords: Audio-visual teaching module, COVID-19, direct ophthalmoscopy, torchlight examination, undergraduate medical students


How to cite this article:
Rose JS, Lalgudi S, Joshua R A, Paul J, Susanne M A, Phillips AC, Jeyaraj C, Abraham G, Joshua R, Vinay S, Paul P, Amritanand A, Nadaraj A. A validated audio-visual educational module on examination skills in ophthalmology for undergraduate medical students in the COVID-19 season - An observational longitudinal study. Indian J Ophthalmol 2021;69:400-5

How to cite this URL:
Rose JS, Lalgudi S, Joshua R A, Paul J, Susanne M A, Phillips AC, Jeyaraj C, Abraham G, Joshua R, Vinay S, Paul P, Amritanand A, Nadaraj A. A validated audio-visual educational module on examination skills in ophthalmology for undergraduate medical students in the COVID-19 season - An observational longitudinal study. Indian J Ophthalmol [serial online] 2021 [cited 2024 Mar 29];69:400-5. Available from: https://journals.lww.com/ijo/pages/default.aspx/text.asp?2021/69/2/400/305443



Ophthalmic presentations are common within primary care settings, constituting nearly 20% of emergency and 2–19% of general practice consultations.[1] Ophthalmic medical student education is the cornerstone for improving global eye health care.[2] It is therefore critical that young doctors should be equipped with skills to effectively diagnose common ophthalmic conditions upon graduation. Medical students spend considerably less time in Ophthalmology as compared to other mainstream clinical subjects. Most MBBS (Bachelor of Medicine and Bachelor of Surgery) interns and medical students do not show high levels of confidence in basic ophthalmological clinical skills and knowledge.[3] Standards adopted by the Association of University Professors in Ophthalmology and endorsed by the American Academy of Ophthalmology and the International Council of Ophthalmology recommend that all graduating medical students in the United States be able to recognize key abnormalities of the ocular fundus using a direct ophthalmoscope.[4] Despite these standards, direct ophthalmoscopy is performed infrequently and often inaccurately by interns. Studies have shown that direct ophthalmoscopy is performed poorly and is often avoided due to lack of adequate training and low self-confidence.[5] One of the fundamental problems in teaching direct ophthalmoscopy is that the student cannot see what the teacher sees and vice versa.[3] Therefore, direct ophthalmoscopy may be well suited for video-based instruction, particularly if videos enable the student to see what the examiner sees when performing direct ophthalmoscopy. Torchlight examination is a very important step in the examination of the eye. This simple inexpensive test has the advantage of portability making it a huge asset to the clinical ophthalmological exam. The correct techniques of tests done with torchlight are crucial in the screening and diagnosis of vision-threatening diseases and ocular morbidity that is highly prevalent in communities. Hence, if increasing the exposure of ophthalmology for medical students becomes difficult to fit in their existing curriculum, a system where the focus is towards maximizing their efficacy in the limited period of their ophthalmology posting needs to be worked out on. This new system should focus on improving the efficiency of teaching rather than investing a greater share of teaching time.[6] Many studies have shown that students tend to retain more information and understand things better when taught using multimedia learning tools in the form of audio, video and visual images.[7] As far as the acquisition of the practical clinical skills of torchlight examination of the eye and direct ophthalmoscopy examination of the eye mediated by multimedia tools is concerned, the existing literature is scarce. Hence, there is a need for high-quality videos that include graphics to highlight relevant points, provide realistic visualization of the examiner's view, and animation to emphasize the importance of technique and sound observation. A review of YouTube videos has failed to address these issues adequately.[8] The aim of this study was to assess the impact of an AV teaching module created by the authors -on basic torchlight examination of the eye and direct ophthalmoscopy on medical interns posted in ophthalmology. We chose the time point of the internship, because graduates would be going into service obligations in remote communities and translate into a diagnostic benefit in the remote communities of their service following the MBBS program.

The ongoing COVID-19 (coronavirus disease 2019) pandemic has impacted medical education globally.[9] As social distancing is the most effective preventive strategy for COVID-19, until a vaccine for the same is found, students are refrained from gathering in lecture halls for academic sessions.[10] In such a situation, there is all the more a need for a transition from classroom-based teaching or bedside clinics towards a safer platform without any compromise on learning the basic critical skills in the examination of the eye. Thus, AV teaching modules can be of great help in this situation, where there can be learning without any compromise on safety and social distancing.


  Methods Top


This observational longitudinal study was conducted in the Department of Ophthalmology at a Medical college in Southern India. The subjects were 33 consecutive medical interns posted in Ophthalmology from 16th December 2019 to 23rd March 2020. The study received Institutional Review Board and Research Ethics Committee clearance (IRB NO. 11590) &was conducted according to the tenets of the declaration of Helsinki. The AV teaching module aimed at making medical interns perform basic torchlight examination of the eye like the swinging flashlight test, ROPLAS (Regurgitation On Pressure over the Lacrimal Sac) test, assess the Anterior Chamber Depth (ACD), examination of the cornea, lens and perform Distant Direct Ophthalmoscopy (DDO), Direct Ophthalmoscopy (DO) along with evaluation of the optic disc margin, neuro-retinal rim, cup disc ratio using the prescribed techniques. The module also aimed at making medical interns identify abnormal findings like Relative Afferent Pupillary Defect (RAPD) and interpret its grade, shallow anterior chamber, positive ROPLAS, type of corneal scar, grade of cataract, abnormal DDO reflex, papilledema, optic atrophy, and glaucomatous cupping.

Preparatory phase

Prior to the study, the investigators prepared a script which included the list of eye examination techniques that the study focussed on and a detailed step by step construct of each of the tests as shown in [Table 1]. This was followed by collecting subjects with abnormal eye findings, i.e., RAPD grade 2 and 3, shallow anterior chamber, positive ROPLAS, corneal scar, Mature and immature cataract, glaucomatous disc, papilledema, optic atrophy and normal. A video recording of the various eye tests on a smart-phone and a digital camera were done. Software analysts were called over to our institute and were shown these videos with a clear and concise narration of these clinical examination techniques as scripted. Real-time anatomy like using the human skull for a demonstration of the ROPLAS test was used. Using the concept and the script, a voice-over of the senior-most investigator of the study was lent for the proposed AV module. Series of editing then followed to fit in the videos with the voice over. The content of the AV module was validated by 2 qualified ophthalmologists who were actively involved in teaching undergraduate medical students.
Table 1: Steps of the basic eye examination techniques

Click here to view


Execution phase

All Medical interns posted in Ophthalmology for a 1-week period from December 2019 to March 2020 were included in the study. Assessment modules were created using a picture-based MCQ to assess knowledge and a validated OSCE to test clinical skills. The content was validated to ensure the assessment tool was aligned with the objectives. All interns had a pre-exposure standardized manned OSCE to measure torchlight and direct ophthalmoscopy examination skills. A picture and video-based MCQs were administered to measure knowledge of the objectives mentioned above. The AV teaching module was displayed to the students on day 1 of the internship posting in Ophthalmology after the pretest. This module was approximately for duration of 20 minutes. It consisted of 5 videos that illustrated an audio-visual presentation of the swinging flashlight test and different grades of RAPD along with normal pupillary reflex, assessment of anterior chamber depth showing shallow and a normal anterior chamber, demonstration of the ROPLAS test showing a positive and negative ROPLAS, examination of the cornea and the lens showing normal cornea and lens along with different grades of corneal scars and mature and immature cataract, direct ophthalmoscopy demonstrating the technique of distant direct ophthalmoscopy showing normal red reflex, dim red reflex, white reflex in the pupillary area and direct ophthalmoscopy showing normal disc, glaucomatous disc, optic atrophy and papilledema. Each video had two parts. The first part provided a descriptive animation with a transcript detailing the precise technique of examination, positive and negative test results. The second half included live-recorded demonstrations of real patients with normal and abnormal test results.

All the interns had an immediate standardized manned OSCE and a picture & Video based MCQ questionnaire similar to that of the pre-exposure test in torchlight and DO examination following the AV module. Following this, they were posted in various areas of ophthalmology using a weekly existing protocol, which includes equal rotations in outpatient clinics, operation theatre, casualty and outreach field visits. A logbook with a prefixed number of torchlight and direct ophthalmoscopy examinations that need to be completed, as field practice, was maintained and monitored by the faculty in charge of the rotation. At the end of the 1-week posting in ophthalmology, the interns underwent the final picture & video-based questionnaire and a manned OSCE in torchlight and DO examination. The assessment of OSCE pretest, immediate posttest and 1-week posttest were done by the same investigator for all the 33 students. All interns were given a feedback form after the one-week posttest which had questions graded on the Likert scale. The MCQs comprised of 10 questions and were allotted 1 point each for the total of 10-points. The OSCE had five stations namely RAPD (8 points), ROPLAS (4 points), Anterior chamber depth assessment (5 points), cornea and lens examination (5 points) and direct ophthalmoscopy (8 points), thus amounting to a total of 30 points for OSCE [Table 2] (OSCE Scoring Sheet used for assessment is attached in Supporting Material).
Table 2: Mean scores at the various OSCE stations

Click here to view


The continuous variables, which include- the MCQ and OSCE scores were represented statistically as mean with standard deviation. The change in MCQ and OSCE scores over time were analyzed statistically using Generalised estimating Equations (GEE) with an exchangeable correlation structure and P value for the same was determined. All analysis was done by SPSS 21 Version.


  Results Top


Thirty-three medical interns (20 women and 13 men) at a Medical college in Southern India were recruited for the study. Their mean age was 23.5 ± 0.8. The mean MCQ score in the pretest was 5.84 (SD = 1.98), immediate posttest was 8.81 (SD = 1.15) and one-week posttest was 8.87 (SD = 1.66). The change of knowledge during the course of the study is shown in [Figure 1]a. The mean OSCE score in the pretest was 12.21 (SD = 4.97), for immediate posttest was 23.21 (SD = 3.39) and for one-week posttest was 23.90 (SD = 3.70). The change in skill during the course of the study is shown in [Figure 1]b. The mean scores in the various OSCE stations is depicted in [Table 2]. The comparison of the overall Percentage obtained in the individual OSCE stations in the pretest and one-week posttest is shown in [Figure 2]a. The percentage increase in the performance in the individual OSCE stations is shown in [Figure 2]b. The percentage increase from pretest to one-week posttest at the various OSCE stations were 69.83%, 143.58%, 99.98%, 47.33% and 211.26% for RAPD, ROPLAS, Anterior chamber depth, Cornea and lens and direct ophthalmoscopy stations respectively.
Figure 1: (a) Graph showing the increasing curve in Knowledge. (b) Graph showing the increasing curve in skills

Click here to view
Figure 2: (a) Percentage of the mean OSCE score in the pretest and one-week posttest. (b) Percentage increase from pretest to one-week posttest in the individual OSCE stations

Click here to view


The change in the performance of students in MCQs and the individual OSCE stations in the immediate posttest and one-week posttest when compared to the pretest was assessed using Generalised Estimating Equation (GEE) as shown in [Table 3]. The feedback form for the AV module was evaluated based on a 5 point Likert scale with values 1 (strongly disagree) to 5 (strongly agree). The responses of students based on the 5-point Likert scale for the contents of the module is shown in [Figure 3].
Table 3: Change in MCQ and OSCE over time using GEE

Click here to view
Figure 3: Graph showing the response of students based on the 5-point Likert scale for the questions in the feedback form

Click here to view



  Discussion Top


The limited medical undergraduate curriculum time has resulted in an increased focus towards acquiring more knowledge and skills in subjects like Medicine and Surgery.[15] As a result, students get limited opportunities to get sufficient experience in subspecialties like Ophthalmology. Ophthalmic skills are challenging to learn and require a lot of practice to master. Thus, it is difficult to become fully competent in performing basic tests in ophthalmology given the short time frame dedicated towards this speciality. With the current COVID-19 pandemic in the country, there is little scope for medical students in the coming year to master these skills. Therefore, powerful and precise AV technology is the need of the hour in ensuring that the current group of medical students are proficient in their examination skills.

In an attempt to fill this gap, we believe that the AV teaching tool created with its series of animated & real-time videos will have a huge impact on our country. The module consists of 5 videos with an explanation and demonstration of the important torchlight examination skills of the eye that are crucial in the diagnosis of diseases that can lead to irreversible visual loss and other common aetiologies of avoidable blindness. These included assessment of the pupillary light reflex and swinging flashlight test to check for RAPD, Anterior chamber depth assessment, the examination of the cornea and lens, ROPLAS test and direct ophthalmoscopy. These clinical skills help students to diagnose vision-threatening conditions in the eye with portable tools and will have immense translational benefit in preventing blindness especially in remote communities, which lack expensive infrastructure.

The assessment of students at the start of the Ophthalmology posting was done using MCQs to judge their theoretical knowledge and OSCE to check their clinical skills in the performance of the various eye tests. The mean MCQ pretest score which was 5.84, improved to 8.81 and 8.87, thereby showing a 51.02% and 52.05% increase in their scores in the immediate posttest and one-week posttest respectively. The mean OSCE pretest score which was 12.21, improved to 23.21 and 23.90, thereby showing a 90.07% and 95.82% increase in their performance in the immediate posttest and one-week posttest respectively.

The percentage increase from pretest to one-week posttest at the various OSCE stations ranged from 47.33% to 211.26%, the maximum increase being seen in the direct ophthalmoscopy and ROPLAS stations. All of the above results were found to be statistically significant (p < 0.001). Thus, the AV tool was useful in improving the knowledge and practical skills.

The Feedback on the Likert scale as shown in [Figure 3] indicated a more than 80% agreement in themes ranging from the clarity of understanding, holistic coverage, confidence in performance and interpretive abilities of the students. There was good agreement in terms of the ideal time duration of the AV module and the interest is stimulated. Only 30% of students felt the need for a resource person to answer doubts. This is an inevitable limitation of any exclusive AV teaching module. However, it is encouraging to note that 70% of students were self-sufficient even in this respect.

This innovative AV teaching tool is an attempt to address the barriers in the existing system responsible for the gaps in the acquisition of the basic skills in ophthalmology. This teaching tool can have many benefits. It is a standardised resource, thereby, ensuring that students are provided with equally consistent learning that can address their learning needs. Other modes of teaching these practical skills require staff, staff time, equipment and an adequate learning space all of which are taken care of with this teaching tool. Amidst the COVID-19 season, with concerns regarding safety and social distancing as well as with a decrease in patient load in hospitals, this AV teaching module can keep the medical education process going.[10] It can also be used in conjunction with the existing teaching system for their better understanding as this involves both video and audio mediums. We created this tool specifically for the basic torch light tests of the eye and direct ophthalmoscopy technique keeping in mind that these are the basic tests, which can be of benefit to medical students once they are posted in various peripheral hospitals after competition of their MBBS as well for those students who plan to pursue as general practitioners. These skills can help them pick up conditions like a relative afferent pupillary defect (RAPD), blocked ducts (ROPLAS positive), shallow anterior chamber of the eye (Primary angle-closure suspects), corneal ulcer, Mature cataract, papilledema, glaucomatous discs, white reflex in the pupillary area in a child all of which need a prompt referral to an ophthalmologist which can be vision-saving due to the timely diagnosis and timely referral.

The drawback of this tool is the cost involved in creating these animation videos. However, this is a one-time investment and this validated AV Module could have powerful translational implications in the present COVID-19 crisis, in sustaining competence in clinical skills amongst medical students. The 1-week outcome measures only evaluate the primary levels of Kirkpatrick's model of learning.[16] A longer follow up would be required in assessing clinical competence in work place based practice over a period of time. This is a scope for further study.


  Conclusion Top


AV teaching modules for torchlight examination and DO can significantly improve ophthalmology knowledge and skill in undergraduate medical students. Our results have a direct practical application in the current COVID-19 pandemic, where physical demonstrations involving close proximity and groups of students have the potential risk of infection.

Acknowledgement

We would like to acknowledge Ms. Anugraha Mohan and Mr. Navaneethakkannan for yourvideoz.in for their valuable contribution in making the AV teaching module.

Financial support and sponsorship

Institutional Fluid Research Grant - Christian Medical College, Vellore.

Conflicts of interest

There are no conflicts of interest.



 
  References Top

1.
Wenting SZ, Samin MM, Sanjay S, Neelam K, Shibli K, Chang S, et al. A comparison of undergraduate clinical ophthalmology learning methods: Smart phone television display versus slit-lamp teaching telescope. Can J Ophthalmol 2017;52:385-91.  Back to cited text no. 1
    
2.
Succar T, Grigg J, Beaver HA, Lee AG. A systematic review of best practices in teaching ophthalmology to medical students. Surv Ophthalmol 2016;61:83-94.  Back to cited text no. 2
    
3.
Zhang HH, Hepschke JL, Shulruf B, Francis IC, Spencer SK, Coroneo M, et al. Sharpening the focus on ophthalmology teaching: Perceptions of medical students and junior medical officers. Clin Exp Ophthalmol 2018;46:984-93.  Back to cited text no. 3
    
4.
International Task Force on Opthalmic Education of Medical Students, International Council of Opthalmology. Principles and guidelines of a curriculum for ophthalmic education of medical students. Klin Monatsbl Augenheilkd 2006;223(Suppl 5):S1-19.  Back to cited text no. 4
    
5.
Bruce BB. Non-mydriatic ocular fundus photography in the emergency department: How it can benefit neurologists. Semin Neurol 2015;35:491-5.  Back to cited text no. 5
    
6.
Hogg HDJ, Pereira M, Purdy J, Frearson RJ, Lau GB. A non-randomised trial of video and written educational adjuncts in undergraduate ophthalmology. BMC Med Educ 2020;20:10.  Back to cited text no. 6
    
7.
Steedman M, Abouammoh M, Sharma S. Multimedia learning tools for teaching undergraduate ophthalmology: Results of a randomized clinical study. Can J Ophthalmol 2012;47:66-71.  Back to cited text no. 7
    
8.
Borgersen NJ, Henriksen MJV, Konge L, Sørensen TL, Thomsen ASS, Subhi Y. Direct ophthalmoscopy on YouTube: Analysis of instructional YouTube videos' content and approach to visualization. Clin Ophthalmol Auckl NZ 2016;10:1535-41.  Back to cited text no. 8
    
9.
Sandhu P, de Wolf M. The impact of COVID-19 on the undergraduate medical curriculum. Med Educ Online 2020;25:1764740.  Back to cited text no. 9
    
10.
Del Rio C, Malani PN. 2019 Novel coronavirus-important information for clinicians. JAMA 2020;323:1039-40.  Back to cited text no. 10
    
11.
Bell RA, Waggoner PM, Boyd WM, Akers RE, Yee CE. Clinical grading of relative afferent pupillary defects. Arch Ophthalmol Chic Ill 1960 1993;111:938-42.  Back to cited text no. 11
    
12.
Thomas R, Thomas S, Braganza A, Muliyil J. Evaluation of the role of syringing prior to cataract surgery. Indian J Ophthalmol 1997;45:211-4.  Back to cited text no. 12
[PUBMED]  [Full text]  
13.
Shikino K, Hirose Y, Ikusaka M. Oblique flashlight test: Lighting up acute angle-closure glaucoma. J Gen Intern Med 2016;31:1538.  Back to cited text no. 13
    
14.
Schneiderman H. The funduscopic examination [Internet]. In: Walker HK, Hall WD, Hurst JW, editors. Clinical Methods: The History, Physical, and Laboratory Examinations. Boston: Butterworths; 1990 [cited 2020 Jun 15]. Available from: http://www.ncbi.nlm.nih.gov/books/NBK221/.  Back to cited text no. 14
    
15.
Bedi KK, Okorie M. A video book of ophthalmic skills for medical students. Int J Med Educ 2019;10:34-5.  Back to cited text no. 15
    
16.
Bates R. A critical analysis of evaluation practice: The Kirkpatrick model and the principle of beneficence. Eval Program Plann 2004;27:341-7.  Back to cited text no. 16
    


    Figures

  [Figure 1], [Figure 2], [Figure 3]
 
 
    Tables

  [Table 1], [Table 2], [Table 3]


This article has been cited by
1 Strategies for Digital Clinical Teaching During the COVID Pandemic: A Scoping Review
Miranda Voss, Anne Geniets, Niall Winters
Medical Science Educator. 2023;
[Pubmed] | [DOI]
2 Scoping review of published research on medical education in India during the Covid-19 pandemic
DINESH KUMAR, JAGDISH VARMA, AMOL DONGRE, HIMANSHU PANDYA
The National Medical Journal of India. 2023; 35: 243
[Pubmed] | [DOI]
3 Impact of COVID-19 pandemic on ophthalmology medical student teaching: educational innovations, challenges, and future directions
Tony Succar, Hilary A. Beaver, Andrew G. Lee
Survey of Ophthalmology. 2021;
[Pubmed] | [DOI]



 

Top
 
 
  Search
 
    Similar in PUBMED
   Search Pubmed for
   Search in Google Scholar for
 Related articles
    Access Statistics
    Email Alert *
    Add to My List *
* Registration required (free)  

 
  In this article
Abstract
Methods
Results
Discussion
Conclusion
References
Article Figures
Article Tables

 Article Access Statistics
    Viewed2961    
    Printed158    
    Emailed0    
    PDF Downloaded252    
    Comments [Add]    
    Cited by others 3    

Recommend this journal