|Ahead of print
Segmentation error and macular thickness measurements obtained with spectral-domain optical coherence tomography devices in neovascular age-related macular degeneration
Kim Moosang1, Lee Seung Jun1, Han Jisang2, Yu Seung-Young2, Kwak Hyung-Woo2
1 Department of Ophthalmology, Kangwon National University Hospital, Chuncheon, Korea
2 Department of Ophthalmology, Kyung Hee University Hospital, Seoul, Korea
#1 Hoegi-dong, Dongdaemun-gu, Seoul 130-702
Source of Support: None, Conflict of Interest: None
| Abstract|| |
Purpose: To evaluate frequency and severity of segmentation errors of two spectral-domain optical coherence tomography (SD-OCT) devices and error effect on central macular thickness (CMT) measurements. Materials and Methods: Twenty-seven eyes of 25 patients with neovascular age-related macular degeneration, examined using the Cirrus HD-OCT and Spectralis HRA + OCT, were retrospectively reviewed. Macular cube 512 × 128 and 5-line raster scans were performed with the Cirrus and 512 × 25 volume scans with the Spectralis. Frequency and severity of segmentation errors were compared between scans. Results: Segmentation error frequency was 47.4% (baseline), 40.7% (1 month), 40.7% (2 months), and 48.1% (6 months) for the Cirrus, and 59.3%, 62.2%, 57.8%, and 63.7%, respectively, for the Spectralis, differing significantly between devices at all examinations (P < 0.05), except at baseline. Average error score was 1.21 ± 1.65 (baseline), 0.79 ± 1.18 (1 month), 0.74 ± 1.12 (2 months), and 0.96 ± 1.11 (6 months) for the Cirrus, and 1.73 ± 1.50, 1.54 ± 1.35, 1.38 ± 1.40, and 1.49 ± 1.30, respectively, for the Spectralis, differing significantly at 1 month and 2 months (P < 0.02). Automated and manual CMT measurements by the Spectralis were larger than those by the Cirrus. Conclusions: The Cirrus HD-OCT had a lower frequency and severity of segmentation error than the Spectralis HRA + OCT. SD-OCT error should be considered when evaluating retinal thickness.
Keywords: Central macular thickness, neovascular age-related macular degeneration, segmentation error, spectral-domain optical coherence tomography
|How to cite this URL:|
Kim M, Lee SJ, Han J, Yu S, Kwak H. Segmentation error and macular thickness measurements obtained with spectral-domain optical coherence tomography devices in neovascular age-related macular degeneration. Indian J Ophthalmol [Epub ahead of print] [cited 2013 May 23]. Available from: http://www.ijo.in/preprintarticle.asp?id=97075
Macular thickness is an important index for determining macular disease severity and progression. Due to the widespread use of intravitreal anti-vascular endothelial growth factor (VEGF) injections to treat neovascular age-related macular degeneration (AMD), accurate macular thickness measurements are required for follow-up and large-scale clinical studies. Fung et al. defined a ≥100 μm increase in retinal thickness as a criterion for retreatment of neovascular AMD in an OCT-guided treatment regimen and stressed the importance of central macular thickness (CMT) measurement in follow-up examinations.
The retinal thickness analyzer, confocal scanning laser ophthalmoscope, and optical coherence tomography (OCT) are used to obtain images of the macula and measure its thickness. Of these, OCT is an important noninvasive diagnostic tool for evaluating retinal diseases and the Stratus OCT (Carl Zeiss Meditec, Dublin, California) is one of the most commonly used OCTs. As a time-domain OCT (TD-OCT), the Stratus OCT can perform 400 A-scans per second and has an axial resolution of approximately 10 μm. Using an image processing technique, the Stratus OCT can automatically detect the inner and outer retinal boundaries and measure retinal thickness in B-scans.  Analyzing images from the Stratus OCT, Keane et al. reported 92% of eyes had retinal thickness measurement errors, 13% of which were severe. The recently introduced Spectral-domain OCT (SD-OCT) has a high axial resolution (5?8 μm) and a speed of over 20,000 A-scans per second, and shows the retinal image in more detail at a faster rate than the TD-OCT. ,,, In addition, while the TD-OCT defines the boundary between the inner and outer segments of the photoreceptor layer as the outer retinal boundary, the SD-OCT has different boundary ranges depending on the machine type. With its high resolution, fast image acquisition, and elaborate image processing software, the SD-OCT was expected to have much fewer errors than the TD-OCT. Recent reports, however, indicate that the SD-OCT also has frequent errors. ,
Previous studies reported only the frequency with which retinal thickness was measured inaccurately due to OCT error. There are no data available regarding the extent to which such an error affects the retinal thickness measurement outcome. Because segmentation errors are thought to have the greatest impact on CMT measurements in patients with neovascular AMD, we examined the frequency and severity of these errors in two SD-OCT devices, and evaluated the extent to which OCT segmentation error affects CMT measurement outcome.
| Materials and Methods|| |
The Institutional Review Board approved the data collection and analysis. Medical records of patients who received intravitreal anti-VEGF (bevacizumab or ranibizumab) injection therapy between September 2008 and January 2010, after diagnosis of choroidal neovascularization (CNV) secondary to neovascular AMD, were retrospectively analyzed. Only patients who received three consecutive intravitreal anti-VEGF injections and were followed up for 6 months or more were included in the study, and the lesion type or size of CNV was not considered. Patients with an ophthalmic disease that could lead to visual loss other than neovascular AMD or those who received cataract surgery and vitrectomy were excluded. The best-corrected visual acuity and OCT records at baseline, 1 month, 2 months and 6 months were analyzed.
OCT images were obtained by one experienced examiner and were read by two retinal ophthalmologists (MSK, SYY) in a blinded manner. Patients were examined 30 minutes after administration of three drops of intraocular mydriatics (Mydrin-P?, Santen, Osaka, Japan) applied with a 5-minute interval. The two OCT devices used in this study were as follows:
The Cirrus HD-OCT (Carl Zeiss Meditec, Dublin, CA) has an axial resolution of approximately 5 m and a speed of 27,000 A-scans per second. Macular cube 512 × 128 and 5-line raster scans were performed. The macular cube 512 × 128 scan uses a raster scan mode that scans a 6 × 6-mm macular area into 512 × 128 (length by width) points. The 5-line raster scan comprises five 6-mm long lines at 250-μm intervals In both scans, only those cases with signal intensity greater than or equal to 7 were included in the study results.
The Spectralis HRA + OCT (Heidelberg Engineering GmbH, Heidelberg, Germany) is a high-resolution SD-OCT that can simultaneously perform scanning laser ophthalmoscopy. A 6 × 6-mm macular area was examined in the fast scanning mode comprising 25 B-scans of 512 pixels. Measurements were performed with the automatic real-time function of eye tracking and volume scans including concentric circles of 1 mm, 3 mm, and 6 mm. Only those cases whose concentric circles were all inside the scan area were included in this study and five B-scans within 1 mm of the central fovea were analyzed separately from 25 B-scans.
This study analyzed inner and outer retinal boundary misidentifications, which are thought to have a greater influence on macular thickness measurements than any other type of error. The scope of analysis was the central fovea of 1 mm in size, not the entire macular area. The Cirrus HD-OCT can measure a 1 mm of fovea because its 5-line raster scan comprises five 6-mm long lines at 250 μm intervals. In the Spectralis HRA + OCT, the 5 B-scans including the 1 mm of fovea were analyzed on the 512 × 25 scan. Frequencies of segmentation errors were assessed by reading each of the five images taken in 5-line raster scan of the Cirrus HD-OCT and each of the five images of the fovea taken with Spectralis HRA + OCT and by dividing the number of images with a segmentation error by the total number of images taken.
To determine segmentation error severity, we modified the error scoring method described by Sadda et al. to obtain the average error score (AES).  Sadda et al.'s  method gives a weight of 1 point to an error found in the center of the macula irrespective of the error type; however, we did not apply such a weight because we only analyzed a 1-mm diameter circle at the fovea (inside a 1-mm diameter circle from the center of the macula). Two retinal specialists analyzed images, gave scores, and calculated the mean values. Zero to five points were allocated to each image; one point if there was a segmentation error, another point for a segmentation error greater than or equal to 1/3 and less than 2/3 of the entire range in horizontal or vertical direction, and two additional points for segmentation errors greater than or equal to 2/3 of the range. Each of the five images obtained in the 5-line raster scan of Cirrus HD-OCT and each of the five images of the fovea taken with the Spectralis HRA + OCT were analyzed and scored and the mean value was calculated as the final error score [Figure 1].
|Figure 1: Example of segmentation error scoring. OCT image shows outer retinal boundary misidentification of the central fovea. We only analyzed a 1 mm distance at the fovea (between arrows). Dotted line is a normal segmentation line. One point is given for the presence of an error. Two points is added because deviation of the horizontal line is from one third to two thirds of the macula. However, there is no additional point because deviation of the vertical line is less than one third of the macula. Therefore, the sum of error score in this scan is 3 points|
Click here to view
Retinal thickness in a 1-mm diameter circle at the fovea was used for automated CMT measurements in a macular cube of 512 × 128 scan for the Cirrus HD-OCT. Manual CMT was determined by calculating the mean value of three thicknesses measured with calipers at three points at the central 1 mm of the 6-mm long 5-line raster scan (the central foveal point and two other points 500 μm away from the central foveal point in either direction). As in the Cirrus HD-OCT, the retinal thickness in a 1-mm diameter circle at the fovea was also determined as the automated CMT in Spectralis HRA + OCT and the manual CMT was determined based on the mean value of three manual thickness measurements in the segmentation line edit mode on three points at the central 1 mm among the five B-scans at the fovea (the central foveal point and two other points 500 μm away from the central foveal point in either direction).
Data were summed up using Microsoft Excel. The Mann-Whitney U test was used to examine the frequency and AES of segmentation errors of the two OCT and to compare automated and manual CMT measurements. Pearson correlation test was used to determine whether a CMT reduction in either device correlated with an improvement in visual acuity. Statistical analysis was performed with SPSS 12.0 for Windows (SPSS INC). P values <0.05 were considered statistically significant.
| Results|| |
This study included 27 eyes of 25 patients (19 men, 6 women; mean age = 68.74 ± 8.52 years). Of the 27 eyes, 7 were treated with bevacizumab (Avastin?, Genentech Inc., San Francisco, CA), 10 with ranibizumab (Lucentis?, Genentech Inc), and 10 switched from bevacizumab to ranibizumab.
During follow-up, the segmentation error frequency was 47.4% (baseline), 40.7% (1 month), 40.7% (2 months), and 48.1% (6 months) in the Cirrus HD-OCT, and 59.3%, 62.2%, 57.8%, and 63.7%, respectively, in the Spectralis HRA + OCT [Table 1], differing significantly different between the two devices at all examinations (P < 0.05), except at baseline. AES was 1.21 ± 1.65 (baseline), 0.79 ± 1.18 (1 month), 0.74 ± 1.12 (2 months), and 0.96 ± 1.11 (6 months) for the Cirrus HD-OCT, and 1.73 ± 1.50, 1.54 ± 1.35, 1.38 ± 1.40, and 1.49 ± 1.30, respectively, for the Spectralis HRA + OCT [Figure 2], differing significantly between the two devices at 1 month (P = 0.011) and 2 months (P = 0.018).
|Figure 2: Average error score (AES). AES tended to decrease with an increase in the number of injections. The AESs of the two systems differed significantly at 1 month and 2 months (∗P < 0.05). P values obtained with the Mann-Whitney U test|
Click here to view
Automated and manual CMT measurements of the Cirrus HD-OCT and Spectralis HRA + OCT are compared in [Figure 3]. During the follow-up, automated CMT values measured with the Spectralis HRA + OCT averaged 79.13 ± 19.2 μm larger than those measured with the Cirrus HD-OCT. Manual CMT values measured with Spectralis HRA + OCT averaged 128.7 ± 5.8 μm larger than those measured with the Cirrus HD-OCT. With the Cirrus HD-OCT, the automated CMT measurement was larger than the manual CMT measurement by a mean of 12.5%, whereas with the Spectralis HRA + OCT, the automated CMT measurement was smaller than that of the manual CMT by a mean of 6.8%.
|Figure 3: Central macular thickness (CMT). In both devices, CMT decreased with an increase in the number of injections. With the Cirrus HD-OCT, there was a statistically significant difference between automated CMT and manual CMT at 1 month and 2 months (∗P < 0.05). Cirrus A: automated CMT of Cirrus HD-OCT, Cirrus M: manual CMT of Cirrus HD-OCT, Spectralis A: automated CMT of Spectralis HRA + OCT, Spectralis M: manual CMT of Spectralis HRA + OCT, P values obtained using Mann-Whitney U test|
Click here to view
[Figure 4] shows the correlations between the decrease in CMT and improvement in visual acuity. Manual CMT measurements were used to exclude segmentation errors. With the Cirrus HD-OCT, a decrease in the manual CMT did not correlate significantly with visual acuity improvement (P = 0.090, correlation coefficient 0.492), but manual CMT measured with the Spectralis HRA + OCT correlated significantly with visual acuity (P = 0.022, Correlation coefficient 0.438).
|Figure 4: Correlation between manual CMT and BCVA in Cirrus HD-OCT and Spectralis HRA + OCT. In the Cirrus HD-OCT, the decrease in the manual CMT did not correlate significantly with the improved visual acuity (P = 0.090, correlation coefficient 0.492); however, the manual CMT measured with the Spectralis HRA + OCT had a significant correlation (∗P = 0.022, correlation coefficient 0.438), CMT = central macular thickness; BCVA = best-corrected visual acuity, P values obtained using Pearson correlation|
Click here to view
| Discussion|| |
Previous studies demonstrated that the frequency of OCT errors differs depending on the OCT type, analysis method, and retinal disease studied. Ray et al. measured the retinal thickness map using the Stratus OCT, a TD-OCT, analyzed 6 radial scan images, and reported an error frequency of approximately 42%. Sadda et al. also used the Stratus OCT, analyzed errors found in all images taken by 6 radial lines or a fast macular thickness protocol, and found one or more errors in approximately 92% of all images, irrespective of a retinal thickness map. Ho et al. compared the errors of recently introduced SD-OCTs (Cirrus HD-OCT, RTVue-100, and Topcon 3D-OCT 1000) and the TD-OCT (Stratus OCT) and reported an error frequency of 73.8% in the Stratus OCT, 68.5% in the Cirrus HD-OCT, 83.3?88.9% in the RTVue-100, and 73.6?90.6% in the Topcon 3D-OCT 1000. Compared to the TD-OCT, SD-OCT has a higher resolution, greater speed, and more elaborate software using the raster scanning method, but the error frequency remains high.
Previous studies examined the frequency with which the retinal thickness was inaccurately measured, but failed to evaluate the extent to which OCT errors affected retinal thickness measurements. Using SD-OCT, we examined the frequency and severity of segmentation errors, which are considered to have the largest impact on CMT measurements and evaluated the extent of the effect on CMT measurements.
We used a modified method of the approach used by Sadda et al. to score the degree of OCT segmentation error. In Sadda et al. and the present study, AES of the Cirrus HD-OCT and Spectralis HRA + OCT was less than 50% of the full score of five points, indicating that although the error frequency was high, the severity of error was unremarkable. When retinal lesions improved with intravitreal anti-VEGF therapy, the AES severity also decreased [Figure 2] and [Figure 5]. Though also SD-OCTs, the Cirrus HD-OCT and Spectralis HRA + OCT produced different segmentation error and AES frequencies because the two devices use different approaches to determine the boundaries based on which retinal thickness is measured. The segmentation algorithm of each machine determined the boundaries. When measuring CMT, the Cirrus HD-OCT measured from the internal limiting membrane to the retinal pigment epithelium (RPE), , while the Spectralis HRA + OCT measured from the internal limiting membrane to Bruch's membrane by distinguishing the RPE from Bruch's membrane. , The frequency and severity of segmentation errors were higher in the Spectralis HRA + OCT than in the Cirrus HD-OCT, mainly because the RPE remains more or less intact compared to Bruch's membrane, which is invaded and destroyed by CNV.
|Figure 5: Changes in the segmentation error following intravitreal anti- VEGF injections in the same patient. In both devices, segmentation error decreased as the macular lesion improved. (a-d), Cirrus HD-OCT. (a), Baseline. (b), 1 month. (c), 2 months. (d), 6 months. (e-h), Spectralis HRA + OCT. (e), Baseline. (f), 1 month. (g), 2 months. (h), 6 months|
Click here to view
The difference in the retinal thicknesses measured by the two OCT machines is derived from the difference in the RPE layer height. The RPE layer height is approximately 9 μm histologically  and the fovea in normal eyes is approximately 20 μm thicker in the Spectralis HRA + OCT , than in the other OCT machines. In patients with neovascular AMD in this study, automated CMT measurements were thicker by a mean of ?80 μm in the Spectralis HRA + OCT than in the Cirrus HD-OCT, possibly due to the fact that the Spectralis HRA + OCT includes the CNV or sub-RPE fluid accumulation when measuring CMT thickness. Because CNV affects the thickness or location of the RPE with a high reflectivity on OCT, the machine cannot accurately detect such changes, which results in frequent outer retinal boundary misidentification. Thus, the Cirrus-HD-OCT tended to overestimate the automated CMT relative to the manual CMT. In the Spectralis HRA + OCT, however, the boundary is determined along the RPE instead of the usually used Bruch's membrane in the presence of large pigment epithelial detachment around the fovea [Figure 6]. This seemed to have resulted in an underestimation of the automated CMT by approximately 6.8% compared to the manual CMT.
|Figure 6: Examples of poorly measured macular thickness. (a). Normal segmentation line (b). Underestimation of macular thickness due to outer retina boundary misidentification. There were some cases in which the boundary was indented along the retinal pigment epithelium when there was a large pigment epithelial detachment, not at the usual Bruch's membrane (dotted line)|
Click here to view
The correlation with the visual acuity improvement was evaluated with manual CMT measurements to exclude the effect of segmentation error. A decline in manual CMT measured with the Cirrus HD-OCT did not significantly correlate with improved visual acuity; however, manual CMT measured with the Spectralis HRA + OCT showed a significant correlation. The trends of the CMT and visual acuity changes were similar in both machines, however, during the overall treatment process.
This study has limitations in that it was a retrospective study, a small number of eyes was investigated, and a subjective scoring system was used to estimate the severity of errors as described by Sadda et al. Thus, we cannot claim that the error score was linearly proportional to the severity of error.
In conclusion, the findings of the present study confirmed that the SD-OCT error was not infrequent in neovascular AMD patients. The frequency of segmentation error and AES was less in the Cirrus HD-OCT than in the Spectralis HRA + OCT. The difference between the automated CMT and manual CMT, however, was smaller in the Spectralis HRA + OCT. When diagnosing diseases and performing follow-up after treatment in a clinical setting, retinal thickness should be considered while considering the errors present in SD-OCT. These errors in SD-OCT can be overcome by upgrading the analysis software built into the system or manually correcting the errors. Further studies are required to determine a practical method to accurately measure retinal thickness by correcting the SD-OCT errors.
| References|| |
|1.||Fung AE, Lalwani GA, Rosenfeld PJ, Dubovy SR, Michels S, Feuer WJ, et al. An optical coherence tomography-guided, variable dosing regimen with intravitreal ranibizumab (Lucentis) for neovascular age-related macular degeneration. Am J Ophthalmol 2007;143:566-83. |
|2.||Schuman JS, Puliafito CA, Fujimoto JG. Optical coherence tomography of ocular disease. 2nd ed. Thorofare: Slack; 2004. |
|3.||Keane PA, Liakopoulos S, Jivrajka RV, Chang KT, Alasil T, Walsh AC, et al. Evaluation of optical coherence tomography retinal thickness parameters for use in clinical trials for neovascular age-related macular degeneration. Invest Ophthalmol Vis Sci 2009;50:3378-85. |
|4.||Wojtkowski M, Bajraszewski T, Gorczyñska I, Targowski P, Kowalczyk A, Wasilewski W, et al. Ophthalmic imaging by spectral optical coherence tomography. Am J Ophthalmol 2004;138:412-9. |
|5.||Wojtkowski M, Srinivasan V, Fujimoto JG, Ko T, Schuman JS, Kowalczyk A, et al. Three dimensional retinal imaging with high-speed ultrahigh-resolution optical coherence tomography. Ophthalmology 2005;112:1734-46. |
|6.||Schmidt-Erfurth U, Leitgeb RA, Michels S, Povazay B, Sacu S, Hermann B, et al. Three dimensional ultrahigh-resolution optical coherence tomography of macular diseases. Invest Ophthalmol Vis Sci 2005;46:3393-402. |
|7.||Alam S, Zawadzki RJ, Choi S, Gerth C, Park SS, Morse L, et al. Clinical application of rapid serial Fourier-domain optical coherence tomography for macular imaging. Ophthalmology 2006;113:1425-31. |
|8.||Ho J, Sull AC, Vuong LN, Chen Y, Liu J, Fujimoto JG, et al. Assessment of artifacts and reproducibility across spectral- and time-domain optical coherence tomography devices. Ophthalmology 2009;116:1960-70. |
|9.||Keane PA, Mand PS, Liakopoulos S, Walsh AC, Sadda SR. Accuracy of retinal thickness measurements obtained with Cirrus optical coherence tomography. Br J Ophthalmol 2009;93:1461-7. |
|10.||Sadda SR, Wu Z, Walsh AC, Richine L, Dougall J, Cortez R, et al. Errors in retinal thickness measurements obtained by optical coherence tomography. Ophthalmology 2006;113:285-93. |
|11.||Ray R, Stinnett SS, Jaffe GJ. Evaluation of image artifact produced by optical coherence tomography of retinal pathology. Am J Ophthalmol 2005;139:18-29. |
|12.||Pons ME, Garcia-Valenzuela E. Redefining the limit of the outer retina in optical coherence tomography scans. Ophthalmology 2005;112:1079-85. |
|13.||Srinivasan VJ, Monson BK, Wojtkowski M, Bilonick RA, Gorczynska I, Chen R, et al. Characterisation of outer retinal morphology with high-speed, ultrahigh-resolution optical coherence tomography. Invest Ophthalmol Vis Sci 2008;49:1571-9. |
|14.||Han IC, Jaffe GJ. Comparison of spectral- and time-domain optical coherence tomography for retinal thickness measurements in healthy and diseased eyes. Am J Ophthalmol 2009;147:847-58. |
|15.||Giani A, Cigada M, Esmaili DD, Salvetti P, Luccarelli S, Marziani E, et al. Artifacts in automatic retinal segmentation using different optical coherence tomography instruments. Retina 2010;30:607-16. |
|16.||Spraul CW, Lang GE, Grossniklaus HE, Lang GK. Histologic and morphometric analysis of the choroid, Bruch's membrane, and retinal pigment epithelium in postmortem eyes with age-related macular degeneration and histologic examination of surgically excised choroidal neovascular membranes. Surv Ophthalmol 1999;44:S10-32. |
|17.||Wolf-Schnurrbusch UE, Ceklic L, Brinkmann CK, Iliev ME, Frey M, Rothenbuehler SP, et al. Macular thickness measurements in healthy eyes using six different optical coherence tomography instruments. Invest Ophthalmol Vis Sci 2009;50:3432-7. |
[Figure 1], [Figure 2], [Figure 3], [Figure 4], [Figure 5], [Figure 6]