[Frontiers in Bioscience E3, 1259-1264, June 1, 2011]

Optimal cut-off values for tumor markers in cerebrospinal fluid with ROC curve analysis

Qiang Shi1, Chuan Qiang Pu1, Xu Sheng Huang1, Cheng Lin Tian1, Xiu Tang Cao2

1Department of Neurology, General Hospital of PLA, Beijing 100853, China, 2 Department of medical statistics, General Hospital of PLA, Beijing 100853, China

TABLE OF CONTENTS

1. Abstract
2. Introduction
3. Materials and Methods
3.1. Clinical data
3.1.1. Introduction of 21 MC patients
3.1.2. Introduction of 25 cancer patients without leptomeningeal disease
3.1.3. Introduction of 45 meningitis patients
3.2. Sampling
3.3. Concentration determinations
3.4. Statistical analyses
4. Results
4.1. Data consistency check among three groups
4.2. Comparison of tumor markers in CSF and serum among three groups
4.2.1. Comparison of tumor markers in CSF among three groups
4.2.2. Comparison of tumor markers in serum among three groups
4.3. MC patients compared with group one through ROC curve
4.3.1. Area under the curve with ROC curve analysis
4.3.2. Optimal cut-off values for tumor markers in CSF
4.4. MC patients compared with group two through ROC curve
4.4.1. Area under the curve with ROC curve analysis
4.4.2. Optimal cut-off values for tumor markers in CSF
5. Discussion
6. References

1. ABSTRACT

To select optimal cut-off values of tumor markers in cerebrospinal fluid for the diagnosis of meningeal carcinomatosis, the concentrations of CEA, CA125, CA153, CA199, CA724, CYFRA21-1, AFP and NSE were determined by means of double-antibody sandwich enzyme-linked immunosorbent assay (ELISA) in 21 MC patients, 25 cancer patients without leptomeningeal disease (group one) and 45 meningitis patients (group two) using the Roche E170 modular immunoassay analyzer. Optimal cut-off values were selected based on a receiver-operating characteristic curve. The results showed that CA125 and CEA in CSF were optimal diagnostic indices distinguishing between MC patients and cancer patients without leptomeningeal disease. Cut-off values for CA125 and CEA were 1.715 microlilters and 0.274 microgram/l, respectively. In addition, CEA in CSF was the optimal diagnostic index distinguishing MC patients from meningitis patients. The cut-off value for CEA was 4.522 microgram/l.

2. INTRODUCTION

Tumor markers in cerebrospinal fluid may be used for the early diagnosis of meningeal carcinomatosis (1-2). However, normal reference values for these markers have not yet been established. In clinical practice, concentrations of tumor markers in serum are often used as references. To test the optimal cut-off values for tumor markers in CSF, statistical analyses were conducted in 21 MC patients, 25 cancer patients without leptomeningeal disease and 45 meningitis patients. For all patients levels of tumor markers in serum and CSF were measured in our hospital between January 2004 and February 2010.

3. MATERIALS AND METHODS

3.1. Clinical data

3.1.1. Introduction of 21 MC patients

Twenty-one MC patients were clearly diagnosed based on CSF cytology or typical brain magnetic resonance images (MRIs). Primarily tumors include pulmonary carcinoma (16/21, 76.0%), gastric cancer (2/21, 9.6%), thyroid carcinoma (1/21, 4.8%), lymphadenoma (1/21, 4.8%) and breast carcinoma (1/21, 4.8%). All samples including serum and CSF were analyzed during the early course of the disease (one to six days). No patients were treated with intrathecal chemotherapy.

3.1.2. Introduction of 25 cancer patients without leptomeningeal disease

Comparison group one was comprised of 25 cancer patients without leptomeningeal disease which included pulmonary carcinoma (14/25, 56.0%), digestive system cancer (6/25, 24.0%), hematological system cancer (2/25, 8.0%), endocrine system cancer (2/25, 8.0%) and nasopharyngeal carcinoma (1/25, 4.0%). All patients were clearly diagnosed based on pathology.

3.1.3. Introduction of 45 meningitis patients

Comparison group two was comprised of 45 meningitis patients. There were 12 cases of viral meningitis, 20 cases of tuberculous meningitis, 3 cases of purulent meningitis, 1 case of cryptococcal meningitis and 9 cases of indefinite pathogenic bacteria meningitis. All patients were cured through clinical treatment.

3.2. Sampling

Signed consent informs were obtained from all patients. Through lumbar puncture, 3 ml of fresh CSF and 4 ml of serum were collected for determination of tumor marker levels.

3.3. Concentration determinations

Concentrations of CEA, CA125, CA153, CA199, CA724, CYFRA21-1, AFP and NSE were determined by means of double-antibody sandwich enzyme-linked immunosorbent assay (ELISA) using the Roche E170 modular immunoassay analyzer.

3.4. Statistical analyses

Normally distributed data were expressed by<s. Data with a skewed distribution were expressed by median and quartile. The Kruskal-Wallis test was used to compare data consistency and tumor markers in serum and CSF across the three groups. Optimal cut-off values for tumor markers in CSF were determined based on Receiver-operating characteristic (ROC) curve analysis. For all tests, a significance level of <0.05 was used. SPSS for Windows 13.0 was used for all statistical analyses.

4. RESULTS

4.1. Data consistency check among three groups

Results shown in Table 1: Age was not significantly different between MC patients and the other two comparison groups (average rank difference =9.60, 5.09, p>0.05).

4.2. Comparison of tumor markers in CSF and serum among three groups

4.2.1. Comparison of tumor markers in CSF among three groups

Results shown in Table 2: CEA, CA125, CA153, CA724, CYFRA21-1 and NSE levels were significantly different between MC patients and comparison group one (p<0.05). The significant differences in the levels of all markers except CA724 were measured between MC patients and comparison group two (p<0.05). CA125, CA199, CA724 and CYFRA21-1 levels were significantly different between comparison one and comparison group two (p<0.05).

4.2.2. Comparison of tumor markers in serum among three groups

Results shown in Table 3: CEA, CA125, CA153 and CA199 levels were significantly different between MC patients and comparison group one (p<0.05). CEA, CA125, CA153, CA199 and AFP levels were significantly different between MC patients and comparison group two (p<0.05). Only CYFRA21-1 was present at significantly different levels between comparison group one and comparison group two (p<0.05).

4.3. MC patients compared with group one through ROC curve

4.3.1. Area under the curve with ROC curve analysis

Results shown in Table 4 and Figure 1: CEA, CA125, CA153, CA724, CYFRA21-1 and NSE had diagnostic value between these two groups (p<0.05), while AFP and CA199 were of no diagnostic value between these two groups (p>0.05).

4.3.2. Optimal cut-off values for tumor markers in CSF

Results shown in Table 5: Clinical value was determined for CA125, CEA, CA153, CYFRA21-1, NSE and CA724 according to Youden's index. Levels of CA125 and CEA were optimal diagnostic indices for which Youden's index was greater than 0.70.

4.4. MC patients compared with group two through ROC curve

4.4.1. Area under the curve with ROC curve analysis

Results shown in Table 6 and Figure 2: CEA, CA125, CA153, CA199, CYFRA21-1 and NSE had diagnostic value between these two groups (p<0.05), while AFP and CA724 were of no diagnostic value between these two groups (p>0.05).

4.4.2. Optimal cut-off values for tumor markers in CSF

Results shown in Table 7: Clinical value was determined for CEA, CYFRA21-1, CA125, CA153, CA199 and NSE according to Youden's index. CEA was the optimal diagnostic index, with a valve of greater than 0.70 for Youden's index.

5. DISCUSSION

ROC curve analysis is said to have originally developed during World War II to analyze classification accuracy in differentiating signal from noise in radar detection. The principles of ROC analysis were later implemented for improving medical decision making (3). Evidently, this methodology has been adapted to several medical areas that are dependent on the accuracy of screening and diagnostic tests, such as laboratory testing (4-5), epidemiology (6-7), radiology (8), several clinical disciplines (9-12), and bioinformatics (13-14).

Tumor markers consist of a cluster of substances that are synthesized and released by tumor cells during the development and reproduction of tumors or released due to host reactions to carcinomas. The presence of certain tumor marker may indicate the nature of tumor. From a clinical perspective, tumor markers may have a variety of functions that correspond to different stages in disease development. Analysis of tumor markers can assist in the care of patients who are asymptomatic, those who are suspected to have the disease and those with overt disease for whom therapy may or may not have been initiated. Analysis of tumor markers can also be used for determining treatment response or surveillance after therapy. The accuracy of analyzing tumor marker is the presupposition for its appropriate use for these purposes. Analyzing tumor markers must give clinicians the ability to correctly classify one condition and/or outcome from another (15). Because all the samples were obtained during early onset of MC (one to six days) and because patients were not treated with intrathecal chemotherapy, so statistical results could be used for early diagnosis.

Based on their chemical characteristics, tumor markers may be classified into embryonic antigen tumor markers, carbohydrate antigen tumor markers, enzyme tumor markers, hormone tumor markers, protein tumor markers and gene tumor markers. CEA and AFP are embryonic antigen tumor markers CA125, CA153, CA199, CA724 and CYFRA21-1 are carbohydrate antigen tumor markers, while NSE is an enzyme marker (16). Different biomarkers are sensitive to different diseases. AFP is sensitive to primary hepatic carcinoma while CA724 is sensitive to gastric cancer. Primarily tumors in MC patients are different. Because the origin of this group is almost certain, AFP levels in CSF or serum are of no diagnostic value for distinguishing between MC patients and cancer patients without leptomeningeal disease.

There are two possible mechanisms to explain the elevation of tumor markers in CSF. One possibility is that tumor markers are locally produced by cancer cells. Alternatively, Tumor markers could be passively transferred to serum, reflecting elevated serum tumor markers levels and/or a blood-CSF-barrier disturbance. This may cause differences between CSF and serum levels when MC comparing MC patients to cancer patients without leptomeningeal disease.

6. REFERENCES

1. Yasumoto K, Takahashi Y, Mai M, etal. Meningeal carcinomatosis preceded by a rapid increase in serum CA19-9 levels in a patient with breast cancer. Int J Clin Oncol. 2005; 10:276-80. (PubMed: 16136375)
doi:10.1007/s10147-005-0483-z

2. Miura M, Iijima N, Hayashida K, et al. Case of leptomeningeal carcinomatosis effectively treated with intrathecal chemotherapy using ventriculoperitoneal shunt. Rinsho Shinkeigaku. 2006; 46:404-9. (PubMed: 16986702)

3. Lusted LB. Decision-making studies in patient management. N Engl J Med 1971; 284:416-24. (PubMed: 4395661)
doi:10.1056/NEJM197102252840805

4. Obuchowski NA, Lieber ML, Wians FH Jr. ROC curves in clinical chemistry: uses, misuses, and possible solutions. Clin Chem 2004; 50:1118-25. (PubMed: 15142978)
doi:10.1373/clinchem.2004.031823

5. Zweig MH, Campbell G. Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. Clin Chem 1993; 39:561-77. (PubMed: 8472349)

6. Pepe MS, Janes HE. Gauging the performance of SNPs, biomarkers, and clinical factors for predicting risk of breast cancer. J Natl Cancer Inst 2008; 100:978-9. (PubMed: 18612128)
doi:10.1093/jnci/djn215

7. Walter SD, Sinuff T. Studies reporting ROC curves of diagnostic and prediction data can be incorporated into meta-analyses using corresponding odds ratios. J Clin Epidemiol 2007; 60:530-4. (PubMed: 17419965)
doi:10.1016/j.jclinepi.2006.09.002

8. Obuchowski NA. ROC analysis. AJR Am J Roentgenol 2005; 184:364-72. (PubMed: 15671347)

9. Zou KH, O'Malley AJ, Mauri L. Receiver-operating characteristic analysis for evaluating diagnostic tests and predictive models. Circulation 2007; 115:654-7. (PubMed: 17283280)
doi:10.1161/CIRCULATIONAHA.105.594929

10 Musial J, Swadzba J, Motyl A, et al. Clinical significance of antiphospholipid protein antibodies. Receiver operating characteristics plot analysis. J Rheumatol 2003; 30:723-30. (PubMed: 12672190)

11 Cheung R, Altschuler MD, D'Amico AV,et al. Using the receiver operating characteristic curve to select pretreatment and pathologic predictors for early and late postprostatectomy PSA failure. Urology 2001; 58:400-5. (PubMed: 11549488)

12 Körner H, Söreide JA, Söndenaa K. Diagnostic accuracy of inflammatory markers in patients operated on for suspected acute appendicitis: a receiver operating characteristic curve analysis. Eur J Surg 1999; 165:679-85. (PubMed: 10452263)

13 Li J, Fine JP. ROC analysis with multiple classes and multiple tests: methodology and its application in microarray studies. Biostatistics 2008; 9:566-76. (PubMed: 18304996)
doi:10.1093/biostatistics/kxm050

14 Zheng Y,Cai T, Feng Z. Application of the time-dependent ROC curves for prognostic accuracy with multiple biomarkers. Biometrics 2006; 62:279-87. (PubMed: 16542256)
doi:10.1111/j.1541-0420.2005.00441.x

15 Søreide K. Receiver-operating characteristic curve analysis in diagnostic, prognostic and predictive biomarker research.J Clin Pathol. 2009; 62:1-5. (PubMed: 18818262)
doi:10.1136/jcp.2008.061010

16 Shi Q, Pu CQ, Wu WP,etal. The determination of medical reference values for tumor markers in cerebrospinal fluid Zhonghua Yi Xue Za Zhi. 2009; 89:355-6. (PubMed: 19563718)

Abbreviations: ROC curve: receiver-operating characteristic curve, MC: meningeal carcinomatosis, CSF: cerebrospinal fluid

Key Words: Tumor markers, Receiver-operating characteristic curve, Cerebrospinal fluid

Send correspondence to: Chuan Qiang Pu, Department of Neurology, General Hospital of PLA, Beijing 100853, China, Tel: 010-66939963, Fax: 010-66939963, E-mail:pucq30128@yahoo.com.cn