METHODS: Using Singapore Malaysia Hospital-Based Breast Cancer Registry, clinical information was retrieved from 7064 stage I to III breast cancer patients who were diagnosed between 1990 and 2011 and underwent surgery. Predicted and observed probabilities of positive nodes and survival were compared for each subgroup. Calibration was assessed by plotting observed value against predicted value for each decile of the predicted value. Discrimination was evaluated by area under a receiver operating characteristic curve (AUC) with 95 % confidence interval (CI).
RESULTS: The median predicted probability of positive lymph nodes is 40.6 % which was lower than the observed 43.6 % (95 % CI, 42.5 %-44.8 %). The calibration plot showed underestimation for most of the groups. The AUC was 0.71 (95 % CI, 0.70-0.72). Cancermath predicted and observed overall survival probabilities were 87.3 % vs 83.4 % at 5 years after diagnosis and 75.3 % vs 70.4 % at 10 years after diagnosis. The difference was smaller for patients from Singapore, patients diagnosed more recently and patients with favorable tumor characteristics. Calibration plot also illustrated overprediction of survival for patients with poor prognosis. The AUC for 5-year and 10-year overall survival was 0.77 (95 % CI: 0.75-0.79) and 0.74 (95 % CI: 0.71-0.76).
CONCLUSIONS: The discrimination and calibration of CancerMath were modest. The results suggest that clinical application of CancerMath should be limited to patients with better prognostic profile.