METHODS: Data collection included two strategies. First, previous systematic reviews were searched for studies that met the inclusion criteria of the current review. Second, a new search was done, covering the time since the previous reviews, i.e. January 2013 to May 2017. Five search concepts were combined in order to capture relevant literature: stigma, mental health, intervention, professional students in medicine and nursing, and LMICs. A qualitative analysis of all included full texts was done with the software MAXQDA. Full texts were analysed with regard to the content of interventions, didactic methods, mental disorders, cultural adaptation, type of outcome measure and primary outcomes. Furthermore, a methodological quality assessment was undertaken.
RESULTS: A total of nine studies from six countries (Brazil, China, Malaysia, Nigeria, Somaliland and Turkey) were included. All studies reported significant results in at least one outcome measure. However, from the available literature, it is difficult to draw conclusions on the most effective interventions. No meta-analysis could be calculated due to the large heterogeneity of intervention content, evaluation design and outcome measures. Studies with contact interventions (either face-to-face or video) demonstrated attitudinal change. There was a clear lack of studies focusing on discriminatory behaviours. Accordingly, training of specific communication and clinical skills was lacking in most studies, with the exception of one study that showed a positive effect of training interview skills on attitudes. Methods for cultural adaptation of interventions were rarely documented. The methodological quality of most studies was relatively low, with the exception of two studies.
CONCLUSIONS: There is an increase in studies on anti-stigma interventions among professional students in LMICs. Some of these studies used contact interventions and showed positive effects. A stronger focus on clinical and communication skills and behaviour-related outcomes is needed in future studies.
OBJECTIVE: To evaluate the degree to which using data-driven methods to simultaneously select an optimal Patient Health Questionnaire-9 (PHQ-9) cutoff score and estimate accuracy yields (1) optimal cutoff scores that differ from the population-level optimal cutoff score and (2) biased accuracy estimates.
DESIGN, SETTING, AND PARTICIPANTS: This study used cross-sectional data from an existing individual participant data meta-analysis (IPDMA) database on PHQ-9 screening accuracy to represent a hypothetical population. Studies in the IPDMA database compared participant PHQ-9 scores with a major depression classification. From the IPDMA population, 1000 studies of 100, 200, 500, and 1000 participants each were resampled.
MAIN OUTCOMES AND MEASURES: For the full IPDMA population and each simulated study, an optimal cutoff score was selected by maximizing the Youden index. Accuracy estimates for optimal cutoff scores in simulated studies were compared with accuracy in the full population.
RESULTS: The IPDMA database included 100 primary studies with 44 503 participants (4541 [10%] cases of major depression). The population-level optimal cutoff score was 8 or higher. Optimal cutoff scores in simulated studies ranged from 2 or higher to 21 or higher in samples of 100 participants and 5 or higher to 11 or higher in samples of 1000 participants. The percentage of simulated studies that identified the true optimal cutoff score of 8 or higher was 17% for samples of 100 participants and 33% for samples of 1000 participants. Compared with estimates for a cutoff score of 8 or higher in the population, sensitivity was overestimated by 6.4 (95% CI, 5.7-7.1) percentage points in samples of 100 participants, 4.9 (95% CI, 4.3-5.5) percentage points in samples of 200 participants, 2.2 (95% CI, 1.8-2.6) percentage points in samples of 500 participants, and 1.8 (95% CI, 1.5-2.1) percentage points in samples of 1000 participants. Specificity was within 1 percentage point across sample sizes.
CONCLUSIONS AND RELEVANCE: This study of cross-sectional data found that optimal cutoff scores and accuracy estimates differed substantially from population values when data-driven methods were used to simultaneously identify an optimal cutoff score and estimate accuracy. Users of diagnostic accuracy evidence should evaluate studies of accuracy with caution and ensure that cutoff score recommendations are based on adequately powered research or well-conducted meta-analyses.