METHOD: Two categories of participants, i.e., medical doctors (n = 11) and final year medical students (Group 1, n = 5; Group 2, n = 10) participated in four separate focus group discussions. Nielsen's 5 dimensions of usability (i.e. learnability, effectiveness, memorability, errors, and satisfaction) and Pentland's narrative network were adapted as the framework to study the usability and the implementation of the checklist in a real clinical setting respectively.
RESULTS: Both categories (medical doctors and medical students) of participants found that the TWED checklist was easy to learn and effective in promoting metacognition. For medical student participants, items "T" and "W" were believed to be the two most useful aspects of the checklist, whereas for the doctor participants, it was item "D". Regarding its implementation, item "T" was applied iteratively, items "W" and "E" were applied when the outcomes did not turn out as expected, and item "D" was applied infrequently. The one checkpoint where all four items were applied was after the initial history taking and physical examination had been performed to generate the initial clinical impression.
CONCLUSION: A metacognitive checklist aimed to check cognitive errors may be a useful tool that can be implemented in the real clinical setting.
METHODS: This systematic review was registered prospectively on Prospero (CRD42020188715). It was designed using the COSMIN guidelines and reported in line with the PRISMA checklist. Two reviewers independently searched Medline, Embase, SportDiscus, and CINAHL Plus databases from inception to the 24th July 2022 with an update of the search conducted until 14th of October 2023. The COSMIN risk of bias checklist was used to assess the risk of bias in each study. The updated criteria for good measurement properties were used to rate individual studies and then the overall pooled results. The level of evidence was rated by two reviewers independently using a modified GRADE approach.
RESULTS: Fifteen studies were included in this review, 13 reporting absolute JPE and 2 reporting constant JPE. The measurement properties assessed were reliability, measurement error, and validity. The measurement of JPE showed sufficient reliability and validity, however, the level of evidence was low/very low for both measurement properties, apart from convergent validity of the constant JPE, which was high.
CONCLUSION: The measure of cervical JPE showed sufficient reliability and validity but with low/very low levels of evidence. Further studies are required to investigate the reliability and validity of this test as well as the responsiveness of the measure.