METHODS: A bibliometric review was conducted on literature from over 23 years from January 2000 to May 2023. Articles focusing on any type of OSCE research in pharmacy education in both undergraduate and postgraduate sectors were included. Articles were excluded if they were not original articles or not published in English. A summative content analysis was also conducted to identify key topics.
RESULTS: A total of 192 articles were included in the analysis. There were 242 institutions that contributed to the OSCE literature in pharmacy education, with the leading country being Canada. Most OSCE research came from developed countries and were descriptive studies based on single institution data. The top themes emerging from content analysis were student perceptions on OSCE station styles (n = 98), staff perception (n = 19), grade assessment of OSCEs (n = 145), interprofessional education (n = 11), standardized patients (n = 12), and rubric development and standard setting (n = 8).
IMPLICATIONS: There has been a growth in virtual OSCEs, interprofessional OSCEs, and artificial intelligence OSCEs. Communication rubrics and minimizing assessor variability are still trending research areas. There is scope to conduct more research on evaluating specific types of OSCEs, when best to hold an OSCE, and comparing OSCEs to other assessments.
METHODS: A cross-sectional study was conducted using validated modified-communication tools; Patient Communication Assessment Instruments (PCAI), Student Communication Assessment Instruments (SCAI) and Clinical Communication Assessment Instruments (CCAI) which included four communication domains. One hundred and seventy-six undergraduate clinical year students were recruited in this study whereby each of them was assessed by a clinical instructor and a randomly selected patient in two settings: Dental Health Education (DHE) and Comprehensive Care (CC) clinic.
RESULTS: Comparing the three perspectives, PCAI yielded the highest scores across all domains, followed by SCAI and CCAI (p
METHODS: A total of 255 dental students in Universiti Malaya completed the modified Index of Learning Styles (m-ILS) questionnaire containing 44 items which classified them into their respective LS. The collected data, referred to as dataset, was used in a decision tree supervised learning to automate the mapping of students' learning styles with the most suitable IS. The accuracy of the ML-empowered IS recommender tool was then evaluated.
RESULTS: The application of a decision tree model in the automation process of the mapping between LS (input) and IS (target output) was able to instantly generate the list of suitable instructional strategies for each dental student. The IS recommender tool demonstrated perfect precision and recall for overall model accuracy, suggesting a good sensitivity and specificity in mapping LS with IS.
CONCLUSION: The decision tree ML empowered IS recommender tool was proven to be accurate at matching dental students' learning styles with the relevant instructional strategies. This tool provides a workable path to planning student-centered lessons or modules that potentially will enhance the learning experience of the students.
EDUCATIONAL ACTIVITY AND SETTING: A one day accelerated dispensing course using MyDispense software was delivered to 59 GE students. The accelerated dispensing course was identical to the standard three-week dispensing course delivered to UG students. The same assessment of dispensing skills was conducted after course completion for both UG and GE students and included dispensing four prescriptions of varying difficulty. The assessment scores of the UG and GE students were compared. Perception data from the accelerated course were also collected.
FINDINGS: The accelerated dispensing curriculum was well received by students. They found the simulation relevant to practice, easy to navigate, and helpful for preparing them for assessment. Overall, 5.1% of GE students failed the assessment, which was lower than the 32.6% failure rate in the UG cohort. Comparison of assessment grades between UG and GE students showed no notable disadvantage to attainment of learning outcomes with the accelerated curriculum. However, UG students were more likely to provide unsafe instructions compared to GE students in their labeling for three out of four prescriptions.
SUMMARY: An accelerated dispensing curriculum can be effectively delivered to mature learners with a prior science-related degree as no notable deficiencies were identified when comparing the assessment results of GE students against UG students when both student cohorts undertook the same dispensing assessment.
METHODS: A three-station OSCE set in a hospital and community pharmacy was designed and mapped to the World Health Organisation's AMS intervention practical guide. This OSCE comprised 39 unique cases and was implemented across two campuses (Malaysia and Australia) at one institute. Stations were 8 min long and consisted of problem-solving and applying AMS principles to drug therapy management (Station 1), counselling on key antimicrobials (Station 2) or managing infectious diseases in primary care (Station 3). Primary outcome measure to assess viability was the proportion of students who were able to pass each case.
KEY FINDINGS: Other than three cases with pass rates of 50, 52.8 and 66. 7%, all cases had pass rates of 75% or more. Students were most confident with referral to medical practitioner cases and switching from intravenous to oral or empirical to directed therapy.
CONCLUSIONS: An AMS-based OSCE is a viable assessment tool in pharmacy education. Further research should explore whether similar assessments can help improve students' confidence at recognising opportunities for AMS intervention in the workplace.
METHODS: All second-year undergraduate Bachelor of Dental Surgery (BDS) students were invited to participate in a TBL-CBL session. These participants were randomly allocated to six different groups of 10-12 students, and the session was conducted by one lecturer as the facilitator. A 23-item questionnaire assessing four domains (perceptions of effectiveness, teacher, team interaction and learning environment) was administered at the end of the TBL-CBL session.
RESULTS: The response rate was 91.9% (n = 68). Mean scores for the questionnaire items ranged from 4.13 to 4.60 suggesting a positive perception among the students towards the hybrid TBL-CBL approach. Regarding the open-response questions, students emphasised that the TBL-CBL session was effective for team interaction and group discussions. However, students wished to have a better venue for future sessions.
CONCLUSION: Positive perceptions of the students encourage future educators to consider the use of TBL-CBL approach in teaching dental materials science and to avoid the reliance on standalone conventional lectures. Future research could consider examining its effects on students' academic achievement as well as the perspectives of teachers regarding its adoption in different dental specialities.
METHODS: All undergraduate second-year dental students were invited to participate in the dental materials science practical session and were randomly allocated into two groups: Group 1 (feedback) sandwich and Group 2 (ATA). The session began with the teacher giving a short briefing on the commonly used dental materials, followed by a short demonstration of the manipulation of those materials. Students were then allowed to mix and manipulate the materials, and teachers provided feedback accordingly. At the end of the session, 16 close-ended (five-point Likert scales) and an open-ended questionnaire were distributed to students to evaluate their perceptions of the feedback given. Internal reliability of the questionnaire items was evaluated using Cronbach's alpha. Mean feedback scores were analysed using an independent t-test with ANCOVA for controlling gender and ethnicity. Thematic analysis was used to code the qualitative data.
RESULTS: Sixty-nine students participated in the present study with the majority being females (72.5%) and Chinese (79.7%). Cronbach's alpha analysis suggested removing three Likert-scale items, with the remaining 13 items being accepted. Generally, no significant difference was noted between the two groups (p = 0.197), but three items were found to be significant (p
MATERIALS AND METHODS: A quasi-experimental study was conducted to develop and administer a team-based SDL versus a conventional SDL to teach undergraduate surgical topics. One hundred and seventy-four medical students who underwent the Year 5 surgical posting were recruited. They were assigned to two groups receiving either the teambased SDL or the conventional SDL. Pre- and post-SDL assessments were conducted to determine students' understanding of selected surgical topics. A selfadministered questionnaire was used to collect student feedback on the team-based SDL.
RESULTS: The team-based SDL group scored significantly higher than the conventional SDL group in the post-SDL assessment (74.70 ± 6.81 vs. 63.77 ± 4.18, t = -12.72, p < 0.01). The students agreed that the team-based SDL method facilitated their learning process.
CONCLUSION: The study demonstrated that the use of a teambased SDL is an effective learning strategy for teaching the Year 5 surgical posting. This method encouraged peer discussion and promoted teamwork in completing task assignments to achieve the learning objectives.
MATERIALS AND METHODS: We compared the LC scores of three previous years with those of the SBCE and studied the feedback of the three stakeholders: students, examiners, and simulated patients (SPs), regarding their experience with SBCE and the suitability of SBCE as an alternative for LC in future examinations.
RESULTS: The SBCE scores were higher than those of the LC. Most of the examiners and students were not in favour of SBCE replacing LC, as such. The SPs were more positive about the proposition. The comments of the three stakeholders brought out the plus and minus points of LC and SBCE, which prompted our proposals to make SBCE more practical for future examinations.
CONCLUSION: Having analysed the feedback of the stakeholders, and the positive and negative aspects of LC and SBCE, it was evident that SBCE needed improvements. We have proposed eight modifications to SBCE to make it a viable alternative for LC.
Methods: . We assessed links through curriculum mapping, between assessments and expected learning outcomes of dental physiology curriculum of three batches of students (2012-14) at Melaka-Manipal Medical College (MMMC), Manipal. The questions asked under each assessment method were mapped to the respective expected learning outcomes, and students' scores in different assessments in physiology were gathered. Students' (n = 220) and teachers' (n=15) perspectives were collected through focus group discussion sessions and questionnaire surveys.
Results: . More than 75% of students were successful (≥50% scores) in majority of the assessments. There was moderate (r=0.4-0.6) to strong positive correlation (r=0.7-0.9) between majority of the assessments. However, students' scores in viva voce had a weak positive correlation with the practical examination score (r=0.230). The score in the assessments of problem-based learning had either weak (r=0.1-0.3) or no correlation with other assessment scores.
Conclusions: . Through curriculum mapping, we were able to establish links between assessments and expected learning outcomes. We observed that, in the assessment system followed at MMMC, all expected learning outcomes were not given equal weightage in the examinations. Moreover, there was no direct assessment of self-directed learning skills. Our study also showed that assessment has supported students in achieving the expected learning outcomes as evidenced by the qualitative and quantitative data.
METHODS: The norm-referenced method of standard setting was applied to the real scores of 40 final-year dental students on a multiple-choice question (MCQ), a short answer question (SAQ), and an objective structured clinical examination (OSCE). A panel of 10 judges set the standard using the modified-Angoff method for the same paper in one sitting. One judge set the passing score of 10 OSCE questions after 2 weeks. A comparison of the grades and pass/fail rates derived from the absolute standard, norm-referenced, and modified-Angoff methods was made. The intra-rater and inter-rater reliabilities of the modified-Angoff method were assessed.
RESULTS: The passing rate for the absolute standard was 100% (40/40), for the norm-referenced method it was 62.5% (25/40), and for the modified-Angoff method it was 80% (32/40). The modified-Angoff method had good inter-rater reliability of 0.876 and excellent test-retest reliability of 0.941.
CONCLUSION: There were significant differences in the outcomes of these three standard-setting methods, as shown by the difference in the proportion of candidates who passed and failed the assessment. The modified-Angoff method was found to have good reliability for use with a professional qualifying dental examination.
METHODS: The Jefferson Scale of Physician Lifelong Learning for medical student (JeffSPLL-MS) questionnaire was used. Factor analysis was performed, Cronbach's alpha and effect size were calculated. The types of learning activities that contribute to LL skills were identified.
RESULTS: Three-factor structure emerged from the factor analysis and were identified as learning beliefs and motivation, skills in seeking information and attention to learning opportunities. A significant increase (p
METHODS: Forty third-year undergraduate dental students were randomly assigned into FC (n = 20) or LD (n = 20) cohort. Each student attended six teaching sessions, each to teach students' competency in fabricating one type of wire component, for a total competency in fabricating six wire components over the course of six teaching sessions. Either LD or FC teaching methods were used. After each session, wire assignments had to be submitted. Wire assignments were then evaluated using a blinded wire-bending assessment protocol. As part of their formative assessment, the assessment results were distributed to students, lecturers, and technicians before the next session. After the first session (T0) and at the end of all six sessions (T1), students completed a self-reported questionnaire.
RESULTS: The mean wire-bending scores for FC were significantly higher than LD for two of the six assignments, namely the Adams clasp (p
METHODS: We compared two methods of OSCE feedback delivered to fourth year medical students in Malaysia: (i) Face to face (FTF) immediate feedback (semester one) (ii) Individualised enhanced written (EW) feedback containing detailed scores in each domain, examiners' free text comments and the marking rubric (semester two). Both methods were evaluated by students and staff examiners, and students' responses were compared against their OSCE performance.
RESULTS: Of the 116 students who sat for both formative OSCEs, 82.8% (n=96) and 86.2% (n=100) responded to the first and second survey respectively. Most students were comfortable to receive feedback (91.3% in FTF, 96% in EW) with EW feedback associated with higher comfort levels (p=0.022). Distress affected a small number with no differences between either method (13.5% in FTF, 10% in EW, p=0.316). Most students perceived both types of feedback improved their performance (89.6% in FTF, 95% in EW); this perception was significantly stronger for EW feedback (p=0.008). Students who preferred EW feedback had lower OSCE scores compared to those preferring FTF feedback (mean scores ± SD: 43.8 ± 5.3 in EW, 47.2 ± 6.5 in FTF, p=0.049). Students ranked the "marking rubric" to be the most valuable aspect of the EW feedback. Tutors felt both methods of feedback were equally beneficial. Few examiners felt they needed training (21.4% in FTF, 15% in EW) but students perceived this need for tutors' training differently (53.1% in FTF, 46% in EW) CONCLUSION: Whilst both methods of OSCE feedback were highly valued, students preferred to receive EW feedback and felt it was more beneficial. Learning cultures of Malaysian students may have influenced this view. Information provided in EW feedback should be tailored accordingly to provide meaningful feedback in OSCE exams.
METHODS: We analysed 350 items used in 7 professional examinations and determined their distractor efficiency and the number of functional distractors per item. The items were sorted into five groups - excellent, good, fair, remediable and discarded based on their discrimination index. We studied how the distractor efficiency and functional distractors per item correlated with these five groups.
RESULTS: Correlation of distractor efficiency with psychometric indices was significant but far from perfect. The excellent group topped in distractor efficiency in 3 tests, the good group in one test, the remediable group equalled excellent group in one test, and the discarded group topped in 2 tests.
CONCLUSIONS: The distractor efficiency did not correlate in a consistent pattern with the discrimination index. Fifty per cent or higher distractor efficiency, not hundred percent, was found to be the optimum.
METHODS: This cross-sectional study involved third- and fourth-year pharmacy students at the International Islamic University Malaysia. A validated self-administered questionnaire was distributed to students who had taken a vOSCE a week before.
RESULTS: Out of the 253 students who were approached, 231 (91.3%) completed the questionnaire. More than 75% of the participants agreed that the instructions and preparations were clear and helpful in familiarizing them with the vOSCE flow. It was found that 53.2% of the respondents were satisfied with the flow and conduct of the vOSCE. However, only approximately one-third of the respondents believed that the tasks provided in the vOSCE were more convenient, less stressful, and easier to perform than those in the conventional OSCE. Furthermore, 49.7% of the students favored not having a vOSCE in the future when conducting a conventional OSCE becomes feasible again. Internet connection was reported as a problem hindering the performance of the vOSCE by 51.9% of the participants. Students who were interested in clinical pharmacy courses were more satisfied than other students with the preparation and operation of the vOSCE, the faculty support, and the allocated time.
CONCLUSION: Students were satisfied with the organization and operation of the vOSCE. However, they still preferred the conventional OSCE over the vOSCE. These findings might indicate a further need to expose students to telehealthcare models.