METHODS: A three-station OSCE set in a hospital and community pharmacy was designed and mapped to the World Health Organisation's AMS intervention practical guide. This OSCE comprised 39 unique cases and was implemented across two campuses (Malaysia and Australia) at one institute. Stations were 8 min long and consisted of problem-solving and applying AMS principles to drug therapy management (Station 1), counselling on key antimicrobials (Station 2) or managing infectious diseases in primary care (Station 3). Primary outcome measure to assess viability was the proportion of students who were able to pass each case.
KEY FINDINGS: Other than three cases with pass rates of 50, 52.8 and 66. 7%, all cases had pass rates of 75% or more. Students were most confident with referral to medical practitioner cases and switching from intravenous to oral or empirical to directed therapy.
CONCLUSIONS: An AMS-based OSCE is a viable assessment tool in pharmacy education. Further research should explore whether similar assessments can help improve students' confidence at recognising opportunities for AMS intervention in the workplace.
EDUCATIONAL ACTIVITY AND SETTING: A one day accelerated dispensing course using MyDispense software was delivered to 59 GE students. The accelerated dispensing course was identical to the standard three-week dispensing course delivered to UG students. The same assessment of dispensing skills was conducted after course completion for both UG and GE students and included dispensing four prescriptions of varying difficulty. The assessment scores of the UG and GE students were compared. Perception data from the accelerated course were also collected.
FINDINGS: The accelerated dispensing curriculum was well received by students. They found the simulation relevant to practice, easy to navigate, and helpful for preparing them for assessment. Overall, 5.1% of GE students failed the assessment, which was lower than the 32.6% failure rate in the UG cohort. Comparison of assessment grades between UG and GE students showed no notable disadvantage to attainment of learning outcomes with the accelerated curriculum. However, UG students were more likely to provide unsafe instructions compared to GE students in their labeling for three out of four prescriptions.
SUMMARY: An accelerated dispensing curriculum can be effectively delivered to mature learners with a prior science-related degree as no notable deficiencies were identified when comparing the assessment results of GE students against UG students when both student cohorts undertook the same dispensing assessment.
METHODS: A bibliometric review was conducted on literature from over 23 years from January 2000 to May 2023. Articles focusing on any type of OSCE research in pharmacy education in both undergraduate and postgraduate sectors were included. Articles were excluded if they were not original articles or not published in English. A summative content analysis was also conducted to identify key topics.
RESULTS: A total of 192 articles were included in the analysis. There were 242 institutions that contributed to the OSCE literature in pharmacy education, with the leading country being Canada. Most OSCE research came from developed countries and were descriptive studies based on single institution data. The top themes emerging from content analysis were student perceptions on OSCE station styles (n = 98), staff perception (n = 19), grade assessment of OSCEs (n = 145), interprofessional education (n = 11), standardized patients (n = 12), and rubric development and standard setting (n = 8).
IMPLICATIONS: There has been a growth in virtual OSCEs, interprofessional OSCEs, and artificial intelligence OSCEs. Communication rubrics and minimizing assessor variability are still trending research areas. There is scope to conduct more research on evaluating specific types of OSCEs, when best to hold an OSCE, and comparing OSCEs to other assessments.
METHODS: A cross-sectional survey was conducted via a validated 49-item questionnaire, administered immediately after all students completed the examination. The questionnaire comprised of questions to evaluate the content and structure of the examination, perception of OSCE validity and reliability, and rating of OSCE in relation to other assessment methods. Open-ended follow-up questions were included to generate qualitative data.
RESULTS: Over 80% of the students found the OSCE to be helpful in highlighting areas of weaknesses in their clinical competencies. Seventy-eight percent agreed that it was comprehensive and 66% believed it was fair. About 46% felt that the 15 minutes allocated per station was inadequate. Most importantly, about half of the students raised concerns that personality, ethnicity, and/or gender, as well as interpatient and inter-assessor variability were potential sources of bias that could affect their scores. However, an overwhelming proportion of the students (90%) agreed that the OSCE provided a useful and practical learning experience.
CONCLUSIONS: Students' perceptions and acceptance of the new method of assessment were positive. The survey further highlighted for future refinement the strengths and weaknesses associated with the development and implementation of an OSCE in the International Islamic University Malaysia's pharmacy curriculum.
Methods: We retrieved the in-course continuous assessment (ICA) and final professional examination results of 3 cohorts of medical students (n = 245) from the examination unit of the International Medical University, Seremban, Malaysia. The ICA was 3 sets of composite marks derived from course works, which includes summative theory paper with short answer questions and 1 of the best answers. The clinical examination includes end-of-posting practical examination. These examinations are conducted every 6 months in semesters 6, 7 and 8; they are graded as pass/fail for each student. The final professional examination including modified essay questions (MEQs), 1 8-question objective structured practical examination (OSPE) and a 16-station objective structured clinical examination (OSCE), were graded as pass/fail. Failure in the continuous assessment that can predict failure in each component of the final professional examination was tested using chi-square test and presented as odds ratio (OR) with 95% confidence interval (CI).
Results: Failure in ICA in semesters 6-8 strongly predicts failure in MEQs, OSPE and OSCE of the final professional examination with OR of 3.8-14.3 (all analyses p< 0.001) and OR of 2.4-6.9 (p<0.05). However, the correlation was stronger with MEQs and OSPE compared to OSCE.
Conclusion: ICA with theory and clinical examination had a direct relationship with students' performance in the final examination and is a useful assessment tool.
METHODS: Forty third-year undergraduate dental students were randomly assigned into FC (n = 20) or LD (n = 20) cohort. Each student attended six teaching sessions, each to teach students' competency in fabricating one type of wire component, for a total competency in fabricating six wire components over the course of six teaching sessions. Either LD or FC teaching methods were used. After each session, wire assignments had to be submitted. Wire assignments were then evaluated using a blinded wire-bending assessment protocol. As part of their formative assessment, the assessment results were distributed to students, lecturers, and technicians before the next session. After the first session (T0) and at the end of all six sessions (T1), students completed a self-reported questionnaire.
RESULTS: The mean wire-bending scores for FC were significantly higher than LD for two of the six assignments, namely the Adams clasp (p
METHODS: The Jefferson Scale of Physician Lifelong Learning for medical student (JeffSPLL-MS) questionnaire was used. Factor analysis was performed, Cronbach's alpha and effect size were calculated. The types of learning activities that contribute to LL skills were identified.
RESULTS: Three-factor structure emerged from the factor analysis and were identified as learning beliefs and motivation, skills in seeking information and attention to learning opportunities. A significant increase (p
Methods: . We assessed links through curriculum mapping, between assessments and expected learning outcomes of dental physiology curriculum of three batches of students (2012-14) at Melaka-Manipal Medical College (MMMC), Manipal. The questions asked under each assessment method were mapped to the respective expected learning outcomes, and students' scores in different assessments in physiology were gathered. Students' (n = 220) and teachers' (n=15) perspectives were collected through focus group discussion sessions and questionnaire surveys.
Results: . More than 75% of students were successful (≥50% scores) in majority of the assessments. There was moderate (r=0.4-0.6) to strong positive correlation (r=0.7-0.9) between majority of the assessments. However, students' scores in viva voce had a weak positive correlation with the practical examination score (r=0.230). The score in the assessments of problem-based learning had either weak (r=0.1-0.3) or no correlation with other assessment scores.
Conclusions: . Through curriculum mapping, we were able to establish links between assessments and expected learning outcomes. We observed that, in the assessment system followed at MMMC, all expected learning outcomes were not given equal weightage in the examinations. Moreover, there was no direct assessment of self-directed learning skills. Our study also showed that assessment has supported students in achieving the expected learning outcomes as evidenced by the qualitative and quantitative data.