OBJECTIVES: This study aims to compare student performance in MCQ and VSAQ and obtain feedback. from the stakeholders.
METHODS: Conduct multiple true-false, one best answer, and VSAQ tests in two batches of medical students, compare their scores and psychometric indices of the tests and seek opinion from students and academics regarding these assessment methods.
RESULTS: Multiple true-false and best answer test scores showed skewed results and low psychometric performance compared to better psychometrics and more balanced student performance in VSAQ tests. The stakeholders' opinions were significantly in favour of VSAQ.
CONCLUSION AND RECOMMENDATION: This study concludes that VSAQ is a viable alternative to multiple-choice question tests, and it is widely accepted by medical students and academics in the medical faculty.
METHODS: The norm-referenced method of standard setting was applied to the real scores of 40 final-year dental students on a multiple-choice question (MCQ), a short answer question (SAQ), and an objective structured clinical examination (OSCE). A panel of 10 judges set the standard using the modified-Angoff method for the same paper in one sitting. One judge set the passing score of 10 OSCE questions after 2 weeks. A comparison of the grades and pass/fail rates derived from the absolute standard, norm-referenced, and modified-Angoff methods was made. The intra-rater and inter-rater reliabilities of the modified-Angoff method were assessed.
RESULTS: The passing rate for the absolute standard was 100% (40/40), for the norm-referenced method it was 62.5% (25/40), and for the modified-Angoff method it was 80% (32/40). The modified-Angoff method had good inter-rater reliability of 0.876 and excellent test-retest reliability of 0.941.
CONCLUSION: There were significant differences in the outcomes of these three standard-setting methods, as shown by the difference in the proportion of candidates who passed and failed the assessment. The modified-Angoff method was found to have good reliability for use with a professional qualifying dental examination.
OBJECTIVE: To appraise and synthesize the best available evidence that examines the effectiveness of OBE approaches towards the competencies of nursing students.
DESIGN: A systematic review of interventional experimental studies.
DATA SOURCES: Eight online databases namely CINAHL, EBSCO, Science Direct, ProQuest, Web of Science, PubMed, EMBASE and SCOPUS were searched.
REVIEW METHODS: Relevant studies were identified using combined approaches of electronic database search without geographical or language filters but were limited to articles published from 2006 to 2016, handsearching journals and visually scanning references from retrieved studies. Two reviewers independently conducted the quality appraisal of selected studies and data were extracted.
RESULTS: Six interventional studies met the inclusion criteria. Two of the studies were rated as high methodological quality and four were rated as moderate. Studies were published between 2009 and 2016 and were mostly from Asian and Middle Eastern countries. Results showed that OBE approaches improves competency in knowledge acquisition in terms of higher final course grades and cognitive skills, improve clinical skills and nursing core competencies and higher behavioural skills score while performing clinical skills. Learners' satisfaction was also encouraging as reported in one of the studies. Only one study reported on the negative effect.
CONCLUSIONS: Although OBE approaches does show encouraging effects towards improving competencies of nursing students, more robust experimental study design with larger sample sizes, evaluating other outcome measures such as other areas of competencies, students' satisfaction, and patient outcomes are needed.
METHODS: All undergraduate second-year dental students were invited to participate in the dental materials science practical session and were randomly allocated into two groups: Group 1 (feedback) sandwich and Group 2 (ATA). The session began with the teacher giving a short briefing on the commonly used dental materials, followed by a short demonstration of the manipulation of those materials. Students were then allowed to mix and manipulate the materials, and teachers provided feedback accordingly. At the end of the session, 16 close-ended (five-point Likert scales) and an open-ended questionnaire were distributed to students to evaluate their perceptions of the feedback given. Internal reliability of the questionnaire items was evaluated using Cronbach's alpha. Mean feedback scores were analysed using an independent t-test with ANCOVA for controlling gender and ethnicity. Thematic analysis was used to code the qualitative data.
RESULTS: Sixty-nine students participated in the present study with the majority being females (72.5%) and Chinese (79.7%). Cronbach's alpha analysis suggested removing three Likert-scale items, with the remaining 13 items being accepted. Generally, no significant difference was noted between the two groups (p = 0.197), but three items were found to be significant (p
METHODS: All second-year undergraduate Bachelor of Dental Surgery (BDS) students were invited to participate in a TBL-CBL session. These participants were randomly allocated to six different groups of 10-12 students, and the session was conducted by one lecturer as the facilitator. A 23-item questionnaire assessing four domains (perceptions of effectiveness, teacher, team interaction and learning environment) was administered at the end of the TBL-CBL session.
RESULTS: The response rate was 91.9% (n = 68). Mean scores for the questionnaire items ranged from 4.13 to 4.60 suggesting a positive perception among the students towards the hybrid TBL-CBL approach. Regarding the open-response questions, students emphasised that the TBL-CBL session was effective for team interaction and group discussions. However, students wished to have a better venue for future sessions.
CONCLUSION: Positive perceptions of the students encourage future educators to consider the use of TBL-CBL approach in teaching dental materials science and to avoid the reliance on standalone conventional lectures. Future research could consider examining its effects on students' academic achievement as well as the perspectives of teachers regarding its adoption in different dental specialities.
MATERIALS AND METHODS: MCQ items in papers taken from Year II Parts A, B and C examinations for Sessions 2001/02, and Part B examinations for 2002/03 and 2003/04, were analysed to obtain their difficulty indices and discrimination indices. Each paper consisted of 250 true/false items (50 questions of 5 items each) on topics drawn from different disciplines. The questions were first constructed and vetted by the individual departments before being submitted to a central committee, where the final selection of the MCQs was made, based purely on the academic judgement of the committee.
RESULTS: There was a wide distribution of item difficulty indices in all the MCQ papers analysed. Furthermore, the relationship between the difficulty index (P) and discrimination index (D) of the MCQ items in a paper was not linear, but more dome-shaped. Maximal discrimination (D = 51% to 71%) occurred with moderately easy/difficult items (P = 40% to 74%). On average, about 38% of the MCQ items in each paper were "very easy" (P > or =75%), while about 9% were "very difficult" (P <25%). About two-thirds of these very easy/difficult items had "very poor" or even negative discrimination (D < or =20%).
CONCLUSIONS: MCQ items that demonstrate good discriminating potential tend to be moderately difficult items, and the moderately-to-very difficult items are more likely to show negative discrimination. There is a need to evaluate the effectiveness of our MCQ items.
MATERIALS AND METHODS: This review is on some of the issues in standard setting based on the published articles of educational assessment researchers.
RESULTS: Standard or cut-off score should be to determine whether the examinee attained the requirement to be certified competent. There is no perfect method to determine cut score on a test and none is agreed upon as the best method. Setting standard is not an exact science. Legitimacy of the standard is supported when performance standard is linked to the requirement of practice. Test-curriculum alignment and content validity are important for most educational test validity arguments.
CONCLUSION: Representative percentage of must-know learning objectives in the curriculum may be the basis of test items and pass/fail marks. Practice analysis may help in identifying the must-know areas of curriculum. Cut score set by this procedure may give the credibility, validity, defensibility and comparability of the standard. Constructing the test items by subject experts and vetted by multi-disciplinary faculty members may ensure the reliability of the test as well as the standard.
MATERIALS AND METHODS: A quasi-experimental study was conducted to develop and administer a team-based SDL versus a conventional SDL to teach undergraduate surgical topics. One hundred and seventy-four medical students who underwent the Year 5 surgical posting were recruited. They were assigned to two groups receiving either the teambased SDL or the conventional SDL. Pre- and post-SDL assessments were conducted to determine students' understanding of selected surgical topics. A selfadministered questionnaire was used to collect student feedback on the team-based SDL.
RESULTS: The team-based SDL group scored significantly higher than the conventional SDL group in the post-SDL assessment (74.70 ± 6.81 vs. 63.77 ± 4.18, t = -12.72, p < 0.01). The students agreed that the team-based SDL method facilitated their learning process.
CONCLUSION: The study demonstrated that the use of a teambased SDL is an effective learning strategy for teaching the Year 5 surgical posting. This method encouraged peer discussion and promoted teamwork in completing task assignments to achieve the learning objectives.
METHODS: A total of 255 dental students in Universiti Malaya completed the modified Index of Learning Styles (m-ILS) questionnaire containing 44 items which classified them into their respective LS. The collected data, referred to as dataset, was used in a decision tree supervised learning to automate the mapping of students' learning styles with the most suitable IS. The accuracy of the ML-empowered IS recommender tool was then evaluated.
RESULTS: The application of a decision tree model in the automation process of the mapping between LS (input) and IS (target output) was able to instantly generate the list of suitable instructional strategies for each dental student. The IS recommender tool demonstrated perfect precision and recall for overall model accuracy, suggesting a good sensitivity and specificity in mapping LS with IS.
CONCLUSION: The decision tree ML empowered IS recommender tool was proven to be accurate at matching dental students' learning styles with the relevant instructional strategies. This tool provides a workable path to planning student-centered lessons or modules that potentially will enhance the learning experience of the students.