Displaying publications 21 - 40 of 140 in total

Abstract:
Sort:
  1. Torke S, Upadhya S, Abraham RR, Ramnarayan K
    Adv Physiol Educ, 2006 Mar;30(1):48-9.
    PMID: 16481610
    Matched MeSH terms: Educational Measurement/methods*
  2. Rao M
    Adv Physiol Educ, 2006 Jun;30(2):95.
    PMID: 16709743
    Matched MeSH terms: Educational Measurement/methods*
  3. Sim SM, Rasiah RI
    Ann Acad Med Singap, 2006 Feb;35(2):67-71.
    PMID: 16565756
    INTRODUCTION: This paper reports the relationship between the difficulty level and the discrimination power of true/false-type multiple-choice questions (MCQs) in a multidisciplinary paper for the para-clinical year of an undergraduate medical programme.

    MATERIALS AND METHODS: MCQ items in papers taken from Year II Parts A, B and C examinations for Sessions 2001/02, and Part B examinations for 2002/03 and 2003/04, were analysed to obtain their difficulty indices and discrimination indices. Each paper consisted of 250 true/false items (50 questions of 5 items each) on topics drawn from different disciplines. The questions were first constructed and vetted by the individual departments before being submitted to a central committee, where the final selection of the MCQs was made, based purely on the academic judgement of the committee.

    RESULTS: There was a wide distribution of item difficulty indices in all the MCQ papers analysed. Furthermore, the relationship between the difficulty index (P) and discrimination index (D) of the MCQ items in a paper was not linear, but more dome-shaped. Maximal discrimination (D = 51% to 71%) occurred with moderately easy/difficult items (P = 40% to 74%). On average, about 38% of the MCQ items in each paper were "very easy" (P > or =75%), while about 9% were "very difficult" (P <25%). About two-thirds of these very easy/difficult items had "very poor" or even negative discrimination (D < or =20%).

    CONCLUSIONS: MCQ items that demonstrate good discriminating potential tend to be moderately difficult items, and the moderately-to-very difficult items are more likely to show negative discrimination. There is a need to evaluate the effectiveness of our MCQ items.

    Matched MeSH terms: Educational Measurement/methods*
  4. Hong WH, Vadivelu J, Daniel EG, Sim JH
    Med Educ Online, 2015;20:27561.
    PMID: 26314338 DOI: 10.3402/meo.v20.27561
    Studies have shown the importance of metacognition in medical education. Metacognitive skills consist of two dimensions: knowledge of metacognition and regulation of metacognition.
    Matched MeSH terms: Educational Measurement*
  5. Vahalia KV, Subramaniam K, Marks SC, De Souza EJ
    Clin Anat, 1995;8(1):61-5.
    PMID: 7697515
    Multiple-choice questions (MCQ) are widely used to evaluate students in the health sciences, including anatomy. Unusual responses in 90 simple MCQ examinations have been identified and classified as to cause, including a number of illustrated examples. About one-quarter of these errors were attributable to the teacher and could have been avoided by a critical analysis of the questions before use. The increasing use of sophisticated formats of the MCQ in medical education indicates that teachers need to analyze their questions more carefully before and after actual tests to minimize errors.
    Matched MeSH terms: Educational Measurement*
  6. Puthiaparampil T, Rahman MM
    BMC Med Educ, 2020 May 06;20(1):141.
    PMID: 32375739 DOI: 10.1186/s12909-020-02057-w
    BACKGROUND: Multiple choice questions, used in medical school assessments for decades, have many drawbacks such as hard to construct, allow guessing, encourage test-wiseness, promote rote learning, provide no opportunity for examinees to express ideas, and do not provide information about strengths and weakness of candidates. Directly asked, directly answered questions like Very Short Answer Questions (VSAQ) are considered a better alternative with several advantages.

    OBJECTIVES: This study aims to compare student performance in MCQ and VSAQ and obtain feedback. from the stakeholders.

    METHODS: Conduct multiple true-false, one best answer, and VSAQ tests in two batches of medical students, compare their scores and psychometric indices of the tests and seek opinion from students and academics regarding these assessment methods.

    RESULTS: Multiple true-false and best answer test scores showed skewed results and low psychometric performance compared to better psychometrics and more balanced student performance in VSAQ tests. The stakeholders' opinions were significantly in favour of VSAQ.

    CONCLUSION AND RECOMMENDATION: This study concludes that VSAQ is a viable alternative to multiple-choice question tests, and it is widely accepted by medical students and academics in the medical faculty.

    Matched MeSH terms: Educational Measurement/methods*
  7. Abd-Rahman ANA, Baharuddin IH, Abu-Hassan MI, Davies SJ
    J Dent Educ, 2021 Jul;85(7):1210-1216.
    PMID: 33792052 DOI: 10.1002/jdd.12600
    BACKGROUND: The outcome of assessments is determined by the standard-setting method used. Standard setting is the process of deciding what is good enough. A cutoff score of 50% was commonly used in dental schools in Malaysia. This study aims to compare the conventional, norm-referenced, and modified-Angoff standard-setting methods.

    METHODS: The norm-referenced method of standard setting was applied to the real scores of 40 final-year dental students on a multiple-choice question (MCQ), a short answer question (SAQ), and an objective structured clinical examination (OSCE). A panel of 10 judges set the standard using the modified-Angoff method for the same paper in one sitting. One judge set the passing score of 10 OSCE questions after 2 weeks. A comparison of the grades and pass/fail rates derived from the absolute standard, norm-referenced, and modified-Angoff methods was made. The intra-rater and inter-rater reliabilities of the modified-Angoff method were assessed.

    RESULTS: The passing rate for the absolute standard was 100% (40/40), for the norm-referenced method it was 62.5% (25/40), and for the modified-Angoff method it was 80% (32/40). The modified-Angoff method had good inter-rater reliability of 0.876 and excellent test-retest reliability of 0.941.

    CONCLUSION: There were significant differences in the outcomes of these three standard-setting methods, as shown by the difference in the proportion of candidates who passed and failed the assessment. The modified-Angoff method was found to have good reliability for use with a professional qualifying dental examination.

    Matched MeSH terms: Educational Measurement*
  8. Chan SW, Ismail Z, Sumintono B
    PLoS One, 2016;11(11):e0163846.
    PMID: 27812091 DOI: 10.1371/journal.pone.0163846
    Based on a synthesis of literature, earlier studies, analyses and observations on high school students, this study developed an initial framework for assessing students' statistical reasoning about descriptive statistics. Framework descriptors were established across five levels of statistical reasoning and four key constructs. The former consisted of idiosyncratic reasoning, verbal reasoning, transitional reasoning, procedural reasoning, and integrated process reasoning. The latter include describing data, organizing and reducing data, representing data, and analyzing and interpreting data. In contrast to earlier studies, this initial framework formulated a complete and coherent statistical reasoning framework. A statistical reasoning assessment tool was then constructed from this initial framework. The tool was administered to 10 tenth-grade students in a task-based interview. The initial framework was refined, and the statistical reasoning assessment tool was revised. The ten students then participated in the second task-based interview, and the data obtained were used to validate the framework. The findings showed that the students' statistical reasoning levels were consistent across the four constructs, and this result confirmed the framework's cohesion. Developed to contribute to statistics education, this newly developed statistical reasoning framework provides a guide for planning learning goals and designing instruction and assessments.
    Matched MeSH terms: Educational Measurement/methods*
  9. Rakami NMHN, Ismail NAH, Abu Kassim NL, Idrus F
    J Appl Meas, 2020;21(1):91-100.
    PMID: 32129771
    This paper describes the process of assessing the unidimensionality and validity of egalitarian education (EE) items based on the Rasch measurement model. Egalitarian education was measured by a self-developed 5 EE items of Likert-scale format. The process of assessing the validity of EE items involved a collection of data from 400 Malay teachers, who are teaching in government school around peninsular of Malaysia where the measurement of construct validity for the overall EE items were established using Winsteps. Various Rasch measurement tools were utilized to demonstrate the true unidimensionality and validity measure of the EE items and in meeting the needs of the Rasch measurement model. The findings show that the validity and unidimensionality of EE items can be truly established and can satisfy the characteristics of the Rasch measurement model.
    Matched MeSH terms: Educational Measurement*
  10. Mohammed M, Omar N
    PLoS One, 2020;15(3):e0230442.
    PMID: 32191738 DOI: 10.1371/journal.pone.0230442
    The assessment of examination questions is crucial in educational institutes since examination is one of the most common methods to evaluate students' achievement in specific course. Therefore, there is a crucial need to construct a balanced and high-quality exam, which satisfies different cognitive levels. Thus, many lecturers rely on Bloom's taxonomy cognitive domain, which is a popular framework developed for the purpose of assessing students' intellectual abilities and skills. Several works have been proposed to automatically handle the classification of questions in accordance with Bloom's taxonomy. Most of these works classify questions according to specific domain. As a result, there is a lack of technique of classifying questions that belong to the multi-domain areas. The aim of this paper is to present a classification model to classify exam questions based on Bloom's taxonomy that belong to several areas. This study proposes a method for classifying questions automatically, by extracting two features, TFPOS-IDF and word2vec. The purpose of the first feature was to calculate the term frequency-inverse document frequency based on part of speech, in order to assign a suitable weight for essential words in the question. The second feature, pre-trained word2vec, was used to boost the classification process. Then, the combination of these features was fed into three different classifiers; K-Nearest Neighbour, Logistic Regression, and Support Vector Machine, in order to classify the questions. The experiments used two datasets. The first dataset contained 141 questions, while the other dataset contained 600 questions. The classification result for the first dataset achieved an average of 71.1%, 82.3% and 83.7% weighted F1-measure respectively. The classification result for the second dataset achieved an average of 85.4%, 89.4% and 89.7% weighted F1-measure respectively. The finding from this study showed that the proposed method is significant in classifying questions from multiple domains based on Bloom's taxonomy.
    Matched MeSH terms: Educational Measurement*
  11. Tan K, Chong MC, Subramaniam P, Wong LP
    Nurse Educ Today, 2018 May;64:180-189.
    PMID: 29500999 DOI: 10.1016/j.nedt.2017.12.030
    BACKGROUND: Outcome Based Education (OBE) is a student-centered approach of curriculum design and teaching that emphasize on what learners should know, understand, demonstrate and how to adapt to life beyond formal education. However, no systematic review has been seen to explore the effectiveness of OBE in improving the competencies of nursing students.

    OBJECTIVE: To appraise and synthesize the best available evidence that examines the effectiveness of OBE approaches towards the competencies of nursing students.

    DESIGN: A systematic review of interventional experimental studies.

    DATA SOURCES: Eight online databases namely CINAHL, EBSCO, Science Direct, ProQuest, Web of Science, PubMed, EMBASE and SCOPUS were searched.

    REVIEW METHODS: Relevant studies were identified using combined approaches of electronic database search without geographical or language filters but were limited to articles published from 2006 to 2016, handsearching journals and visually scanning references from retrieved studies. Two reviewers independently conducted the quality appraisal of selected studies and data were extracted.

    RESULTS: Six interventional studies met the inclusion criteria. Two of the studies were rated as high methodological quality and four were rated as moderate. Studies were published between 2009 and 2016 and were mostly from Asian and Middle Eastern countries. Results showed that OBE approaches improves competency in knowledge acquisition in terms of higher final course grades and cognitive skills, improve clinical skills and nursing core competencies and higher behavioural skills score while performing clinical skills. Learners' satisfaction was also encouraging as reported in one of the studies. Only one study reported on the negative effect.

    CONCLUSIONS: Although OBE approaches does show encouraging effects towards improving competencies of nursing students, more robust experimental study design with larger sample sizes, evaluating other outcome measures such as other areas of competencies, students' satisfaction, and patient outcomes are needed.

    Matched MeSH terms: Educational Measurement/methods*
  12. Lin GSS, Tan WW, Hashim H, Foong CC
    BMC Oral Health, 2023 Jun 23;23(1):417.
    PMID: 37353763 DOI: 10.1186/s12903-023-03141-5
    BACKGROUND: Feedback is regarded as a key component of formative assessment and one of the elements with the greatest impact on students' academic learning. The present study aimed to evaluate and compare students' perceptions of the use of two feedback models, namely feedback sandwich and Ask-Tell-Ask (ATA), in teaching dental materials science courses.

    METHODS: All undergraduate second-year dental students were invited to participate in the dental materials science practical session and were randomly allocated into two groups: Group 1 (feedback) sandwich and Group 2 (ATA). The session began with the teacher giving a short briefing on the commonly used dental materials, followed by a short demonstration of the manipulation of those materials. Students were then allowed to mix and manipulate the materials, and teachers provided feedback accordingly. At the end of the session, 16 close-ended (five-point Likert scales) and an open-ended questionnaire were distributed to students to evaluate their perceptions of the feedback given. Internal reliability of the questionnaire items was evaluated using Cronbach's alpha. Mean feedback scores were analysed using an independent t-test with ANCOVA for controlling gender and ethnicity. Thematic analysis was used to code the qualitative data.

    RESULTS: Sixty-nine students participated in the present study with the majority being females (72.5%) and Chinese (79.7%). Cronbach's alpha analysis suggested removing three Likert-scale items, with the remaining 13 items being accepted. Generally, no significant difference was noted between the two groups (p = 0.197), but three items were found to be significant (p 

    Matched MeSH terms: Educational Measurement*
  13. Lin GSS, Tan WW, Foong CC
    Eur J Dent Educ, 2023 Nov;27(4):956-962.
    PMID: 36527313 DOI: 10.1111/eje.12887
    INTRODUCTION: Limited studies have been conducted on the use of a hybrid team-based learning (TBL) and case-based learning (CBL) approach in dental education. The present study aims to evaluate students' experience of the hybrid TBL-CBL in learning dental materials science subjects.

    METHODS: All second-year undergraduate Bachelor of Dental Surgery (BDS) students were invited to participate in a TBL-CBL session. These participants were randomly allocated to six different groups of 10-12 students, and the session was conducted by one lecturer as the facilitator. A 23-item questionnaire assessing four domains (perceptions of effectiveness, teacher, team interaction and learning environment) was administered at the end of the TBL-CBL session.

    RESULTS: The response rate was 91.9% (n = 68). Mean scores for the questionnaire items ranged from 4.13 to 4.60 suggesting a positive perception among the students towards the hybrid TBL-CBL approach. Regarding the open-response questions, students emphasised that the TBL-CBL session was effective for team interaction and group discussions. However, students wished to have a better venue for future sessions.

    CONCLUSION: Positive perceptions of the students encourage future educators to consider the use of TBL-CBL approach in teaching dental materials science and to avoid the reliance on standalone conventional lectures. Future research could consider examining its effects on students' academic achievement as well as the perspectives of teachers regarding its adoption in different dental specialities.

    Matched MeSH terms: Educational Measurement*
  14. Kwa SK, Sheikh Mohd Amin MM, Ng AC
    Malays Fam Physician, 2007;2(1):18-21.
    MyJurnal
    Questions on Key Features Problems (KFP) are an important component of the theory paper for Part 1 of the membership examination of the Academy of Family Physicians of Malaysia (MAFP) and the Fellowship for the Royal Australian College of General Practitioners (FRACGP).This paper will attempt to provide information on the format and marking scheme of KFP. Expected answers for some KFP cases will be discussed and common errors made by candidates highlighted with suggestions on how to avoid them.
    Matched MeSH terms: Educational Measurement
  15. Joong, Hiong Sim, Yang Faridah Abdul Aziz, Vijayananthan, Anushya, Azura Mansor, Vadivelu, Jamuna, Hamimah Hassan
    MyJurnal
    ntroduction: In the marking of objective structured clinical examination (OSCE), checklist scoring and global rating are two commonly used scoring systems. Objective: The purpose of this study was to examine correlations between checklist scores and global ratings for four OSCE stations of different station type. Method: Data for this study was obtained from the Final Year OSCE (n=185). Each station’s score sheet consisted of a detailed checklist of items examined. A global rating scale was also included for the examiner to indicate the global assessment for the station. Spearman’s rho correlation coefficients between checklist scores and global ratings were computed for four stations of different station type. For each station, correlations between checklist scores and global ratings were also checked across the three parallel circuits running concurrently and throughout the four rounds. Result: Spearman’s rho correlation coefficients (ρ) between checklist scores and global ratings for the four stations ranged between 0.62 to 0.88, at p
    Matched MeSH terms: Educational Measurement
  16. Sim SK, Myo N, Sohail M
    Med J Malaysia, 2023 Jan;78(1):61-67.
    PMID: 36715193
    INTRODUCTION: To evaluate the effectiveness of team-based self-directed learning (SDL) in the teaching of the undergraduate Year 5 surgical posting.

    MATERIALS AND METHODS: A quasi-experimental study was conducted to develop and administer a team-based SDL versus a conventional SDL to teach undergraduate surgical topics. One hundred and seventy-four medical students who underwent the Year 5 surgical posting were recruited. They were assigned to two groups receiving either the teambased SDL or the conventional SDL. Pre- and post-SDL assessments were conducted to determine students' understanding of selected surgical topics. A selfadministered questionnaire was used to collect student feedback on the team-based SDL.

    RESULTS: The team-based SDL group scored significantly higher than the conventional SDL group in the post-SDL assessment (74.70 ± 6.81 vs. 63.77 ± 4.18, t = -12.72, p < 0.01). The students agreed that the team-based SDL method facilitated their learning process.

    CONCLUSION: The study demonstrated that the use of a teambased SDL is an effective learning strategy for teaching the Year 5 surgical posting. This method encouraged peer discussion and promoted teamwork in completing task assignments to achieve the learning objectives.

    Matched MeSH terms: Educational Measurement
  17. Shoaib LA, Safii SH, Idris N, Hussin R, Sazali MAH
    BMC Med Educ, 2024 Jan 11;24(1):58.
    PMID: 38212703 DOI: 10.1186/s12909-023-05022-5
    BACKGROUND: Growing demand for student-centered learning (SCL) has been observed in higher education settings including dentistry. However, application of SCL in dental education is limited. Hence, this study aimed to facilitate SCL application in dentistry utilising a decision tree machine learning (ML) technique to map dental students' preferred learning styles (LS) with suitable instructional strategies (IS) as a promising approach to develop an IS recommender tool for dental students.

    METHODS: A total of 255 dental students in Universiti Malaya completed the modified Index of Learning Styles (m-ILS) questionnaire containing 44 items which classified them into their respective LS. The collected data, referred to as dataset, was used in a decision tree supervised learning to automate the mapping of students' learning styles with the most suitable IS. The accuracy of the ML-empowered IS recommender tool was then evaluated.

    RESULTS: The application of a decision tree model in the automation process of the mapping between LS (input) and IS (target output) was able to instantly generate the list of suitable instructional strategies for each dental student. The IS recommender tool demonstrated perfect precision and recall for overall model accuracy, suggesting a good sensitivity and specificity in mapping LS with IS.

    CONCLUSION: The decision tree ML empowered IS recommender tool was proven to be accurate at matching dental students' learning styles with the relevant instructional strategies. This tool provides a workable path to planning student-centered lessons or modules that potentially will enhance the learning experience of the students.

    Matched MeSH terms: Educational Measurement
  18. Rajiah K, Veettil SK, Kumar S
    Clin Teach, 2014 Dec;11(7):551-6.
    PMID: 25417986 DOI: 10.1111/tct.12213
    The evaluation of clinical skills and competencies is a high-stakes process carrying significant consequences for the candidate. Hence, it is mandatory to have a robust method to justify the pass score in order to maintain a valid and reliable objective structured clinical examination (OSCE). The aim was to trial the borderline approach using the two-domain global rating scale for standard setting in the OSCE.
    Matched MeSH terms: Educational Measurement*
  19. Lai NM
    Med Educ, 2009 May;43(5):479-80.
    PMID: 19344346 DOI: 10.1111/j.1365-2923.2009.03320.x
    Matched MeSH terms: Educational Measurement/methods*
Filters
Contact Us

Please provide feedback to Administrator (afdal@afpm.org.my)

External Links