Introduction: Clinical educators around the globe agreed that an optimal educational climate is a vital aspect for effective learning to take place. This study was conducted to evaluate the perceptions of graduates toward the quality of clinical education climate in USM medical school. Methods: A cross-sectional study was conducted on a cohort of USM medical graduates. Questionnaires were administered to the graduates to measure their perception on four aspects of clinical education climate that include structure of clinical rotation, clinical teaching and learning activities, quality of lecturers and end clinical rotation assessment across 13 clinical rotations. The graduates were requested to respond to seven-Likert scale ranging from 1(poor) to 7(excellent). Scores of equal to or more than 5 was considered as positive areas, scores of between 4 and 5 were considered as areas for improvement, and scores less than 4 were considered as areas of concern. Data analysis was performed using SPSS version 20. Results: A total of 105 (96.3%) graduates responded to the questionnaire. Results showed only the paediatric rotation obtained positive ratings on all areas of the clinical rotation structure. With regards to teaching and learning activities, the graduates scored most of the clinical rotations between 4 and 5. With regards to the quality of lecturers, most of the clinical rotations obtained score more than 5. Most of the areas related to the end-of-assessment of clinical rotation obtained score more than 5 except for the feedback adequacy, indicating inadequacy of feedback they received. Conclusion: USM medical graduates positively perceived the quality of lecturers during clinical training, however several areas of clinical education related to clinical rotation structure, clinical teaching and learning activities, and feedback practice were perceived by them as areas for improvement. Medical schools should introduce strategic measures to address the concerns raised by the graduates to ensure the best clinical learning experience are provided to the current and future medical students.
Introduction: Mentoring medical students is one of the essential responsibilities or missions of a medical school faculty. Objective: This study aimed to determine the perceptions of mentorship and mentoring practices among mentors using a convergent parallel method. Method: Quantitative data was collected by using an adopted validated self- administered questionnaire and analyzed using SPSS version 20. Qualitative data was done using one-to-one interview based on semi structured interview guide and analyzed using thematic analysis. Result: A total of 61 respondents participated in the quantitative survey. Approximately 75% of the respondents had 5 to 10 mentees, with majority rated themselves as satisfactory mentor. More than 60% of them met their mentees at least once every six months. Most respondents were friendly (86.9%) and frank to their mentees (68.9%) and were interested in their mentees’ professional development (95.1%). Phone calling (93.4%) and E-mail (95.1%) were preferred as modes of contact. Mentees were allowed to call their mentors anytime of the day (74.1%). Respondents preferred to counsel their mentees (80.3%) and would refer them for professional help whenever necessary (70.5%). For qualitative data, a total of 5 participants participated with themes emerged: concepts of mentoring, factors contributing to ineffective mentoring and ways to improve mentoring practices. Conclusion: The respondents had positive perceptions regarding their mentorship and practices. A more structured approach with clear mentoring guideline and proper training should be in place.
Objective: To determine the internal consistency and construct validity of the Adult Learning Inventory (AL-i) among first year medical students in a Malaysian medical school. Methods: Cross sectional study was done on 196 first year medical student in Universiti Sains Malaysia (USM). The Cronbach’s alpha reliability analysis, exploratory factor analysis and confirmatory factor analysis were applied to measure internal consistency and construct validity of the AL-i respectively. These analyses were done using Predictive Analytics SoftWare (PASW) version 18 and Analysis of Moment Structure (AMOS) version 19. Result: A total of 196 medical students responded to this study. Exploratory factor analysis showed that two potential constructs would be extracted from the inventory. The confirmatory factor analysis showed the two factor model with six items had a good fit with the latent constructs (X2 (df) = 25.63 (8), p = 0.048, RMR = 0.045, GFI = 0.974, AGFI = 0.933, NFI = 0.974, RFI = 0.951, IFI = 0.987, TLI = 0.975, CFI = 0.987, RMSEA = 0.07). Each domain of the final model of the AL-i has three items. The Cronbach’s alpha value of the AL-i was 0.72. The Cronbach’s alpha values of andragogy and pedagogy domains were 0.87 and 0.86 respectively. Composite Reliability and Average Variance Extracted values were more than 0.6 and 0.5 respectively indicating good construct reliability and adequate convergent validity. Conclusion: This study suggested that the two factor model with 6 items of the AL-i has a good fit and shown good psychometric values. It is a valid and reliability measurement to determine types of leaner among first year medical students.
Background: In order to achieve the desired performance of graduates a number of traditional evaluation exercises have been practiced to assess their competence as medical students. Many of these assessments are done in a controlled environment and mostly reflect on tests of competence than performance. Mini-CEX or direct observed procedural skills (DOPS) are the real performance-based assessment of clinical skills. Increased opportunity for observation and just-in-time feedback from the role model superiors produce a positive educational impact on students learning. This also provides trainees with formative assessment to monitor their learning objectives. However, to implement assessment strategies with Mini-CEX or DOPS needs to develop institution’s clear policy for a different teaching and learning culture of workplace based assessment. It also needs to develop user friendly rating form, checklist, elaboration of clinical competence and its attributes and procedural guidelines for practice. A precise role of these tools in the assessment of postgraduate program must be established before practicing them to evaluate and monitor trainee’s progress.
Objective: To determine DOPS for its acceptability and feasibility as a method of formative assessment of clinical skills in postgraduate program of Otolaryngology and Head-Neck Surgery.
Method: A total of 25 trainees were assessed for DOPS by 8 supervisors in this 12-weeks pilot study. A faculty development program for faculty members and trainees was run for DOPS. Trainees were advised to undertake at least one DOPS encounter out of 42 shortlisted procedures. Assessors were asked to mark trainees by completing a rating form using a checklist developed for each procedure. Trainees and assessors were asked to endorse their opinion on feasibility and acceptance of DOPS for practice of formative assessment in future. Data was analyzed to determine feasibility and acceptability of DOPS in assessment program. Result: Faculty development and trainees orientation in DOPS were found satisfactory for its acceptance and feasible for its practice. Trainees were mostly assessed in outpatient clinical setting. Majority reported higher rating of satisfaction by assessors and trainees. Among clinical skills higher rating was received in procedural skills performed by the senior trainees. Conclusion: DOPS was found feasible for practice of formative assessment of trainees in postgraduate program of Otolaryngology and Head-Neck Surgery in School of Medical Sciences (SMS) at Universiti Sains Malaysia (USM). It was well accepted by the trainees to help monitor their quality of procedural skills as self-directed learning.
Objective: To determine the construct validity, convergent validity, construct reliability and internal consistency of the Medical Student Stressor Questionnaire (MSSQ) among first-year medical students in Malaysia. Methods: A multicenter cross-sectional study was done on 375 medical students of four medical schools in Malaysia. The confirmatory factor analysis and reliability analysis were applied to measure construct validity, construct reliability and internal consistency of the MSSQ. These analyses were done using Predictive Analytics SoftWare (PASW) version 18 and Analysis of Moment Structure (AMOS) version 19. The Composite Reliability and Average Variance Extracted of the final constructs were calculated manually to determine construct reliability and convergent validity. Results: A total of 359 (95.7%) medical students responded to this study. The confirmatory factor analysis showed the six factor model with 20 items had a good fit with the latent constructs (X2 (df) = 258.02 (155), p < 0.001, RMR = 0.055, GFI = 0.933, AGFI = 0.910, NFI = 0.931, RFI = 0.916, IFI = 0.971, TLI = 0.965, CFI = 0.971, RMSEA = 0.043). The Cronbach’s alpha value of the MSSQ was 0.92. The Cronbach’s alpha values of the six constructs were more than 0.7. Composite Reliability and Average Variance Extracted values of the six constructs were more than 0.6 and 0.5 respectively indicating good construct reliability and adequate convergent validity. Conclusion: This study suggested that the six factor model with 20 items of the MSSQ had a good fit and shown good psychometric values. It is a valid and reliability measurement to identify stressors among medical students across institutions in Malaysia.
Background: The weekly held clinical pathologic case conference popularly known as CPC provides an effective and regular educational media of collaborative learning for inter-disciplinary exchange of knowledge among the faculty members of an institution. CPC has been routinely practiced for the last two decades in School of medical Sciences (SMS) at Universiti Sains Malaysia (USM). An hour session primarily involves a case presentation hiding the diagnosis followed by discussion on differential diagnosis and floor interaction on interesting clinical cases. It also gives an opportunity to new teaching staff in the institution to experience an in-house practice of presenting the clinical cases; witch can readily be reproduced as a case report for publication. An effort to follow the original format of CPC is comprehended as an essential outcome of this study to keep up the sanctity of CPC as a case method of learning medicine in future. Methodology: A questionnaire-based survey was recently conducted to evaluate the weekly held CPC in SMS. It was a cross sectional survey in which a questionnaire comprising of 23 items was administered to a targeted population of faculty members of School of Medical Sciences. The items in questionnaire were grouped into 5 clusters. All respondents were adequately briefed through a letter addressing the objectives and importance of survey and its appraisal aiming to revamp the CPC guided by the out-come of study. Questionnaires were administered to 240 academic staff, covering > 80% of the target population of 294 faculty members. 159 (66.2%) members of sample population completed the questionnaires. Total non-responses were 81 (33.7%) and item non-responses were 320 (8.7%) Result: All the items in questionnaire were found significant (p 0.016) except those two items related to, observing a difference in preparing for a case presentation verses a formal CPC presentation and its promotion (p 0.556 and 0.197 respectively). It was also established that the major respondents were unaware of the original format of CPC (p 0.003) in which a presenter select and prepares a case, which is discussed with participating faculty members for its differential diagnoses. 51.6% faculty members did not follow the formal CPC format (p 0.016) in their presentations. A lack of awareness about the format of CPC was shown by (61.0%) faculty members (p 0.003). Conclusion : It was concluded that emphasis to discuss the differential diagnosis by a competent discussant was lacking, as presenters did not follow the formal CPC format. It was critically observed that a number of presentations made in this weekly program deviate from the original format adapted by SMS in USM. However, the out-come appraisal of this survey was the pledge shown by the majority faculty members to adapt the guidelines as a reverence to the formal CPC format.
Objective: To determine the internal consistency and construct validity of the Learning Approach Inventory (LA-i) among first year medical students in a Malaysian medical school. Methods: Cross sectional study was done on 196 first year medical students in Universiti Sains Malaysia (USM). The items of the LA-i were framed based on characteristics of three learning approaches. The Cronbach’s alpha reliability analysis, exploratory factor analysis and confirmatory factor analysis were applied to measure internal consistency and construct validity. These analyses were done using Predictive Analytics SoftWare (PASW) version 18 and Analysis of Moment Structure (AMOS) version 19. The Composite Reliability (CR) and Average Variance Extracted (AVE) were calculated manually to measure construct reliability and convergent validity. Result: A total of 196 medical students responded to this study. Exploratory factor analysis showed that three potential constructs were extracted from the inventory. The confirmatory factor analysis showed the three factor model with nine items had a good fit with the latent constructs (X2(df) = 26.07 (20), p = 0.163, RMR = 0.04, GFI = 0.969, AGFI = 0.93, NFI = 0.967, RFI = 0.941, IFI = 0.992, TLI = 0.985, CFI = 0.992, RMSEA = 0.04). Each domain of the final model of the LA-i has three items. The Cronbach’s alpha value of the AL-i was 0.86. The Cronbach’s alpha values of surface, strategic and deep approach domains were 0.62, 0.73 and 0.88 respectively. Most of learning approach domains had Composite Reliability and Average Variance Extracted values were more than 0.6 and 0.5 respectively indicating good construct reliability and adequate convergent validity. Conclusion: This study suggested that the three factor model with 9-items of the LA-i has a good fit and shown good psychometric values. It is a valid and reliability measurement to determine learning approaches among first year medical students.
Background: Faculty’s role as educators is over looked in clinical education, even though the teaching has a direct reflection of performance of clinical competence and professional development of graduating doctors. Two major problems of clinical education are the lack of uniform teaching and learning strategies in postgraduate as well as later years of undergraduate clinical teaching and the professional development of faculty in teaching in medical institutions. Objective: The survey has two major objectives. First objective was to know about the faculty response to a survey on teaching while trying to create awareness for teaching and research in teaching. The second objective was to know the faculty members’ understanding with principles of learning and teaching with strengths and weaknesses of respondents’ performance in clinical teaching on completing The Educator’s Self-Reflective Inventory (ESRI). Method: The ESRI was administered to approach 214 faculty members in SMS at USM. Appraisal of self-reflection inventory as medical teacher and personal development with respect to challenges, opportunities, innovations and need assessment of teaching were explored in response to 35 items grouped in 5 clusters through a questionnaire-based survey utilizing ESRI. Result: Statistical analysis of respondent’s data indicates a mixed response with lab-based disciplines 54.54% followed by surgical-based disciplines 50% and medical-based disciplines 30%. Individual discipline best response is received from Plastic Surgery and ORL-HNS (100%) and Hematology (77.77%). A result of individual item response in each cluster WAS also analyzed. Conclusion: The survey evaluated the faculty’s response to ESRI and concern shown to develop their abilities as teachers and researchers in clinical teaching. However, the initial response suggested the need for more survey to continue creating the awareness for faculty development and research in teaching. Conclusion drawn from analysis of each items in inventory is encouraging for teaching in medical education.
Background: Tertiary education environment has always been regarded as highly stressful to students. Medical training further adds to the already stressful environment. The stress of medical training was associated with negative consequences to the mental and physical health of medical students. We describe in this article a stress-management program known as the 'Medical Student Well-Being Workshop' in our medical school.
Methodology: The workshop was run over two half-days over a weekend. Prior to the workshop the society announced the workshop to the students and participation was voluntary. It was open to students from all years of the medical course except for first year students. A separate stress management workshop is planned for them.
Results: A total of 55 students participated in the workshop, out of which 55 (82%) were female students. The years of study were almost equally represented; 14 students (26%) from years two and three, 20 (37%) from year four and 6 (11%) from year five. All sessions were rated as highly useful; the lowest rated, the introduction session, obtained an overall usefulness rating of 3.73 out of the possible 5 (74.6%).
Conclusion: Medical Students Well-being Workshop is a promising intervention program in improving medical students' ability in managing stress. Perhaps similar approach can be considered relevant to be incorporated in other medical schools.
Objective: BigSib Students' Peer-Group Mentoring Programme was implemented as an innovative, interactive and integrated instructional method in the Universiti Sains Malaysia medical school curriculum designed to enhance and strengthen medical students training in soft skills and professional development. This study was conducted to evaluate first- and second-year medical students’ perceptions of and attitudes towards the Programme.
Methodology: A cross sectional study was carried on 314 medical students. Questionnaires assessing medical students' perceptions and attitudes towards the Programme were administered. Data were analysed by using SPSS version 12.
Results: 45.9 % of the students perceived the BigSib Students' Peer-Group Mentoring Programme as successful. More than 50% of the students are willing to participate in the Programme. About 60% of the students perceived it as an effective Programme in developing their soft skills and professionalism.
Conclusion: Medical students have positive attitudes toward the Programme and it is perceived as a successful and effective Programme in developing students' personal attributes. Similar peer-group mentoring programme may be considered relevant to be incorporated into the medical curriculum in the future.
Background: One of important educational climate roles is to provide an environment that promotes positive development of medical students' psychological wellbeing during training. Unfortunately, many studies have reported that educational climate in medical education are not favourable to them. Therefore, it is a real need for a simple, valid, reliable and stable tool that will help medical schools to screen psychological wellbeing of their students so that early intervention could be done.
Objective: This study aimed to explore the psychometric properties of the Medical Student Wellbeing Index (MSWBI) to measure psychological wellbeing at different interval of measurements in a cohort of medical students.
Method: A prospective study was done on a cohort of medical students. MSWBI was administered to the medical students at five different intervals. The confirmatory factor analysis, Cronbach's alpha and intra-class correlation analysis were applied to measure construct validity, internal consistency and agreement level at different interval of measurements.
Result: A total of 153 (89.5%) medical students responded completely to the MSWBI. The MSWBI showed that the one-factor model had acceptable values for most of the goodness of fit indices signified its construct was stable across multiple measurements. The overall Cronbach's alpha values for the MSWBI at the five measurements ranged between 0.69 and 0.78. The ICC coefficient values for the MSWBI total score was 0.58 to 0.59.
Conclusion: This study found that the MSWBI had stable psychometric properties as a screening tool for measuring psychological wellbeing among medical students at different time and occasions. Continued research is required to refine and verify its psychometric credentials at different educational settings.
Introduction: Various studies had been done on medical students stress, but there is yet no comparative study done between universities in Asia and Europe. Universiti Sains Malaysia (USM) and Universiteit Maastricht (UM) share a lot in common in terms of medical education as both actively apply PBL-oriented education into their curriculum. It will be interesting to find out the effect of differing culture, one Eastern and another Western, on the prevalence of stress and stressors among medical students of both universities.
Method: A comparative study was conducted on medical students from USM and UM. Psychological distress was measured by the 12 item General Health Questionnaire and stressors were measured by the 40 item Medical Student Stressor Questionnaire. The calculated sample size was 215 per university. The collected data was analyzed using Statistical Package for Social Sciences (SPSS) version 20.
Result: Results showed that the overall prevalence of psychological distress among medical students of USM and UM was 25.9% and no significant difference was found between the two universities. Binary logistic regression test showed that medical students in pre-clinical phase were 1.84 times more likely to develop psychological distress than medical students in clinical phases (B = 0.612, odd ratio (CI95%) = 1.84 (1.16, 2.93), p = 0.010). The major stressors were related to academic requirements, UM medical students perceived the stressors as causing less stress than USM medical students (t-stat (df) = 5.33 (380), p-value < 0.001).
Conclusion: Psychological health among medical students in the two universities was comparable. Academic requirements were the most stressful events as perceived by the students, but UM medical students had more positive perception toward the stressors than USM medical students. Pre-clinical students experienced higher psychological pressures than the clinical students. The medical schools should provide more attention to pre-clinical students because they might need psychological support from them.
Context: Community-based medical education (CBME) has become widely accepted as an important innovation in undergraduate medical education. In curriculum featuring CBME, students are acquainted with the community early in their studies however; the impact of this training can be judged best to see them practice the required aspects of CBME. Malaysia is a multiracial country with a very strong community dependant life style. Main national health problems have called for a change in health profession education from traditional hospital based health care to community-based delivery system. Three major university's medical schools that either practice community oriented or community based medical education in undergraduate medical curriculum are evaluated. Universiti Sains Malaysia (USM) has a community based medical education (CBME) curriculum as Community and Family Case Study (CFCS) compared to a community oriented education curriculum (COE) adopted by Universiti Malaya (UM) and Universiti Kebangsaan Malaysia (UKM). However, UM at the time of undertaking this study back in 2005 was though practicing COE has also later opted CBME as CFCS.
Objective: To determine whether medical graduates from USM with a community-based medical education in its curriculum for more than 25 years are inspired to have stronger commitment towards community health as shown in their on-job practice of medicine compared to other graduates from UM and UKM, who have adopted community-oriented medical education program.
Method: A questionnaire-based pilot study with 12 items (variables) was designed to obtain supervisor's opinion on commitment of interns towards the health of community they serve. The questionnaire was administered to a randomized group of 85 specialists supervising the internship training program in five major disciplines including internal medicine, surgery, orthopaedic, gynaecology and obstetrics and paediatric medicine. The data received from 62 respondents from five major disciplines was analyzed utilizing SPSS version 12.0.1.
Result: The responses received from 62 supervisors on an inventory in which 9 out of 12 variables were directly related to community commitments of interns. It was shown that the USM graduates who were taught through a CBME curriculum have performed better than the graduates from UM and UKM who followed a COE curriculum. P-value (< 0.001) was highly significant and consistent with higher mean score in those variables.
Conclusion: The graduates taught through a CBME curriculum performed better in community commitments towards patients care compared to graduates from COE curriculum.
This paper presents observation made during a brief observation of the PBL programme at School of Medical Sciences (SMS), Universiti Sains Malaysia (USM). It provides a classification for the type of PBL offered at USM highlights the main aspects of the tutorial process there and reviews the experience of students and tutors engaged in PBL at this SMS. The paper proposes a series of recommendations with regards to the planned 2014 curricular reform.
Several studies reveal high rates of alcohol use among college students affecting their health and performances. This cross-sectional survey was done to study medical students' drinking pattern, its predictors and to develop any possible link between their academic performance and alcohol consumption. Data was collected using newly designed, validated questionnaire from students (n= 348) who consumed and not consumed alcohol. The response rate was 60% (209/348). 94% of drinkers started consuming alcohol before entering into the medical school. Most of them (85%) drank with parents' awareness. Among drinkers, 63% were of Chinese race and 35% of Indian race. None of the Malay respondents reported of drinking. 63% of drinkers and 23% of non-drinkers reported that most of their friends consumed alcohol. Drinking was not associated with smoking or drug abuse. There were no statistically significant differences in exam scores between drinkers and nondrinkers. Non-drinkers considered religious and moral obligations for not consuming alcohol. In conclusion, at our Institute, students did not allow their alcohol use to interfere with their academic performance. The drinking habit developed during school time is more likely to continue during college years. Those who have non-drinking friends are more likely not to consume alcohol themselves. Moral and religious obligations have positive impact on alcohol intake.
Introduction: There is lacking of evidence available in literatures on faking good in personality and emotional intelligent (EI) tests among medical school applicants. Thus more research is required to address the faking good issues in medical context specifically related to student admission. Objective: This study aimed to estimate the prevalence of faking good in personality and EI tests during a high stake situation which was during student selection process. Method: A one-year prospective study was carried out on a cohort of medical school applicants. Data collection was carried out at five different intervals; one measurement at pre-selection (Time 1) and four measurements at post-selection (Time 2 to Time 5). The USMaP-i and USMEQ-i were used to measure personality and EI. Faking good was positive if the scores at Time 1 beyond the 95% CI of average scores of Time 2 to Time 5.Result: The highest prevalence of faking good among personality traits was in conscientiousness (83.1%) and the lowest was in openness (74.1%). The highest prevalence of faking good among EI constructs was in emotional conscientiousness (77%) and the lowest was in emotional awareness (51.7%). About 1.7% of applicants were not faking good at any of the personality dimensions while 11.5% of them were not faking good at any of the EI constructs. About 47.4% faked good at all the personality dimensions and 33.9% faked good at all the EI constructs. Conclusion: The prevalence of faking good in the self-reporting personality and EI tests was high. Certain personality traits and EI constructs were more susceptible to faking good. The personality test was more susceptible to faking good than the EI test. Considering the potential positive impacts of personality and EI on individual performance, alternative ways should be designed to address the faking good issues.
Introduction: Medical and allied health educators around the globe agreed that an optimal educational climate is a vital aspect for effective learning to take place. Without a doubt, appraisal of the educational climate has been emphasized as a key to the delivery of high quality medical education. In addition, the appraisal provides useful feedback to particular institution to improve their curriculum.
Objective: This study was employed as part of the School of Medical Sciences (SMS) Universiti Sains Malaysia curriculum review process. It aimed to explore the strengths and weaknesses of the current medical curriculum thus could provide useful information to guide the curriculum review committee during the review process.
Method: A cross sectional study was conducted on a total of 656 medical students from the first, third and fifth year of study. Purposive sampling method was applied. DREEM was administered to the medical students to evaluate the educational climate in the studied medical school.
Result: A total of 511 (77.9%) medical students completely responded to the 50 statements of DREEM. The mean global score across phases of medical training was 128.36/200. The global scores for year 1, year 3 and year 5 were 138.94/200, 122.27/200 and 125.49/200 respectively. Results showed that; 1) the medical school had reasonably level of educational climates across phases of medical training; 2) the medical teachers were knowledgeable and well prepared for the teaching; 3) the students were overloaded with factual knowledge; 4) the medical teachers were quite harsh to students during teaching session especially in clinical phase; 5) students experienced a significant amount of stress that led to poor memory; 6) the learning process was inclined toward teacher-centered rather than student-centered learning; 7) students had a considerable healthy social relationships with peers as well as others; and 8) academic dishonesty became more apparent in the clinical phase.
Conclusion: The medical school's educational environment across different phases of study was more positive than negative. However, there are plenty of rooms for improvement as perceived by the medical students. The medical school should address various important issues highlighted in this article during the curriculum review process.
Introduction: A clear concept and understanding about the measure and the measuring tools is essential for good practice of assessment. Assessors need to have information about the full range of assessment tools inclusive of psychometric validity and purpose of its use. Subjective inferences drawn from the readily available data as numbers of summative scores over the years and statistical evidences of reliability and validity of assessment tools used to measure student’s performance are good sources of feedback for competent assessment program. It also provides meaningful evaluation of learning and teaching in medical education. Method: A retrospective study of 119 candidates was carried out to analyze the summative assessment scores of their certifying examination of Masters of Surgery in School of Medical Sciences (SMS) at Universiti Sains Malaysia. Subjective judgment of raw data followed by internal consistency as reliability, convergent validity and discriminant validity as constructs of individual assessment tool was analyzed. Finally each assessment tool as a measure of written or clinical construct was evaluated against six aspects of Messick’s criteria for quality control. Result: The correlation coefficient for validity and Cronbach’s alpha for reliability was evaluated for clinical measures. However, the test of internal reliability was not possible for essay being the only measure in written construct of summative assessment in surgery. All measures of clinical construct were found highly reliable with Cronbach’s alpha between 0.962-0.979. Long case and the short cases have shown excellent correlations (r=0.959 at p
Teaching stress management skills for medical students has been echoed as an important educational component in medical education. Discussions about approaches to teaching stress management in medical education context are largely unexplored despite of a large number of articles have emphasized on its importance. This paper describes four elements in a framework as an approach to teaching stress management skills in medical education. As one moves through the framework, it provides a greater degree of insight on stress management ability as is acquired through one's awareness, experience and conscious effort that allow stressful situations to be handled effectively and efficiently. It may provide a useful educational framework for medical teachers to teach and assess stress management skills of medical students. It also may be used as an aid in planning, implementing and evaluating stress management programs in medical schools. The authors discuss about the implications of this framework for future research in medical education.
Context: Question vetting is important to ensure validity, reliability, and other quality indicators of assessment tools, including the MCQ. Faculty members invest a substantial amount of time and effort into the MCQ vetting process. However, there is shortage of scientific evidence showing its effectiveness and at which level it needs to be focused on. This study aimed to provide scientific evidence regarding the effects of question vetting process on students’ examination performance by looking at their scores and pass-fail outcomes.
Method: A parallel randomized control trial was conducted on third year medical students in a medical school. They were randomly assigned into two equal groups (i.e. control and experimental). Two mock examinations were conducted (i.e. time I and time II). At time I, non-vetted MCQs were administered to both groups as a baseline measurement. At time II, vetted MCQs were administered to the experimental group, while the same non-vetted MCQs were administered to the control group.
Results: Out of 203 students, 129 (63.5%) participated in both mock examinations. 65 students were in the control group and 64 students were in the experimental group. Statistical analysis showed no significant differences (p > 0.05) in mean examination scores and pass-fail outcomes between or within the control and experimental groups.
Conclusion: This study indicated that the MCQ vetting process did not influence examination performance. Despite these findings, the MCQ vetting process should still be considered an important activity to ensure that test items are developed at the highest quality and standards. However, it can be suggested that such activity can be done at the departmental level rather than at the central level.