Item and test analysis to identify quality multiple choice questions (MCQS) from an assessment of medical students of Ahmedabad, Gujarat
Open Access
- 1 January 2014
- journal article
- research article
- Published by Medknow in Indian Journal of Community Medicine
- Vol. 39 (1), 17-20
- https://doi.org/10.4103/0970-0218.126347
Abstract
Background: Multiple choice questions (MCQs) are frequently used to assess students in different educational streams for their objectivity and wide reach of coverage in less time. However, the MCQs to be used must be of quality which depends upon its difficulty index (DIF I), discrimination index (DI) and distracter efficiency (DE). Objective: To evaluate MCQs or items and develop a pool of valid items by assessing with DIF I, DI and DE and also to revise/ store or discard items based on obtained results. Settings: Study was conducted in a medical school of Ahmedabad. Materials and Methods: An internal examination in Community Medicine was conducted after 40 hours teaching during 1 st MBBS which was attended by 148 out of 150 students. Total 50 MCQs or items and 150 distractors were analyzed. Statistical Analysis: Data was entered and analyzed in MS Excel 2007 and simple proportions, mean, standard deviations, coefficient of variation were calculated and unpaired t test was applied. Results: Out of 50 items, 24 had "good to excellent" DIF I (31 - 60%) and 15 had "good to excellent" DI (> 0.25). Mean DE was 88.6% considered as ideal/ acceptable and non functional distractors (NFD) were only 11.4%. Mean DI was 0.14. Poor DI (< 0.15) with negative DI in 10 items indicates poor preparedness of students and some issues with framing of at least some of the MCQs. Increased proportion of NFDs (incorrect alternatives selected by < 5% students) in an item decrease DE and makes it easier. There were 15 items with 17 NFDs, while rest items did not have any NFD with mean DE of 100%. Conclusion: Study emphasizes the selection of quality MCQs which truly assess the knowledge and are able to differentiate the students of different abilities in correct manner.Keywords
This publication has 6 references indexed in Scilit:
- Analysis of One-Best MCQs: the Difficulty Index, Discrimination Index and Distractor Efficiency2012
- An assessment of functioning and non-functioning distractors in multiple-choice questions: a descriptive analysisBMC Medical Education, 2009
- A tool for self-assessment of communication skills and professionalism in residentsBMC Medical Education, 2009
- Chapter-12 Test and Item AnalysisPublished by Jaypee Brothers Medical Publishing ,2009
- Relationship Between Item Difficulty and Discrimination Indices in True/False-Type Multiple Choice Questions of a Para-clinical Multidisciplinary PaperAnnals of the Academy of Medicine, Singapore, 2006
- Item analysis of published MCQs.1998