A study on the quality of University Question Papers in lines with Bloom’s Taxonomy

A study on the quality of University Question Papers in lines with Bloom’s Taxonomy

The quality of an education system to a greater extent depends on the standard of its assessment practices. When the standards of assessments are poised at a higher level of learning, then obviously the curriculum and the learning experience should keep in pace with the level of evaluation standards. Hence it is truly said that assessment is an engine that drives the students’ learning.

One of the common recommendations by several committees on examination reform do insist that the Higher order thinking skills of the scholars need to be tested especially at higher education level. In this context it seems more relevant to conduct a study on to what extent the Indian University and Higher Education systems endorse this policy. 

St. Philomena’s (Autonomous) College, Mysore in collaboration with ipsr solutions limited had conducted a National Level FDP program on Outcome Based Education. More than 1000 teachers participated from almost all states of India. One of the sessions was on Bloom’s Taxonomy and the teachers have submitted an activity named – Question paper analysis intended to analyze one of the previous year’s University question papers in their subject in line with the cognitive domain of Bloom’s Taxonomy.

A sample of 220 reports of analysis from various teachers of different states were randomly selected and analysed. The major observation of the Analysis is given below:

1. It is observed that an average of 77% of the questions are from Lower Order Thinking Skills (LOTS). While the Higher Order Thinking Skills (HOTS) like Analytical, Evaluation type and creating type questions are much less.

2. It is further observed that when considering the average number of questions from various level of bloom’s taxonomy maximum number of questions are from conceptual level and remembering level, that is 59.2% of the questions are direct and of very lower order as per Bloom’s Taxonomy.

3. It is found that 30.3% of the questions on an average is testing the student’s learning in application of the concepts in relevant situations and their ability to analyze a situation and identify the relationship between various components involved in the situation.

4. It is also observed that an average of 3% questions are from create level which are normally from arts related discipline.

5. Considering the average weightage of marks related to various levels of learning it is observed that 69% of marks are related to Lower Order Thinking skill (LOTS) questions.

7. It is noted that 7.27% of questions papers analysed do not have any question from remembering level. 69.09% of the question paper has less than 25% questions from the remembering level.

8. 22.7 % of the question paper is having more than 50% of questions from understanding level, while 46.82% of the question paper is having less than 25% of questions from understanding level. Also less than 1% of the question paper is not having any questions from understanding level.

9. 17.73% of the question papers do not have any questions from application level and 20.45% of question papers do not have any questions from analytical level.

10. Only 3.18% percent of the question paper is having more than 50% of questions from application level and less than 1% of the question paper is having more than 50% of analytical level questions.

11. 79.1% of question papers have only less than 25% of questions from application level and 78.63% of question papers have only less than 25% of analytical level questions.

12. 42.73% of question papers do not have any questions from evaluation level and 67.73% of question paper do not have any create level questions

13. It is also noted that 0.91% of question papers are having create level questions in a range of 25% to 50%.

Link to detailed analysis

Rinta Merin Sony

Student, Data Analytics and Machine Learning, ipsr solutions limited

Dr. Sunil Job K. A​

A highly-esteemed resource person in Outcome-Based Education (OBE), Blooms Taxonomy, Data Analytics and Visualization, Machine Learning, and Research Methodology, Dr. Sunil Job has 25+ years of teaching experience and 10+ years of corporate consultancy experience. He holds a PhD in Mathematical Education and has been an Associate Professor at M.G. University, College of Teacher Education. He has served as the Chief Examiner of Valuation Board of M.G. University B.Ed Program, Visiting Team Member of NCTE for grant of recognition and as a resource person for affiliation renewal committee of M.G. University. An active blogger in cutting edge technologies in IT, Education and Data Science, Dr. Job has published articles in National Journals and authored a few academic books and a reference manual in mathematics.

Dr. Mendus Jacob

A prominent Academician and an Entrepreneur with 30+ years of experience. He is also the Director of MCA Programme at Marian College, Kuttikkanam (Autonomous). Former Director of School of Applicable Mathematics, M.G. University. Research Guide of Lincoln University. Member of Academic and Administrative bodies of Autonomous Colleges, Engineering Colleges and Business Schools. He is a Ph.D. in Operations Research and has to his credit a number of National and International publications. He has served as resource person for many National & International Seminars & Conferences in Mathematics, Management and Computer Applications. He has organised, conducted and served as resource person for a number of Faculty Development Programmes including UGC sponsored Refresher Courses. His areas of interests are Outcome Based Education, Accreditations, New Educational Policy etc.