Rubrics: A Criterion-referenced Evaluation Manual for Enhancing Objectivity

usage of evaluation rubrics will become mandatory in the education system.

Rubrics: A Criterion-referenced Evaluation Manual for Enhancing Objectivity

Feb-18-2021, Articles

“Assessment is like an engine that drives students learning”. In this context, it is important that the engine should be flawless and perfectly tuned to a certain level of standards. A simple anecdote to depict the significance of the consolidation and tuning of the assessment tool is narrated here. 

“Once three persons were assigned a task to value the worth of a tree. The first person valued that the tree is highly beneficial for it is a high yielding fruit tree. The second person was much moved by its lush and beautiful overgrowth; he valued it based on how it contributes to the serenity and natural ambience of the environment around. The third person with a materialistic eye was more attracted about the size of the trunk, which is about one meter in diameter, he estimates that it could be a good deal in the timber market”. All these three persons are right from their perspectives, moreover, they will never converge to a unique opinion. Hence consolidation of significant criteria relevant to the scenario and elimination of biasedness in the estimation process is an essential characteristic of a good evaluation system. Especially if the evaluation is about a performance-based activity then a set of exclusive traits or criteria should be formulated, this could be made possible by using an evaluation Rubrics.

Structure of Rubrics

A rubric is an evaluation manual used for scoring the students’ response, based on the expectation of quality around a task. A rubric includes three components:

  1. the criteria to which evaluation to be made 
  2. the scale of assessment of the criteria
  3. the qualitative statements corresponding to each criterion (descriptors). 

Rubrics  Task Descriptions

Here, a rubric will help to identify how well the students have met the criteria corresponding to the learning outcome than their respective position with respect to their peers. Thus, for an objective estimation of student’s performance using assessments tools like assignments, projects, seminars, portfolios, exams etc. it would be ideal to prepare evaluation Rubrics, based on the criteria that are significant.

Types of Rubrics

Based on the type of scales adopted in the rubrics we could classify the rubrics as Checklist, Holistic rubrics and Analytic Rubrics. If we adopt a dichotomous scale like “yes or no”, “criteria met or not met” we call it as a Check List. This type of rubrics is easy to use and it will only ensure the presence of the trait or criteria. It does not give any information about the level of performance related to the criteria.

In both holistic rubrics and analytic rubrics, Likert rating scale is used to mark the level of performance of the students. The holistic rubrics is modelled in such a way that it does not differentiate the various criteria of performance, instead assigns a single score based on an overall assessment of the students work. Analytic rubric digs deep into criteria-level to project the criteria wise judgement of the student’s work. However, the score assigned to each level of performance is an ordinal scale of measurement.

Preparation of Rubrics

Preparation of an evaluation rubrics creates clarity of focus on the assessment process and outcomes among the assessors. This will directly influence the teachers in generating the right environment for learning appropriate for the learning outcomes. It is also a good practice to share the rubrics to the students so that they remain focused on their learning process. The development of rubrics requires a deep insight into the curricular structure and the nature of activity or tools for which rubrics are developed. The sequential steps in the construction of a rubrics are detailed here.

The first stage is the review of the learning outcomes by breaking down the outcomes into component outcomes and connect it to the activities or tools for which the evaluation rubrics are developed.

The next stage is to identify the set of criteria related to the activity that addresses the component outcome under consideration.

The third stage is to develop quality statements for each criterion. These statements should be specific, observable and measurable descriptors which characteristics the expectation at each level of performance.

The fourth stage is to arrange the criteria and scale of measurement with the appropriate qualifying statement in a tabular grid. The fifth stage will be to assign a numerical score to each level of performance.

The next phase is to ensure the fairness of the rubrics with expert opinion from resource persons and by using it to evaluate the previous students’ performance. It is also a good practice to share the rubrics to the students before they involve in the assigned activity that will be assessed.

Rubrics Task description2

In an OBE enabled evaluation plan, the evaluation rubrics must be integrated with the outcomes – at both course level and the program level with which the activities correlate. For this, each criterion must be mapped onto the corresponding outcomes that each criterion addresses. Also, the mapping strength should be recorded in terms of high, moderate or low.  This should be mentioned in a score pattern which ranges from 3 to 1. It should be presented as a matrix extension grid of various criteria to outcomes at the course level and program level as shown in the figure.

Rubrics Task description3

The weighted average of the attainment scores converted into a three-point scale will contribute to the score of outcome attainment with respect to the activity. These attainments could be cumulated to the Program matrix table or the course matrix table for computation of the respective course outcome or program outcome.

Development of an appropriate analytic rubrics is a skill which needs a certain level of expertise. However, there are few customizable templates available online, for easier creation of rubrics. Beginners who are not familiar with rubrics-making can work with such templates to enhance the competency level so that in further stages they could build better rubrics independently as per the requirements.

Conclusion

In the milieu of the new educational policy 2020, revolutionary changes are happening in the higher education system towards enhancement of quality and transformation of India to a knowledge superpower. One major focus of the transformation is the change of the education system from input-based to output-based. Consequently, there is a change in the curricular level activities from a lower-order learning process to a higher-order learning process.

In such a situation, for assessments of Higher Order Thinking Skills (HOTS), we cannot completely rely on a paper-pencil summative test. To ensure authenticity in student-level assessment, we must incorporate multi-level performance-based activities and projects. Obviously, the usage of evaluation rubrics will become mandatory in the education system. Clearly, a rubric enabled assessment scheme will safeguard objectivity and validity of the evaluation process, based on set criteria and outcomes.

 

ipsr solutions ltd.

Leave a Reply

Your email address will not be published. Required fields are marked *

Get Free Email Updates!

Join us for FREE to get instant email updates!

Your Information is Safe With us!

Articles

Highlights of National Education Policy 2020 (NEP)

National Education Policy 2020 (NEP) has marked an epoch development in the educational landscape of India. The policy envisions an India centred education system compatible to transform India to a vibrant knowledge society. Remarkably, the thrust area of the new education policy is to make the system of education well-resourced and multidisciplinary by the consolidation […]

How to Conduct Academic and Administrative Audit (AAA) – Templates Included

The NAAC expects the institutions to undertake AAA to monitor and evaluate the institutional process through systematic internal and external reviews. In order to introduce academic reforms, review their progress and support reforms in the respective Higher Education Institutions (HEIs), it was necessary to implement Academic and Administrative Audit (AAA). The Academic and Administrative Audit […]

Assessment Practices and Question Banks

Assessment and Evaluation are the processes which are integrated into the teaching at both interactive and post-active phases. An Achievement Test is one of the most commonly used summative assessment tools. Question Bank is a Best Practice for the generation of a good Achievement Test.

Active Learning: Understand the Keys to Learning and Apply in Teaching

To learn something well, students should be able to hear it, see it, do it, ask questions about it and to discuss it with others.

Fight COVID 19 – Keep Distance and Avail Distance Learning

A collection of Online resources to assist Distance Learning, during the COVID 19 lockdown.

FAQ on OBE

Some of the Frequently Asked Questions about Outcome Based Education, answered by experts in our mentor panel.

Indian Higher Education in synergy with International Standards

A quick glimpse into government policies in the Indian higher education scenario after the Independence and the major changes that include autonomy and outcome based learning that evolved from these to create standards of excellence.

White paper on Outcome-Based Education (OBE)

IPSR AcademiX Whitepaper on OBE: Designing and Implementing Outcome Based Education (OBE) for Indian HEIs

Bloom’s Taxonomy? A Video Primer for Indian Educators – Part 1

A Video Primer on the Cognitive domain of Bloom's Taxonomy, by Dr. Sunil Job. Gain a basic understanding of Bloom's scientific classification of knowledge levels.

Copyright @ 2021 Copyright ipsr solutions ltd ipsr solutions ltd. All rights reserved