Loading...

Testing On Third-Party Learning Assessments: Objectives and Challenges

“Ek glass dudh to pi li jiye madam”, one of the teachers at the Government Higher Primary School in Mehdinagar, Ramanagar, insisted. There is not a government school visit in memory where I have not been offered tea, coffee, fruits, the midday meal, or a combination of all the above. I am sure that fellow associates working with schools across India will say the same. The warmth and welcome offered to any guest at an Indian home can be found in our schools, with the bonus of five or six smiling and eager faces wondering what you are up to.

A few weeks ago, when I was offered the glass of milk, our team was on the annual run to conduct what we call ‘baseline’ tests for students of grades 4, 5, 6 and 7. These MCQ-based tests in English, Math, and Science, will help us measure the grade appropriate abilities of students in classrooms where we will soon introduce methods of experiential teaching and learning. This series of tests – the ‘baseline’ test, and around four months later, an ‘endline’ test – offer us the chance to compare students’ abilities before and after teachers have been acquainted experiential learning pedagogies. This comparison is crucial to assess whether our initiatives in supporting teachers explore novel and relevant classroom practices work well. Moreover, the results, when presented to teachers and headteachers, exhibit the need for improvement in student learning outcomes. Another annual assessment for which Caring with Colour (CWC) aids the Tumukuru and Ramanagara District Institutes of Education and Training (DIETs) is the District Student Achievement Survey (DSAS), whose results are shared with the clusters and schools in each district.

Image 1. A teacher invigilates an assessment in a classroom.

Third party-assessments such as ours are not new in India – tests on a much larger scale such as the National Assessment Survey (NAS) or the Annual Status of Education Report (ASER) are other assessments that try to evaluate student learning levels. Much like a thermometer, independent tests like these check the ‘temperature’ of teaching and learning so that educational planners and designers can view the spots where the said planning and designing needs revision.

Assessments such as these are arguably the first step to be taken before designing meaningful remedial action. Are students able to correctly answer questions pertaining to grade appropriate levels? In general, which grades seem to need more support? Which subjects have the greatest number of concepts that students struggle to get right? Which concepts are these? Is there a relationship between the gender or social identity of the student and their performance on the test? Are some districts or blocks in a state doing better than others? Ideally, a comprehensive student learning assessment ought to be able to answer these types of fundamental questions. The answers to these questions, in turn, provide us with starting points for analyses and informed decision-making by personnel at different levels – from the National Council of Educational Research and Training (NCERT) to Cluster Resource Centres.

Image 2. A graphic from NAS Report 2021, for Class 5, Karnataka state.

So far, the subject of third-party assessments seems straight-forward enough. However, there are some issues that researchers have identified, and a few that our team has experienced ourselves.

First, there are challenges on-field to ensure the reliability of the data collected. Several external variables may affect the performance of the students on these tests. For example, one concern is that of teachers or invigilators helping students answer the questions, which inflate test results. In our experience, we have observed that some teachers and HMs may be uncomfortable with the tests and unsure about the implications of their results. At times, the test may also be regarded as an attempt to judge the product of the teachers’ semester-long effort in completing learning objectives.

Second, many of these tests are not conducted ‘by surprise’. The recurrence of these assessments is often public knowledge, and there is a possibility that teachers, schools, and even departments begin cultivating a culture of ‘teaching to the test’. While awareness of the test and the pattern of its content helps expose teachers to new teaching perspectives, it is possible that the focus may move away from learning goals and instead towards students’ ability to perform well on these tests or assessments in general.

It is difficult to prescribe antidotes to these challenges. If we expect teachers to be the leaders of shifts in educational practice, we cannot afford to alienate them from initiatives taken to improve the quality of primary education. On the other hand, it is not possible to envision educational improvement without some standardized approach to assessing the current levels of learning in schools. As a community of education practitioners, we must encourage transparency and good faith between assessment developers and the teacher/school network.

One possible step could be to ensure continued engagement with teachers before the assessment. Meetings and discussions before tests can be used to clarify the aims and objectives of the assessment and share guidelines with teachers on how strict invigilation during the tests is crucial to extracting accurate results regarding the capabilities of the students. Consistent interaction with the teacher/head teacher community will also help foster a feeling of partnership and shared interests.

Second, and perhaps most importantly, there ought to be a formal and detailed transfer of test results and analysis to the teacher and the parent communities. Analyses of student performance for different grades and subjects can be a motivating factor to improve teacher practices as they directly show teachers the gaps or areas of improvement in student learning. Such discussions about the results and analysis become opportunities for professional self-reflection and re-evaluation, which in turn encourages teachers to explore new pedagogies and classroom practices.

Learning assessments are a crucial step in outlining educational objectives and reviewing where students are at a given point in time with respect to these objectives. However, conducting these large-scale tests comes with challenges, two of which have been discussed here. These are complex problems – they directly impact the assessment results and can also influence the larger aims of schooling and teaching itself. The key, as with most societal dilemmas, is collaboration. As organizations working in a society as diverse as India, we must work with schools, teachers, and departments as though we are all on the same team.

Testing Spoken English Skill Evaluation of Government School Teachers in Ramanagara District Karnataka: Survey.

With 58 English medium schools in the district, there was a need to foster an English-speaking environment within classrooms. In response, DIET-Ramanagara collaborated with Caring with Colour to assess the needs of teachers and improve their spoken English skills.

In light of our findings, the District Institute of Education and Training (DIET) – Ramanagara reached out to us to identify the needs of the teachers and help improve the Spoken English skills of the school teachers.

Based on the scores obtained during our evaluation, it was identified that there are primarily three categories of English-speaking skills among the teachers:

 ElementaryCan understand and use familiar everyday expressions and very basic phrases. Can introduce him/herself and others. Can ask and answer questions about personal details such as where he/she lives, people he/she knows and things he/she has. Can interact using simple phrases provided the other person talks slowly and clearly and is prepared to help.
IntermediateCan understand sentences and frequently uses expressions related to areas of most immediate relevance (e.g. very basic personal and family information, shopping, local geography, employment). Can communicate using simple phrases during a simple and direct exchange of information on familiar and routine matters. Can describe in simple terms aspects of his/her background, immediate environment and matters in areas of immediate need.
AdvancedCan understand the main points of clear standard input on familiar matters regularly encountered in work, school, leisure, etc. Can deal with most situations likely to arise whilst travelling in an area where the language is spoken. Can produce simple connected text on topics which are familiar or of personal interest. Can describe experiences and events, dreams, hopes & ambitions and briefly give reasons and explanations for opinions and plans.

We observed that  75% of the chosen government school teachers had only an elementary level of spoken English proficiency. These teachers have yet to acquire the skills required to initiate conversation in English. We noted that the optimal growth path for these teachers should start with comprehensive spoken English basics. Among the group, 22% of teachers had an intermediate level of spoken English proficiency. These teachers can respond to questions in English but will require conscious practice to initiate and sustain a good-quality conversation. Optimal Growth path for these teachers includes an intermediate to Advanced spoken English course. Only 3% of the Teachers had an Advanced level of spoken English proficiency. These teachers have a mature and advanced spoken English level and therefore are ideal candidates to be developed into English Resource Persons (RP) who can train and support other teachers.

Testing Teacher’s Utopia: A step towards a perfect education world!

The Indian school education system is one of the largest and most complex education systems in the world with over 1.5 million schools, two-third of which are run by the government. According to a 2018 Annual Status of Education (ASER) report, one in four students in Class VIII cannot even read a Class II text. The quality of education in government run schools is a major problem. This crisis has worsened in the aftermath of the covid-19 pandemic.

So, what can we do?

The National Education Policy (NEP) 2020 says that experiential learning can be one of the key tools to improve the quality of education. Experiential learning involves students directly in the teaching-learning process by encouraging activity-based learning. While this sounds like a proven effective way to improve the quality of education, implementation is a huge challenge. Teachers are not trained efficiently and appropriate content is not available to use.

We, at Caring with Colour, have come up with a technology-based solution for this challenge and launched our mobile app named Teachopia.

While the app serves students, parents, government functionaries etc, teachers are the focal point in the design of this solution. As the name indicates, it is a utopia (an imagined place or state of things in which everything is perfect) for teachers.

Testing Key Reforms in School Education: NEP-2020

A new National Education Policy has been approved and published in July 2020 for the Indian education system. This policy revisits various policies which were present in the Indian education ecosystem for the last 34 years.

Vision – The National Education Policy 2020 envisions an India-centric education system that contributes directly to transforming our nation sustainably into an equitable and vibrant knowledge society by providing high-quality education to all.

The Draft NEP was 484 pages. The process involved a rigorous consultation and feedback in formulating the draft policy: “Over two lakh suggestions from 2.5 lakh gram panchayats, 6,600 blocks, 6,000 Urban Local Bodies (ULBs), 676 districts were received.”

The NEP 2020 has introduced several reforms in school education. Here is all you need to know about the new education policy reforms for students, teachers and schools.

Key reforms in school education:

  • Schooling will start at the age of 3 years
  • Earlier, schooling was mandatory for children between the age of 6 and 14 years. However, under the National Education Policy (NEP 2020), education will be compulsory for children between 3 and 18 years.
  • 5+3+3+4 curricular and teaching structure
  • The new National Education Policy aims to shift from the decades-old 10+2 format to a 5+3+3+4 system, keeping a child’s development and capabilities in mind.
  • Emphasis on mother tongue as medium of instruction:
    The National Education Policy lays emphasis on a child’s mother tongue as the medium of instruction. However, The NEP only recommends the mother tongue as a medium of instruction; it has not been made compulsory. The policy states that children learn and grasp non-trivial concepts more quickly in their mother tongue.

According to the policy:
Wherever possible, the medium of instruction until at least Grade 5, but preferably till Grade 8 and beyond, will be the home language, mother tongue, local language or the regional language. Thereafter, the home or local language shall continue to be taught as a language wherever possible. This will be followed by both public and private schools.

  • 100% Gross Enrolment Ratio
    It aims 100% Gross Enrolment Ratio (GER) in school education by the year 2030. **NEP 2020 promotes an Open schooling system by bringing 2 crore out of school children back into the mainstream through recognized open schools. **mother tongue/ regional language to be taught till class 5th at least
  • No rigid separation between Science, Arts and Commerce streams
    Under the National Education Policy, there will be no stiff separation between arts and sciences, between curricular and extra-curricular activities, and between vocational and academic streams. Students can select subjects of their liking across streams.

    The Committee proposes an equal emphasis on all the subjects – science, social sciences, art, languages, sports, mathematics with the integration of vocational and academic streams in school.
  • Internships and vocational education from Class 6
    The National Education Policy also seeks to align vocational occupations with international standards prescribed by the International Labour Organisation. To overcome the situation of social stigma attached to the vocationalisation of education, the NEP recommends:
    1. The integration of vocational education programmes into mainstream education in all educational institutions in a phased manner which would lead to emphasizing the dignity of labour and importance of various vocations involving Indian arts and artisanship.
    2. The teaching of vocational courses from class 6, mostly in the form of internships and practical activities, to ensure that every student studies at least one vocational course.
  • Focus on attaining foundational literacy and numeracy
    Foundational Literacy and Numeracy refers to building adequate literacy and numeracy skills during the foundational stage of school education. These are the first 5 years of education up to class 2 when the child is between 3 – 7 years.

    The goal is to enable children to form concepts related to the world around them through direct experience and interactions with the physical, social, and natural environment through language, mathematical thinking, and environmental awareness.
  • Board exams to have low stakes
    Board exams for Grades 10 and 12 will be redesigned and a new National Assessment Centre, Parakh (Performance Assessment, Review, and Analysis of Knowledge for Holistic Development), will be set up as a standard-setting body. The changes in the board structure, which seek to make the exams a test of core competencies will be implemented from the 2021 academic session.

    The new NEP 2020 seeks to test the students of Classes 3, 5, 8, 10 and 12 based on their cognitive skills.
  • Education of gifted children
    In addition to the regular education, emphasis will be given to socially and economically disadvantaged groups (SEDGs), which include gender, socio-cultural, and geographical identities and disabilities. This includes setting up the gender inclusion fund and special education zones for disadvantaged regions. The policy states that children with disabilities will be able to attend regular school from the foundational stage to higher education, with the support of educators with cross-disability training and technology-based tools tailored to suit their needs.