Analysts working with SDG indicators on learning proficiency, in particular Indicator 4.1.1, would in many cases be familiar with a formula such as the following:
The percentage of enrolled learners who are proficient,ÌýS, is typically known from assessment results. The percentage of children of the age of the grade in question who are not enrolled,ÌýN, is typically known from household data.ÌýPÌýis what planners are ultimately interested in: the percentage of the relevant age cohortÌýin the populationÌýwho are proficient. While there is some ambiguity over whether Indicator 4.1.1 refers toÌýSÌýorÌýP,ÌýPÌýis clearly important and must be monitored.
The above formula assumes that non-enrolled children do not reach minimum proficiency levels, following the approach taken inÌýUIS (2020)ÌýandÌýUIS (2017). The relationships can be illustrated as in the following graph, which is based loosely on levels of learning proficiency and the out-of-school problem in developing countries. HereÌýPÌýis a function ofÌýSÌýandÌýN, according to the above formula.Ìý
In the context of COVID-19, sudden declines in enrolment, meaningÌýNÌýrises, and declines in proficiency in the population due to disruptions in schools, meaningÌýPÌýdrops, are possible. In examining the effects on the three statisticsÌýP,ÌýNÌýandÌýS, it is important to remember thatÌýNÌýandÌýSÌýinfluence each other. Assuming that children who drop out of the schooling system are the academically weakest learners, an assumption that is likely to hold for a number of reasons, one can expectÌýSÌýeither to rise or decline, depending on the magnitudes of the two effects: dropping out of school and learning losses. If one has estimates ofÌýPÌýandÌýN, then the newÌýSÌýis calculated according to the following transformation of the previous formula:
To illustrate the ambiguity, we can imagine learning losses resulting in a drop inÌýPÌýfrom the 35% seen in the graph to 33%. If out-of-schoolÌýNÌýincreases from 5% to 9%,ÌýSÌýdeclines from 37% to 36%. However, ifÌýNÌýdisplays a larger increase, from 5% to 13%, thenÌýSÌýdisplays anÌýincreaseÌýfrom 37% to 38%. Even with learning losses in the population of a specific age, if enough learners drop out, and we assume that these learners are those who struggled most academically, then assessment systems may in fact detect an increase in the percentage of proficient learners.
Clearly, planners need to be fully aware of these relationships.ÌýAbove all, the first formula above should not be used to conclude that more out-of-school children on its own produces a decline in P.ÌýIfÌýSÌýwas 37% (as in the graph) and then out-of-schoolÌýNÌýincreases from 5% to 13%, one cannot conclude thatÌýPÌýdrops to 32%. This would ignore the fact that ifÌýNÌýchanges,ÌýSÌýautomatically changes too.Ìý
Ìý
Leave a comment