The Hong Kong Examinations and Assessment Authority (HKEAA) has moved from norm-referenced to standards-referenced assessment, including the incorporation of a substantial school-based summative oral assessment component(SBA) into the compulsory English language subject in the Hong Kong Certificate of Education Examination (HKCEE), a high-stakes examination for all Form 4–5 students (Davison, 2007).[1]
School-based Assessment (SBA) was first proposed in the Reform Proposals for the Education System in Hong Kong, published in September 2000. According to the proposal, the modes, content and the assessment methods of public examinations should be reviewed (p. 44). A "core-competence" approach, similar to criterion-referencing, will be adopted. In this approach, basic skills and knowledge required by a Form 5 graduate will be indicated and students do not have to compare with the others. Under the education reforms in which a new culture of learning and teaching is to be cultivated, schools can use different modes of broad-based assessments, including observation of students' performance in classroom and participation in project work to promote learning in a more flexible manner. Another benefit is advocating students' all-round development which gives a more comprehensive picture of individual students' learning needs, as well as fosters the positive washback effects of public examinations. It also helps to address the limitations of judging students on their performance in one single examination.[2]
The rationales laid down by the SBA Consultancy Team (2005) for implementing SBA are as follows:
The SBA component, worth 15% of the total HKCEE English mark, involves four assessments of English oral language skills based on texts—one from each category: print fiction, print non-fiction, non-print fiction, non-print non-fiction—drawn from a programme of independent extensive reading and viewing (SBA Consultancy Team, 2005).[5] At the time the SBA was introduced, students were required to choose at least four texts to read or view over the course of 2 years; keep brief notes in a logbook; and undertake a number of activities in and out of class to develop their independent reading, speaking, and generic skills. Due to teachers' concerns over excessive workload, the requirements have been modified to "at least three texts over the course of 2 years" (Davison, 2007).[1]
The assessment format and requirements as originally specified in the introduction to the SBA in September 2005 are summarised in Table 1.
Requirements | Form 4 | Form 5 | Total | |
---|---|---|---|---|
No. and type of texts to be read | Minimum of two texts,from two categories | Remaining two texts,remaining categories | Four texts, one from each category(print fiction, print nonfiction,non-print fiction, non-print non-fiction) | |
No. and timing of assessment,tasks to be undertaken | Minimum of twointeractive tasks tobe undertakenanytime during Form 4,must be on differenttexts | Minimum of oneinteractive task, oneindividualpresentation to beundertaken anytimeduring F5, must be ondifferent texts | Four tasks on fourtexts, one from eachcategory | |
No., %, and timing of marks to be reported | One mark, best markout of the two tasks,5% of total Englishmark, reported at endof Form 4 | Best mark for theinteraction and bestmark for thepresentation, 10% oftotal English mark,reported at end of Form 5 | 15% of total English mark |
Source: (SBA Consultancy Team, 2005, p. 5).
For assessment students are required to partake in interactions with classmates on a particular aspect of the text they have read or viewed, leading up to making a more formal group interaction or an individual presentation on a specific text and responding to questions from their audience (HKEAA, 2008).[6] Students are assessed according to a set of assessment criteria, consisting of a set of descriptors at each of six levels across four domains (HKEAA, 2007).[7] The domains are briefly described as follows:
The current SBA for HKCEE English Language will be extended to the Hong Kong Diploma of Secondary Education (HKDSE) English Language Examination from 2012 onwards(HKEAA, 2007).[8] The SBA component will also be extended to other humanities and science subjects in HKDSE (HKEAA, 2009).[9]
Using Brindley’s (1998)[10] framework, the SBA component is controversial in terms of political issues, to do with the purposes and intended use of the assessment; technical issues, primarily to do with validity and reliability; and practical issues, to do with the means by which the assessment was put into practice. These issues were gathered from key stakeholder groups, including teachers, students and education bureau officials.
Politically, in Davison’s (2007) words, “In fact, the SBA guidelines asked teachers to set their own time limits according to the needs of the students, but this was interpreted through the prism of teachers’ existing experience—many schools used buzzers and stopwatches to allocate an identical period of time to each students, with the result that in some schools students’ stress levels were high and their “performance” very contrived and/or rushed. As an outcome-oriented standards-referenced system, SBA is a significant cultural and attitudinal change, not only for teachers but for the whole school community, including students and parents. Hence, it is not surprising that fairness was a deep-seated sociocultural, not just political concern."[1]
Technically, many teachers and students are concerned over validity, reliability and fairness of the SBA component.[3] While teacher-educators and researchers view that SBA will enhance the validity and reliability of the HKCEE theoretically, some frontline teachers and students are sceptical on this.
As for practical issues, teachers raised such concerns as: