UNIVERSITY OF WARWICK
AQSC Working Group on Assessment Conventions
Summary of Progress to end April 2007
1. Impetus for the Group
QAA has recommended to the University in successive audits that we should ensure equity of treatment to undergraduates in the degree classification process, with a clear steer that this should be done by harmonising conventions across all Faculties (except the MBChB). AQSC thus set up an Assessment Conventions Working Group, which met a number of times in 2004 and 2005 and has recently reconvened. We should note that QAA have recently highlighted the issue of degree classification conventions in a briefing paper, Quality matters (April 2007, http://www.qaa.ac.uk/enhancement/qualityMatters/QMApril07.pdf) which has been reported, with inevitable spin, in the Times Higher and The Boar.
2. Main ideas
The main ideas emerging to date include:
-
the introduction of a 17-point marking scale for use across the University (except on numeric-based assessments/exams where the full range of marks from 0 to 100 is used, e.g. some Mathematics or language assessments);
-
the development of a single set of degree classification conventions for undergraduate degrees;
-
the introduction of a GPA-style overall summative measure of student achievement alongside the Honours classification;
-
the development of the existing transcript to become a Bologna-compliant Diploma Supplement;
-
system to facilitate and encourage students to take additional credit, and for this to be treated consistently in classification/GPA decisions.
17-point marking scale
The intention is to facilitate greater convergence in the use of mark scales across different faculties, by encouraging use of the full range of marks. This should help to ensure equitable treatment across the University, which is particularly important for inter- and multi-disciplinary courses. The proposed scale (see Annex) should reward excellence appropriately, and should encourage the use of the full range of marks in all subjects. The proposal is that work should be assessed initially in terms of its ‘grade’ (e.g. Excellent 1st, High 2.1, Mid 2.2 etc). This then has to be converted to a numerical scale (0-16), or distributed to identified points across the 100-point scale.
Any new marking scale must be designed to allow excellence to be rewarded appropriately. Although we notionally use a 0-100 scale now, in practice some disciplines award all assessed work marks within a range of 30-80. This contributes to relatively low numbers of First-Class degrees being awarded: where a First Class piece of work is given a mark in the low 70s, regardless of where in the First Class range it lies, the average mark is depressed, which can lead to marks clustering around the mean. The advantage of using identified points across the whole 0-100 scale is that the difference between work which is just a First, a comfortable First and an exceptionally strong First is stretched. This avoids depressing the mean, and allows excellence to be rewarded. Similarly, stretching the scale in the Fail range means that incompetence is punished more harshly compared with current practice.
Numeric-based examinations and other assessments which are already marked using a percentage scale (e.g. on mathematical or language-based papers, where the full range of marks from 1 to 100 is used, typically where a mark scheme allocates small numbers of marks to each of several/many questions or parts of questions) may continue to be marked as such, with departments invited to specify which assessment tasks would be marked in this way.
Single set of degree classification conventions
The Group recognises that the conventions for degree classification would need to be revised in the light of the use of the 17-point scale, and would most likely be based on the average of a student’s marks on modules which count towards the final result, weighted to take account of the size of the module (i.e. CATS/credit weighting), and, where appropriate, year of study (i.e. if final-year modules may in some departments count more heavily than penultimate-year modules). New conventions would not require the pure and unfettered application of mathematical formula; Boards of Examiners would still have some discretion.
GPA-style summative assessment
It is proposed that the University introduce a Grade Point Average (GPA) as a summary measure of students’ achievements in their degree courses, alongside degree classifications. A student’s GPA would be calculated when determining their degree classification and would be the mean of their module results, weighted appropriately, as set out above. This would be recorded on the transcript/Diploma Supplement, alongside the degree classification.
Diploma Supplement
Warwick already produces transcripts for graduating students. A Diploma Supplement contains the same data but with added contextual information, to assist in the students’ and graduates’ mobility and the recognition of their qualifications across the European Higher Education Area and beyond. The Academic Office is developing the technological solutions to allow Diploma Supplements to be produced within the next twelve months.
Recognition of additional credit
In order to allow and encourage students to broaden and/or deepen their studies by taking extra modules beyond those required by their course regulations, it is proposed that a mechanism be developed within the degree classification conventions to recognise additional credit. Students would only be allowed to register for additional modules after consulting with their personal tutor (or other appropriate individual). It would need to be borne in mind that:
-
some students would not wish or be able to take extra modules for a wide variety of reasons;
-
the ability to take extra modules could be a distinctive feature of a Warwick education;
-
extra students on modules imply extra resource requirements (e.g. to maintain acceptable staff/student ratios in seminars or labs, to provide adequate books, equipment and other learning resources) and timetabling constraints (classes and exams);
-
current arrangements for the treatment of extra credit taken by Science students (the Seymour formula) may provide significant incentives for Scientists to study languages;
Further work is needed to design a mechanism that will be appropriate and consistently applicable across the University, in the light of:
-
work being done by the Academic Registrar and the Planning section of the Academic Office on the resources involved in teaching students who are overloading their credits;
-
conversations with the Language Centre to establish the level of uptake by Science students of language modules;
-
the need to develop a consistent framework for regulating the choices of additional modules, including the level of any extra modules and the maximum acceptable load.
3. Further issues to be considered by the Working Group
-
ensuring consistency in the treatment of fail marks;
-
treatment of borderline cases, including defining which averages should normally be treated as borderline cases;
-
modules amounting to how many credits, or, in current Arts/Social Science parlance, how many marks, are counted towards degree classification. The current situation in Arts/Social Science can be summarised as using the best seven marks from eight across years 2 and 3 (for a 3-year degree) – marks from the best 210 credits’-worth of modules are used in the final classification.
Annex
Draft table with marking scale and descriptors
With the exception of the top and bottom marks the descriptors cover a range of marks, with the location within each group dependent on the extent to which the elements in the descriptor are met.
Class
|
Marking scale
|
point on scale
|
to be converted to this mark
|
descriptor
|
First
|
Excellent 1st
|
16
|
96
|
Exceptional command of the subject, including material which ranges well beyond that covered in lectures/classes. Work of exceptional insight, bringing new perspectives to bear on the material, or developing new knowledge or techniques. Achieves or is close to publishable standard.
|
High 1st
|
15
|
89
|
Very high quality work, with full understanding of the subject matter.
Work that demonstrates intellectual maturity, and is perceptive with highly developed organisation.
An ambitious project carried out successfully, with sophisticated handling of primary and secondary material, reasoned, analytic argument.
Some degree of originality, independent research and thought.
|
Mid 1st
|
14
|
81
|
Low 1st
|
13
|
74
|
Upper Second
|
High 2.1
|
12
|
68
|
Highly competent in organisation and presentation, evidence of individual research; appropriate and intelligent use of primary and secondary material, good understanding of subject matter allied with perceptive analysis.
|
Mid 2.1
|
11
|
65
|
Low 2.1
|
10
|
62
|
Lower Second
|
High 2.2
|
9
|
58
|
Conscientious work, attentive to subject matter and title/task set; a focused response to the task demonstrating good knowledge, balanced more towards the descriptive than the analytical.
Good knowledge, reasonable understanding of material and task. Descriptive rather than analytical.
|
Mid 2.2
|
8
|
55
|
Low 2.2
|
7
|
52
|
Third
|
High 3rd
|
6
|
48
|
Some relevant knowledge, some accurate repetition of lecture/class notes/work. Partial or pedestrian description.
|
Mid 3rd
|
5
|
45
|
Low 3rd
|
4
|
42
|
Fail
|
High Fail (near miss)
|
3
|
33
|
Work does not meet standards required for the appropriate stage of an Honours degree, albeit with some basic understanding of relevant concepts and techniques.
|
Fail
|
2
|
20
|
Ineptitude in knowledge, structure, academic/professional practice
Failure or inability to answer the question/respond to the task.
No evidence of basic understanding of relevant concepts/techniques
|
Low Fail
|
1
|
7
|
Zero
|
Zero
|
0
|
0
|
Work of no merit
OR
Absent, work not submitted, penalty in some misconduct cases
|
Membership of the Working Group (as at the last meeting of AQSC)
Prof Michael Whitby (Chair)
Brian Duggan
Dr Ken Flint
Prof Mark Harrison
Dr David Lamburn
Cleo Longworth
Prof Michael Luntley
Prof Mark Smith
Prof Simon Swain
Dr Joe Taylor
Jenny Bradfield (Secretariat)
Dr Julian Moss (Secretariat)
Dostları ilə paylaş: |