Learning outcomes and assessment based course design
Learning outcomes are the specific intentions of a programme or module, written in specific terms. They describe what a student should know, understand, or be able to do at the end of that programme, module or course.
What are the benefits of Learning Outcomes
Designing your courses using learning outcomes leads to a more student-centred approach: it marks a shift from the content of a module or course towards its outcome. Actually means "What the student is able to do on successful completion of the course or module?".
Learning outcomes can:
-
help to guide students in their learning in that they explain what is expected of them, in turn helping them to succeed in their studies.
-
help staff to focus on exactly what they want students to achieve in terms of both knowledge and skills.
-
provide a useful guide to inform potential candidates and employers about the general knowledge and understanding that a graduate will possess.
|
Bloom identified six categories of learning – knowledge, comprehension, application, analysis, synthesis and evaluation – which you can use at any academic level. The first two of these relate specifically to knowledge and understanding, while the remaining four involve intellectual skills.
Comments in italics are our own brief explanations of the
differences between the six levels of the taxonomy. The list of verbs
here is not exhaustive, and some appear under more than one heading.
Click on the headings to link to examples for each of these levels.
> > Increasing level of cognitive complexity > > | |||||
< knowledge & understanding |
intellectual skills > | ||||
Recalling important information | Explaining important information | Solving closed-ended problems | Solving open-ended problems | Creating ‘unique’ answers to problems | Making critical judgments based on a sound knowledge base |
Evaluation | |||||
Synthesis |
judge appraise evaluate rate compare revise assess estimate |
||||
Analysis |
compose plan propose design formulate arrange assemble collect construct create set up organize manage prepare |
||||
Application |
distinguish analyse differentiate appraise calculate experiment test compare contrast criticize diagram inspect debate question relate solve examine categorize |
||||
Comprehension |
interpret apply employ use demonstrate dramatize practise illustrate operate schedule sketch |
||||
Knowledge |
translate restate discuss describe recognize explain express identify locate report review tell |
||||
define repeat record list recall name relate underline |
If you have any longer-term outcomes on a programme and feel a student may only be able to demonstrate them on completion of the programme, state them as programme outcomes, rather than module outcomes.
Start programme outcomes with the phrase:
‘A successful learner from this programme will be able to …’
Start module outcomes with the phrase:
‘On successful completion
of the module, students will be able to …’
OR, better still:
‘On successful completion of the module, you will be able
to …’
These phrases lead you to use action verbs so that students are able to demonstrate that they have learned or achieved the outcome. Verbs relating to knowledge outcomes – ‘know’, ‘understand’, ‘appreciate’ – tend to be rather vague, or to focus on the process students have gone through (e.g. ‘undertake action research’) rather than the final outcome of that process (e.g. ‘formulate strategies appropriate to their topic’), so use action verbs – ‘solve’, ‘evaluate’, ‘analyse’ – to indicate how students can demonstrate acquisition of that knowledge.
Make
sure you only use one verb per learning outcome, and that you keep the
sentence structure simple to avoid misinterpretation. Avoid unnecessary
jargon; if absolutely necessary, use more than one sentence to ensure
clarity.
Linking Outcomes to assessment
It is often helpful to combine intellectual outcomes and skills-based outcomes when devising assessments. For instance, if your outcomes state that students will be able to:
-
analyse contrasting strategies for dealing with organizational change,
-
demonstrate that they are effective team workers, and
- reflect on the role they play in groupwork,
you can then conflate these through one assessment, such as a group presentation with supporting group documentation including individual statements about the role each individual played in the final piece of work.
On successful completion of the module, students will be able to:
-
Explain the meaning, character and identity of place, and how landscape is constructed.
-
Identify the theories of learning that are implicit in their current approach to education.
-
Discuss Romantic poetry in relation to the major themes of Romanticism.
- Describe the underlying principles governing gene transmission and expression.
Pointers on knowledge and understanding outcomes
|
Intellectual (thinking) skills: application
On successful completion of the module, students will be able to:
-
Apply Kolb’s model of learning to the design of a teaching programme.
-
Illustrate, using phonetics, the problem of sigmatism in children.
Intellectual (thinking) skills: analysis
On successful completion of the module, students will be able to:
-
Appraise the key issues of market segmentation in a brewing industry case study.
-
Compare Hofstede’s theories of culture with those of Trompenaars and Hampden-Turner.
Intellectual (thinking) skills: synthesis
On successful completion of the module, students will be able to:
-
Create a set of criteria to assess Home Office implementation of immigration rules.
-
Design an engine component that conforms to the following criteria…
Intellectual (thinking) skills: evaluation
On successful completion of the module, students will be able to:
-
Explain the reasoning behind their allocation of scarce resources in the treatment of patients in an Accident and Emergency setting.
-
Prioritize conclusions they reached from an analysis of paint techniques, giving reasons.
Practical skills (=subject-specific)
On successful completion of the module, students will be able to:
-
Express themselves in writing for different professional and academic audiences.
-
Employ appropriate ICT skills in order to forecast demographic trends.
-
Use web-creation tools to produce an interactive website suitable for use by young schoolchildren.
Key/transferable skills (=generic)
On successful completion of the module, students will be able to:
-
Work effectively as part of a team.
-
Reflectively evaluate their own learning and personal planning processes.
Good practice in writing learning outcomes: S uggestions
Open-ended learning outcomes
Not all learning is pre-planned: in many subjects (especially creative ones), students are expected to choose their own route through a module, and you can devise open-ended learning outcomes to reflect this. For example, you could say that students are expected to be able to:
-
draw creatively on experience to devise work which integrates art forms
-
apply theory critically to analyse their professional experience
-
evaluate the impact of their clinical intervention
-
use a self-reflective approach to devising, developing and delivering project work.
Avoiding plagiarism
Learning outcomes can also be used to help avoid plagiarism:
-
Learning outcome: Students will be able to demonstrate the origins of their ideas by referencing sources used in their work.
- Assessment criterion: Accurate use of the standard referencing styles within the text for all sources used.
Suggested steps in writing assessment criteria
-
Consider which learning outcome is being assessed (e.g. demonstrate critical awareness of social housing issues)
-
Consider the assessment task set (e.g. present a self-made artefact to the group to represent your critique of social housing issues)
-
Work out requirements for successful performance of the assessment, or the attributes required for this (e.g. clarity and fluency in terms of presentation; logical argumentation and marshalling of information in terms of content)
-
If necessary, specify the range to clarify contextual factors and the level (e.g. demonstrate critical awareness of social housing issues since the introduction of right-to-buy in the UK, making appropriate reference to the recommended reading for the module)
-
Focus on what is essential and categorize the requirements or attributes into clearly worded criteria
-
Check that the criteria are measurable or assessable in valid and reliable ways and that the criteria are clear and unambiguous (e.g. ask colleagues to read the criteria to see if they interpret them in the same way)
-
Repeat steps 3, 4, 5 and 6 until fully satisfied.
Using assessment criteria to motivate students
In order to motivate students further, it can be helpful to use grading assessment criteria: while your learning outcomes have established the minimum requirement to pass a module, and can be linked to the minimum standard to fulfil a particular assessment criterion, grading criteria indicate what a student must demonstrate to achieve a higher grade. You will then have a set of statements to help you differentiate the level of a students’ performance. The idea behind this is that, rather than focusing on the threshold level stated in the outcomes, students can see the criteria for a First, or a Distinction, and will shift their focus to the highest level. For example:
Learning Outcome: | |||||
By the end of the module, students will be able to: | Assessment criteria: | ||||
Fail | Third | Lower 2nd | Upper 2nd | First | |
use
evidence appropriately in support of an argument .
|
Unsubstantiated or invalid conclusion, based on anecdotes and generalizations only | Limited evidence of finding and conclusions supported by the literature and theory | Evidence of findings and conclusions grounded in theory or literature | Good development shown in arguments based on theory or literature and beginnings of synthesis | Analytical and clear conclusions well grounded in theory and literature, showing development of new concepts |
Grading criteria of this sort not only encourage students to aim higher, but also give them greater confidence in the objectivity and transparency of the marking process.