Measuring learning outcomes and keeping evidence under Circular 54
Writing new outcomes is the first step. Circular 54 also asks each institution to measure how far learners reach them and to use the results to improve the programme. Its Appendix II sets the principles. This guide explains them and suggests a simple evidence register.
What does Circular 54 say about measuring outcomes?
Institutions evaluate their programmes regularly through their internal quality assurance system, including measuring how far learners reach the outcomes (Article 20.1).
The measurement follows the principles in Appendix II, and the results are the basis for improving teaching, assessment and the programme itself (Article 20.2). Assessment must be based on the outcomes and show how far each course and the whole programme reaches them (Article 10.2).
What are the principles in Appendix II?
- Purpose. Measurement shows how far learners meet course and programme outcomes, and supports improvement and accountability (item 1).
- Linking. Programme outcomes are linked to course outcomes through a matrix or another method the institution sets (item 2).
- Direct and indirect methods. Attainment is determined by combining direct and indirect assessment from suitable data and evidence (item 3).
- The institution sets the rules. It decides the pass threshold, scale, tools, weighting and how results are combined, in a way that is objective, consistent, feasible and transparent (item 4).
- Formulas are examples only. The appendix gives a percentage of learners meeting the outcome and a weighted score as references; each institution may choose or build its own method (item 5).
- Written guidance. The institution issues guidance on collecting data, processing results, managing evidence and using results for improvement (item 6).
Who decides the threshold for meeting an outcome?
The institution does. This circular does not set a national pass mark, although field programme standards issued by the Minister may add specific outcome requirements (Article 7.2(d)).
Appendix II leaves thresholds, scales, tools and weighting to each institution, provided the method is objective, consistent, feasible, transparent and public (item 4), and has a basis, evidence and the ability to compare results (item 5). Our suggestion: write the threshold down before the term starts, so the bar is not set after the results are known.
What counts as evidence?
The circular asks for direct and indirect methods from suitable data and evidence (Appendix II, item 3). It does not list the documents, so the examples below are ours.
| Direct evidence | Indirect evidence |
|---|---|
| Rubric scores on an assignment linked to the outcome | Student self-assessment surveys |
| A common task at the start and the end of the term | Course evaluation results |
| Recorded oral checks and their scores | Feedback from graduates and employers |
| Project products and AI-use logs | Lecturer reflections on the course |
What is an evidence register, and what goes in it?
A single table that records, for each outcome, what was assessed, where the evidence is kept, the result and what was changed.
The circular asks institutions to publish, update and keep programme records, data and evidence (Article 19.5(c)) and to issue guidance on managing evidence (Appendix II, item 6). It does not prescribe a format. A register with these columns is enough to start:
- Programme outcome and the course that carries it.
- Assessment task and the rubric used.
- Threshold set before the term.
- Result: how many learners met the outcome.
- Where the evidence is stored, and who owns it.
- Action taken after the result, with a date.
These columns are WorldWise Learning's suggestion. The Toolkit includes an evidence register template in English and Vietnamese.
How often are programmes reviewed and reported?
A programme is reviewed and updated at least after every two graduating cohorts, and reported every year before 31 December.
- Review, evaluation and update at least after every two cohorts graduate, or when development and quality assurance need it (Article 20.3).
- The rector decides amendments on the basis of self-evaluation, outcome measurement and review (Article 20.4).
- Changes are updated on the higher education database within 30 working days of the decision (Article 20.5).
- An annual report before 31 December includes the results of self-evaluation, accreditation and improvement (Article 23.2 and 23.3(d)).
- Objectives, outcomes and programme structure are published on the institution's website (Article 23.4(a)).
How can a faculty start this semester?
- Pick one outcome in one course, for example the AI outcome in a second-year course.
- Set one common task at the start and the end of the term, with the same rubric.
- Write the threshold down before the first task.
- Record both rounds in the evidence register.
- At the end of term, note one change to teaching or assessment, and date it.