Sweden Germany
U.K. Greece
Click on the relevant flag for information.


Log in to the
private project server
as a KeyNet Partner

KeyNet Project

Assessment Guide

4. Assessment at the Start of a programme:
how do I begin?

 

4.1 Why initial assessment?
There is no question that initial assessment, usually diagnostic assessment, is rapidly becoming one of the most significant issues, not just in key skills implementation but in work-based training generally. A recent report from the UK's Further Education Development Agency (FEDA) reported that 'Simple, appropriate and effective methods of initial assessment and action planning need to be developed and staff training for their use provided.' It is recognised that effective initial assessment could lead to training programmes more closely tuned to trainee's individual learning needs and also improve retention and completion rates. Initial assessment is particularly important in the context of key skills, especially in Application of Number and Communication. Trainees of all ages enter programmes with widely different levels of achievement in these areas and it is vital that the people who work with them should have a clear and accurate picture of their starting points, and therefore of their development needs.

In many training situations, however, there is some confusion about what adds up to good and effective practice. It seems that there is, at the outset, the need for greater clarity over:

the purpose of initial assessment;
the methods it involves; and
the demands it places on training providers.

 

4.1 What is initial or diagnostic assessment?
A good start in understanding initial assessment in most training, especially in work-based training, can be made by seeing it as one of three interlocking but quite distinct activities:

determining programme eligibility
This involves making decisions on whether individuals qualify for particular training programmes, and what has to be done to make them eligible.

recruitment and selection
This is deciding whether an individual is the best and most appropriate person to join a course, programme or fill a vacancy.

initial assessment on entry
Building up a clear, accurate and relevant picture of the individual's attainment and potential as a basis for negotiating a programme of learning and assessment opportunities.

It is initial assessment on entry which most concerns many practising trainers in the work-based route. It helps to see it not as a one-off, once-and-for-all event but as the first step in a continuous process of matching needs to opportunities.

 

4.1 What form can this assessment take?
It is important to recognise that effective initial or diagnostic assessment requires a system that is accurate, systematic, rigorous, consistent and fair. A great deal of the discussion of initial assessment has focused on the role of tests and initial assessment instruments. However, good initial assessment depends on the right blend of a range of activities, including:

using written information - qualifications, records of achievement, references, and so on.
interviews - and conversations with the individual.
observations - seeing how the individual performs.
structured tasks and assignments - designed to give valid and reliable samples of the individual's performance. (See Annex 1 and Annex 2.)
self-assessments - the individual's own views should be taken seriously.

The clear conclusion that we have come to is that there is no single test or assessment currently available that fully meets the needs of key skills initial assessment - and that it is important to see formal tests, no matter how rigorously developed, as just one item in an extensive assessment toolkit.

With this in view, the next section, 4.4, looks at a number of examples of strategies that have worked in practice. But before that a word of warning about a very important issue that impinges upon all aspects of assessment - i.e. the demands on teachers and trainers, in particular, the skills and expertise required of trainers as assessors.

The demands of key skills initial assessment are an important part of the discussion on assessment and two areas of expertise should be highlighted:

diagnostic skills - the knowledge and skills required to make accurate judgements about an individual's attainment and potential from examples of their performance - particularly in Application of Number and Communication.
interpretative skills - the ability to build up an accurate picture of attainment and potential making appropriate use of all of the sources of information about a student or trainee.

Another word of warning! It was stated earlier that the assessment of key skills throws up many more problems than in more specific school-based or employment sector-based assessments. The generic and transferable nature of the key skills means that assessment has to be appropriate to a wide range of contexts. As result, the examples given below have been selected to show that they could be readily adapted to other contexts. For example, an assessment could be set in the context of a task that looks at organising a competition, finding ways to cut waste, presenting yourself and your organisation, carrying out a risk assessment or planning your self-development. The tasks can be used at different stages during a student or trainee's development. For instance, they could be used to help trainees practise their key skills at work, or later on to gather evidence for a portfolio. There are several ways of adapting tasks to the needs of an individual or an organisation:

add a cover sheet which gives any additional information and instructions - for example, timescale, who to contact, etc.
add examples relevant to the student's programme or trainee's occupation.
modify parts of the tasks or assignment to achieve a better fit with your local trainee or employer.
extend the task to cover a wider area.
modify language and wording.
change the presentation - for example, by adding more 'white space' or illustrations. ·
add the school, college or company logo or reformat the material into an individual house style.

 

4.1 Examples of initial or diagnostic assessment
Three examples of initial or diagnostic assessment are given below:

a programme developed for use in schools and colleges with students aged 16-23, largely, those about to enter further education or first-time employment.

an example taken from a training provider programme targeting Modern Apprenticeships (for recently unemployed young people).

an example taken from a general key skills programme used by a young people who do not have a definite job choice, job seekers and the unemployed.

Does the assessment allow me (the trainee) to see my strengths and weaknesses?

Does this assessment provide me (the employer) with information about this employee that allows me to provide her/him with an appropriate training programme?

 

Working your way through the ExamplesThe three 'Examples' that follow, and the others later in this 'Assessment Guide', are all presented in the same way. It is important, therefore, that their structure and possible applications are explained. The following guidelines should be used in working your way through them.

  1. Each example illustrates an approach to assessing key skills in order to obtain information that will be useful to the trainer or employer and, ultimately, the trainee or job seeker. It has been successful in the context of the example. As a result, as a first step, trainers should consider this context, given in the title of the Example. This step is particularly important because the examples are derived from the partner countries within which there is a relatively wide range of educational and training strategies (Section 2).

  2. The next step should be to consider the target group. This describes the background of the students/trainers or job seekers at which the assessments were aimed.

  3. Even though the Examples relate to the assessment process, it is important to discover the relationship between this and the learning/training programme upon which it is based - this focuses on the aims of the exercise.

  4. The Strategy describes the steps through which the assessment programme moves, from the beginning of the process to the analysis of the results of the assessment. This part of the Example attempts to relate the key skills to the particular form of assessment being discussed.

  5. The next section, the Assessment, gives examples of the assessment processes used to discover the individual's key skill achievement.

  6. An important part of key skill assessment is the building up of evidence of achievement, and its 'storage' in some kind of retrieval system. This usually results in the development of a portfolio. This section of the Example considers the approach to portfolio building.

  7. An integral part of the assessment process is the possibility of the student/trainee or job seeker being able to develop an individual action plan. It is clear from the wide range of examples catalogued, that this is a critical component in the success or failure of any key skill development programme. It usually results from diagnostic assessment, but features as an important influence in both formative and summative assessment.

These Examples provide information about assessment strategies which may be appropriate to your particular situation and needs. They are supported by the Annexes that contain examples of techniques of assessment which are used by each strategy and deliver the information about individual achievement. Again, you are able to use an assessment technique best suited to your needs. The Examples include reference to the relevant Annex.

EXAMPLE 1: A SCHOOL/COLLEGE BASED TRAINING AND ASSESSMENT
PROGRAMME IN THE UK


Target Group
School and college students following academic or vocational programmes of which key skills form an integral part.

Aims
To introduce students to key skills whilst simultaneously assessing their prior knowledge, understanding and skills, leading to the production of an Individual Action Plan that can be used by the students.

Strategy
Stage1 - 'key skills' are introduced to students/trainees through an induction session. For example, a key question to start the process could be 'What important skills do we use, both inside and outside the college/workplace, that are often taken for granted but without which, we would not be able to get very much done?' The notion of key skills introduced through discussion of activities recently done.
Stage 2 - these activities could then be broken down into the recognisable key skills units.
Stage 3 - a range of further questions asked, such as 'Which of these skills do you think you currently use? Where? How?' 'Are there any you do not use as much as you would like, or not all? Which?' 'Are there any skills you feel you need to improve? If so, which ones?'
Stage 4 - introduce through discussion, the idea that key skills are generic that, for example, they help them improve own learning, emphasise flexibility and putting into practice what they know and understand, and can be transferred from one context to another.
Stage 5 - the student/trainee is given the diagnostic test (Annex 1). This merely asks the individual to consider her/his confidence in relation to the individual key skills already discussed. They are asked to indicate by 'circling' one response from, say, 5, their confidence in relation to a key skill.
Stage 6 - the results of the assessment are discussed with the individual, in the process, explaining that the purpose of the test has been to identify existing strengths and weaknesses, and to provide opportunities for improvement and progress (Annex).

The assessment (Annex 1)
This is a straightforward test. The student/trainee is asked:
Are you - 4 totally confident, 3 quite confident, 2 in need of some guidance, 1 in need of a lot of guidance, 0 do not have or have not used this skill: e.g.
When having discussions you vary how and when you participate to suit your purpose and situation.

Portfolio building
The induction, assessment and discussion of the individual results allow the trainer/tutor to get the student/trainee to think about the following question - 'How can you prove to me or your employer that you have and can use these skills?' This allows a discussion of evidence collection and the building up of a portfolio of evidence drawn from courses, programmes and work place. (See Annex 5.)

Individual Action Plan
This is the end product of the assessment and discussion and allows the student/trainee to use this data to identify current level of progress, existing evidence that the skills are possessed, and gaps in competencies, skills and evidence and hence, what has to be done to achieve the highest level possible at that time in the individual's career.

 

EXAMPLE 2: A UK PROGRAMME DESIGNED FOR MODERN APPRENTICESHIPS
- FOR THE YOUNG UNEMPLOYED.
ALSO USED WITH THE OLDER (OVER-40) UNEMPLOYED

Target Group
Trainees, Modern Apprentices and recently unemployed in the following routes: Care and Child Care, Business Administration, Information Technology, Retail.

Aims
To set up systems to enhance the working relationships between trainees, trainers and employers so as to ensure the full integration of key skills within each individual's vocational training, to the mutual benefit of trainee and the employer.
To provide information which will allow trainees to be placed on appropriate key skill enhancement programmes. To introduce students to key skills whilst simultaneously assessing their prior knowledge, understanding and skills, leading to the production of an Individual Action Plan that can be used by the students.

Strategy
No formal prior qualifications required. ·
Pre-training is an important aspect of the programme, and is closely linked to a programme of accrediting prior learning or achievement through 'individual action planning'. This involves trainees and trainers mapping and linking prior learning and skills against the NVQ (National Vocational Qualifications) by means of a 'talking through' process. This results in a programme aimed at 'filling in the gaps'
Attention is focused upon the key skills of Working With Others and Improving Own Learning and Performance, which many employers find absent in the recently unemployed seeking work, and the over-40s.
The greater part of the initial assessment is located in the work place or, for those unemployed, an appropriate college or training centre.

The assessment
This diagnostic assessment is largely based upon a combination of discussion and the practical experience of 'mapping' and linking prior learning and qualifications against the vocational qualifications being, or hopefully about to be followed by the individual trainee or unemployed individual.

Portfolio building
In this example again, the trainers and employers emphasise the importance of the trainee building up a portfolio of exercises and work tasks. However, a greater emphasis is placed upon specifically designed tasks that focus upon individual trainees; thus, the importance of the diagnostic assessment which provides information about the 'point of entry' for each trainee. The portfolio would comprise:
stand-alone projects that link off- and on-job components of the work. Assignments are designed to allow trainees to produce documents that can be used by staff in the workplace.
an assignment set up in the work place, e.g. a trainee has to produce written and processed notes on procedures in the work place. Individual tasks focus on strengths and weaknesses revealed by the diagnostic test. Alternatively, for the longer term unemployed individual, this could be based upon a 'simulation' activity set up by the college or training agency.
An assignment generated by normal working practice.

Individual Action Plan
This Action Plan is even more important than that referred to in Example 1 because
the training is work place-based or a 'simulation' and more susceptible to variation in practice/interpretation than in the more formal college situation.
it provides the context for each individual trainee's programme of work and training.
it also acts as a first point of reference when considering individual progress.

 

EXAMPLE 3: A SWEDISH PROGRAMME DESIGNED
TO DETERMINE AN INDIVIDUAL'S INTEREST, APTITUDE AND ABILITY
FOR INDUSTRIAL OCCUPATIONS

Target Group
Young people in Sweden who are:
interested in industrial work but are currently not employed in it.
job seekers who do not have a definite job choice.

Aims
Through the assessment programme, 'A Survey of Occupations in Industry', to give individuals a better understanding of themselves, increased competence, and to create an action plan which will lead to a new, or first, job, and hopefully a job with a future.

Strategy
The strategy is based upon a thorough induction programme where the job-seeker is told what the assessment is about and how it will be carried out. The test only begins when the job-seekers are willing to participate.
The assessment consists of two steps of four weeks each:
     Step 1 consists of explanation and discussion about goals and purposes, together with the provision of information about employers' competence requirements. In addition, the assessments are carried out.
     Step 2 sees further assessment based on the information obtained in Step 1, in particular, to discover whether the interest and aptitude shown earlier, are extant.
The results obtained from Steps 1 and 2 allow the training-assessment organisation to provide the job-seeker with an idea of her/his competence and better self-knowledge.

The assessment
The assessments used during the two Steps are varied, often using IT, providing a 'profile' of the individual. Most of the assessments are individual 'focused and comprise interviews, talks and tests. In addition, the individual works with a workbook which contains various statements and questions concerning the various aspects of the six key skills. These tasks are aimed to make the individual think more profoundly and gain an insight into who they are, what they want to do in the future and what type of work they are suited for. Simulation exercises provide information about a person's preferred way of working which can be compared with 'real' work situations. These are supplemented by personality tests which allow the individual to become more aware of strengths and weaknesses and how to use them in the right way.

Portfolio building
In this example, the portfolio is based upon the development of the workbook together with evidence drawn from the wide range of interviews, discussion evidence, witness statements and material supplied by the assessor. (See Annex 5.).

Individual Action Plan
This Action Plan is extremely important to the whole training and assessment programme. The Plan draws upon the results of the various components of the assessment programme to produce an Action Plan based upon the following categories of personal development:
academic knowledge in the core subjects (Swedish, mathematics, English). The assessments provide information through a document template about possible difficulties in reading and writing, general academic ability and possible limitations.
vocational technical knowledge
recommended personal learning styles

 

These three examples, drawn from the contrasting educational and largely work place environments, highlight the importance of the use of well designed assessment programmes, underpinned by a relevant and carefully planned induction strategy, in delivering successful diagnostic assessment. In summary, it is suggested that successful programmes have the following features in common:

they have clear aims and objectives.

they use a variety of assessment techniques, firmly based on the concept of 'fitness for purpose', that is, a technique of assessment is used that is most appropriate to the situation.

they have an induction programme in which key skills are discussed and explained, and related to the student/trainee's programme or work.

they use easily understood and completed tasks or tests as a result of which the individual is able to see and understand her/his strengths and weaknesses and the implications of these for employment.

assessment results in a clearly expressed 'individual action plan' which is owned by the student/trainee (or the unemployed individual) but is shared with the trainer and employer.

the diagnostic assessment together with the induction programme and the resulting action plan are closely linked to the use of a 'portfolio' of evidence of achievement.

trainers link the acquisition of key skills to the student/trainee's main programme of study or work or employment goals; as a result, they become more meaningful and more readily accessible.

the tests and tasks are capable of being used by those who have been out of mainstream education, training or employment for some time. They can also be used on and with various forms of information technology.

 

back | top | next

 


United Kingdom

WJEC
(Welsh Joint Education Committee)
Information
KeyNet Web-site

NREC
(National Rural Enterprise Centre)
Web-site

Produced by:
UK: WJEC, NREC
Germany: BILSE (Institute for Education and Research),
Economic Development Company
Greece: PRISMA
Sweden: Swedish University Agricultural Department,
Hogsby Municipality, Sweden

Project carried out with the support of the European Community within the framework of the Leonardo da Vinci Programme.

This document does not necessarily represent the Commission's official position.