|
4.1 Why initial assessment?
There
is no question that initial assessment, usually diagnostic assessment,
is rapidly becoming one of the most significant issues, not just
in key skills implementation but in work-based training generally.
A recent report from the UK's Further Education Development Agency
(FEDA) reported that 'Simple, appropriate and effective methods
of initial assessment and action planning need to be developed
and staff training for their use provided.' It is recognised
that effective initial assessment could lead to training programmes
more closely tuned to trainee's individual learning needs and
also improve retention and completion rates. Initial assessment
is particularly important in the context of key skills, especially
in Application of Number and Communication. Trainees of all ages
enter programmes with widely different levels of achievement in
these areas and it is vital that the people who work with them
should have a clear and accurate picture of their starting points,
and therefore of their development needs.
In
many training situations, however, there is some confusion about
what adds up to good and effective practice. It seems that there
is, at the outset, the need for greater clarity over:
the purpose of initial assessment;
the
methods it involves; and
the
demands it places on training providers.
4.1 What is initial or diagnostic assessment?
A good
start in understanding initial assessment in most training, especially
in work-based training, can be made by seeing it as one of three
interlocking but quite distinct activities:
determining programme eligibility
This involves making decisions on whether individuals qualify
for particular training programmes, and what has to be done to
make them eligible.
recruitment and selection
This
is deciding whether an individual is the best and most appropriate
person to join a course, programme or fill a vacancy.
initial assessment on entry
Building up a clear, accurate and relevant picture of the individual's
attainment and potential as a basis for negotiating a programme
of learning and assessment opportunities.
It
is initial assessment on entry which most concerns many practising
trainers in the work-based route. It helps to see it not as a
one-off, once-and-for-all event but as the first step in a continuous
process of matching needs to opportunities.
4.1 What form can this assessment take?
It is
important to recognise that effective initial or diagnostic assessment
requires a system that is accurate, systematic,
rigorous, consistent and fair. A great deal
of the discussion of initial assessment has focused on the role
of tests and initial assessment instruments. However, good initial
assessment depends on the right blend of a range of activities,
including:
using written information - qualifications, records
of achievement, references, and so on.
interviews - and conversations with the individual.
observations - seeing how the individual performs.
structured tasks and assignments - designed to give
valid and reliable samples of the individual's performance.
(See Annex 1 and Annex
2.)
self-assessments - the individual's own views should
be taken seriously. |
The
clear conclusion that we have come to is that there is no single
test or assessment currently available that fully meets the needs
of key skills initial assessment - and that it is important to
see formal tests, no matter how rigorously developed, as just
one item in an extensive assessment toolkit.
With
this in view, the next section, 4.4, looks at a number of examples
of strategies that have worked in practice. But before that a
word of warning about a very important issue that impinges upon
all aspects of assessment - i.e. the demands on teachers and trainers,
in particular, the skills and expertise required of trainers as
assessors.
The
demands of key skills initial assessment are an important part
of the discussion on assessment and two areas of expertise should
be highlighted:
diagnostic skills - the knowledge and skills required
to make accurate judgements about an individual's attainment
and potential from examples of their performance - particularly
in Application of Number and Communication.
interpretative skills - the ability to build up an
accurate picture of attainment and potential making appropriate
use of all of the sources of information about a student or
trainee. |
Another
word of warning! It was stated earlier that the assessment of
key skills throws up many more problems than in more specific
school-based or employment sector-based assessments. The generic
and transferable nature of the key skills means that assessment
has to be appropriate to a wide range of contexts. As result,
the examples given below have been selected to show that they
could be readily adapted to other contexts. For example, an assessment
could be set in the context of a task that looks at organising
a competition, finding ways to cut waste, presenting yourself
and your organisation, carrying out a risk assessment or planning
your self-development. The tasks can be used at different stages
during a student or trainee's development. For instance, they
could be used to help trainees practise their key skills at work,
or later on to gather evidence for a portfolio. There are several
ways of adapting tasks to the needs of an individual or an organisation:
add a cover sheet which gives any additional information and
instructions - for example, timescale, who to contact, etc.
add examples relevant to the student's programme or trainee's
occupation.
modify parts of the tasks or assignment to achieve a better
fit with your local trainee or employer.
extend the task to cover a wider area.
modify language and wording.
change the presentation - for example, by adding more 'white
space' or illustrations. ·
add the school, college or company logo or reformat the material
into an individual house style. |
4.1
Examples of initial or diagnostic assessment
Three
examples of initial or diagnostic assessment are given below:
a programme developed for use in schools and colleges with students
aged 16-23, largely, those about to enter further education or
first-time employment.
an example taken from a training provider programme targeting
Modern Apprenticeships (for recently unemployed young people).
an example taken from a general key skills programme used by a
young people who do not have a definite job choice, job seekers
and the unemployed.
|
Does the assessment allow me (the trainee) to see my strengths
and weaknesses?
Does this assessment provide me (the employer) with information
about this employee that allows me to provide her/him with
an appropriate training programme?
|
Working
your way through the ExamplesThe
three 'Examples' that follow, and the others later in this 'Assessment
Guide', are all presented in the same way. It is important, therefore,
that their structure and possible applications are explained.
The following guidelines should be used in working your way through
them.
-
Each example illustrates an approach to assessing key skills
in order to obtain information that will be useful to the trainer
or employer and, ultimately, the trainee or job seeker. It has been
successful in the context of the example. As a result, as a
first step, trainers should consider this context, given in the title
of the Example. This step is particularly important because the examples
are derived from the partner countries within which there is a relatively
wide range of educational and training strategies (Section
2).
-
The
next step should be to consider the target group. This describes
the background of the students/trainers or job seekers at which the
assessments were aimed.
-
Even
though the Examples relate to the assessment process, it is important
to discover the relationship between this and the learning/training
programme upon which it is based - this focuses on the aims
of the exercise.
-
The
Strategy describes the steps through which the assessment programme
moves, from the beginning of the process to the analysis of the results
of the assessment. This part of the Example attempts to relate the
key skills to the particular form of assessment being discussed.
-
The
next section, the Assessment, gives examples of the assessment
processes used to discover the individual's key skill achievement.
-
An
important part of key skill assessment is the building up of evidence
of achievement, and its 'storage' in some kind of retrieval system.
This usually results in the development of a portfolio. This
section of the Example considers the approach to portfolio building.
-
An
integral part of the assessment process is the possibility of the
student/trainee or job seeker being able to develop an individual
action plan. It is clear from the wide range of examples catalogued,
that this is a critical component in the success or failure of any
key skill development programme. It usually results from diagnostic
assessment, but features as an important influence in both formative
and summative assessment.
These Examples
provide information about assessment strategies which may be
appropriate to your particular situation and needs. They are supported
by the Annexes that contain examples of techniques of assessment
which are used by each strategy and deliver the information about individual
achievement. Again, you are able to use an assessment technique best
suited to your needs. The Examples include reference to the relevant
Annex.
EXAMPLE
1: A SCHOOL/COLLEGE BASED TRAINING AND ASSESSMENT
PROGRAMME IN THE UK
Target
Group
School and college students following academic or vocational
programmes of which key skills form an integral part.
Aims
To
introduce students to key skills whilst simultaneously assessing
their prior knowledge, understanding and skills, leading to
the production of an Individual Action Plan that can be used
by the students.
Strategy
Stage1 - 'key skills' are introduced to students/trainees
through an induction session. For example, a key question to
start the process could be 'What important skills do we use,
both inside and outside the college/workplace, that are often
taken for granted but without which, we would not be able to
get very much done?' The notion of key skills introduced
through discussion of activities recently done.
Stage 2 - these activities could then be broken down
into the recognisable key skills units.
Stage 3 - a range of further questions asked, such as
'Which of these skills do you think you currently use? Where?
How?' 'Are there any you do not use as much as you would like,
or not all? Which?' 'Are there any skills you feel you need
to improve? If so, which ones?'
Stage 4 - introduce through discussion, the idea that
key skills are generic that, for example, they help them improve
own learning, emphasise flexibility and putting into practice
what they know and understand, and can be transferred from one
context to another.
Stage 5 - the student/trainee is given the diagnostic
test (Annex 1). This merely asks the
individual to consider her/his confidence in relation to the
individual key skills already discussed. They are asked to indicate
by 'circling' one response from, say, 5, their confidence in
relation to a key skill.
Stage 6 - the results of the assessment are discussed
with the individual, in the process, explaining that the purpose
of the test has been to identify existing strengths and weaknesses,
and to provide opportunities for improvement and progress (Annex).
The
assessment (Annex 1)
This is a straightforward test. The student/trainee is asked:
Are you - 4 totally confident, 3 quite confident, 2 in need
of some guidance, 1 in need of a lot of guidance, 0 do not have
or have not used this skill: e.g.
When having discussions you vary how and when you participate
to suit your purpose and situation.
Portfolio
building
The induction, assessment and discussion of the individual results
allow the trainer/tutor to get the student/trainee to think
about the following question - 'How can you prove to me or
your employer that you have and can use these skills?' This
allows a discussion of evidence collection and the building
up of a portfolio of evidence drawn from courses, programmes
and work place. (See Annex 5.)
Individual
Action Plan
This is the end product of the assessment and discussion and
allows the student/trainee to use this data to identify current
level of progress, existing evidence that the skills are possessed,
and gaps in competencies, skills and evidence and hence, what
has to be done to achieve the highest level possible at that
time in the individual's career.
|
EXAMPLE
2: A UK PROGRAMME DESIGNED FOR MODERN APPRENTICESHIPS
- FOR THE YOUNG UNEMPLOYED.
ALSO USED WITH THE OLDER (OVER-40) UNEMPLOYED
Target
Group
Trainees, Modern Apprentices and recently unemployed
in the following routes: Care and Child Care, Business
Administration, Information Technology, Retail.
Aims
To set up systems to enhance the working relationships
between trainees, trainers and employers so as to ensure
the full integration of key skills within each individual's
vocational training, to the mutual benefit of trainee
and the employer.
To provide information which will allow trainees to
be placed on appropriate key skill enhancement programmes.
To introduce students to key skills whilst simultaneously
assessing their prior knowledge, understanding and skills,
leading to the production of an Individual Action Plan
that can be used by the students.
Strategy
No formal prior qualifications required. ·
Pre-training is an important aspect of the programme,
and is closely linked to a programme of accrediting
prior learning or achievement through 'individual action
planning'. This involves trainees and trainers mapping
and linking prior learning and skills against the NVQ
(National Vocational Qualifications) by means of a 'talking
through' process. This results in a programme aimed
at 'filling in the gaps'
Attention
is focused upon the key skills of Working With Others
and Improving Own Learning and Performance, which many
employers find absent in the recently unemployed seeking
work, and the over-40s.
The greater part of the initial assessment is located
in the work place or, for those unemployed, an appropriate
college or training centre.
The
assessment
This diagnostic assessment is largely based upon a combination
of discussion and the practical experience of 'mapping'
and linking prior learning and qualifications against
the vocational qualifications being, or hopefully about
to be followed by the individual trainee or unemployed
individual.
Portfolio
building
In this example again, the trainers and employers emphasise
the importance of the trainee building up a portfolio
of exercises and work tasks. However, a greater emphasis
is placed upon specifically designed tasks that focus
upon individual trainees; thus, the importance of the
diagnostic assessment which provides information about
the 'point of entry' for each trainee. The portfolio
would comprise:
stand-alone projects that link off- and on-job components
of the work. Assignments are designed to allow trainees
to produce documents that can be used by staff in the
workplace.
an assignment set up in the work place, e.g. a trainee
has to produce written and processed notes on procedures
in the work place. Individual tasks focus on strengths
and weaknesses revealed by the diagnostic test. Alternatively,
for the longer term unemployed individual, this could
be based upon a 'simulation' activity set up by the
college or training agency.
An assignment generated by normal working practice.
Individual
Action Plan
This Action Plan is even more important than that referred
to in Example 1 because
the training is work place-based or a 'simulation' and
more susceptible to variation in practice/interpretation
than in the more formal college situation.
it provides the context for each individual trainee's
programme of work and training.
it also acts as a first point of reference when considering
individual progress.
|
EXAMPLE
3: A SWEDISH PROGRAMME DESIGNED
TO DETERMINE AN INDIVIDUAL'S INTEREST, APTITUDE
AND ABILITY
FOR INDUSTRIAL OCCUPATIONS
Target
Group
Young people in Sweden who are:
interested in industrial work but are currently
not employed in it.
job seekers who do not have a definite job choice.
Aims
Through
the assessment programme, 'A Survey of Occupations
in Industry', to give individuals a better
understanding of themselves, increased competence,
and to create an action plan which will lead
to a new, or first, job, and hopefully a job
with a future.
Strategy
The strategy is based upon a thorough induction
programme where the job-seeker is told what
the assessment is about and how it will be carried
out. The test only begins when the job-seekers
are willing to participate.
The assessment consists of two steps of four
weeks each:
Step 1 consists of
explanation and discussion about goals and purposes,
together with the provision of information about
employers' competence requirements. In addition,
the assessments are carried out.
Step 2 sees further
assessment based on the information obtained
in Step 1, in particular, to discover whether
the interest and aptitude shown earlier, are
extant.
The
results obtained from Steps 1 and 2 allow the
training-assessment organisation to provide
the job-seeker with an idea of her/his competence
and better self-knowledge.
The
assessment
The assessments used during the two Steps are
varied, often using IT, providing a 'profile'
of the individual. Most of the assessments are
individual 'focused and comprise interviews,
talks and tests. In addition, the individual
works with a workbook which contains various
statements and questions concerning the various
aspects of the six key skills. These tasks are
aimed to make the individual think more profoundly
and gain an insight into who they are, what
they want to do in the future and what type
of work they are suited for. Simulation exercises
provide information about a person's preferred
way of working which can be compared with 'real'
work situations. These are supplemented by personality
tests which allow the individual to become more
aware of strengths and weaknesses and how to
use them in the right way.
Portfolio
building
In
this example, the portfolio is based upon the
development of the workbook together with evidence
drawn from the wide range of interviews, discussion
evidence, witness statements and material supplied
by the assessor. (See Annex
5.).
Individual
Action Plan
This Action Plan is extremely important to the
whole training and assessment programme. The
Plan draws upon the results of the various components
of the assessment programme to produce an Action
Plan based upon the following categories of
personal development:
academic knowledge in the core subjects (Swedish,
mathematics, English). The assessments provide
information through a document template about
possible difficulties in reading and writing,
general academic ability and possible limitations.
vocational technical knowledge
recommended personal learning styles
|
These
three examples, drawn from the contrasting educational
and largely work place environments, highlight the importance
of the use of well designed assessment programmes, underpinned
by a relevant and carefully planned induction strategy,
in delivering successful diagnostic assessment. In summary,
it is suggested that successful programmes have the following
features in common:
|
they have clear aims and objectives.
they use a variety of assessment techniques, firmly
based on the concept of 'fitness for purpose', that
is, a technique of assessment is used that is most
appropriate to the situation.
they have an induction programme in which key skills
are discussed and explained, and related to the
student/trainee's programme or work.
they use easily understood and completed tasks or
tests as a result of which the individual is able
to see and understand her/his strengths and weaknesses
and the implications of these for employment.
assessment results in a clearly expressed 'individual
action plan' which is owned by the student/trainee
(or the unemployed individual) but is shared with
the trainer and employer.
the diagnostic assessment together with the induction
programme and the resulting action plan are closely
linked to the use of a 'portfolio' of evidence of
achievement.
trainers link the acquisition of key skills to the
student/trainee's main programme of study or work
or employment goals; as a result, they become more
meaningful and more readily accessible.
the tests and tasks are capable of being used by
those who have been out of mainstream education,
training or employment for some time. They can also
be used on and with various forms of information
technology.
|
back | top | next

|