第42届全球人才评鉴高峰会

暨领导人才发展论坛THE 42ND INTERNATIONAL

CONGRESS ON ASSESSMENT CENTER METHODS

AND DEVELOPING LEADERSHIP TALENT

Using personality tasks to boost the validity of Assessment Centres

Alan HowardMosaic Personality Tasks

I will cover…

1. Personality Assessment & Centres

2. Personality & Competencies

3. Factors reducing Centre Validity

4. Questionnaires

5. Tasks

Is Personality Relevant to Competencies?

Common Problems with Personality Questionnaires

An Alternative to Personality Questionnaires

Can Personality Assessment Help?

Do you use Personality Data?

1. Using Personality Assessment as part of your Centre

Who sometimes uses personality questionnaires?

…And as part of your Centre?

2. Is Personality relevant when assessing Competencies?

Personality: a great source of additional information about behavioural competencies…

For Assessment Centres for hiring / selection or

talent identification / HiPOspersonality data can add

extra information to our other centre activities e.g. about emotional stability

For Development Centres to help participants learn

about new competencies required of them for personal development

e.g. becoming a leader, personality data can provide in depth / deep feedback for a person

Personality & Behavioural Competencies

Meta Analysis of 29 International Studies

More Than 3000 people;Statistically significant link

What does the research say?

Bartram et al 2002

Great 8 model of Behavioural CompetenciesCompetency

1. Leading & Deciding2. Supporting & Cooperating3. Interacting & Presenting4. Analysing & Interpreting5. Creating & Conceptualizing6. Organizing & Executing7. Adapting & Coping8. Enterprising & Performing

Great 8 model of Behavioural Competencies

Competency Rating from Line Managers Examples of Relevant Personality Scales

1. Leading & Deciding 1. Controlling; Decisive2. Supporting & Cooperating 2. Caring; Affiliative3. Interacting & Presenting 3. Socially Confident; Outgoing4. Analysing & Interpreting 4. Evaluative; Data Rational5. Creating & Conceptualizing 5. Innovative; Independent 6. Organizing & Executing 6. Conscientious; Forward Planning7. Adapting & Coping 7.Tough–minded; Relaxed8. Enterprising & Performing 8. Achieving; Competitive

3. Common factors reducing the validity of our Centres….

& how personality assessment can help

TRIALLING EXERCISES – Do they work?COMPETENCIESOVERLAP

ROLE PLAYERSSCORING PROCEDURES NOT FOLLOWED

% OF ASSESSORS FULLY TRAINED? ASSESSORS OVERLOADEDEXERCISES TOO EASY OR TOO HARD

201420152016201720182019

It can be completed before the Centre

Assessors are not involved

Personality–based scores added to your exercise-based ratings

How can personality assessment help?

It is fully trialled & standardized

How can personality assessment help?

Lead Innovate Team Think Influence Organise

Group

Presentation

Role Play

Written

Personality P P P P P

Personality Questionnaires are the

main assessment option at the

moment?

4. Common problems with Personality Questionnaires

FAKING

40%

Faking - a problem for Assessment Centres in a selection / hiring context

“I enjoy working as part of a team”

“I like to work hard”

(strongly disagree / disagree / agree / strongly agree)

LOW SELF AWARENESS

70%

Lack of self-awareness – a problem for Development Centres in a learning context

On questionnaires, people can be too critical about themselves

Or not critical enough!

WHAT PERCENT OF THE TRUTH DO WE REALLY GET?

People were asked…

What do you want your personality to be?

• more Extravert• more Conscientious• more Agreeable• more Open to Experience• less Neurotic

Hudson & Roberts 2014

What is the alternative?

• Personality Tasks: direct measurement of personality in action

• What do people habitually do whilst engaged on a task?

Back to the Future: What are Personality Tasks?

• Raymond Cattell: 16PF fame• 1950s onwards• Questionnaires; Life Data;

Tests or Tasks• 100s of paper and pencil

Tests and Tasks

WHAT ARE PERSONALITY TASKS LIKE?08

We call the tasks Objective Personality Tasks (OPTs)

OPTs

01

Short, online puzzles, activities and tasks

ONLINE

02

Engaging & challenging, but most are easy to get right

EASY

07

Research carefully matches scores on each task to personality scales e.g. time taken to Anxiety

PERSONALITY

03

Each task produces multiple measures or scores

MEASURES

06

No unsupervised A.I. The psychological meaningfulness of each Algorithm is checked

NO BLACK BOX

05

Scoring Algorithms are derived from Research.

ALGORITHMS

04

Measures of behavior are captured LIVE during completion.

LIVE

A “mosaic” of different behavioural measures are possible from Personality Tasks

• Corrects, Omissions, Mistakes• The order activities on screen are

completed• Completion times, both overall task

completion time and on components of tasks

• Alternative ways of solving the same problem

• Memory performance for different types of material

• Ratios of corrects to mistakes, mistakes to omissions etc

• Ratios of corrects for different types of material

• Contrasts in performance across different rounds of same task

• Performance on very easy parts of tasks• Number of question attempts before

correct• Time before starting next round• Time thinking / Decision time• Error rate• Time checking work• Standard versus “unusual” answers• Etc…

Demo ofOPTs

A “mosaic” of different behavioural measures are possible from Personality Tasks

• Corrects, Omissions, Mistakes• The order activities on screen are

completed• Completion times, both overall task

completion time and on components of tasks

• Alternative ways of solving the same problem

• Memory performance for different types of material

• Ratios of corrects to mistakes, mistakes to omissions etc

• Ratios of corrects for different types of material

• Contrasts in performance across different rounds of same task

• Performance on very easy parts of tasks• Number of question attempts before

correct• Time before starting next round• Time thinking / Decision time• Error rate• Time checking work• Standard versus “unusual” answers• Etc…

Can Personality Tasks be Faked?

• Almost impossible to fake• Participants are unaware of which aspects of

personality are being assessed• We checked with our volunteers – few could guess

Can Personality Tasks be Faked?

• Additionally, the behaviourscollected are often instinctual whilst people are engaged in the task

• For example, our Big 5 Conscientiousness assessment uses 33 different behaviouralmeasures collected from 7 different personality tasks

• We believe deliberate faking on all of these would be almost impossible

The Mosaic Wheel

Report FormatCompetencies

COMPETENCY POTENTIAL PROFILESten 1 2 3 4 5 6 7 8 9 10 Sten

Assertiveness (8) Achievement

Striving (9) Agreeableness (6)

Belief in Own Ability (7)

Emotionality Stability (6)

Achievement Striving (9) Belief

in Own Ability (7)

Engagement with Detail (6)

Dutiful (6) Tidiness (5)

Achievement Striving (9)

Assertiveness (8) Belief in Own

Ability (7)

Less Engagement with detail

(3 )

Open minded (8)

Agreeableness (6) Open

Minded (6)

Worry -Free (4) Positive about

self (5) M ood Stability (4)

Calmness under pressure (6)

Belief in Own Ability (7)

Intellectual Interests (5)

Engagement with Complexity

(6) Engagement with De tail (6 )

Sympathetic (4) Helpful (6)

Sincere (2) Modest (5)

Emotionality (6)

Gregariousness (5)

Assertiveness (8)

Considerate (2) Dutiful (6)

Leading Others

Achievement Orientation

Planning & Organising

lnfluencing

Innovation

Change & Adaptability

Resilience

Analaysing Information

Working with People

Principles & Values

8

8

7

7

7

6

6

5

4

4

Obtained by about 2.3 4.4 9.3 15 19 19 15 9.3 4.4 2.3 % of the comparison group

Personality Tasks & Assessment / Development Centres

Lead Innovate Team Think Influence Organise

Group

Presentation

Role Play

Written

Mosaic M M M M M

Mosaic Versions

8 tasks version In-depth profiling High stakes assessmentCompetency profileCompletion time 90

minutesTasks can be completed

over multiple visits

3 tasks versionSifting applicationsEntry level positionsCompetency profileCompletion time 25-30

minutesTasks can be completed

over multiple visits

Mosaic Status

• Beta version, final trial underway

• Completed product: Q1 2020• Reliability & validity data

already available• Time to complete the tasks will

be reduced• Please trial!!

Key Points

Personality assessment can improve the validity of your AC or DC, and add unique information e.g. Emotional Stability Personality Questionnaires suffer

from distortion:“faking”and lack of self awareness Personality Tasks offer an alternative

to questionnaires