Skip to content
  • About PBC
  • About Hogan
  • Blog
  • About PBC
  • About Hogan
  • Blog
Cart(0)
  • Our Services
  • Assessments
  • Certifications
  • Resources
  • Contact Us
  • Get Certified
  • Our Services
  • Assessments
  • Certifications
  • Resources
  • Contact Us
  • Get Certified
All Services
Selection
Development
Teams
Organisation
Coaching
Research
Cancel
Our Services
All Services
Selection
Development
Teams
Organisation
Coaching
Research
  • Our Services
  • Assessments
  • Certifications
  • Resources
  • Contact Us
  • Get Certified
  • Our Services
  • Assessments
  • Certifications
  • Resources
  • Contact Us
  • Get Certified
Cart(0)
  • About PBC
  • About Hogan
  • Blog
  • About PBC
  • About Hogan
  • Blog
BLOG

Does personality change? On the stability of personality assessment scores

Does personality change? This is a question we receive regularly from our clients, along with a lot of hypotheses about when and why scores shift. Answering this seemingly straightforward question actually requires addressing three related questions:

  1. How often do scores on assessments change?
  2. When scores on assessments change, how large are those changes?
  3. Why do scores on assessments sometimes change?

How often do scores on assessments change?

Personality assessments—like the ones we create at Hogan—measure patterns of behavior. Decades of research have demonstrated that personality assessments predict future behavior, including workplace performance. A major reason why personality assessments work so well at predicting future behavior is because personality is quite stable; that is, people do not change very much. For example, in one study elementary school teacher ratings of students’ personalities predicted how those students behaved as adults 40 years later! The best method for quantifying personality stability is the test-retest correlation: you take a test now and we see how well it predicts your scores on the same test in the future. The short term (14-21 day) test-retest correlations for the Hogan Personality Inventory scales range from .69-.87. The long term (8-year) test-retest correlations range from .30-.73. A meta-analysis of 3,217 (7-year) test-retest correlations ranged from .30-.70. The point here is this: personality test scores are highly stable. Thus, most of the time, a person retaking a personality assessment will get very similar results.

When scores on assessments change, how large are those changes?

If you are a careful reader, you will note that “very similar results” is not the same thing as “identical results,” or that the test-retest correlations just described are not perfect. Indeed, even over short intervals, test scores do fluctuate. This is true for all tests, including cognitive ability and even medical tests (e.g., blood pressure, glucose tests, etc.). For Hogan, reassessments typically fall within two raw points of the original assessment. This indicates a small degree of fluctuation, and typically does not change the interpretation of the overall profile.

Why do scores on assessments sometimes change?

Consider the following situation: Your doctor measures your cholesterol levels. After some time has passed, your doctor measures your cholesterol again to discover the result has changed. In this scenario, there are two broad (and obvious) reasons the result changed: (a) something about the measurement process changed and/or (b) your actual cholesterol levels changed. Likewise, for psychological assessments, changes in scores may occur because of measurement-related and/or individual/psychological reasons.

Changes Related to the Measure

Sometimes aspects of the testing and measurement process itself result in score changes upon reassessment. There are three major methodological reasons scores on a psychological assessment might change: (1) imprecision in measurement, (2) changes in forms, and (3) changes in norms.

Imprecision in Measurement. When a doctor measures your cholesterol, he or she is not literally measuring all of the cholesterol in your bloodstream. Only a small sample of your blood is taken, and this sample is assumed to represent all of your bloodstream. Cholesterol in one sample may vary from cholesterol in another sample. Thus, one reason your cholesterol levels might change is because the instruments and procedures employed are imperfect. These imperfections are referred to as measurement errors. On a personality assessment, most people will always mark the item “I like to bend the rules every now and then” as either True or False no matter how many times they are asked. However, for a small group of people, whether they mark True or False to this item may depend on something that has happened to them recently (e.g., watched a movie about prisoners; sped through an intersection). Such imprecision in measurement affects the person’s score on the assessment. The good news is that these measurement errors occur randomly, meaning that the tests are unbiased. Such imperfections are present in all assessments, including medical tests. In developing our assessments, we work to reduce measurement error to the minimum possible. The short-term test-retest correlations reported above indicate that measurement error is quite low for our assessments.

Changes in forms. At Hogan, we believe in Kaizen Psychometrics. This means we work to continually improve our assessments. In doing so, we regularly update our testing instruments with new, better, forms when they are available. Because the new forms are designed to be better, they are not identical to the previous forms. Thus, a person completing an assessment on an earlier form and later taking an assessment on a new form, may receive slightly different scores.

Changes in norms. Because raw scales score can be hard to interpret (e.g., what does a 7 out of 12 mean?), we report normed (percentile) scores for our clients. Our norms are calculated from a stratified sample of millions of assessments completed by test-takers from nearly every job in every sector all over the world. However, in keeping with our commitment to Kaizen Psychometrics, we continually work to update our norms as better or more representative samples become available. As a result, a person completing an assessment scored on a previous norm may receive slightly different scores on a more recent assessment using updated norms.

Changes Related to the Individual

Beyond methodological reasons for change, there are also psychological reasons scores on assessments can change over time related to (a) maturity, (b) major life events, and (c) feedback and coaching.

Maturity. Although personality is relatively stable, personality does change across the lifespan. People become more self-confident, agreeable, conscientious, and more emotionally stable as they age. This pattern of personality development is typical for most people and reflects maturation into adulthood. As a result, such changes in personality are most dramatic for teenagers and young adults (early 20s), with personality becoming more stable with age. Thus, assessments taken over a shorter time span and assessments taken by older adults are less likely to show change.

Major Life Events. Personality can also change due to life events or personal experiences. For example, personality does seem to change in the wake of major life events (e.g., unemployment, marriage, divorce). Likewise, there is some evidence that experience in the military can result in personality change. However, people tend to adapt and return towards their baseline scores shortly after, even when these events are traumatic (such as bereavement) or conversely, positive (such as winning the lottery). Large changes due to major life events are rarely permanent, though small changes may be more lasting. Assessments taken recently after a major life event may show dramatically different results from assessments taken under more normal circumstances. However, in our experience, these results are still accurate at the time of assessment. For example, if a person experiencing a personal trauma scores lower on a scale measuring stress tolerance compared to their baseline, this is often a real and interpretable result. In other words, even though the change in scores may be temporary, they should not be discarded as “inaccurate.”

Assessment Feedback and Coaching. Finally, there is evidence that personality can change as a result of intentional practice and/or expert feedback and coaching. Likewise, effective coaching in business contexts appears to affect personal and organizational outcomes. However, in such cases the change in personality assessment scores tends to be relatively small. Thus, while coaching can be effective, we would expect any changes to manifest in 360° or performance feedback rather than in personality test results. When changes do occur, it is impossible to discern whether this is due to actual developmental growth or due to increased awareness about one’s assessment results (e.g., the person becomes aware of tendency to be arrogant and un- or sub-consciously manipulates assessment responses). These changes can and do occur in both directions: (1) the score becomes more exaggerated or (2) decreases in strength due to heightened awareness.

Summary

Personality is quite stable overall. Changes in scores on re-assessments of personality are rare, usually small, and often due to methodological reasons related to the assessment rather than meaningful psychological reasons specific to the individual. Thus, when a reassessment looks very different from the original result, it is best to verify whether these differences are driven by methodological reasons first (changes in forms or norms). Although less common, assessment results may change due to psychological factors (maturation, life events, or intentional efforts). However, such changes usually are not very large or meaningful, and are difficult to interpret.

References

  • This post was co-authored by Hogan’s Chief Science Officer, Ryne Sherman, and Hogan’s Director of Global Learning, Jackie V. Sahm.
  • Originally posted on Hogan assessment

TOPIC AREA

DATE POSTED

August 28, 2018

SHARE ON YOUR SOCIALS

Latest blog posts

Loading...

PBC Webinar: Success in Succession – Leveraging Hogan Insights for Leadership Pipeline

PBC Webinar – Safety Month – Using Psychometrics to Measure Safety

PBC Webinar: Fairness in Talent Assessment – Navigating DEI Challenges in ANZ

PBC Webinar: Defining and Measuring High Performing Teams

PBC Webinar: Unleashing the Potential of AI in Coaching

Questions?

We’re here
to help.

Contact Us

Get certified
today

Gain comprehensive training on how to use Hogan’s personality assessments

Get Certified Now

Related Articles

PBC Webinar: Success in Succession – Leveraging Hogan Insights for Leadership Pipeline

Join Sharon Ardley (Head of Practice) and Jo Stamp (Director) as they explore PBC’s Six Pillars of Succession Planning. In this interactive session,…
Read More

PBC Webinar – Safety Month – Using Psychometrics to Measure Safety

Understanding attitudes and behaviours towards safety and safe working are key to building safe workplaces. Hogan Assessment’s Safe System has…
Read More

PBC Webinar: Fairness in Talent Assessment – Navigating DEI Challenges in ANZ

In today’s evolving landscape of Diversity, Equity, and Inclusion (DEI), the fairness of talent assessment tools is more important than…
Read More
View All

Stay connected

Copyright 2024 Peter Berry Consultancy.

Sydney

Level 8/201 Miller Street,
North Sydney, NSW 2060 Australia

Phone: +61 2 8918 0888

Peter Berry Consultancy wishes to acknowledge the Traditional Custodians the Cammeraygal and their Country on which we work today.

See map

Melbourne

Suite 303, 430 Little Collins Street, Melbourne, VIC, 3000 Australia

Phone: +61 3 8629 5100

Peter Berry Consultancy wishes to acknowledge the Traditional Custodians the Boon Wurrung and Woiwurrung (Wurundjeri) peoples of the Kulin Nation and their Country on which we work today.

See map

Auckland

11 Britomart Place, Auckland CBD,
Auckland 1010, New Zealand

Phone: +64 9 941 9790

See map

Ireland

Suite 301, 53 Merrion Square South, Dublin 2, D02 PR63, Ireland

Phone: +353 1 578 3607

See map
  • TERMS & CONDITIONS
  • PRIVACY POLICY – AU
  • PRIVACY POLICY – NZ
  • COOKIES POLICY
  • EU COMPLIANCE
  • TERMS & CONDITIONS
  • PRIVACY POLICY – AU
  • PRIVACY POLICY – NZ
  • COOKIES POLICY
  • EU COMPLIANCE
  • TERMS & CONDITIONS
  • PRIVACY POLICY – AU
  • PRIVACY POLICY – NZ
  • COOKIES POLICY
  • EU COMPLIANCE
  • TERMS & CONDITIONS
  • PRIVACY POLICY – AU
  • PRIVACY POLICY – NZ
  • COOKIES POLICY
  • EU COMPLIANCE
Peter Berry Consultancy
Manage Consent

PBC uses cookies. Learn more about our policies by clicking the links below.

Functional Always active
The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.
Preferences
The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.
Statistics
The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.
Marketing
The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.
Manage options Manage services Manage {vendor_count} vendors Read more about these purposes
View preferences
{title} {title} {title}