Choosing Psychometric Services – Caveat Emptor
Updated: Oct 21
Image from Canva
Caveat Emptor [Latin, Let the buyer beware.] A warning that notifies a buyer that the goods he or she is buying are “as is,” or subject to all defects. Often when we buy things, there is a propensity to trust the people we buy from, as there is always a guarantee. This is all well and good but how about services? Can one use this phrase to safeguard malpractice and bad service?
I am not sure legally whether the term will stand but I suspect that this may be possible in terms of a contract. The concern is how many of you have had an experience that services rendered to you did not meet the promised requirements? So what actions can one take? Or for that matter can one prevent such an incident from happening?
I want to focus on one area of psychological services that, as it stands in Hong Kong, are not curtailed or governed by any legislation. If you are HR and involved in psychometric assessments for selection, assessment and development, you will be familiar that, in the market, many service providers are offering their proprietary tools or are representatives of psychometric tools. How then does one decide who are the legitimate and qualified providers versus those fly-by-night service providers? Let’s do a checklist.
THE REAL McCoy – the person selling you the services and products
1) Always check the credentials of the person offering that service.
– There is a difference between an HR practitioner and an industrial organisational psychologist. Both have different educational backgrounds, the former being a generalist and the latter a specialist.
– There is also a distinct difference between someone with a bachelor's degree in Psychology and one with a Master's or PhD in Industrial Organisational psychology. This is because someone who has a Master's degree/PhD in Industrial Organisational focuses on the application of that form of psychology, whereas someone who has a bachelor's degree learns about the general aspects of psychology. A quick way to determine whether the person you are dealing with has the appropriate qualifications is to ask them. If they have a bachelor's degree but have, somewhat, managed to do a psychometric assessment, they are known to be people who know about psychometrics and NOT IO psychologists. Usually, untrained people use terms like ‘business or organisation psychologist’ to present themselves as an IO psychologist.
– A person trained in one form of psychology does not qualify that person to become a psychologist in another field. For example, a clinical psychologist cannot be an IO psychologist because the ‘workplace’ they used to practice is not similar to that of an IO psychologist. Similarly, a sports psychologist does not automatically qualify to assess behaviours in a workplace just because he works in a business environment.
– It is also important to stress that, like any professional services, IO psychologists should be registered in at least 1 psychological society, such as the Hong Kong Psychological Society (HKPS), British Psychological Society (BPS), American Psychological Association (APA) and Australian Psychological Society (APS) and will also be part of their Divisional groups such as DOP, DIOP and SIOP. Please note that while most psychological societies will accept registration from anyone who has done a general psychology degree, it is the Master’s degree that will determine their capabilities in their practice form of psychology. For e.g. an HK registered psychologist with the HKPS will have letters – Reg. Psychol after their name while a registered IO psychologist will have letters – Reg. Psychol (I.O.).
The piece de resistance – the tools or services
2) Always learn about the tool and not just take it at face value.
– Psychometric tools come in various forms. The common ones are abilities (cognitive tests) and a personality questionnaire. While they look on the surface to many similarities (face validity), they are far from the truth. Legitimate psychometric tools are usually rigorously designed and validated to ensure that they are valid and reliable when applied.
– One way to ensure that the tools you will use fit your purpose is to ask for technical information on how the tool is being constructed and what validation studies were done. Being more informed, you can choose the right tool for your intended use. If service providers cannot do so, my advice is to STAY CLEAR of that tool.
– Other forms of psychometric tools include assessment and development centres. These culminate forms of cognitive tests, personality questionnaires, exercises and interviews. Assessment and development centres are usually done from 1 to 2 days. Assessors will be used to pull evidence from these areas to provide a written report of individuals being assessed. While IO psychologists are not always engaged in such work, remember that the process must be sound and robust. This will all be subject to how the AC/DC is designed. Again, checking the credentials of the person selling and designing the service is vital. A trained consultant addresses your intentions and advice appropriately, while a somewhat inexperienced consultant will propose mostly off-the-shelf solutions. This distinguishes a consultant vs. a salesperson. I strongly believe in providing valued services and solutions and not just sub-standard services. Do not be fooled by jargon used by some consultants, they are there to give you the impression that they are knowledgeable. However, on the contrary, the consultants who can provide succinct and clear logical processes to your needs will be your prevailing business partner.
– You can tell whether the consultants know their craft or they are just pulling the wool over your eyes. Do not be afraid to ask the right questions. It is the way they articulate their suggestions after hearing your needs that can be a determinant of how well they are going to be doing the work. While a proposal that has 20 pages with fanciful process funnels might seem impressive, the test is how the work is conducted and carried out. Remember, you are paying the consultants for their expertise, so they should be providing you with that.