For me this goes back to a paper I helped with over twenty years ago now:
Blount, C., Evans, C., Birch, S., Warren, F., & Norton, K. (2002). The properties of self-report research measures: Beyond psychometrics. Psychology and Psychotherapy: Therapy, Research and Practice, 75, 151–164. https://doi.org/10.1348/147608302169616 (Sadly, that’s not open access, do contact me if you’d like a copy.)
Details #
That was a qualitative piece of work asking to look at five questionnaires:
- Personality Diagnostic Questionnaire (PDQ-IV)
- Millon Clinical Multiaxial Inventory (MCMI-III)
- the Borderline Syndrome Index (BSI)
- Rosenberg’s Self-Esteem Scale (RSE) and the
- Social Functioning Questionnaire (SFQ)
We asked ex and current client members of the Henderson Hospital therapeutic community (sadly long since closed), staff of the TC and its outreach service, and some lay people to comment on the experience of reading the questionnaires and we conducted a thematic analysis, and a mapping, of the reponses. There were some clear differences between responses from the lay/staff and the client/ex-client groups but also considerable similarities which showed clearly that completing measures can elicit strong emotions and that all groups had substantial and important criticisms of all the measures.
For me these issues overlap into hugely important linguistic and cultural issues that must be taken seriously when translating measures. It’s been satisfying to get back to these issues of “qualitative psychometrics” recently in these papers.
- Evans, C., Paz, C., & Mascialino, G. (2021). “Infeliz” or “Triste”: A Paradigm for Mixed Methods Exploration of Outcome Measures Adaptation Across Language Variants. Frontiers in Psychology, 12, 695893. https://doi.org/10.3389/fpsyg.2021.695893.
- Paz, C., Adana-Díaz, L., & Evans, C. (2020). Clients with different problems are different and questionnaires are not blood tests: A template analysis of psychiatric and psychotherapy clients’ experiences of the CORE‐OM. Counselling and Psychotherapy Research, 20(2), 274–283. https://doi.org/10.1002/capr.12290. (Again, not open access so do contact me if you’d like a copy.)
- Valdiviezo-Oña, J., Ortiz-Mancheno, N., Valdivieso-Arias, G., Erazo-Pérez, D., Rodríguez-Lorenzana, A., Evans, C., & Paz, C. (2024). Assessing the suitability and psychometric properties of the Spanish version of the YP-CORE for adolescents in Latin America: A study in Ecuador. BMC Psychology, 12(1), 671. https://doi.org/10.1186/s40359-024-02169-8.
Try also #
GULP (Generalisability, Usability, Linguistics (and cultural Location) and Psychometrics)
Psychometrics
Translating measures
Chapters #
It’s really a running theme in the OMbook that psychometric issues are not just quantitative.
Online resources #
None forseeable.
Dates #
First created 7.xii.24.
