Latent Structure of the WHOQOL-BREF: Implications for Measuring Quality of Life Among Autistic Adults
Publication: Autism in Adulthood
Abstract
Background: To accurately measure quality of life among autistic adults, researchers need surveys that are psychometrically validated for autistic populations. Researchers have demonstrated that the short version of the World Health Organization Quality of Life instrument (WHOQOL-BREF) has strong psychometric properties in the general population. Although there has been some research exploring basic psychometric properties (reliability, convergent validity, etc.) of the WHOQOL-BREF in autistic populations, the underlying latent structure of the measure has not been tested in autistic adults. Our goal in the current study was to compare different confirmatory factor analysis (CFA) models to test which one best captured the underlying latent structure of the WHOQOL-BREF data in a sample of autistic adults.
Methods: A total of 842 autistic adults between the ages of 18 and 83 years completed the WHOQOL-BREF. Based on participant responses, we compared four a priori CFA models—correlated four-factor, unidimensional, higher-order, and bifactor models—to demonstrate which model structure best captures the underlying latent structure of the measure in this population.
Results: Similar to past research, the WHOQOL-BREF showed strong internal reliability in our sample of autistic adults. The bifactor model demonstrated the best fit to the data—demonstrating that the WHOQOL-BREF is best conceptualized as having both domain-specific quality-of-life factors (i.e., the Physical, Psychological, Environmental, and Social domains of the WHOQOL-BREF) and a general quality-of-life factor.
Conclusion: Our results provide researchers with psychometric validation of the underlying latent structure of the WHOQOL-BREF in autistic populations. Items on the WHOQOL-BREF capture both domain-specific and general quality of life among autistic adults. Researchers can use the bifactor model to accurately capture multiple dimensions of quality of life in autistic adults, advancing the ways that the WHOQOL-BREF can be used as a measure of quality of life among autistic people.
Abstract
Community Brief
Why is this an important issue?
Quality of life is an important outcome to the autistic community. To study quality of life, researchers need tools to accurately measure it for autistic people. Unlike measures such as a person’s height or weight, there is not one “true” way to measure quality of life. Instead, researchers use questions to learn about and measure quality of life. However, researchers need to test how well their questions learn about quality of life for autistic people. This is especially important when researchers use questions that were not made specifically for autistic people.
What is the purpose of this study?
The goal of this study is to compare different measurement models of a common quality-of-life tool—called the WHOQOL-BREF—in autistic adults. A measurement model describes how the questions in a survey are related to the idea being measured, such as quality of life. A better understanding of how the questions on the WHOQOL-BREF relate to quality of life for autistic people will help researchers do more accurate research.
What did the researchers do?
We looked at survey responses from 842 autistic adults (ages 18–83) to find the best type of measurement model for the WHOQOL-BREF. The measurement models tested whether the WHOQOL-BREF items were best related to specific quality-of-life areas (Physical, Psychological, Environmental, and Social), general quality of life, or both specific and general quality of life.
What were the results of the study?
We found that a measurement model that captures both specific quality-of-life areas and general quality of life was the best fit for the autistic adults in our study. This means that the questions on the WHOQOL-BREF capture both general and specific aspects of quality of life among autistic adults.
What do these findings add to what was already known?
These findings can help researchers use the WHOQOL-BREF to measure quality of life in autistic adults. Past research tested these types of questions in general population samples, but this study is the first to test these measurement models in autistic adults.
What are the potential weaknesses of this study?
Our findings were based on a sample of autistic adults who did not have co-occurring intellectual disability, were majority White, and many attended college. Because of this sample, we do not know how our findings may apply to more diverse samples of autistic adults.
How will these findings help autistic adults now or in the future?
Our findings provide more accurate ways that researchers can use the WHOQOL-BREF to estimate quality of life among autistic adults. We hope that having better tools to measure quality of life will help researchers improve the quality of life of autistic adults.
Get full access to this article
View all available purchase options and get full access to this article.
Authorship Confirmation Statement
E.A.K.-K.: Conceptualization, methodology, formal analysis, and writing—original draft. G.A.M.: Methodology, resources, data curation, and writing—reviewing and editing. N.R.L.: Writing—reviewing and editing. G.L.W.: Supervision and writing—reviewing and editing. B.E.Y.: Supervision and writing—reviewing and editing. The article has been submitted solely to Autism in Adulthood.
References
1. Autistica. Your research priorities. 2017. Available from: https://www.autistica.org.uk/our-research/our-research/your-research-priorities
2. Benevides TW, Shore SM, Palmer K, et al. Listening to the autistic voice: Mental health priorities to guide research and practice in autism from a stakeholder-driven project. Autism. 2020;24(4):822–833;
3. Gotham K, Marvin AR, Taylor JL, et al. Characterizing the daily life, needs, and priorities of adults with autism spectrum disorder from Interactive Autism Network data. Autism. 2015;19(7):794–804;
4. Ne’eman A. The future (and the past) of autism advocacy, or why the ASA’s magazine, the advocate, wouldn’t publish this piece. DSQ. 2010;30(1);
5. Pellicano E, Dinsmore A, Charman T. What should autism research focus upon? Community views and priorities from the United Kingdom. Autism. 2014;18(7):756–770;
6. Robertson SM. Neurodiversity, quality of life, and autistic adults: Shifting research and professional focuses onto real-life challenges. DSQ. 2009;30(1);
7. World Health Organization. Division of mental health and prevention of substance abuse. WHOQOL: Measuring Quality of Life; 1997. Available from: http://www.who.int/iris/handle/10665/63482
8. Roche L, Adams D, Clark M. Research priorities of the autism community: A systematic review of key stakeholder perspectives. Autism. 2021;25(2):336–348;
9. Mason D, Mackintosh J, McConachie H, Rodgers J, Finch T, Parr JR. Quality of life for older autistic people: The impact of mental health difficulties. Research in Autism Spectrum Disorders. 2019;63:13–22;
10. McQuaid GA, Weiss CH, Said AJ, Pelphrey KA, Lee NR, Wallace GL. Increased perceived stress is negatively associated with activities of daily living and subjective quality of life in younger, middle, and older autistic adults. Autism Res. 2022;15(8):1535–1549;
11. Oakley BF, Tillmann J, Ahmad J, et al. How do core autism traits and associated symptoms relate to quality of life? Findings from the Longitudinal European Autism Project. Autism. 2021;25(2):389–404;
12. White K, Flanagan TD, Nadig A. Examining the relationship between self-determination and quality of life in young adults with autism spectrum disorder. J Dev Phys Disabil. 2018;30(6):735–754;
13. Yerys BE, McQuaid GA, Lee NR, Wallace GL. Co-occurring ADHD symptoms in autistic adults are associated with less independence in daily living activities and lower subjective quality of life. Autism. 2022;26(8):2188–2195;
14. Schiltz HK, Williams ZJ, Zheng S, et al. Autism PROMnet. Measurement matters: A commentary on the state of the science on patient reported outcome measures (PROMs) in autism research. Autism Res. 2024;17(4):690–701;
15. World Health Organization. The World Health Organization Quality of Life (WHOQOL)-BREF. World Health Organization; 2004.
16. WHOQOL Group. Development of the World Health Organization WHOQOL-BREF quality of life assessment. Psychological Medicine. 1998;28:551–558.
17. Oliveira SEH, Carvalho H, Esteves F. Toward an understanding of the quality of life construct: Validity and reliability of the WHOQOL-BREF in a psychiatric sample. Psychiatry Res. 2016;244:37–44;
18. Skevington SM, McCrate FM. Expecting a good quality of life in health: Assessing people with diverse diseases and conditions using the WHOQOL-BREF: Quality of life and WHOQOL-BREF use. Health Expect. 2012;15(1):49–62;
19. Skevington SM, Lotfy M, O’Connell KA, WHOQOL Group. The World Health Organization’s WHOQOL-BREF quality of life assessment: Psychometric properties and results of the international field trial. A Report from the WHOQOL Group. Qual Life Res. 2004;13(2):299–310;
20. Ayres M, Parr JR, Rodgers J, Mason D, Avery L, Flynn D. A systematic review of quality of life of adults on the autism spectrum. Autism. 2018;22(7):774–783;
21. Hong J, Bishop-Fitzpatrick L, Smith LE, Greenberg JS, Mailick MR. Factors associated with subjective quality of life of adults with autism spectrum disorder: Self-report versus maternal reports. J Autism Dev Disord. 2016;46(4):1368–1378;
22. Kamp-Becker I, Schröder J, Remschmidt H, Bachmann CJ. Health-related quality of life in adolescents and young adults with high functioning autism-spectrum disorder. Psychosoc Med. 2010;7; Doc03; ISSN 1860-5214. Published online
23. McConachie H, Mason D, Parr JR, Garland D, Wilson C, Rodgers J. Enhancing the validity of a quality of life measure for autistic people. J Autism Dev Disord. 2018;48(5):1596–1611;
24. Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983;67(6):361–370;
25. Merz EL, Roesch SC, Malcarne VL, et al. Validation of interpersonal support evaluation list-12 (ISEL-12) scores among English- and Spanish-speaking Hispanics/Latinos from the HCHS/SOL Sociocultural Ancillary Study. Psychol Assess. 2014;26(2):384–394;
26. Ephraim PL, MacKenzie EJ, Wegener ST, Dillingham TR, Pezzin LE. Environmental barriers experienced by amputees: The Craig hospital inventory of environmental factors–short form. Arch Phys Med Rehabil. 2006;87(3):328–333;
27. Cummins RA. The comprehensive quality of life scale—intellectual disability: An instrument under development. Australia and New Zealand Journal of Developmental Disabilities. 1991;17(2):259–264;
28. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal. 1999;6(1):1–55;
29. van de Schoot R, Lugtig P, Hox J. A checklist for testing measurement invariance. European Journal of Developmental Psychology. 2012;9(4):486–492;
30. Moss P, Mandy W, Howlin P. Child and adult factors related to quality of life in adults with autism. J Autism Dev Disord. 2017;47(6):1830–1837;
31. Williams ZJ, Everaert J, Gotham KO. Measuring depression in autistic adults: Psychometric validation of the beck depression inventory–II. Assessment. 2021;28(3):858–876;
32. Lee SY, Song XY, Skevington S, Hao YT. Application of structural equation models to quality of life. Structural Equation Modeling: A Multidisciplinary Journal. 2005;12(3):435–453;
33. Snell DL, Siegert RJ, Surgenor LJ, Dunn JA, Hooper GJ. Evaluating quality of life outcomes following joint replacement: Psychometric evaluation of a short form of the WHOQOL-BREF. Qual Life Res. 2016;25(1):51–61;
34. Chen WC, Wang JD, Hwang JS, Chen CC, Wu CH, Yao G. Can the web-form WHOQOL-BREF be an alternative to the paper-form? Soc Indic Res. 2009;94(1):97–114;
35. Reise SP. The rediscovery of Bifactor measurement models. Multivariate Behav Res. 2012;47(5):667–696;
36. Reise SP, Morizot J, Hays RD. The role of the bifactor model in resolving dimensionality issues in health outcomes measures. Qual Life Res. 2007;16 Suppl 1(S1):19–31;
37. Perera HN, Izadikhah Z, O’Connor P, McIlveen P. Resolving dimensionality problems with WHOQOL-BREF item responses. Assessment. 2018;25(8):1014–1025;
38. Hays DG, Wood C. Stepping outside the normed sample: Implications for validity. Measurement and Evaluation in Counseling and Development. 2017;50(4):282–288;
39. Clements CC, Watkins MW, Schultz RT, Yerys BE. Does the factor structure of IQ differ between the differential ability scales (DAS‐II) normative sample and autistic children? Autism Res. 2020;13(7):1184–1194;
40. Medeiros K, Mazurek MO, Kanne S. Investigating the factor structure of the child behavior checklist in a large sample of children with autism spectrum disorder. Research in Autism Spectrum Disorders. 2017;40:24–40;
41. Wilkinson E, Farmer C, Kleiman E, Bal VH. Factor structure of the VABS-3 comprehensive parent/caregiver form in autistic individuals: Poor fit of three-factor and unidimensional models. Autism. 2023;28(3):616–626;
42. Schiltz H, Williams ZJ, Zheng S, et al. Measurement matters: A commentary on the state of the science on patient reported outcome measures (PROMs) in autism research. PsyArXiv; 2023.
43. Evers K, Maljaars J, Schepens H, Vanaken G, Noens I. Conceptualization of quality of life in autistic individuals. Dev Med Child Neurol. 2022;64(8):950–956;
44. McConachie H, Wilson C, Mason D, et al. What is important in measuring quality of life? Reflections by autistic adults in four countries. Autism Adulthood. 2020;2(1):4–12;
45. Flake JK, Fried EI. Measurement schmeasurement: Questionable measurement practices and how to avoid them. Advances in Methods and Practices in Psychological Science. 2020;3(4):456–465.
46. Pellicano E, Heyworth M. The foundations of autistic flourishing. Curr Psychiatry Rep. 2023;25(9):419–427;
47. Feliciano P, Daniels AM, Green Snyder L, et al. SPARK: A US cohort of 50,000 families to accelerate autism research. Neuron. 2018;97(3):488–493;
48. Lee NR, McQuaid GA, Grosman HE, Jayaram S, Wallace GL. Vocational outcomes in ASD: An examination of work readiness skills as well as barriers and facilitators to employment identified by autistic adults. J Autism Dev Disord. 2022;54(2):477–490;
49. Rødgaard E, Jensen K, Miskowiak KW, Mottron L. Representativeness of autistic samples in studies recruiting through social media. Autism Res. 2022;15(8):1447–1456;
50. RStudio Team. RStudio: Integrated development environment for R. RStudio, PBC; 2021. Available from: http://www.rstudio.com/
51. Rosseel Y. LAVAAN: An R package for structural equation modeling. J Stat Soft. 2012;48(2);
52. Li CH. Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behav Res Methods. 2016;48(3):936–949;
53. Xia Y, Yang Y. RMSEA, CFI, and TLI in structural equation modeling with ordered categorical data: The story they tell depends on the estimation methods. Behav Res Methods. 2019;51(1):409–428;
54. Savalei V. Improving fit indices in structural equation modeling with categorical data. Multivariate Behav Res. 2021;56(3):390–407;
55. McNeish D, An J, Hancock GR. The thorny relation between measurement quality and fit index cutoffs in latent variable models. J Pers Assess. 2018;100(1):43–52;
56. Marsh HW, Hau KT, Wen Z. In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling: A Multidisciplinary Journal. 2004;11(3):320–341;
57. Chen FF. Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal. 2007;14(3):464–504;
58. Cheung GW, Rensvold RB. Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal. 2002;9(2):233–255;
59. Nørholm V, Bech P. The WHO Quality of Life (WHOQOL) questionnaire: Danish validation study. Nord J Psychiatry. 2001;55(4):229–235;
60. Ohaeri JU, Awadalla AW, El-Abassi AHM, Jacob A. Confirmatory factor analytical study of the WHOQOL-Bref: Experience with Sudanese general population and psychiatric samples. BMC Med Res Methodol. 2007;7(1):37;
61. Chung WS, Lan YL, Yang MC. Psychometric testing of the short version of the world health organization quality of life (WHOQOL-BREF) questionnaire among pulmonary tuberculosis patients in Taiwan. BMC Public Health. 2012;12(1):630;
62. Lin LC, Yao G. A review on the psychometric properties of the WHOQOL-BREF. Taiwan Journal of Public Health. 2019(38);
63. Lin LC, Yao G. Validation of the factor structure of the WHOQOL-BREF using meta-analysis of exploration factor analysis and social network analysis. Psychol Assess. 2022;34(7):660–670. Published online
64. Allison PD. Missing data techniques for structural equation modeling. J Abnorm Psychol. 2003;112(4):545–557;
65. Newman DA. Missing data: Five practical guidelines. Organizational Research Methods. 2014;17(4):372–411;
66. Beck KB, Terhorst LA, Greco CM, Kulzer JL, Skidmore ER, McCue MP. Item understanding of common quality of life measures for use with autistic adults. J Autism Dev Disord. 2023;
67. Power MJ, Green AM, The WHOQOL-Dis Group. Development of the WHOQOL disabilities module. Qual Life Res. 2010;19(4):571–584;
68. Williams ZJ, Gotham KO. Assessing general and autism‐relevant quality of life in autistic adults: A psychometric investigation using item response theory. Autism Res. 2021;14(8):1633–1644;
69. Nicolaidis C, Raymaker DM, McDonald KE, et al. Creating accessible survey instruments for use with autistic adults and people with intellectual disability: Lessons learned and recommendations. Autism Adulthood. 2020;2(1):61–76;
70. Jones DR, Nicolaidis C, Ellwood LJ, et al. An expert discussion on structural racism in autism research and practice. Autism Adulthood. 2020;2(4):273–281;
71. West EA, Travers JC, Kemper TD, et al. Racial and ethnic diversity of participants in research supporting evidence-based practices for learners with autism spectrum disorder. J Spec Educ. 2016;50(3):151–163;
72. Giwa Onaiwu M. “They don’t know, don’t show, or don’t care”: Autism’s white privilege problem. Autism Adulthood. 2020;2(4):270–272;
Information & Authors
Information
Published In
Autism in Adulthood
Copyright
Copyright 2024, Mary Ann Liebert, Inc., publishers.
History
Published online: 17 June 2024
Topics
Authors
Author Disclosure Statement
The authors declare that they have no conflict of interest.
Funding Information
Support for writing this article was provided, in part, by the Children’s Hospital of Philadelphia Women’s Committee (E.A.K.-K.) and the Autism Science Foundation Accelerator Grant (E.A.K.-K.). Additional support was provided by the National Institutes of Health to E.A.K.-K. (under grant R01MH133838), G.A.M. (under grants R01MH100028; K01MH129622), N.R.L. (under grants R21HD100997; R21HD106164), B.E.Y. (under grants R21MH129777; R01MH133838; P50HD105354), and G.L.W. (under grants R01MH100028; R21HD106164; R21MH129777; P50HD111142; R01MH133838).
Metrics & Citations
Metrics
Citations
Export Citation
Export citation
Select the format you want to export the citations of this publication.
View Options
Get Access
Access content
To read the fulltext, please use one of the options below to sign in or purchase access.⚠ Society Access
If you are a member of a society that has access to this content please log in via your society website and then return to this publication.