2022/02/10 by Ashwin A. Kotwal, Ashwin Kotwal, Irena S. Cenzer +6 · 28 citations
Social Sciences · Health Professions · #Health disparities and outcomes #Employment and Welfare Studies #Health, psychology, and well-being
paper · doi:10.1111/jgs.17700
Loneliness is common, particularly during the COVID-19 pandemic, prompting many clinicians and researchers to assess for loneliness.1-3 However, the best approach for screening is unclear. One option is a single question directly asking about loneliness (“how often are you lonely?”). However, concerns about sensitivity or stigma surrounding self-identifying as “lonely” have led to use of multi-item scales that avoid the term “lonely,”4 which can be time-intensive or unfamiliar to clinicians.5 The COVID-19 pandemic presents a unique opportunity to revisit the use of the single loneliness question for two reasons. First, societal perceptions of identifying as “lonely” may have changed due to social restrictions, making it a common experience more openly discussed. Second, national surveys now (a) include both single direct loneliness questions and longer scales, and (b) have similar administration protocols for each assessment, making comparisons of performance more feasible. If the single question performs similarly to longer scales, it could reduce barriers to loneliness assessments in clinical and research settings. Our objective was therefore to compare the relationship between the single question and scale loneliness assessments in COVID-19 and pre-pandemic samples. We used the nationally-representative National Social Life Health and Aging Project (NSHAP), including participants interviewed in Round 3 (R3) (2015–2016), and re-interviewed in the COVID-19 supplement (September 14, 2020–January 27, 2021) (conditional response rate: 58%), yielding a sample of 2168 community-dwelling older adults.6 Loneliness was measured using a single direct question (“how often do you feel lonely”) and the gold-standard 3-item UCLA Loneliness scale (range: 3–9 points) at both study time points.7 There were notable differences in administration of each assessment in pre-pandemic data which were resolved in COVID-19 data (described in Table S1). For the single loneliness assessment, we categorized responses of “some of the time” or higher as indicating loneliness based on prior literature and consistency of this category between waves.8, 9 Demographic and health measures included age, gender, marital status, education, depression, self-reported happiness, and self-reported health. We first re-established the optimal cut-point to translate between the single question and the UCLA scale (range: 3–9 points) using receiver operating characteristic (ROC) curves,4 and computed the area under the curve (AUC), a global measure of test discrimination. We prioritized a cut-point minimizing false negatives as more harm might arise in a clinical setting from failing to identify individuals as lonely. We then examined the bivariate associations of the single question and the UCLA scale with demographic and health measures to demonstrate construct validity and whether different sub-groups responded differently to each assessment. Analyses were stratified by the time of data collection (2015–2016 vs. COVID-19) and made use of provided sample weights. At baseline, participants were on average 63.9 years old (SD = 8.8, 50–64: 55%, 65–74: 32%, 75–84: 11%, 85–94: 2%), 56% female, 71% married, 9% Black/African American, and 6% Hispanic, Non-White. There was an increase in loneliness from pre-pandemic to COVID-19 data for both loneliness assessments (single question: 28%–32%, p-value = 0.007; UCLA scale: 18%–21%, p-value = 0.03). ROC curves demonstrated the positive response on the single question corresponded most optimally with a cut-point of ≥6 points on the UCLA scale, and that the AUC was higher in the COVID-19 data (AUC = 0.908, 95% CI: 0.89–0.92) compared with the pre-pandemic data (AUC = 0.751, 95% CI: 0.73–0.77, Figure 1). The single question had 90% sensitivity and 83% specificity for identifying individuals scoring ≥6 points on the UCLA scale, with a lower rate of false negatives in COVID-19 data compared to pre-pandemic data (3% vs. 10%; Table S2). Loneliness differed by education level when using the single question, but did not differ when using the UCLA scale (p-value for difference = 0.02) (Table 1). Health measures, including depression, happiness, and self-rated health, were strongly correlated with both loneliness assessments at a similar magnitude. In a nationally-representative sample of community-dwelling older adults, the single question “how often are you lonely?” was sufficient to classify individuals as lonely during the COVID-19 pandemic. The single question misclassified only 3% of those identified as lonely by the longer measure. Notably, both measures were strongly, and similarly associated with mental health, including depression, happiness, and self-rated health, suggesting strong construct validity of the single question and that both assessments can provide important clinical insight into psychological well-being. The substantially stronger association between the single question and 3-item UCLA scale during than before the pandemic may be attributable to (1) normalization and reduced stigma of identifying as lonely, and (2) the use of identical administration protocols for the two assessment types during the pandemic in contrast to substantial differences in prior rounds of NSHAP and other national surveys (see Table S1).4 Taken together, while longer scales remain appropriate for comprehensive assessments of loneliness, results suggest a single question is a reasonable candidate to reduce barriers to screening in time-limited surveys or clinical settings, and could be incorporated into comprehensive, multi-domain assessments of the social determinants of health. Results are generalizable to community-dwelling adults without severe cognitive impairment, age 50 or older. An important limitation is that NSHAP respondents were relatively anonymous, in contrast to clinical settings where individuals are not de-identified; stigma and sensitivity may consequently still play a role in false negative responses to the single question. Future work in diverse clinical settings can determine if the single question loneliness assessment performs similarly to these survey results. All authors report no conflicts of interest. Dr. Ashwin Kotwal's effort on this project was supported by grants from the National Institute on Aging (K23AG065438 and R03AG064323), the NIA Claude D. Pepper Older Americans Independence Center (P30AG044281), the National Palliative Care Research Center Kornfield Scholar's Award, and the Hellman Foundation Award for Early-Career Faculty. The National Social life Health and Aging Project is supported by grants from the NIA (AG043538-08S1, R01AG021487, R01AG033903, R01AG043538, R01AG048511, and R37AG030481). Conception and design: Ashwin A. Kotwal, Irena Cenzer, and Louise Hawkley. Acquisition of the data: Linda Waite and Louise Hawkley. Analysis and interpretation: Ashwin A. Kotwal, Irena Cenzer, Linda Waite, Alexander Smith, Carla Perissinotto, and Louise Hawkley. Drafting and revising manuscript: Ashwin A. Kotwal, Irena Cenzer, Linda Waite, AS, Carla Perissinotto, and Louise Hawkley. Approval of final manuscript: Ashwin A. Kotwal, Irena Cenzer, Linda Waite, Alexander Smith, Carla Perissinotto, and Louise Hawkley. The sponsor had no role in the design, methods, data collection, analysis, or preparation of the paper. Table S1. Differences in administration protocol of the Single Item and UCLA 3-Item loneliness assessments between NSHAP Round 3 (2015–2016) and COVID-19 data. Table S2. Relationship of Single Loneliness Question to 3-item UCLA Loneliness Scale in data collected during the COVID-19 pandemic and pre-pandemic (2015–2016). Highlighted boxes indicate the rates of false negatives when using the single question. All percentages are row percentages. Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article.