Skip to main content

Screening for cognitive symptoms in dialysis patients with an extended version of Kidney Disease Quality of Life Cognitive Function subscale (KDQOL-CF): a validation study

Abstract

Background

Cognitive impairment and cognitive complaints are highly prevalent in haemodialysis patients and are associated with adverse health outcomes. Currently, there is no established guideline on cognitive screening in this population. Although neuropsychological tests are the gold standard measure of cognition, they are time-consuming and require trained personnel. The Kidney Disease Quality of Life Cognitive Function subscale (KDQOL-CF), a self-administered questionnaire with only three items, may be a feasible alternative for busy renal settings. In this study, we validated an extended version of KDQOL-CF by including an additional memory item (i.e., “How much of the time during the past four weeks did you have memory difficulties?”) to improve its ability to capture memory impairments that are common in dialysis patients but missing in the original scale.

Methods

A total of 268 haemodialysis patients treated in 10 dialysis centres in Singapore completed the extended KDQOL-CF and gold standard measures of objective cognition (Montreal Cognitive Assessment) and subjective cognition (Patient’s Assessment of Own Functioning Inventory). Patients also self-reported their functional impairment and treatment nonadherence. Statistical analyses were performed to determine the factor structure and psychometric properties of the extended KDQOL-CF. Receiver operating characteristic curve analyses were conducted to determine the diagnostic ability of the extended KDQOL-CF in identifying objective cognitive impairments and subjective cognitive complaints. Additionally, we examined associations between the extended KDQOL-CF and patients’ self-reported functional impairment and treatment nonadherence.

Results

The extended KDQOL-CF can be explained by a one-factor model and has good internal consistency and convergent validity. Receiver operating characteristic curve analysis provided support for the diagnostic accuracy of the extended KDQOL-CF in identifying objective cognitive impairments (area under curve = 60.9%) and subjective cognitive complaints (area under curve = 76.2%). The extended KDQOL-CF also performed better than the original KDQOL-CF in predicting functional impairment and treatment nonadherence in the recruited patients.

Conclusions

The extended KDQOL-CF may be used as a first-step cognitive screening tool in dialysis settings to offer a gateway for further diagnostic evaluation and preventive or rehabilitative programs.

Peer Review reports

Introduction

Cognitive impairments (CIs) are very common in haemodialysis (HD) patients. Studies using neuropsychological tests have found that less than 30% of HD patients had intact cognitive function, and more than half had moderate to severe CIs [1, 2]. Other studies have assessed patient-perceived CIs, or subjective cognitive complaints (SCCs), that were found to be present in more than two thirds of HD patients [3]. Both objective and subjective CIs have been associated with adverse health outcomes including functional impairment, treatment nonadherence, poor quality of life, hospitalisation, and mortality [3,4,5,6,7,8,9]. However, CIs in HD patients are poorly recognised; less than 15% of those with CIs had chart documentation [2, 6].

Identifying objective CIs in HD patients is pivotal as it enables healthcare providers to establish diagnosis, initiate cognitive rehabilitation or compensatory strategies, and may allow for advance care planning as appropriate. Although research on the effectiveness of interventions targeting CIs in HD patients is scarce, several strategies have shown promising results. In particular, a recent randomised controlled trial showed that a 12-week combined intradialytic cycling and cognitive training program significantly enhances cognitive function among HD patients [10]. There is also evidence that certain renal replacement modalities result in better cognitive outcomes. Kidney transplantation significantly improves cognitive function in dialysis patients [11]. Cooled dialysis offers cognitive benefits including better systemic haemodynamic stability, less alteration in cerebral white matter, and less cerebral ischaemic incidents during HD [1, 12, 13]. Interventions aimed at improving toxin clearance, such as nocturnal daily HD [14], and haemodiafiltration in the recent CONVINCE trial [15], have also demonstrated cognitive advantages over conventional thrice-weekly HD.

Assessing SCCs is equally important because they reflect patients’ experienced cognitive difficulties in everyday life that interfere with functional capacity and treatment adherence [4, 5, 9]. Also, SCCs are now regarded as a prodromal marker of future progression to mild CIs and dementia, which may offer a gateway to further neuropsychological evaluation or preventive programs [16, 17]. To date, research in the context of chronic kidney disease has primarily focused on objective CIs and neuropsychological performance, with SCCs typically thought to be unreliable or inaccurate.

Several studies have validated the Montreal Cognitive Assessment (MoCA), with results showing variable sensitivity and specificity for identifying objective CIs in HD patients [18,19,20]. There is a growing consensus that MoCA is a screening tool superior to other objective measures such as the Mini-Mental State Examination (MMSE) because of its inclusion of executive function, a domain predominantly impaired in HD patients [21]. Despite mounting evidence supporting the use of MoCA in this population [18,19,20,21], its implementation in real-world dialysis settings as a first-step screener can be challenging. MoCA on average takes 10–15 min to complete for each dialysis patient and requires trained personnel to administer and score the tests [19]. It is both time-consuming and costly to administer MoCA in all patients especially in settings with staff shortage and limited training resources.

In light of this challenge, short self-reported measures may be a viable alternative that offers the benefits of brevity and ease of administration and interpretation, and may allow for universal cognitive screening in dialysis settings [22]. In a recent systematic review of 221 studies on SCCs in end-stage kidney disease, a total of 13 self-reported measures of SCCs used in this population were identified [3], including questionnaires specifically designed to measure SCCs, composite measures with a cognition subscale, and cognition-related items in electronic item banks. Among these, the Kidney Disease Quality of Life Cognitive Function subscale (KDQOL-CF) [22] was the most frequently used measure; more than 90% of the 221 included studies employed this measure [3]. This tool consists of three items that inquire about patients’ experiences with slow reaction time, concentration difficulties, and confusion over the past four weeks. This tool may be particularly well-suited for renal settings globally, as it is available in various languages, is already in use, and does not necessitate extensive training. Patients can self-administer and complete it within one minute, making it a highly feasible alternative to objective cognitive measures. However, only two studies have validated the KDQOL-CF, with inconclusive results.

Kurella et al. assessed the KDQOL-CF in 79 HD patients and 78 non-dialysis patients with stage 3–5 chronic kidney disease [22]. They found a significant correlation between KDQOL-CF scores and performance on the Modified MMSE (3MS). The authors also recommended a cut-off point of 60 (out of 100) on KDQOL-CF to identify objective CIs, with a specificity of 82% and sensitivity of 52% [22]. A limitation of this study, however, was the use of 3MS as the reference standard, which may underestimate the prevalence of executive functional impairment due to its primary focus on memory. A subsequent validation study was conducted using a more comprehensive neuropsychological battery. In the 168 HD patients recruited, Sorensen et al. found no correlation between KDQOL-CF scores and objective cognitive performance [23]. It was also found that a cut-off point of 60 on KDQOL-CF had generally poor sensitivity (28–36%) and modest specificity (77–81%) in identifying executive functional and memory impairments [23]. It was hence concluded that KDQOL-CF is a poor determinant of objective cognitive performance.

Both validation studies determined the clinical utility of KDQOL-CF solely based on its relevance to neuropsychological tests. However, KDQOL-CF is essentially a measure of SCCs and hence its validity should also be examined against established SCC measures. Moreover, the cognitive domains assessed in the neuropsychological tests of these two studies were not well aligned with the content of KDQOL-CF items. Most notably, both validation studies adopted objective tests of memory ability [22, 23], but memory complaints were not assessed in the KDQOL-CF measure. This lack of memory item is problematic since memory impairments are common in the dialysis population [1], and are often considered an important barrier to treatment adherence [24]. As such, the current study aimed (1) to develop an extended version of KDQOL-CF with the addition of a new memory question, (2) to validate the original and extended versions of KDQOL-CF against established measures of objective and subjective CIs, (3) and to examine associations between the KDQOL-CF and other key endpoints such as functional disability and treatment adherence.

Methods

Participants

A convenience sample of HD patients was recruited from the National Kidney Foundation Singapore (NKF). The inclusion criteria were: (1) 21 years of age or older, (2) diagnosed with end-stage kidney disease and have undergone HD treatment for at least 3 months, and (3) fluent in either English or Mandarin. The exclusion criteria were: (1) only fluent in dialects, (2) unable to give consent due to psychiatric diagnoses or established diagnosis of dementia, or (3) unable to complete survey/assessment due to visual or hearing impairments.

Procedure

The study protocol was approved by the institutional review board of Nanyang Technological University (IRB-2021-025). A list of eligible patients was provided by the nurse managers at each dialysis centre. Study team members fluent in the patients’ preferred language approached each patient during one of their regular dialysis sessions. Following written informed consent, the following instruments were administered. Upon completion, patients were given a cash reimbursement.

Measures

Objective cognitive function

The Montreal Cognitive Assessment (MoCA) was used as the reference standard for objective CIs in the current study. The MoCA is a brief cognitive screening test that assesses visuospatial and executive functions (i.e., Trail-Making Test part B, cube copy, clock drawing, abstraction), attention (i.e., digit span forward and backward, vigilance, serial-7 subtraction), short-term memory (i.e., delayed recall), language (i.e., naming, sentence repetition, verbal fluency), and orientation (i.e., awareness of time and place) [25]. The test was administered by trained interviewers. The total score of MoCA can range from 0 to 30. A cut-off score of 23.5 has been suggested as the optimal threshold (99% sensitivity and 74% specificity) to differentiate HD patients with and without CIs [18].

Subjective cognitive function

The Kidney Disease Quality of Life (KDQOL) instrument is a self-administered questionnaire designed to assess health-related quality of life in patients with kidney disease [26, 27] and has been validated in HD patients in Singapore [28, 29]. Its cognitive function subscale (i.e., KDQOL-CF) assesses SCCs using three items: “How much of the time during the past 4 weeks did you (1) react slowly to things that were said or done, (2) have difficulty concentrating or thinking, and (3) become confused” [22]. In the current study, we added a new item to this measure in order to capture memory complaints (i.e., “How much of the time during the past four weeks did you have memory difficulties?”). Participants were asked to respond to each item on a six-point Likert scale, which were then transformed to scores ranging from 0 to 100 (0 = all of the time, 20 = most of the time, 40 = a good bit of the time, 60 = some of the time, 80 = a little of the time, 100 = none of the time) [22]. The total score of KDQOL-CF is the average of all items and can range from 0 to 100, with higher scores indicating better self-perceived cognitive functioning [26, 27].

We also administered the 33-item Patient’s Assessment of Own Functioning Inventory (PAOFI) as a gold standard measure for SCCs [30]. This measure assesses the frequency of experienced everyday cognitive difficulties in four domains: memory (10 items; e.g., “How often do you forget people whom you met in the last day or two?”), language (nine items; e.g., “How often do you have difficulty thinking of the names of things?”), motor/sensory-perceptual ability (five items; e.g., “How often do you have difficulty feeling things with your right hand?”), and higher-level cognitive functions (nine items; e.g., “How often do you have difficulty finding your way about?”). Participants rated on a six-point Likert scale (1 = almost never, 2 = very infrequently, 3 = once in a while, 4 = fairly often, 5 = very often, 6 = almost always) [30]. Higher scores indicate more frequent SCCs. Woods et al. suggested that the presence of three or more items on PAOFI endorsed as “almost always”, “very often”, or “fairly often” is indicative of the presence of SCCs [31]. This cut-off point has also been used in other patient populations including HIV [31, 32] and cancer patients [33] to diagnose neurocognitive disorders.

Functional impairment

We assessed functional impairment using the Work and Social Adjustment Scale (WSAS) [34]. Participants rated their self-perceived functional impairment in five domains (i.e., work, home management, social leisure activities, private leisure activities, and social relationships) due to cognitive difficulties on a nine-point Likert scale ranging from 0 (i.e., “not at all impaired”) to 8 (i.e., “very severely impaired”).

Treatment adherence

Patients’ self-reported medication adherence was measured by the five-item Medication Adherence Report Scale (MARS-5 ©Professor Rob Horne), which was rated on a five-point scale ranging from “never” to “always” [35]. A higher total score indicates poorer medication adherence. The Dialysis Diet and Fluid non-adherence Questionnaire (DDFQ) was also assessed, which is a four-item scale that assesses frequency and degree of dietary and fluid nonadherence in dialysis patients [36]. No total score can be calculated for DDFQ. Instead, four scores were derived, each representing a distinct aspect of adherence (i.e., frequency of diet nonadherence, degree of diet nonadherence, frequency of fluid nonadherence, and degree of diet nonadherence).

Sociodemographic and clinical information

Self-reported demographic information was collected, including age, gender, ethnicity, education, relationship status, and employment status. Clinical information including primary kidney disease diagnosis, comorbidities, duration on HD, dialysis adequacy (Kt/V), and medication count, were extracted from patients’ medical record.

Statistical analyses

Statistical analyses were performed in R 4.2.2 [37]. Descriptive statistics were computed for sociodemographic, clinical, and cognitive variables. To validate the extended KDQOL-CF, we first conducted a confirmatory factor analysis (CFA) to determine the dimensionality of this four-item scale. Model fit was assessed based on the Comparative Fit Index (CFI), Tucker–Lewis Index (TLI), the Root Mean Square Error of Approximation (RMSEA), the Standardised Root Mean Square (SRMR), and the Chi-square [38]. Good model fit was indicated by CFI and TLI values above 0.95, RMSEA values lower than 0.06, and SRMR values lower than 0.08 [38, 39]. Internal consistency of the extended KDQOL-CF was then examined using Cronbach’s alpha, alpha if item deleted, corrected item-scale correlations, and inter-item correlations [40]. Internal consistency was considered acceptable if (1) Cronbach’s alpha was greater than 0.70, (2) deleting any item decreased the alpha, (3) corrected item-scale correlations were greater than 0.50, (4) inter-item correlations ranged from 0.15 to 0.85, and (5) average inter-item correlation was between 0.15 and 0.50 [40]. We also assessed the convergent validity (i.e., the degree to which two measures that theoretically should be related, are in fact related) of the extended KDQOL-CF by performing correlation analyses between KDQOL-CF scores and scores on MoCA and PAOFI. Receiver operating characteristic (ROC) curve analysis was conducted to determine the diagnostic ability of the original and extended versions of KDQOL-CF in identifying patients with objective CIs based on MoCA and patients with SCCs based on PAOFI. The area under curve (AUC) was used as a global measure of diagnostic accuracy. An AUC lower than 0.6 was considered bad or not useful, whereas an AUC between 0.6 and 0.7 was considered sufficient, and an AUC above 0.7 was considered good [41]. Finally, we examined differences in functional impairment and treatment adherence between patients scoring below vs. above the optimal cut-off points on the original and extended KDQOL-CF.

Results

Participant characteristics

A total of 369 eligible HD patients in NKF dialysis centres were invited to the study from May to November 2022. Two-hundred-and-sixty-eight patients agreed to participate (response rate 72.6%). The main reasons for rejection were lack of interest and feeling unwell. Table 1 reports the sociodemographic and clinical profiles of the sample, as well as scores on cognitive measures. The mean age of the sample was 59.87 (SD = 11.72). The majority of patients were male (57.5%), Chinese (56.3%), and with secondary education (50.6%). Patients on average had been on HD for 78.85 months (SD = 62.80). All patient participants at the time of study were on a high-flux HD regimen that comprised three four-hour sessions per week.

Table 1 Sample characteristics (N = 268)

Confirmatory factor analysis

We performed a CFA to test whether the four items of KDQOL-CF can be explained by one general factor. Results showed that the one-factor model had excellent fit: CFI = 0.999, TLI = 0.998, RMSEA = 0.021, SRMR = 0.015, χ2(2) = 2.237 (p = .327). This confirmed the unidimensionality of the 4-item KDQOL-CF.

Internal consistency

Table 2 reports data on the internal consistency of the extended KDQOL-CF. The Cronbach’s alpha was 0.80. Cronbach’s alpha if item deleted ranged from 0.69 to 0.78, suggesting that removing any item from the scale would decrease the overall alpha. Corrected item-scale correlations were all greater 0.50. Inter-item correlations ranged from 0.40 to 0.61, and the average inter-item correlation was 0.50, which were all within the recommended ranges. These results showed that the extended KDQOL-CF has good internal consistency.

Table 2 Internal consistency of the extended kidney disease quality of life cognitive function subscale

Convergent validity

We then examined correlations between KDQOL-CF items and scores on MoCA and PAOFI to establish the convergent validity of the extended KDQOL-CF (see Table 3). The three original KDQOL-CF items each correlated significantly with performance on visuospatial/executive, attention, and language subtests of MoCA, but were not associated with performance on memory or orientation subtests. The new memory item was significantly correlated with performance on attention, memory, and language subtests of MoCA. This memory item was the only item in the extended KDQOL-CF that correlated with the MoCA memory score. The KDQOL-CF scores were also correlated with PAOFI scores, with moderate effect sizes. The new memory item had the strongest correlation with the PAOFI memory subscale among other KDQOL-CF items.

Table 3 Convergent validity of the extended kidney disease quality of life cognitive function subscale

ROC curve analysis

ROC curve analyses were performed to examine the diagnostic ability of the original and extended versions of KDQOL-CF in identifying objective CIs (see Fig. 1). When using the MoCA cut-off point as the reference standard for objective CIs, the AUC for the original and extended versions of KDQOL-CF were 62.3% and 60.9%, respectively, which were both considered sufficient. There was no significant difference between these two ROC curves (p = .183). A cut-off point of 85 on the extended KDQOL-CF achieved the greatest balance between sensitivity and specificity (specificity = 57.9%, sensitivity = 61.8%, positive predictive value = 72.8%, negative predictive value = 45.5%). That is, patients who score 85 or lower on the extended KDQOL-CF are considered as having objective CIs.

Fig. 1
figure 1

Receiver operating characteristics (ROC) curve for the original and extended versions of Kidney Disease Quality of Life Cognitive Function subscale (Montreal Cognitive Assessment as the reference standard for objective cognitive impairments)

When using the PAOFI cut-off point as the reference standard for presence of SCCs, the AUC for the original and extended versions of KDQOL-CF were 74.8% and 76.2%, respectively, which were both considered good (see Fig. 2). There was no difference between these two ROC curves (p = .173). A cut-off point of 75 achieved the greatest balance between sensitivity and specificity (specificity = 78.9%, sensitivity = 62.9%, positive predictive value = 62.9%, negative predictive value = 78.9%). Raising this cut-off point to 85 increased sensitivity to 78.4% but decreased specificity to 58.5%.

Fig. 2
figure 2

Receiver operating characteristics (ROC) curve for the original and extended versions of Kidney Disease Quality of Life Cognitive Function subscale (Patient Assessment of Own Functioning Inventory as the reference standard for subjective cognitive complaints)

Of note, the original cut-off point of 60 on the three-item KDQOL-CF derived by Kurella et al. [22] had very low sensitivity in identifying objective CIs based on MoCA (8.7%), and SCCs based on PAOFI (15.5%), in the current sample.

Associations with other outcomes

  • Finally, we compared the original and extended versions of KDQOL-CF in terms of their ability to predict other important dialysis outcomes including functional impairment and treatment adherence (see Table 4). We classified study participants into two groups based on the cut-off point of 60 on the original KDQOL-CF (i.e., a score < 60 considered as having SCCs) and compared their scores on WSAS, MARS-5, and DDFQ. Patients with SCCs based on the original KDQOL-CF had more severe functional impairment and medication nonadherence compared to those without, but there was no difference in dietary and fluid adherence. We then classified patients into two groups based on the newly-derived cut-off point of 85 on the extended KDQOL-CF. Patients with SCCs based on the extended KDQOL-CF had more severe functional impairment, and medication, fluid, and diet nonadherence, compared to those without.

Table 4 Difference in daily functioning and treatment adherence between patients with and without significant cognitive complaints

Discussion

The high prevalence rate of CIs in HD patients, coupled with logistical constraints that hinder the implementation of neuropsychological assessments in routine care, highlight the need for self-reported cognitive screeners, but the validity and suitability of existing self-report tools have been called into doubt. In this study, we validated an extended version of the KDQOL-CF with the addition of a memory item. Our findings indicate that the extended KDQOL-CF exhibit unidimensionality, good internal consistency, and convergent validity as evidenced by significant correlations with established measures of objective and subjective CIs. The derived cut-off point of 85 (out of 100) on the extended KDQOL-CF offers a practical threshold for identifying HD patients with objective CIs and/or SCCs, demonstrating superior performance compared to the original version in predicting functional impairment and treatment nonadherence.

One key finding was the significant associations between the extended KDQOL-CF and performance on MoCA. Most notably, the new memory item was the only item within KDQOL-CF that correlated with performance on the delayed recall task which assesses short-term memory. The memory item was also correlated with performance on attention and language subtests of MoCA. It could be that some of these subtests such as backward digit span and sentence repetition required participants’ working memory, hence were associated with subjective memory complaints. These findings suggest that the inclusion of the memory item in the KDQOL-CF is essential to improve the scale’s ability to capture memory impairments and complaints. Previous research has shown that HD patients perform significantly worse on memory tasks compared to non-dialysis patients and the general population [24, 42, 43]. Self-reported forgetfulness and impairments in both retrospective and prospective memory are also key barriers to treatment adherence in the context of dialysis [24, 44, 45]. The omission of memory domain in the original KDQOL-CF is therefore problematic.

Despite the significant associations between the extended KDQOL-CF and MoCA scores, it is of note that these correlations were generally weak in magnitude. Also, ROC curve analysis showed modest sensitivity (61.8%) and specificity (57.9%) of the extended KDQOL-CF in classifying MoCA status. The implication is that a score higher than 85 on the extended KDQOL-CF may not necessarily indicate intact cognition. Indeed, research in the Alzheimer’s disease literature suggests that individuals with more advanced CIs may have diminished insight, a phenomenon known as anosognosia, where individuals are unable to recognise their own cognitive deficits [46]. This suggests that the predictive power of subjective cognitive measures such as KDQOL-CF may be stronger at earlier stages of kidney disease and the preclinical stage of CIs, where individuals start experiencing subtle cognitive changes in everyday life while exhibiting normal performance on objective tests [17]. This highlights the potential of KDQOL-CF to be administered periodically in renal settings to monitor patients’ cognition prior to the diagnosis of kidney failure or initiation of dialysis before CIs become too severe or irreversible. Nevertheless, the sensitivity of the extended KDQOL-CF reported in the current study is already higher than that of the original cut-off point on the three-item KDQOL-CF (i.e., 52% in Kurella et al. [22]; 28–36% in Sorensen et al. [23]; 8.7% in the current study). It could be that the additional memory item improved the measure’s ability in detecting memory impairments. Future studies need to determine an optimal set of SCC items that captures complaints in various domains to achieve better diagnostic accuracy.

The current study is the first attempt to validate the KDQOL-CF against a comprehensive SCC questionnaire. There is a growing recognition that SCCs comprise a valid clinical endpoint and a core patient-reported outcome even in the absence of objective CIs. These complaints may represent a preclinical stage of cognitive decline that predicts future progression [17], and may indicate an increased risk of impairments in decision-making, self-care, and functional capacity [4, 5, 9]. In the current sample, patient responses to the extended KDQOL-CF and PAOFI were moderately correlated. These correlations also showed domain specificity where the new memory item, among all four KDQOL-CF items, had the strongest correlation with the memory subscale of PAOFI. The utility of the extended KDQOL-CF to identify SCCs in HD patients was further supported by ROC curve analysis where a score of 75 was considered the optimal cut-off. However, as a first-stage screening tool in prevalent HD patients where sensitivity should be preferred, we recommend adopting a cut-off point of 85 (same as the cut-off for identifying objective CIs) which has a sensitivity of 78.4% and specificity of 58.5%. This cut-off point was also able to identify patients at risk of functional impairment and treatment nonadherence, which may allow for early intervention and initiation of support strategies in clinical practice.

Overall, the current study suggests a need to include a memory item in the KDQOL-CF measure and a need to raise its cut-off point on the extended scale. When dialysis patients report SCCs on the extended KDQOL-CF, it may simultaneously indicate the presence of objective CIs that need further neuropsychological evaluation, the presence of everyday cognitive difficulties that need to be supported or compensated with cognitive rehabilitative interventions, and potential functional disability and treatment nonadherence that need to be addressed to improve prognostic outcomes. Although there is still room for improvement regarding the predictive power of KDQOL-CF, it should be highlighted that its current classification accuracy was achieved using only four self-reported items that can be completed by patients within one minute without the need for trained staff. Self-reported cognitive screeners such as the extended KDQOL-CF may prove to be a cost-effective first-stage screener in a step-up diagnostic framework, followed by more comprehensive cognitive assessments (e.g., MoCA), referral to specialists, and revision of the care plan.

Currently, however, there is a lack of established protocol in renal settings to address HD patients’ cognitive challenges following identification. Interventions aimed at improving toxin clearance through novel dialysis modalities, such as nocturnal daily HD [14] and haemodiafiltration [15], have demonstrated cognitive advantages over conventional HD. Lifestyle interventions such as intradialytic cycling and cognitive training through tablet games have also shown potential to enhance cognitive function among HD patients [10]. Besides facilitating interventions that directly target cognition, it is of note that the identification of cognitive difficulties through tools like the extended KDQOL-CF serves a broader purpose. The results of cognitive screening can be used as a reference for healthcare providers to adjust their approach to patient care. For instance, providers may tailor communication strategies to patients’ cognitive capacity, using simpler instructions and clearer language. Involving family members in the care process is particularly important to ensure the safety and well-being of patients with cognitive issues. Furthermore, given the increased risk of nonadherence in patients with SCCs as evidenced in this study, it may be necessary to consider strategies to modify and/or support the complex medical regimen prescribed to this subgroup. In this light, cognitive screening in renal settings is not merely a precursor to intervention but also a cornerstone for delivering patient-centred care.

Research on the clinical utility of SCC measures is still in its infancy. In dementia research, SCCs are considered a prodromal marker of CIs [17]. In the context of cancer, SCCs serve as a stand-alone outcome measure that has important patient implications [47]. In kidney disease research, however, SCCs have frequently been assessed as a secondary outcome, and in some studies regarded as a mere reflection of psychological distress. While neuropsychological tests remain the gold standard measure of cognition, they are not the sole indicators of overall cognitive well-being. We therefore propose three future directions in this area. First, there is growing evidence in the Alzheimer’s disease literature showing that SCCs emerge prior to clinical CIs and constitute an independent risk factor for progression to dementia [17, 48,49,50]. However, the role of SCCs as a prodromal marker in the context of kidney disease remains to be tested. Relatedly, self-reported measures such as the KDQOL-CF may be a more sensitive tool in earlier stages of chronic kidney disease when CIs are milder than in advanced stages post-dialysis initiation. These hypotheses should be investigated in future longitudinal studies. Another important next step would be to relate subjective cognitive measures to more comprehensive assessments of neuropsychological, neuroimaging, and biological parameters of CIs to further confirm their convergent validity. Third, to overcome the limitations of self-report in stages of severe CIs where anosognosia may be present, informant-report of SCCs may be particularly useful. Research has indicated that informant-reports are more accurate than self-reports at advanced stages of dementia [17], and are an independent predictor of diagnostic conversion to objective CIs [51]. Exploring caregivers’ perspective of patients’ cognitive abilities may be a fruitful area of future research.

While this study focuses on validating the extended KDQOL-CF, a conventional pencil-and-paper questionnaire, computerised methodologies such as the Patient Reported Outcome Measurement Information System (PROMIS), developed based on item response theory to calibrate items, may also be a viable alternative for routine testing as these enable computerised adaptive testing and a time-efficient and personalised assessment [52]. The application of PROMIS for evaluating SCCs in kidney disease research has only emerged recently [15, 53]. While we recognise that these features offer great advantages for use in dialysis settings, our decision to concentrate on the KDQOL-CF was driven by its widespread acceptance and utilisation in research, clinical trials, and clinical practice globally [3]. By adding a memory item to KDQOL-CF, we provide clinicians with an easily administered tool to screen for cognitive difficulties before assessor-administered evaluation such as MoCA are recommended.

Some limitations warrant acknowledgement. The extended KDQOL-CF was validated in a sample of prevalent HD patients who had been on dialysis for an average of six years at the time of assessment. More work is needed to evaluate the utility of this measure in other kidney disease segments such as incident HD patients, and patients on other treatment modalities such as peritoneal dialysis. This will enable careful calibration of cut-off points for different subgroups and identification of the most suitable self-report screener to support timely diagnosis and care across the spectrum of this population. To this end it is also important to note that the sample comprised individuals of Asian ancestry, hence generalisability of findings to other ethnic groups could not be ascertained. The other two validation studies of KDQOL-CF were both conducted in the US, comprising mainly Caucasian participants [22, 23]. It is possible that the optimal cut-off points differed as a function of ethnic background of the recruited sample due to different cultural values towards dementia that may impact willingness for self-disclosure and help seeking [54].

Conclusions

In summary, this study reports the psychometric properties of an extended version of the KDQOL-CF measure that includes a new memory item. Our findings suggest that the extended KDQOL-CF is a valid and reliable questionnaire for identifying objective and subjective CIs among prevalent HD patients in Singapore. The extended KDQOL-CF also identifies HD patients at risk of functional impairment and treatment nonadherence. The KDQOL-CF is currently the most frequently used SCC measure in renal settings [3]. To improve its clinical utility, we recommend researchers and healthcare providers interested in this measure to include the additional memory question and consider adopting the new cut-off point to aid interpretation of patient responses. We need more research to determine an optimal set of SCC items that are brief and accurate so that they could be used in renal settings to maximise efficiency of cognitive screening.

Data availability

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

AUC:

Area under curve

Cis:

Cognitive impairments

CFI:

Comparative Fit Index

CFA:

Confirmatory factor analysis

DDFQ:

Dialysis Diet and Fluid non-adherence Questionnaire

HD:

Haemodialysis

KDQOL-CF:

Kidney Disease Quality of Life Cognitive Function subscale

MARS-5:

Medication Adherence Report Scale

MMSE:

Mini-Mental State Examination

3MS:

Modified MMSE

MoCA:

Montreal Cognitive Assessment

NKF:

National Kidney Foundation Singapore

PAOFI:

Patient’s Assessment of Own Functioning Inventory

ROC:

Receiver operating characteristic

RMSEA:

Root Mean Square Error of Approximation

SD:

Standard deviation

SRMR:

Standardised Root Mean Square

SCCs:

Subjective cognitive complaints

TLI:

Tucker–Lewis Index

WSAS:

Work and Social Adjustment Scale

References

  1. Drew DA, Weiner DE, Sarnak MJ. Cognitive impairment in CKD: Pathophysiology, Management, and Prevention. Am J Kidney Dis. 2019;74:782–90. https://doiorg.publicaciones.saludcastillayleon.es/10.1053/j.ajkd.2019.05.017.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Murray AM, Tupper DE, Knopman DS, Gilbertson DT, Pederson SL, Li S, et al. Cognitive impairment in hemodialysis patients is common. Neurology. 2006;67:216–23.

    Article  CAS  PubMed  Google Scholar 

  3. Chan FHF, Goh ZZS, Zhu X, Tudor Car L, Newman S, Khan BA, et al. Subjective cognitive complaints in end-stage renal disease: a systematic review and meta-analysis. Health Psychol Rev. 2023;17:614–40.

    Article  PubMed  Google Scholar 

  4. Chan FHF, Newman S, Khan BA, Griva K. The role of subjective cognitive complaints in self–management among haemodialysis patients: a cross–sectional study. BMC Nephrol. 2022;23:363. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12882-022-02994-2.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Chan FHF, Newman S, Khan BA, Griva K. Prevalence and trajectories of subjective cognitive complaints and implications for patient outcomes: a prospective study of haemodialysis patients. Br J Health Psychol. 2023;28:651–71.

    Article  PubMed  Google Scholar 

  6. Sehgal AR, Grey SF, DeOreo PB, Whitehouse PJ. Prevalence, recognition, and implications of mental impairment among hemodialysis patients. Am J Kidney Dis. 1997;30:41–9.

    Article  CAS  PubMed  Google Scholar 

  7. Griva K, Stygall J, Hankins M, Davenport A, Harrison M, Newman SP. Cognitive impairment and 7-Year mortality in Dialysis patients. Am J Kidney Dis. 2010;56:693–703. https://doiorg.publicaciones.saludcastillayleon.es/10.1053/j.ajkd.2010.07.003.

    Article  PubMed  Google Scholar 

  8. Kavanagh NT, Schiller B, Saxena AB, Thomas IC, Kurella Tamura M. Prevalence and correlates of functional dependence among maintenance dialysis patients. Hemodial Int. 2015;19:593–600.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Song M-K, Ward SE, Bair E, Weiner LJ, Bridgman JC, Hladik GA, et al. Patient-reported cognitive functioning and daily functioning in chronic dialysis patients. Hemodial Int. 2015;19:90–9.

    Article  PubMed  Google Scholar 

  10. Bogataj Š, Pajek M, Kren A, Kurnik Mesarič K, Pajek J. Randomized Controlled Trial of Intradialytic Cognitive and Physical Training to Enhance Functional Capacity. Kidney Int Rep. 2024;9:2028–36.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Joshee P, Wood AG, Wood ER, Grunfeld EA. Meta-analysis of cognitive functioning in patients following kidney transplantation. Nephrol Dial Transpl. 2018;33:1268–77.

    Article  CAS  Google Scholar 

  12. Crowe K, Quinn TJ, Mark PB, Findlay MD. Is it removed during Dialysis?—Cognitive dysfunction in advanced kidney Failure—A review article. Front Neurol. 2021;12:787370.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Pépin M, Klimkowicz-Mrowiec A, Godefroy O, Delgado P, Carriazo S, Ferreira AC, et al. Cognitive disorders in patients with chronic kidney disease: approaches to prevention and treatment. Eur J Neurol. 2023;30:2899–911.

    Article  PubMed  Google Scholar 

  14. Jassal SV, Devins GM, Chan CT, Bozanovic R, Rourke S. Improvements in cognition in patients converting from thrice weekly hemodialysis to nocturnal hemodialysis: a longitudinal pilot study. Kidney Int. 2006;70:956–62. https://doiorg.publicaciones.saludcastillayleon.es/10.1038/sj.ki.5001691.

    Article  CAS  PubMed  Google Scholar 

  15. Rose M, Fischer FH, Liegl G, Strippoli GFM, Hockham C, Vernooij RWM et al. The CONVINCE randomized trial found positive effects on quality of life for patients with chronic kidney disease treated with hemodiafiltration. Kidney Int. 2024.

  16. Jessen F, Amariglio RE, Van Boxtel M, Breteler M, Ceccaldi M, Chételat G, et al. A conceptual framework for research on subjective cognitive decline in preclinical Alzheimer’s disease. Alzheimer’s Dement. 2014;10:844–52.

    Article  Google Scholar 

  17. Rabin LA, Smart CM, Amariglio RE. Subjective cognitive decline in preclinical Alzheimer’s Disease. Annu Rev Clin Psychol. 2017;13:369–96.

    Article  PubMed  Google Scholar 

  18. Angermann S, Baumann M, Steubl D, Lorenz G, Hauser C, Suttmann Y, et al. Cognitive impairment in hemodialysis patients: implementation of cut-off values for the Montreal Cognitive Assessment (MoCA)-test for feasible screening. PLoS ONE. 2017;12:e0184589.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Tiffin-Richards FE, Costa AS, Holschbach B, Frank RD, Vassiliadou A, Krüger T, et al. The Montreal Cognitive Assessment (MoCA) - a sensitive screening instrument for detecting cognitive impairment in chronic hemodialysis patients. PLoS ONE. 2014;9:e106700.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Drew DA, Tighiouart H, Rollins J, Duncan S, Babroudi S, Scott T, et al. Evaluation of screening tests for cognitive impairment in patients receiving maintenance hemodialysis. J Am Soc Nephrol. 2020;31:855–64.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Pépin M, Ferreira AC, Arici M, Bachman M, Barbieri M, Bumblyte IA, et al. Cognitive disorders in patients with chronic kidney disease: specificities of clinical assessment. Nephrol Dial Transpl. 2021;37:ii23–32.

    Article  Google Scholar 

  22. Kurella M, Luan J, Yaffe K, Chertow GM. Validation of the kidney Disease Quality of Life (KDQOL) cognitive function subscale. Kidney Int. 2004;66:2361–7.

    Article  PubMed  Google Scholar 

  23. Sorensen EP, Sarnak MJ, Tighiouart H, Scott T, Giang LM, Kirkpatrick B, et al. The kidney disease quality of life cognitive function subscale and cognitive performance in maintenance hemodialysis patients. Am J Kidney Dis. 2012;60:417–26. https://doiorg.publicaciones.saludcastillayleon.es/10.1053/j.ajkd.2011.12.029.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Jones DJW, Harris JP, Butler LT, Vaux EC. A potential barrier to adherence? Memory for future intentions is impaired in hemodialysis patients. Hemodial Int. 2020;24:114–20.

    Article  PubMed  Google Scholar 

  25. Nasreddine ZS, Phillips NA, Bedirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal Cognitive Assessment, MoCA: a brief Screening Tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53:695–9.

    Article  PubMed  Google Scholar 

  26. Hays RD, Kallich JD, Mapes DL, Coons SJ, Carter WB. Development of the kidney Disease Quality of Life (KDQOL) Instrument. Qual Life Res. 1994;3:329–38.

    Article  CAS  PubMed  Google Scholar 

  27. Rao S, Carter WB, Mapes DL, Kallich JD, Kamberg CJ, Spritzer KL, et al. Development of subscales from the symptoms/problems and effects of kidney disease scales of the kidney Disease Quality of Life Instrument. Clin Ther. 2000;22:1099–111.

    Article  CAS  PubMed  Google Scholar 

  28. Yang F, Wang VW, Joshi VD, Lau TWL, Luo N. Validation of the English version of the kidney disease quality of life questionnaire (KDQOL-36) in haemodialysis patients in Singapore. Patient. 2013;6:135–41.

    Article  PubMed  Google Scholar 

  29. Chen JY, Choi EPH, Wan EYF, Chan AKC, Tsang JPY, Chan KHY, et al. Validation of the disease-specific components of the kidney disease quality of Life-36 (KDQOL-36) in Chinese patients undergoing maintenance dialysis. PLoS ONE. 2016;11:e0155188.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Chelune GJ, Heaton RK, Lehman RAW. Neuropsychological and personality correlates of patients’ complaints of disability. In: Goldstein G, Tarter RE, editors. Advances in clinical neuropsychology. Boston, MA.: Springer; 1986. pp. 95–126. https://doiorg.publicaciones.saludcastillayleon.es/10.1007/978-1-4613-2211-5_4.

    Chapter  Google Scholar 

  31. Woods SP, Rippeth JD, Frol AB, Levy JK, Ryan E, Soukup VM, et al. Interrater reliability of clinical ratings and neurocognitive diagnoses in HIV. J Clin Exp Neuropsychol. 2004;26:759–78.

    Article  PubMed  Google Scholar 

  32. Blackstone K, Moore DJ, Heaton RK, Franklin DR, Woods SP, Clifford DB, et al. Diagnosing symptomatic HIV-associated neurocognitive disorders: self-report versus performance-based assessment of everyday functioning. J Int Neuropsychol Soc. 2012;18:79–88.

    Article  CAS  PubMed  Google Scholar 

  33. Fardell JE, Bray V, Bell ML, Rabe B, Dhillon H, Vardy JL. Screening for cognitive symptoms among cancer patients during chemotherapy: sensitivity and specificity of a single item self-report cognitive change score. Psychooncology. 2022;31:1294–301.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Mundt JC, Marks IM, Shear MK, Greist JH. The work and Social Adjustment Scale: a simple measure of impairment in functioning. Br J Psychiatry. 2002;180:461–4.

    Article  PubMed  Google Scholar 

  35. Horne R, Weinman J. Self-regulation and self-management in asthma: exploring the role of illness perceptions and treatment beliefs in explaining non-adherence to preventer medication. Psychol Heal. 2002;17:17–32.

    Article  Google Scholar 

  36. Vlaminck H, Maes B, Jacobs A, Reyntjens S, Evers G. The dialysis diet and fluid non-adherence questionnaire: validity testing of a self-report instrument for clinical practice. J Clin Nurs. 2001;10:707–15.

    Article  CAS  PubMed  Google Scholar 

  37. R Core Team. R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. 2018. https://www.r-project.org/

  38. Mueller RO, Hancock GR. Best practices in Structural equation modeling. In: Osborne J, editor. Best practices in quantitative methods. Thousand Oaks, CA: SAGE Publications, Inc.; 2008. pp. 488–508.

    Chapter  Google Scholar 

  39. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model. 1999;6:1–55.

    Article  Google Scholar 

  40. Paulsen J, BrckaLorenz A. Internal consistency. FSSE Psychometric Portfolio. fsse.indiana.edu; 2017.

  41. Šimundić A-M. Measures of diagnostic accuracy: basic definitions. Electron J Int Fed Clin Chem Lab Med. 2009;19:203–11.

    Google Scholar 

  42. O’Lone E, Connors M, Masson P, Wu S, Kelly PJ, Gillespie D, et al. Cognition in people with end-stage kidney disease treated with hemodialysis: a systematic review and meta-analysis. Am J Kidney Dis. 2016;67:925–35. https://doiorg.publicaciones.saludcastillayleon.es/10.1053/j.ajkd.2015.12.028.

    Article  PubMed  Google Scholar 

  43. Brodski J, Rossell SL, Castle DJ, Tan EJ. A systematic review of cognitive impairments associated with kidney failure in adults before natural age-related changes. J Int Neuropsychol Soc. 2019;25:101–14.

    Article  PubMed  Google Scholar 

  44. Griva K, Davenport A, Harrison M, Newman SP. Non-adherence to immunosuppressive medications in kidney transplantation: intent Vs. forgetfulness and clinical markers of medication intake. Ann Behav Med. 2012;44:85–93.

    Article  PubMed  Google Scholar 

  45. Insel K, Morrow D, Brewer B, Figueredo A. Executive function, working memory, and medication adherence among older adults. Journals Gerontol - Ser B Psychol Sci Soc Sci. 2006;61B:102–7.

    Google Scholar 

  46. Morris RG, Mograbi DC. Anosognosia, autobiographical memory and self knowledge in Alzheimer’s disease. Cortex. 2013;49:1553–65. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.cortex.2012.09.006.

    Article  PubMed  Google Scholar 

  47. Henneghan AM, Van Dyk K, Kaufmann T, Harrison R, Gibbons C, Kesler SR. Measuring self-reported Cancer-related cognitive impairment: recommendations from the Cancer Neuroscience Initiative Working Group. J Natl Cancer Inst. 2021;113:djab027.

    Article  Google Scholar 

  48. Lee YC, Kang JM, Lee H, Kim K, Kim S, Yu TY, et al. Subjective cognitive decline and subsequent dementia: a nationwide cohort study of 579,710 people aged 66 years in South Korea. Alzheimer’s Res Ther. 2020;12:52.

    Article  Google Scholar 

  49. Li H, Tan C-C, Tan L, Xu W. Predictors of cognitive deterioration in subjective cognitive decline: evidence from longitudinal studies and implications for SCD-plus criteria. J Neurol Neurosurg Psychiatry. 2023.

  50. Chapman S, Rentería MA, Dworkin JD, Garriga SM, Barker MS, Avila-Rieger J, et al. Association of Subjective Cognitive decline with progression to Dementia in a cognitively unimpaired Multiracial Community Sample. Neurology. 2023;100:e1020–7.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Farias ST, Lau K, Harvey D, Denny KG, Barba C, Mefford AN. Early functional limitations in cognitively normal older adults predict Diagnostic Conversion to mild cognitive impairment. J Am Geriatr Soc. 2017;65:1152–8.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Bevans M, Ross A, Cella D. Patient-reported outcomes measurement information system (PROMIS): efficient, standardized tools to measure self-reported health and quality of life. Nurs Outlook. 2014;62:339–45. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.outlook.2014.05.009.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Sturgill DA, Bal N, Nagavally S, Wolfgram DF. The relationship between Dialysis Metrics and patient-reported cognition, fatigue, and physical function. Kidney Dis. 2020;6:364–70.

    Article  Google Scholar 

  54. Chiu HFK, Sato M, Kua EH, Lee MS, Yu X, Ouyang WC, et al. Renaming dementia - an east Asian perspective. Int Psychogeriatr. 2014;26:885–7.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We thank the nurse managers and staff of the dialysis centres of National Kidney Foundation Singapore for facilitating the patient recruitment procedures and providing patients’ medical data. We would also like to thank Kevin Tan, Shane Tan, Sze Ing Tan, and Nicole Tan for their assistance in patient recruitment and data entry.

Funding

This work was supported by the Venerable Yen Pei-National Kidney Foundation Research Fund, Singapore [grant number NKFRC/2021/01/02]. Dr. Griva received research funding from National Kidney Foundation Singapore. The funding sources had no role in the study design, recruitment of patients, data collection, analysis, interpretation of the results, writing of the manuscript, or decision to submit the manuscript for publication.

Author information

Authors and Affiliations

Authors

Contributions

FC, PS, and PL recruited patients and collected data. BK and JC provided clinical data of consented patients. FC and KG analysed and interpreted the data. FC wrote the first draft of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Konstadina Griva.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the institutional review board of Nanyang Technological University and are in compliance with the Helsinki declaration. Informed consent of each participant was obtained before the study.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chan, F.H.F., Sim, P., Lim, P.X.H. et al. Screening for cognitive symptoms in dialysis patients with an extended version of Kidney Disease Quality of Life Cognitive Function subscale (KDQOL-CF): a validation study. BMC Nephrol 25, 434 (2024). https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12882-024-03848-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12882-024-03848-9

Keywords