Sensitivity of EQ-5D-3L, HUI2, HUI3, and SF-6D to changes in speech reception and tinnitus associated with cochlear implantation (2025)

Table of Contents

Abstract Purpose Methods Results Conclusions Electronic supplementary material Introduction Methods Participants Outcome measures Analyses Results Sensitivity of outcome measures to implantation Sensitivity of individual dimensions of GPMs to cochlear implantation Sensitivity of measures of HRQL to speech reception and tinnitus Sensitivity of individual dimensions to speech reception and tinnitus Discussion Electronic supplementary material Acknowledgements Funding Conflict of interest Ethical approval Informed consent Footnotes References Associated Data Supplementary Materials

Abstract

Purpose

There is concern that some generic preference-based measures (GPMs) of health-related quality of life may be insensitive to interventions that improve hearing. Establishing where sensitivity arises could contribute to the design of improved measures. Accordingly, we compared the sensitivity of four widely used GPMs to a clinically effective treatment—cochlear implantation—which restores material degrees of hearing to adults with little or no functional hearing.

Methods

Participants (N = 147) received implants in any of 13 hospitals in the UK. One month before implantation and 9months after, they completed the HUI2, HUI3, EQ5D3L, and SF-6D questionnaires, together with the EuroQoL visual-analogue scale as a direct measure of health, a performance test of speech reception, and a self-report measure of annoyance due to tinnitus.

Results

Implantation was associated with a large improvement in speech reception and a small improvement in tinnitus. HUI2 and HUI3 were sensitive to the improvement in speech reception through their Sensation and Hearing dimensions; EQ5D3L was sensitive to the improvement in tinnitus through its Anxiety/Depression dimension; SF-6D was sensitive to neither. Participants reported no overall improvement in health. Variation in health was associated with variation in tinnitus, not variation in speech reception.

Conclusions

None of the four GPMs was sensitive to the improvements in both speech reception and tinnitus that were associated with cochlear implantation. To capture fully the benefits of interventions for auditory disorders, developments of current GPMs would need to be sensitive to both the health-related and non-health-related aspects of auditory dysfunction.

Electronic supplementary material

The online version of this article (10.1007/s11136-018-2070-6) contains supplementary material, which is available to authorised users.

Keywords: Preference-based measures, Health-related quality of life, Cochlear implantation, EQ-5D, HUI2/3, SF-6D

Introduction

Generic preference-based measures (GPMs) of health-related quality of life (HRQL) play important roles in the allocation of resources in health care because they provide the utility component of cost–utility analyses. Such analyses inform prioritisation of treatments by third-party payers in many jurisdictions and are mandated in England when the National Institute for Health and Care Excellence (NICE) commissions the appraisal of a health technology [1].

There is concern that some GPMs are insensitive to interventions which improve hearing [2–5]. The issue is relevant because impaired hearing is prevalent. A clinically significant loss is experienced by 10% of all adults and by 30% of those older than 70years [6, 7]. Sufferers must compete for resources to obtain treatments to alleviate their disability. There would be a failure of equity if treatments were denied not because they were ineffective but because GPMs failed to attribute appropriate value to their benefits.

The development of GPMs begins with researchers identifying dimensions on which good function corresponds to good health. Discrete levels of function are defined on each dimension ranging from poor to good. A subset of the possible combinations of levels is valued by a representative sample of the public. These informants use methods for measuring preferences [8] such that their valuations lie on a scale where 1 corresponds to perfect health, 0 to the state of being dead, and negative values to states considered worse than dead, if relevant. Statistical modelling is used to generate a valuation function which converts any combination of levels into a composite index whose value best aligns with the valuations of the informants. Finally, a questionnaire is compiled to elicit a respondent’s own level of function on each dimension. Then, the responses to the questionnaire and the valuation function are deployed to assign a value to the respondent’s HRQL that reflects public preferences.

We examined four widely used GPMs [9–11]. The EuroQol Descriptive System [9] includes dimensions relating to Mobility, Self-care, Usual Activities, Pain/Discomfort, and Anxiety/Depression. The version of the system until recently preferred by NICE [12] defines three levels on each dimension (EQ-5D-3L). The Mark-2 version of the Health Utilities Index (HUI2) [10, 13] includes dimensions relating to Sensation, Mobility, Emotion, Cognition, Self-care, and Pain, each with 4–6 levels. In the Mark-3 version (HUI3) [14], Sensation was decomposed into Seeing, Hearing, and (being understood when) Speaking. Self-care was re-worked as Dexterity. The Short-Form-6D (SF-6D) [11] includes dimensions relating to Physical functioning, Role limitations, Social functioning, Pain, Mental health, and Vitality, each with 4–6 levels. The dimensions are a subset of those in the Medical Outcomes Study Short-form Health Survey (SF-36) [15], such that an SF-6D utility can be derived from responses to the SF-36 [11].

Given differences in wording, dimensions, and methods of valuation, it is not surprising that the GPMs differ in their sensitivity to interventions [16], including interventions which improve hearing [e.g. 2–4]. A systematic review of studies that measured HRQL in participants with impaired hearing using one or more of EQ-5D, HUI3, and SF-6D [5] reached five conclusions: HUI3 was appropriate for estimating HRQL in studies involving impaired hearing; EQ-5D-3L was not responsive to modest changes in hearing; few studies had been designed to compare GPMs; only one study had included SF-6D; additional ‘head-to-head’ comparisons of GPMs were needed to understand why differences in sensitivity arose.

We made such a comparison by investigating the sensitivity of the four GPMs to cochlear implantation—a clinically effective intervention [17] which restores auditory sensations to people with little or no functional hearing [18, 19]. The primary goal of implantation is to improve the ability to understand speech. A secondary goal is to attenuate tinnitus [20, 21]—“the conscious experience of a sound that originates in an involuntary manner in the head of its owner, or may appear to do so” [22]. Up to 80% of candidates for implantation report some degree of tinnitus [23].

The rationale for the study was that the categorical change from dysfunctional hearing to viable hearing that is brought about by implantation would allow scope for GPMs to show improvement if they were sensitive to hearing. The study adds to those in the systematic review [5] of which only two were prospective evaluations of implantation where participants completed questionnaires themselves; both of those studies included only one GPM.

Against that background, we identified reasons why the four GPMs differed in their sensitivity to implantation. We distinguished their response to impaired speech reception from their response to tinnitus, and we considered the implications for the choice of GPM to use in studies of hearing.

Methods

Participants

Participants were adults who met criteria of candidacy for implantation in the United Kingdom (UK): they had developed a severe-to-profound sensorineural hearing loss in both ears after acquiring spoken language; they had at least one patent cochlear nerve; they could identify no more than 50% of the content words in pre-recorded sentences presented in quiet without lipreading when using hearing aids. Their demographic and audiological characteristics are listed in Table1. They received an implant in one ear in any of 13 hospitals in the UK between June 1997 and May 2000. They were tested one month before implantation and again three and nine months after implantation as part of a larger study [18, 24, 25]. Results are reported for 147 participants (78 F, 69 M) who provided a complete set of outcome measures at the pre-operative and 9month post-operative stages. Online Resource 1 provides evidence that these participants were representative of adults undergoing implantation in the UK.

Table 1.

Biographical and audiological characteristics of participants before implantation

Measure	Minimum	Maximum	Mean	Standard deviation
Age at the time of implantation (years)	18.0	79.3	50.7	14.7
Pre-operative hearing level^a of the implanted ear (dB)	88.8	140.0	118.3	10.5
Pre-operative hearing leve^al of the other ear (dB)	93.8	140.0	117.5	10.5
Duration of severe-profound deafness^b of the implanted ear (years)	0.0	71.0	14.8	15.7
Duration of severe-profound deafness^b of the other ear (years)	0.0	71.0	14.9	15.4
Pre-operative speech-reception score (% correct)^c	0.0	50.0	3.8	9.3

Open in a new tab

^aElevation of detection thresholds for pure tones averaged across the acoustic frequencies of 500, 1000, 2000, and 4000Hz relative to normal hearing

^bSelf-reported by participants

^cBKB Sentence Test [18, 29]

Outcome measures

Five measures of HRQL and two functional measures of hearing were derived from four questionnaires and a performance test. The questionnaires were presented on touch screens. The performance test was conducted in audiological test rooms. The measures are described below where the name given to each derived variable is italicised, e.g. EQ-5D-3L.

Measures of HRQL

The EQ-5D-3L questionnaire and visual-analogue scale of the EuroQoL Descriptive System were presented. Reported levels of the five dimensions were converted to a composite index (EQ-5D-3L) using the valuation function described by Dolan [26]. The visual-analogue scale yielded a value in the range from zero (worst imaginable health) to 100 (best imaginable health) (EQ-VAS). For the Health Utilities Index Mark 2 and 3, a single questionnaire allowed both indices to be calculated. The words “hearing aid” were replaced with “cochlear implant” in the version of the questionnaire presented post-operatively. Reported levels of the dimensions were converted to weights which were combined to yield composite indices for HUI2 [13] and HUI3 [14] (HUI2, HUI3). For the Short-Form-6D, responses to the UK SF-36 questionnaire [27] were analysed to determine the level of function of each participant on each dimension and then to compute a composite index [28] (SF-6D).

Functional measures of hearing

A measure of speech reception was obtained by presenting recordings of sentences to participants at an intensity typical of conversational speech and counting the percentage of content words reported correctly [18, 29] (Speech). A measure of annoyance due to tinnitus was obtained by presenting 13 questions [30; Online Resource 2] which probed the subjective manifestations of tinnitus and its psychological impact. Participants responded by positioning a pointer on a visual-analogue scale whose ends were labelled appropriately for each question. Responses were averaged and expressed as a number in the range from 0 (no annoyance) to 100 (great annoyance) (Tinnitus).

A good outcome from implantation is characterised by a high value of Speech and a low value of Tinnitus. Thus, to the extent that speech reception and annoyance due to tinnitus are associated with HRQL, Speech and Tinnitus are expected to display complementary patterns of correlation; where Speech correlates positively, Tinnitus should correlate negatively, and vice versa.

Analyses

Analyses were conducted with IBM SPSS Statistics v.24 [31].

Sensitivity of outcome measures to implantation

We tested the sensitivity of each outcome measure to implantation by determining whether the change from the pre-operative to the post-operative value of the measure exceeded zero using a t test. Effect sizes (ES) were assessed with the Standardised Response Mean [32] and, for descriptive convenience, were classified as small (0.2 ≤ ES < 0.5), moderate (0.5 ≤ ES < 0.8), or large (0.8 ≤ ES). The changes in the four composite indices were compared in an analysis of variance. Mauchly’s test of sphericity was significant, so the Greenhouse-Geisser adjustment was made to the degrees of freedom.

Sensitivity of individual dimensions of GPMs to implantation

To establish which dimensions of each GPM were sensitive to implantation, and to determine whether positive changes on some dimensions were offset by negative changes on others, we identified dimensions on which there was a significant change—either positive or negative—between the levels to which participants assigned themselves before and after implantation using a Wilcoxon signed-rank test.

Sensitivity of composite indices to speech reception and tinnitus

A composite index could be sensitive to variation in both speech reception and tinnitus, to one, or to neither. To determine which pattern of sensitivity was shown by each GPM, we calculated Kendall rank correlation coefficients between changes in Speech and Tinnitus and changes in each composite index. We also examined whether values of Speech and Tinnitus before and, separately, after implantation were correlated with the pre- and post-operative values of the composite indices.

Sensitivity of individual dimensions to speech reception and tinnitus

To determine which individual dimensions underpinned correlations between composite indices and Speech and Tinnitus, we calculated Kendall rank correlation coefficients between changes in the levels of each dimension and changes in Speech and Tinnitus. We also tested whether values of Speech and Tinnitus before and after implantation were correlated with the pre- and post-operative levels of individual dimensions.

Results

Sensitivity of outcome measures to implantation

Table2 reports the sensitivity of the outcome measures to implantation. In terms of effect size, HUI2 displayed a moderate significant change and HUI3 a large significant change. EQ-5D-3L displayed a small significant change. SF-6D and EQ-VAS did not show significant changes. Analysis of variance showed that the four changes differed significantly (F_(2.4,345.2) = 45.3, p < 0.001); all pair-wise comparisons were significant (p < 0.001), except the comparison between EQ-5D-3L and SF-6D.

Table 2.

Comparison of values of outcome measures before and after implantation

	Outcome measure
	EQ-5D-3L	HUI2	HUI3	SF-6D	EQ-VAS	Speech	Tinnitus
Mean pre-operative value	0.788	0.640	0.433	0.763	76.66	3.81	23.94
Mean post-operative value	0.827	0.775	0.629	0.775	77.93	56.08	16.81
Mean change in value^a	0.040	0.135	0.197	0.012	1.26	52.27	− 7.13
Student’s t₁₄₆^b	2.30*	8.16***	12.10***	1.20	1.00	18.36***	− 4.05***
Adjusted SRM^c	0.20	0.71	1.06	0.12	0.09	1.18	− 0.35

Open in a new tab

^aCalculated as the post-operative value minus the pre-operative value. Improvements are shown by a negative change in Tinnitus (i.e. a reduction in annoyance) and by a positive change in other outcome measures

^b*p < 0.05, ***p < 0.001

^cAdjusted standardised response mean [32]

The first functional measure of hearing, Speech, increased from 3.8% correct to 56.1% correct with a large effect size. The second functional measure, Tinnitus, declined from 23.9 to 16.8 with a small effect size. Thus, implantation was associated with a large primary effect of improved speech reception and a small secondary effect of reduced annoyance due to tinnitus. Online Resource 3 provides additional support for the interpretation of speech reception as the primary outcome and annoyance due to tinnitus as the secondary outcome.

Sensitivity of individual dimensions of GPMs to cochlear implantation

Table3 summarises the sensitivity of the individual dimensions of the GPMs to implantation. For each dimension, the table includes the number of participants who placed themselves at each level before and after implantation, together with the results of a comparison of the 147 pairs of levels. As an example, consider the entry for the Anxiety/Depression dimension of EQ-5D-3L which is at top-right in the table. Before implantation, 83 participants placed themselves at the best level of this dimension, 52at the middle level, and 12at the worst level, summarised as (83,52,12). After implantation, the pattern had improved significantly to (113,30,4) (Wilcoxon z = 4.812, p < 0.001).

Table 3.

Comparison of numbers of participants at each level of each dimension of GPMs before and after implantation

	EQ-5D-3L dimensions
	Mobility	Self-care	Usual activities	Pain/discomfort	Anxiety/depression
N Pre^a	(110,37,0)	(140,7,0)	(113,28,6)	(99,42,6)	(83,52,12)
N Post^b	(108,39,0)	(139,8,0)	(118,27,2)	(89,52,6)	(113,30,4)
Z^c,d	− 0.47	− 0.33	+ 1.50	− 1.54	+ 4.81***

	HUI2 dimensions
	Sensation	Mobility	Emotion	Cognition	Self-care	Pain
N Pre	(0,9,65,73)	(125,8,13,1,0)	(95,42,8,2,0)	(103,42,2,0)	(146,1,0,0)	(116,10,9,4,8)
N Post	(0,80,62,5)	(127,6,12,2,0)	(105,37,4,1,0)	(110,34,3,0)	(143,2,0,2)	(93,30,7,0,17)
Z	+ 8.92***	0.000	+ 1.79	+ 0.93	− 1.52	− 2.85**

	HUI3 dimensions
	Vision	Hearing	Speaking	Ambulation	Dexterity	Emotion	Cognition	Pain
N Pre	(48,96,1,1,1,0)	(3,1,11,4,56,72)	(106,21,13,5,2)	(125,8,13,0,1,0)	(145,0,0,2,0,0)	(97,37,7,5,1)	(103,12,16,13,3,0)	(85,27,24,8,3)
N Post	(41,104,0,1,1,0)	(0,2,107,0,33,5)	(114,22,11,0,0)	(127,6,12,1,0,1)	(147,0,0,0,0,0)	(94,41,12,0,0)	(110,7,14,12,4,0)	(72,37,27,10,1)
Z	− 1.26	+ 9.22***	+ 2.08*	+ 0.17	+ 1.41	+ 0.30	+ 0.64	− 1.28

	SF-6D dimensions
	Physical	Role limitations	Social	Pain	Mental health	Vitality
N Pre	(56,46,19,7,15,4)	(95,19,16,17)	(96,16,22,9,4)	(73,22,29,9,11,3)	(27,46,45,26,3)	(13,75,40,13,6)
N Post	(51,43,29,7,13,4)	(96,10,14,27)	(93,21,24,6,3)	(60,30,21,22,12,2)	(51,42,40,12,2)	(17,70,45,11,4)
Z	− 0.80	− 1.11	+ 0.24	− 2.13*	+ 4.53***	+ 0.86

Open in a new tab

^aN Pre Number of participants at each level of a dimension before implantation. Left-hand number in parentheses is the number at the most advantageous level of the dimension; right-hand number is the number at the least advantageous level

^bN Post Number of participants at each level of a dimension after implantation

^cZ statistic from Wilcoxon signed-rank comparison of pre- and post-operative levels. A negative value indicates that the mean level became less advantageous. A positive value indicates that the mean level became more advantageous

^d*p < 0.05, **p < 0.01, ***p < 0.001

Implantation was associated with three types of change: improvements in Sensation (HUI2), Hearing (HUI3), and Speaking (HUI3); improvements in Anxiety/Depression (EQ-5D-3L) and Mental Health (SF-6D); and a worsening of Pain (HUI2, SF-6D). Thus, each GPM included at least one dimension that displayed a significant improvement, while HUI2 and SF-6D also included dimensions that worsened significantly.

Sensitivity of measures of HRQL to speech reception and tinnitus

The upper panel of Table4 lists Kendall rank-order correlation coefficients between change in Speech and Tinnitus and change in each measure of HRQL. Change in Speech was correlated with change in HUI2 and HUI3, but not with change in EQ-5D-3L or EQ-VAS. Change in Tinnitus showed the opposite pattern; it was correlated with change in EQ-5D-3L and EQ-VAS, but not with change in HUI2 or HUI3. Change in neither functional measure was correlated with change in SF-6D. Thus, none of the composite indices was sensitive to the improvements in both speech reception and tinnitus associated with implantation. Online Resource 4 includes multiple regression analyses which corroborate these patterns of correlation.

Table 4.

Kendall rank-order coefficients of correlation among functional measures of hearing and measures of HRQL

	Tinnitus	EQ-5D-3L	HUI2	HUI3	SF-6D	EQ-VAS
Change in values^a
Speech	− 0.056	0.118	0.185**	0.191**	0.051	− 0.004
Tinnitus		− 0.182*	− 0.112	− 0.069	− 0.054	− 0.179**
Pre-operative values^b
Speech	− 0.053	0.022	0.178 *	0.137	0.135	0.053
Tinnitus		− 0.223**	− 0.230**	− 0.242**	− 0.247**	− 0.225**
Post-operative values^c
Speech	0.002	0.128	0.195**	0.189**	0.136	0.044
Tinnitus		− 0.242**	− 0.201**	− 0.206**	− 0.251**	− 0.236**

Open in a new tab

Low values of Tinnitus, but high values of Speech and of measures of HRQL, were advantageous pre- and post-operatively. A negative change in Tinnitus, but a positive change in Speech and in measures of HRQL, represented improvements. Thus, correlations between Tinnitus and measures of HRQL were negative, while correlations between Speech and measures of HRQL were positive

Significance assessed against Bonferroni-adjusted alpha levels of 0.01 per test (0.05/5) (*) and 0.002 per test (0.01/5) (**)

^aCorrelations among changes in measures; change was calculated as the post-operative value minus the pre-operative value

^bCorrelations among pre-operative values of measures

^cCorrelations among post-operative values of measures

The middle and lower panels of Table4 list coefficients of correlation between the functional measures of hearing and the measures of HRQL before and after implantation. Of the five measures of HRQL, only HUI2 was correlated with Speech before implantation, and only HUI2 and HUI3 were correlated with Speech after implantation. In contrast, each measure of HRQL was correlated with Tinnitus, both before and after implantation.

Sensitivity of individual dimensions to speech reception and tinnitus

Table5 lists coefficients of correlation between the levels of individual dimensions and measures of Speech and Tinnitus. The results corroborate the implication of Table4 that the GPMs were more attuned to variation among participants in Tinnitus than in Speech. The four GPMS together contain 25 dimensions. Variation in Speech was correlated significantly with the levels of only four of them before or after implantation, while variation in Tinnitus was correlated with 15.

Table 5.

Kendall rank-order coefficients of correlation^a between functional measures of hearing and levels of individual dimensions of GPMs

GPM	Dimension	Pre-operative		Post-operative		Change
GPM	Dimension	τ^b	Sig.^e	τ^c	Sig.^e	τ^d	Sig.^e
(a) Correlations with Speech
EQ-5D-3L	Mobility	− 0.090		− 0.041		0.020
	Self-care	0.030		− 0.097		− 0.015
	Usual activities	0.036		− 0.019		− 0.060
	Pain/Discomfort	− 0.021		− 0.064		− 0.003
	Anxiety/Depression	0.020		− 0.212	*	− 0.174	*
HUI2	Sensation	− 0.359	**	− 0.263	**	− 0.230	**
	Mobility	− 0.112		− 0.083		− 0.096
	Emotion	− 0.008		− 0.068		− 0.082
	Cognition	0.094		− 0.154		− 0.054
	Self-care	− 0.047		− 0.027		− 0.057
	Pain	0.052		− 0.075		− 0.040
HUI3	Vision	0.055		− 0.071		− 0.058
	Hearing	− 0.325	**	− 0.193	*	− 0.225	**
	Speaking	0.074		− 0.165		0.023
	Ambulation	− 0.112		− 0.083		− 0.096
	Dexterity	− 0.066		^f		− 0.071
	Emotion	− 0.022		− 0.061		− 0.071
	Cognition	0.092		− 0.159		− 0.085
	Pain	− 0.060		− 0.102		0.006
SF-6D	Physical functioning	− 0.098		− 0.112		− 0.097
	Role limitations	− 0.092		− 0.078		− 0.019
	Social functioning	− 0.131		− 0.115		− 0.134
	Pain	− 0.051		− 0.090		− 0.047
	Mental Health	− 0.163		− 0.201	**	− 0.055
	Vitality	− 0.035		− 0.025		− 0.031
(b) Correlations with Tinnitus
EQ-5D-3L	Mobility	0.216	*	0.227	**	0.062
	Self-care	0.072		− 0.017		− 0.031
	Usual activities	0.204	*	0.250	**	0.150
	Pain/discomfort	0.180	*	0.208	*	0.134
	Anxiety/depression	0.136		0.194	*	0.185	*
HUI2	Sensation	0.207	*	0.054		0.042
	Mobility	0.173		0.123		− 0.103
	Emotion	0.076		0.125		0.053
	Cognition	0.174		0.171		0.120
	Self-care	0.007		− 0.033		− 0.126
	Pain	0.137		0.201	*	− 0.004
HUI3	Vision	− 0.095		0.073		− 0.029
	Hearing	0.193	*	0.083		0.043
	Speaking	0.041		0.003		− 0.032
	Ambulation	0.173		0.123		− 0.103
	Dexterity	0.068		^f		− 0.075
	Emotion	0.199	*	0.197	*	0.034
	Cognition	0.181	*	0.167		0.124
	Pain	0.162		0.189	*	0.050
SF-6D	Physical functioning	0.164		0.149		− 0.012
	Role limitations	0.172	*	0.255	**	0.133
	Social functioning	0.245	**	0.178	*	0.142
	Bodily pain	0.167		0.212	**	0.053
	Mental health	0.132		0.195	*	0.102
	Vitality	0.192	*	0.270	**	0.116

Open in a new tab

^aLevels of dimensions were quantified with sequential integers. The value 1 was assigned to the most advantageous level. Thus, low values of level were advantageous pre- and post-operatively, and a reduction in level represented an improvement. Low values of Tinnitus, but high values of Speech and of measures of HRQL, were advantageous pre- and post-operatively. A negative change in Tinnitus, but a positive change in Speech and in measures of HRQL, represented improvements. Therefore, correlations between Tinnitus and level were generally positive, while correlations between Speech and level were generally negative

^bKendall rank-order coefficients of correlation between pre-operative values of measures

^cKendall rank-order coefficients of correlation between post-operative values of measures

^dKendall rank-order coefficients of correlation between changes in measures calculated as the post-operative value minus the pre-operative value

^eSignificance assessed against Bonferroni-adjusted alpha levels of 0.05/n (*) and 0.01/n (**), where n is the number of dimensions in the GPM (5 for EQ-5D-3L, 6 for HUI2, 8 for HUI3, and 6 for SF-6D).

^fCould not be calculated because all participants placed themselves at the most advantageous level of the Dexterity dimension after implantation

Discussion

The data reported here were gathered in the late 1990s. Improvements in cochlear implants and changes in candidature might have rendered the results irrelevant to today’s outcomes. Two considerations counter those concerns. First, criteria of candidacy for unilateral implantation of adults in England [17] remain the same as the entry criteria for the study, although they are currently under review [33]. Second, accuracy of speech reception following implantation has plateaued since the mid-1990s [34]. Thus, participants in the study, and patients receiving implants in England today, are likely to come from the same population and to demonstrate the same patterns of association among outcome measures.

With those caveats, the study provides evidence at three levels of detail to inform the choice of GPM to use in assessments of interventions for hearing disorders. First, at the level of composite indices, the results corroborate previous demonstrations [2–5] that GPMs differ in their sensitivity to treatments which improve hearing (Table2): HUI2 and HUI3 showed moderate or large responses to implantation; EQ-5D-3L showed a small response; and SF-6D showed no response. In consequence, economic analyses informed by HUI2 or HUI3 suggest that implantation is a cost-effective intervention, while analyses informed by EQ-5D-3L or SF-6D suggest that it is not (Online Resource 5). That result might argue that only HUI3 need be used in studies of hearing.

However, limitations in all of the GPMs emerge at the second level of detail where the changes associated with implantation on individual dimensions are considered (Table3). Significant changes occurred on three groups of dimensions: positive changes resulting from improved auditory sensitivity; positive changes resulting from improved psychological well-being; and negative changes presumably resulting from pain caused by the surgical wound and from irritation induced by wearing the external parts of the implant system against the scalp. Limitations of the GPMs are shown by the fact that no GPM displayed all three types of change.

It is not surprising that the composite indices of HUI2 and HUI3 were sensitive to the improvement in speech reception, given that the questions which map respondents onto the levels of the Sensation (HUI2) and Hearing (HUI3) dimensions ask about the ability to “hear what is said” in conversation. More surprising may be that neither Usual Activities (EQ-5D-3L) nor Role Limitations or Social Functioning (SF-6D) were similarly sensitive. However, participants had been severely profoundly hearing impaired for nearly 15years on average (Table1), so their “usual” activities would have adapted to constraints imposed by their deafness. Also, the questions that map respondents onto levels of the Role Limitations and Social Functioning dimensions emphasise limitations arising from health. The loss of hearing sensitivity that underpins impaired speech reception is not usually the consequence of disease [35] nor is it generally perceived to be a manifestation of ill-health [36].

In contrast, evidence from the third level of detail—individual differences in outcome measures before and after implantation—shows that annoyance due to tinnitus was perceived to be strongly related to perceptions of health (Table4b). It was associated with poorer levels of function on dimensions related to physical activity (Mobility and Usual Activities in EQ-5D-3L, Role Limitations and Social Function in SF-6D), pain (Pain/Discomfort in EQ-5D-3L, Pain in HUI2, HUI3, SF-6D), and mental health (Anxiety/Depression in EQ-5D-3L, Emotion in HUI3, Mental Health in SF-6D). This pattern (see also [37]) can be rationalised by the ideas that the negative influence of tinnitus on the capacity to concentrate reduces productive activity [38], that tinnitus is discomforting and akin to pain [39, 40], and that tinnitus either elevates anxiety [41] or anxiety exacerbates the experience of tinnitus [42].

The conclusion that the GPMs are more attuned to tinnitus than impaired speech reception is reinforced by the finding that variation among participants in the change in self-reported health, EQ-VAS, was correlated with the change in Tinnitus, not the change in Speech (Table4). The conclusion is supported by supplementary analyses in Online Resource 6 and is also compatible with analyses reported by Konerding et al. [16] who examined patterns of association among dimensions of EQ-5D-3L, HUI2, and SF-6D. Correlated patterns across the three GPMs were found among dimensions related to mental health and, separately, physical functioning, and physical pain. The Sensation dimension of HUI2, however, was not related to other dimensions, suggesting that sensory deficits are independent of other aspects of health. That conclusion anticipates the demonstration in the present paper and elsewhere [2–5] that sensitivity to interventions which improve the ability to detect sounds is shown only by those GPMs that explicitly measure the benefits of improved auditory sensitivity.

Which GPM should be used in studies of hearing? Consider first that Tinnitus was associated with aspects of health which are represented by dimensions in each GPM. All of the GPMs, therefore, have the potential to be sensitive to changes in health produced by interventions which reduce annoyance due to tinnitus. Although in the present study only EQ-5D-3L was sensitive to the small improvement in Tinnitus (Table4), in a clinical trial reported by Maes et al. [43], both EQ-5D-3L and HUI3 distinguished patients whose tinnitus improved from patients whose tinnitus did not improve, with HUI3 showing slightly greater sensitivity. Thus, in jurisdictions where policy makers prefer HUI3, it should be used in studies of hearing, insofar as it has been shown to be sensitive to improvements in both tinnitus and auditory sensitivity.

In jurisdictions where policy makers prefer EQ-5D, it should be used to evaluate interventions intended to improve tinnitus, while HUI3 should be used to evaluate interventions intended to improve hearing sensitivity. That distinction aligns with the guidance given by NICE that alternatives to EQ-5D should be used to evaluate conditions for which EQ-5D lacks critical dimensions of health [1]. Nonetheless, it is unsatisfactory to advocate the use of different GPMs to assess treatments for two aspects of dysfunctional hearing which can co-occur and which can both respond to the same treatment. The dilemma reinforces the aim of a consortium of researchers in the UK [44] to develop a successor to the EuroQol Descriptive System which preserves sensitivity to the conventional dimensions of health while adding sensitivity to sensory disorders [45, 46] among other changes.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (PDF 971 KB)^{(971.5KB, pdf)}

Acknowledgements

This study was supported by the intra-mural programme of the Medical Research Council (UK) and Defeating Deafness—The Hearing Research Trust. At the time when the data were gathered, AQS and GRB were employed by the Medical Research Council. The UK Cochlear Implant Study Group involved clinicians in adult cochlear implant programmes in 14 NHS hospitals together with researchers at the MRC Institute of Hearing Research and the University of York. The lead surgeons and clinical coordinators of the programmes were Mr J. Toner FRCS and Mrs C. McAnallen (City Hospital, Belfast), Mr D. Proops FRCS and Mr H. Cooper (Queen Elizabeth Hospital, Birmingham), Mr C. Raine FRCS and Mr S. Khan (Royal Infirmary, Bradford), Mr R. Evans FRCS and Mr. J. Joseph (Princess of Wales Hospital, Bridgend), Mr R. Gray FRCS and Mrs I. Court (Addenbrooke’s Hospital, Cambridge), Mr A. Kerr FRCS and Dr. R. Barr-Hamilton (Royal Infirmary, Edinburgh), Mr J. Osborne FRCS and Ms M. Doran (Glan Clwyd Hospital, Bodelwyddan), Mr. R. Singh FRCS and Dr. A. Allen (Crosshouse Hospital, Kilmarnock), Mr J. Graham FRCS and Ms. W. Aleksy (Royal National Throat Nose and Ear Hospital, London), Mr A. Fitzgerald-O’Connor FRCS and Dr. T. Nunn (St. Thomas’ Hospital, London), Professor R. Ramsden FRCS and Mr. M. O’Driscoll (Royal Infirmary, Manchester), Mr G.M. O’Donoghue FRCS, Mr. K.P. Gibbin FRCS, and Mr. G. Armstrong-Bednall (University Hospital, Nottingham), Mr D. Chapman FRCS and Ms D. Gratton (Royal Hallamshire Hospital, Sheffield), and Mr P. Ashcroft FRCS, Mr M. Pringle FRCS, and Mrs J. Eyles (Institute of Sound and Vibration Research, Southampton). We thank Dr Pádraig Kitterick, Dr David Marshall, Mr John Foster, and Professor Karen Bloor for advice. We thank three anonymous reviewers whose critiques materially improved the paper.

Funding

This study was funded by (i) the intra-mural programme of the Medical Research Council and (ii) a grant from the charity, Deafness Research UK—The Hearing Research Trust.

Conflict of interest

During the 1990s and 2000s, AQS received remuneration of the costs of attending scientific conferences from manufacturers of cochlear implants which had invited him to present the results of research. While attending conferences, AQS received hospitality from manufacturers of cochlear implants. Between 2008 and 2010, AQS received a research grant from a manufacturer of cochlear implants to develop an apparatus to measure the listening skills of users of cochlear implants. Between 2006 and 2010, AQS was chief scientific advisor to the charity, Deafness Research UK—The hearing Research Trust, from which he had previously received a research grant that contributed to the costs of the study reported in this paper. AQS is a trustee of the charity, Action on Hearing Loss, which campaigns on behalf of people who are deaf, have hearing loss, or suffer from tinnitus. Garry Barton (GRB) declares that he has no conflict of interest.

Ethical approval

The research reported in this paper was approved by a multi-centre research ethics committee of the UK National Health Service. All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Footnotes

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

1.National Institute for Health and Care Excellence. (2013). Guide to the Methods of Technology Appraisal 2013. Retrieved 30 November, 2017, from https://www.nice.org.uk/process/pmg9/chapter/foreword. [PubMed]
2.Barton GR, Bankart J, Davis AC, Summerfield AQ. Comparing utility scores before and after hearing-aid provision. Applied Health Economics and Health Policy. 2004;3:103–105. doi: 10.2165/00148365-200403020-00006. [DOI] [PubMed] [Google Scholar]
3.Barton GR, Bankart J, Davis AC. A comparison of the quality of life of hearing-impaired people as estimated by three different utility measures. International Journal of Audiology. 2005;44:157–163. doi: 10.1080/14992020500057566. [DOI] [PubMed] [Google Scholar]
4.Grutters JPC, Joore MA, van der Horst F, Verschuure H, Dreschler WA, Anteunis LJC. Choosing between measures: comparison of EQ-5D, HUI2 and HUI3 in persons with hearing complaints. Quality of Life Research. 2007;16:1439–1449. doi: 10.1007/s11136-007-9237-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
5.Yang Y, Longworth L, Brazier J. An assessment of the validity and responsiveness of generic measures of health-related quality of life in hearing impairment. Quality of Life Research. 2013;22:2813–2828. doi: 10.1007/s11136-013-0417-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
6.Davis AC. Hearing in adults. London: Whurr Publishers Ltd; 1995. [Google Scholar]
7.Goman AM, Lin FR. Prevalence of hearing loss by severity in the United States. American Journal of Public Health. 2016;106:1820–1822. doi: 10.2105/AJPH.2016.303299. [DOI] [PMC free article] [PubMed] [Google Scholar]
8.Drummond MF, O’Brien B, Stoddart GL, Torrance GW. Methods for the economic evaluation of health care programmes. Oxford: Oxford University Press; 1997. [Google Scholar]
9.Brooks R, Rabin R, de Charro F. The measurement and evaluation of health status using EQ-5D: A European perspective. Dordrecht: Kluwer Academic Publishers; 2003. [Google Scholar]
10.Horsman J, Furlong W, Feeny D, Torrance G. The Health Utilities Index (HUI): Concepts, measurement properties and applications. Health Quality of Life Outcomes. 2003;16:1. doi: 10.1186/1477-7525-1-54. [DOI] [PMC free article] [PubMed] [Google Scholar]
11.Brazier J, Roberts J, Deverill M. The estimation of a preference-based measure of health from the SF-36. Journal of Health Economics. 2002;21:271–292. doi: 10.1016/S0167-6296(01)00130-8. [DOI] [PubMed] [Google Scholar]
12.National Institute for Health and Care Excellence. (2017). Position statement on the EQ-5D-5L valuation set. Retrieved 20 December, 2017, from https://www.nice.org.uk/Media/Default/About/what-we-do/NICE-guidance/NICE-technology-appraisal-guidance/eq5d5l_nice_position_statement.pdf.
13.Torrance G, Feeny D, Furlong W, Barr R, Zhang Y, Wang Q. Multiattribute utility function for a comprehensive health status classification system: Health Utilities Index Mark 2. Medical Care. 1996;7:702–722. doi: 10.1097/00005650-199607000-00004. [DOI] [PubMed] [Google Scholar]
14.Feeny D, Furlong W, Torrance GW, Goldsmith CH, Zhu Z, DePauw S, Denton M, Boyle M. Multiattribute and single-attribute utility functions for the Health Utilities Index Mark 3 system. Medical Care. 2002;40:113–128. doi: 10.1097/00005650-200202000-00006. [DOI] [PubMed] [Google Scholar]
15.Ware JE, Snow KK, Kosinski M, Gandek B. SF-36 Health Survey: Manual and Interpretation Guide. Boston: The Health Institute, New England Medical Center; 1993. [Google Scholar]
16.Konerding U, Moock J, Kohlmann T. The classification systems of the EQ-5D, the HUI II and the SF-6D: What do they have in common? Quality of Life Research. 2009;18:1249–1261. doi: 10.1007/s11136-009-9525-8. [DOI] [PubMed] [Google Scholar]
17.National Institute for Health and Care Excellence. (2009). Cochlear implants for children and adults with severe to profound deafness. Technology Appraisal Guidance [TA166]. Retrieved 1 November 2017, from, https://www.nice.org.uk/guidance/ta166.
18.UK Cochlear Implant Study Group Criteria of candidacy for unilateral cochlear implantation in postlingually deafened adults I: Theory and measures of effectiveness. Ear and Hearing. 2004;25:310–335. doi: 10.1097/01.AUD.0000134549.48718.53. [DOI] [PubMed] [Google Scholar]
19.Bond M, Mealing S, Anderson R, Elston J, Weiner G, Taylor RS, Hoyle M, Liu Z, Price A, Stein K. The effectiveness and cost-effectiveness of cochlear implants for severe to profound deafness in children and adults: A systematic review and economic model. Health Technology Assessment. 2009;13:1–330. doi: 10.3310/hta13440. [DOI] [PubMed] [Google Scholar]
20.Coles RRA. Tinnitus. In: Kerr AG, editor. Scott-brown otolaryngology. London: Butterworth-Heinemann; 1997. [Google Scholar]
21.Dauman R. Electrical stimulation for tinnitus suppression. In: Tyler R, editor. Tinnitus handbook. San Diego: Singular; 2000. pp. 377–398. [Google Scholar]
22.McFadden, D. (1982). Tinnitus: Facts, theories, and treatments. Report of Working Group 89, Committee on Hearing Bioacoustics and Biomechanics. Washington, DC.
23.Tyler, R. S., & Kelsay, D. (1990). Advantages and disadvantages reported by some of the better cochlear-implant users. American Journal of Otology 11. [PubMed]
24.UK Cochlear Implant Study Group Criteria of candidacy for unilateral cochlear implantation in postlingually deafened adults II: Cost-effectiveness analysis. Ear and Hearing. 2004;25:336–360. doi: 10.1097/01.AUD.0000134550.80305.04. [DOI] [PubMed] [Google Scholar]
25.UK Cochlear Implant Study Group Criteria of candidacy for unilateral cochlear implantation in postlingually deafened adults III: Prospective evaluation of an actuarial approach to defining a criterion. Ear and Hearing. 2004;25:360–374. doi: 10.1097/01.aud.0000134551.13162.88. [DOI] [PubMed] [Google Scholar]
26.Dolan P. Modeling valuations for EuroQol health states. Medical Care. 1997;35:1095–1108. doi: 10.1097/00005650-199711000-00002. [DOI] [PubMed] [Google Scholar]
27.Jenkinson C, Layte R, Wright L, Coulter A. The UK SF-36: An analysis and interpretation manual. Oxford: Health Services Research Unit, Department of Public Health and Primary Care, University of Oxford; 1996. [Google Scholar]
28.School of Health and Related Research, University of Sheffield (2017). Measuring and Valuing Health: SF-6D. Retrieved 1 November, 2017, from https://www.sheffield.ac.uk/scharr/sections/heds/mvh/sf-6d.
29.Bench J, Kowal A, Bamford J. The BKB (Bamford-Kowal-Bench) sentence lists for partially-hearing children. British Journal of Audiology. 1979;13:108–112. doi: 10.3109/03005367909078884. [DOI] [PubMed] [Google Scholar]
30.Sissons, C. (1996). Tinnitus questionnaire items for measures of severity, maskability, and intrusion/annoyance. Dissertation presented to the Department of Public Health and Epidemiology, University of Nottingham.
31.IBM Corporation . IBM SPSS Statistics for Windows, Version 22.0. Armonk. New York: IBM Corp; 2016. [Google Scholar]
32.Norman GR, Wyrwich KW, Patrick DL. The mathematical relationship among different forms of responsiveness coefficients. Quality of Life Research. 2007;16:815–822. doi: 10.1007/s11136-007-9180-x. [DOI] [PubMed] [Google Scholar]
33.National Institute for Health and Care Excellence. (2017). Review of TA166; Cochlear implants for children and adults with severe to profound deafness. Retrieved 24 July, 2018, from https://www.nice.org.uk/guidance/ta166/documents/review-proposal-paper.
34.Zeng FG. Challenges in improving cochlear implant performance and accessibility. IEEE Transactions in Biomedical Engineering. 2017;64:1662–1664. doi: 10.1109/TBME.2017.2718939. [DOI] [PMC free article] [PubMed] [Google Scholar]
35.Cruickshanks KJ, Tweed TS, Wiley TL, Klein BE, Klein R, Chappell R, Nondahl DM, Dalton DS. The 5-year incidence and progression of hearing loss: The epidemiology of hearing loss study. Archives of Otolaryngology Head and Neck Surgery. 2003;129:1041–1046. doi: 10.1001/archotol.129.10.1041. [DOI] [PubMed] [Google Scholar]
36.Sach TH, Barton GR. Interpreting parental proxy reports of (health-related) quality of life for children with unilateral cochlear implants. International Journal of Pediatric Otorhinolaryngology. 2007;71:435–445. doi: 10.1016/j.ijporl.2006.11.011. [DOI] [PubMed] [Google Scholar]
37.Nondahl DM, Cruickshanks KJ, Dalton DS, Klein BE, Klein R, Schubert CR, Tweed TS, Wiley TL. The impact of tinnitus on quality of life in older adults. Journal of the American Academy of Audiology. 2007;18:257–266. doi: 10.3766/jaaa.18.3.7. [DOI] [PubMed] [Google Scholar]
38.Briner W. A behavioral nosology for tinnitus. Psychological Reports. 1995;77:27–34. doi: 10.2466/pr0.1995.77.1.27. [DOI] [PubMed] [Google Scholar]
39.Folmer RL, Griest SE, Martin WH. Chronic tinnitus as phantom auditory pain. Otolaryngology Head and Neck Surgery. 2001;124:394–400. doi: 10.1067/mhn.2001.114673. [DOI] [PubMed] [Google Scholar]
40.Erlandsson SI, Hallberg LR. Prediction of quality of life in patients with tinnitus. British Journal of Audiology. 2000;34:11–20. doi: 10.3109/03005364000000114. [DOI] [PubMed] [Google Scholar]
41.Sullivan M, Katon WJ, Russo J, Dobie R, Sakai C. Somatization, co-morbidity, and the quality of life: Measuring the effect of depression upon chronic medical illness. Psychiatric Medicine. 1992;10:61–76. [PubMed] [Google Scholar]
42.McCormack A, Edmondson-Jones M, Fortnum H, Dawes PD, Middleton H, Munro KJ, Moore DR. Investigating the association between tinnitus severity and symptoms of depression and anxiety, while controlling for neuroticism, in a large middle-aged UK population. International Journal of Audiology. 2015;54:599–604. doi: 10.3109/14992027.2015.1014577. [DOI] [PMC free article] [PubMed] [Google Scholar]
43.Maes IHL, Joore MA, Cima RFF, Vlayen JW, Anteunis JC. Assessment of health state in patients with tinnitus: a comparison of the EQ-5D and HUI Mark III. Ear and Hearing. 2011;32:428–435. doi: 10.1097/AUD.0b013e3181fdf09f. [DOI] [PubMed] [Google Scholar]
44.School of Health and Related Research, University of Sheffield (2018). Extending the QALY. Retrieved 24 October, 2018, from https://scharr.dept.shef.ac.uk/e-qaly/.
45.Yang Y, Rowen D, Brazier J, Tsuchiya A, Young T, Longworth L. An exploratory study to test the impact on three ‘bolt-on’ items to the EQ-5D. Value Health. 2015;18:52–60. doi: 10.1016/j.jval.2014.09.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
46.Finch AP, Brazier JE, Mukuria C. An exploratory study on using principal-component analysis and confirmatory factor analysis to identify bolt-on dimensions: The EQ-5D case study. Value Health. 2017;20:1362–1375. doi: 10.1016/j.jval.2017.06.002. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary material 1 (PDF 971 KB)^{(971.5KB, pdf)}