1. Introduction
Cochlear implant (CI) has been proven to deliver speech sounds successfully to the recipients with severe to profound hearing loss. Many studies have shown significantly improved speech perception scores after implantation (Chang et al., 2010; Dunn et al., 2014; Grieco-Calub & Litovsky, 2010; Tyler et al., 2007).
However, the music perception of people with hearing loss is still significantly compromised even with high technology hearing devices such as CIs. Researchers reported that postlingually deafened CI users showed significantly reduced music perception skills. In daily life, music consists of integrated frequency, duration, and amplitude, which are regarded as primary acoustic features such as rhythm, pitch, and timbre, resulting in rapid ongoing changes in complexity (Hargreaves & North, 2010; Yitao & Li, 2013). Although CI has presented outstanding achievement on speech perception in quiet conditions and limited music perception in rhythmic contexts, CI users showed reduced accuracy in melody recognition and timbre (tone quality) recognition (Gfeller, 2016; Gfeller & Lansing, 1991; Gfeller et al., 2006; Kang et al., 2009; Looi et al., 2012; McDermott & Looi, 2004). For example, CI group recognized the timbre of the music only 36.7% correctly when their hearing counterparts recognized timbre 82.0% correctly (Wright & Uchanski, 2012).
Also, patients with CIs have complained about the music listening experience through CIs in terms of appreciation and satisfaction. Many of them reported degraded music appreciation (Drennan et al., 2015; Migirov et al., 2009; Mirza et al., 2003). Mostly they feel uncomfortable with the sound quality and song lyrics perception during music listening (Collister & Huron, 2008). For example, Mirza et al. (2003) reported that music appreciation scores dropped from 8.7 (out of 10) before implantation to 2.9 (out of 10) after implantation for postlingual CI users. Not only general music appreciation, but CI users also enjoyed timbre less than their hearing counterparts (Gfeller et al., 2003).
People listen to and enjoy music as a part of life. A communicative life is fulfilled with music and speech, so that the technologies should pursue the goals that aim to better perceive speech and music for the sake of people with hearing devices.
Current hearing technologies have agreed with this notion that they are heading to improve their devices to utilize the acoustic hearing essential to music perception and enjoyment. Residual hearing in low frequencies can provide elements of music such as formants, harmonics, and timbre. Regarding acoustic stimulation, there has been improvement in device type and functions in both CI and HA to utilize this information. Previous studies indicated that sounds through hearing devices with acoustic features could improve music perception and appreciation. Some of these researches compared music perception between CI users and hearing aid users (Looi et al., 2008), CI only users and bimodal (CI in one ear and HA in the other ear) users (Bae et al., 2019; Gantz et al., 2005; Gfeller et al., 2006; Kiefer et al., 2005; Kong et al., 2004; Looi & She, 2010), or CI and electro-acoustic stimulation (EAS: electric stimulation and acoustic stimulation in the same ear) mechanism (Brockmeier et al., 2010; Gantz & Turner, 2003, 2004).
These variations of acoustic stimulation accompanied with CI have been developed as the electrode arrays that are implanted into cochlea have evolved to preserve the existing structure. This technology resulted in preserving low-frequency perception after implantation, and more people with residual hearing pursue CI options when they experience communication difficulties with their hearing status. Thus, CI with low-frequency preservation needs a highly sophisticated surgery technique even there are good chances to be successful in hearing preservation after CI (Bae et al., 2019). Therefore, it is reasonable to follow up the long-term use of the devices to verify the devices' function for listening to music in their lives. However, acoustic use for the CI users has not been investigated in long-term perspectives, rarely focused on research.
This study investigated how adult users with various modes of hearing devices with CI adapted to their hearing status function in music listening performance. Research questions are as follow.
First, do participants with CI variation show improvement in music perception, appreciation, and satisfaction? If so, is there a long-term improvement after CI implantation? Second, do CI participants with acoustic stimulation show better music perception, appreciation, and satisfaction than participants with electrical stimulation exclusively?
2. Methods
The data of 163 adult CI recipients implanted at Soree Ear Clinic were analyzed retrospectively. The participants visited the clinic before and after implantation surgery to follow up performances. Their pre-implantation pure tone thresholds at 125, 250, 500, 750, 1 k, 1.5 k, 2 k, 3 k, 4 k, and 6 kHz were tested and musical perception test and musical appreciation and satisfaction questionnaires were done during their visits.
Participants were selected based on the following criteria; (1)17+ years old at the implantation, (2) one or two CI electrode arrays were implanted in their cochlea(s), (3) no detected anatomical abnormality on cochlea or cochlear nerve, (4) no diagnosed cognitive problems, (5) participated musical testes at least once at pre-implantation, 1-year, and 2-year post-implantation.
Then participants were divided into two groups based on their hearing device/stimulation types. If a participant gains hearing benefits through only electrical stimulation, he/she will be in CI group. The participants in this group utilize either unilateral CI (Uni-CI) or bilateral CI (Bi-CI) since CI provides only electrical stimulation. The other group (EAS group) consisted of adults who hear sounds not only electrical stimulation but also some type of acoustic stimulation. The acoustic options that this group has are CI in one ear and HA in the other ear (bimodal), EAS in one ear only (Uni-EAS), EAS in one ear and HA in the other ear (bimodal EAS), EAS in both ears (Bi-EAS), and EAS in one ear and CI in the other ear (Combined EAS).
The demographic information of the participants is summarized in Table 1.
Participants were tested before the implantation and at their follow ups. In this study, we used data collected at pre-implantation, 1 year and 2 years after switch-on of the devices.
The music tests that the participants had were Melodic Contour Identification test (MCI; Galvin et al., 2007, 2009) and The Korean Version of Musical Background Questionnaire (KMBQ, An et al., 2019) which included appreciation and satisfaction questionnaires.
The MCI test was originally designed by Galvin et al. (2007) and modified to evaluate music perception, especially a melody identification in this study. The test was composed of 9 melodic patterns with 5 successive notes (Figure 1), and each interval between adjacent two notes was 2 semitones. The melodic patterns were randomly provided in three frequency ranges: 220–440, 440–880, and 880–1,760 Hz. The musical stimuli were provided through a speaker at 75 dB SPL, and the participants were asked to select one of 9 patterns after listening to the stimuli. This test was implemented in audition-only condition. After two rehearsals, the participants listened to a total of 27 musical patterns, three times of each of the nine patterns.
KMBQ was developed based on the Iowa Musical Background Questionnaire (IMBQ) (An et al., 2019). KMBQ involves musical background and three factors of self-reported music perception. Musical background is related to previous musical experiences such as formal music education levels or personal music experiences. The first factor is satisfaction about listening to music and music enjoyment. The second and third factors contain self-reported music appreciation in music elements and sound quality related, which are embraced as music appreciation in this study. Each participant was asked to fill in the survey questions when they visited for the MCI test on a regular follow up session.
3. Statistics (Method of analysis)
Groups were divided based on their device types: CI group (Uni-CI or Bi-CI) and EAS group (Bimodal and/or EAS variation), and the testing time points were pre-implantation, 1-year, and 2-year post- implantation. To analyze the music perception, appreciation, and satisfaction of CI users over time between CI and EAS groups, a mixed-design (Group × Time) repeated measures analysis of variance (ANOVA) was used with music perception performance scores as dependent variables. Music perception performance were measured by MCI (melody identification) and KMBQ which includes music appreciation scores (quality of music and elements of music) and music satisfaction scores.
The main effect of the Group and Time conditions and the interaction between them were analyzed at the level of p<0.05. If there was a main effect of the Time, post-hoc analysis corrected by Tukey method was performed to determine where the difference happened among pre-implantation, 1-year, and 2-year post-implantation. Degrees of freedom was calculated using the Kenward-Roger method. All the statistical analyses were done using R program (R Core Team, 2020) and the lmerTest package (Kuznetsova et al., 2017).
4. Results
Mixed design repeated measures ANOVA showed significant main effects for the test periods on all music perception dependent variables, melody identification measured by MCI [F(1, 2)=35.81, **p<0.01], music appreciation scores including elements of music [F(1, 2)=45.54, **p<0.01] and quality of music [F(1, 2)=25.01, **p<0.01], and music satisfaction scores [F(1, 2)=14.24, **p<0.01]. Pairwise analysis adjusted by Tukey for multiple comparison revealed that all the music performance scores improved between pre-implantation and 1-year post-implantation (MCI: **p<0.01, element of music: **p<0.01, quality of music: **p<0.01, music satisfaction: **p<0.01) and pre-implantation and 2-year post-implantation (MCI: **p<0.01, element of music: **p<0.01, quality of music: **p<0.01, music satisfaction: **p<0.01) but there was no significant differences between 1-year and 2-year post-implantation (MCI: p=0.98, element of music: p=0.35, quality of music: p=0.26, music satisfaction: p=0.42). These results indicated that improved auditory input through both electrical signal only and electrical signal with acoustic stimulation enhanced music performance skills and experiences significantly compared to pre-implantation music perception abilities. However, the progress of improvement was not significantly continued between 1-year post-implantation and 2-year post-implantation. Table 2 presents the music performance results of both CI and EAS groups over time.
The main effects of the Group (CI group and EAS group) were analyzed to examine the advantages of acoustic hearing to the electrical stimulation compared to only electrical hearing. Mixed design repeated measures ANOVA showed a significant main effect of Group when the dependent variable was music perception skill measured by MCI [F(1, 2)=7.61, **p<0.01], suggesting that acoustic input benefits music perception skills than exclusively electrical stimulation. However, there was no statistically significant main effects of Group on music appreciation scores [element of music: F(1, 2)=0.34, p=0.55, quality of music: F(1, 2)=0.45, p=0.50] and music satisfaction scores [F(1, 2)=1.42, p=0.23]. These results indicated that the benefit of acoustic auditory input does not expand to music experience, although participants improved the skill to listen to the music (Figure 2).
5. Discussion
In the current study, after one year of device use, both CI and EAS groups showed significant improvement in music perception from the pre-implant period measured by melody identification, appreciation of elements and quality of music, and satisfaction about music. Music performance changes longitudinally, which, unfortunately, few researches have explored. Our data suggested that both CI and EAS users significantly improved their music listening abilities in all three categories of music performance compared to the pre-implantation status. The results are expanding our knowledge of music ability changes over time and encouraging results that improvement maintained up to 2 years.
It is an exciting result supporting that current CI system using electrical stimulation only has improved in music perception unlike previous studies showing degraded music perception after implantation (Gfeller, 2016; Gfeller et al., 2006; Kang et al., 2009; Looi et al., 2012). This might be because the previous studies did not follow the performance long enough for the participants to adapt and utilize the new signals that they gotten through CI system.
It is also an evidence that EAS group did not lose their residual hearing after the electrode implantation as least for 2 years. It had been known that CI surgery technique resulted in a total loss of residual hearing. Evolved electrode manufacturing and advanced surgical technique (Bae et al., 2019) could reserve the low frequency residual hearing for the CI recipients to attain better music perception in this study.
Our current study explored music results between pre-implant, 1-year and 2-year post-implantation and found significant improvement between pre and post implantation, however the difference between 1 and 2-year post-implantation was not significant. These results also can be compared with speech perception improvement over time in CI users. Chang et al. (2010) reported the same pattern in speech that showed significant improvement after 1-year post-implantation in monosyllable word scores from the pre-implant period and then plateaued afterward up to 6-year post-implantation. Based on this research, one can suspect music perception may be also plateaued after 1 year, however, we do not have enough research evidence for that now. In the future, our observation can be extended further to exam if this improvement maintains for more years or if there is further improvement after two years of implant experience.
However, still, many implantees have experienced hearing drops after surgery. We also observed some CI recipients went through hard time to adapt to the sounds by the hybrid system using electrical and acoustic stimulation even with the residual hearing. It seems that they overcame the difficulty adjusting to the new sounds after one-year of device use. Further study is needed to see how this recovery curve is drawn after implantation and if music therapy can be a help of this happening.
The following interesting finding of this study is that the EAS group using electrical stimulation accompanied with acoustic stimulation via their hearing devices scored better in melody identification than the CI group using exclusively electrical sound processing. It means that they could receive better spectral resolution through their acoustic device utilizing low-frequency sounds with their residual hearing.
Hearing technologies have developed to stimulate the human auditory system via direct electrical stimulation on an auditory nerve by CI devices; simultaneously, acoustic amplification systems have evolved to attain better hearing perception through air conduction sound delivery when recipients have a usable residual hearing. This study showed that current hearing technologies combine these two different sound conduction systems with improving hearing abilities and the quality of the incoming sounds.
In accordance with our study, prior work has documented the benefit of acoustic input on music perception and appreciation in hearing device users with severe to profound hearing loss (Gantz et al., 2005; Kiefer et al., 2005; Kong et al., 2004; Looi & She, 2010). These acoustic benefits suggest improving the music listening experience for listeners with bimodal device or EAS device types. For example, Looi & She (2010) reported that listening with bimodal use could improve the melody identification and quality of music in the questionnaire they developed.
However, unlike Looi & She (2010), the current finding did not support acoustic benefits to music appreciation and satisfaction over the CI group. One of the possible explanations could be the level of expectation. In our study, EAS group participants demonstrated greater music perception scores before the surgery compared to the CI group participants due to their residual hearing. Although the EAS group improved music perception scores more than the CI group, the EAS group’s expectation could have been higher for listening to music than the CI group, and that might lead to similar music appreciation and satisfaction scores for both groups even though the acoustic group had greater improvement in music perception test. Another possible explanation could be mismatched auditory feedback. While the CI group only hears through one type of auditory feedback, the EAS group receives acoustic and electrical stimulation. Therefore, a mismatch of timing and different input sound quality may discourage appreciation and satisfaction, not to the level of their music perception skills. However, these explanations need further investigation.
It has also been known that there is a discrepancy between perception skills and subjective experiences in the CI users in terms of music. Many studies found that CI users showed improved perception skills, including melody (Galvin et al., 2009; Nakata et al., 2005; Xu et al., 2009; Yuba et al., 2009) and timbre (Gfeller et al., 2003, Looi & She, 2010), but not appreciation and satisfaction about music after implantation (Wright & Uchanski, 2012).
In this study, we divided the participant groups by the presence of acoustic stimulation. It provided important implications to hearing preservation and acoustic amplification. However, also it was challenging because acoustic stimulation can come in many different forms as the acoustic options vary, such as bimodal, Uni-EAS, bimodal EAS, Bi-EAS, Combined EAS, and that made the choice of device more complicated.
Even though these results suggested the possibilities of better music perception and appreciation through acoustic features, device choices are more complicated when applied to real clinical situations. EAS users may change their mapping system to only electrical stimulation sometimes to try out, and vice versa would happen to CI patients. Yoon et al. (2019) suggested optimal mapping strategies to maximize acoustic benefit along with electrical sound processing. Research that explores music performance of EAS users who use some acoustic input to their implants is needed according to the residual hearing they reserve in their cochlea and mapping strategies to provide overall acoustic benefit to implantation.
In the future, researchers will be able to analyze the effect of specific types of device combinations on music listening. Also, some of the participants tried acoustic stimulation during electrical stimulation and/or changed their stimulation mode, which we could not include in the data points. Further analysis can explore how these temporary or permanent device type changes affect music perception, appreciation, and satisfaction. We explored this benefit would expand to any device types and combinations providing acoustic input to implant users.
The findings and discussions of the current study may lead to the need of music rehabilitation to adult CI users. Our data showed a high standard deviation for music perception, appreciation, and satisfaction scores, which may imply the possibility of improving with music rehabilitation. Music rehabilitation might be helpful to adjust post- implant expectations on music listening, which was discussed as one of the possible reasons for no group differences. Music therapists would be able to educate the way of listening and interpreting new signals from their devices to improve their music performance.
6. Conclusion
Music perception performance was improved in all areas, music perception, appreciation, and satisfaction, after implantation, and it maintained for up to two years. The results suggested the help of electro-acoustic stimulation improve melody identification skills more than electrical stimulation only, although music appreciation and satisfaction of the participants were not improved. These findings can be applied to future device selections and the need for music rehabilitation for this population.