Development of Chinese odor identification test
Introduction
Olfaction is the oldest sensory function of human beings and is essential to human survival (1). The olfactory system not only enables humans to perceive their environment, but also plays an important role in social interaction (2-4) and food intake (5). Therefore, decreased olfactory function can lead to a decline in quality of life (6,7), and even depression (8,9). Olfactory dysfunction is mainly result from chronic sinonasal diseases, head trauma, upper respiratory infections, and neurodegenerative diseases (10). Studies have shown that olfactory dysfunction is also an early biomarker of certain diseases, such as COVID-19 (11,12) and Alzheimer’s disease (13,14). The current diagnosis and classification of olfactory dysfunction mainly rely on psychophysical olfactory tests that evaluate human olfactory function from three aspects: odor threshold (OT), odor discrimination (OD) and odor identification (OI) (15-18). Based on analysis of these three capabilities, a large number of olfactory function tests have been developed since the 1990s. Olfactory tests that are used worldwide include the Connecticut Chemosensory Clinical Research Center (CCCRC) test (19,20), the University of Pennsylvania Smell Identification Test (UPSIT) (21,22), Sniffin’ sticks (23,24), T&T test (25),Scandinavian Odor-Identification Test (SOIT) (26), San Diego Odor Identification Test (SDOIT) (27), and the Cross-Cultural Smell Identification Test (CC-SIT) which was developed on the basis of UPSIT (28,29).
The OI task relies on olfactory detection ability, executive function and semantic memory, which are more cognitively loaded than the OT and OD tests (30,31). Testing OI has been used in clinical settings to diagnose various causes of olfactory disorders and is more sensitive than OT and OD for detecting neurodegenerative diseases, including Parkinson’s and Alzheimer’s diseases (32,33). However, patients often complain that they are not familiar with certain odors, such as cloves, pine resin, raspberry and Japanese cypress, which is related to cultural differences (34). In order to solve this problem for the Chinese, researchers have modified the choice of odors to make the tests more suitable (35-38), but these tests are not widely used in mainland China. Any new olfactory function test should not only consider familiarity with odors but also the ease of use and cost. Too cumbersome and expensive tests will not meet clinical needs in China. Therefore, we developed a Chinese OI test (COIT) based on Sniffin’ sticks and defined the cutoff values of the COIT for diagnosing hyposmia and anosmia in Chinese people. Finally, we tested its reliability and validity in clinical settings in China.
We present the following article in accordance with the MDAR checklist (available at http://dx.doi.org/10.21037/atm-21-913).
Methods
Participants
A total of 60 patients with olfactory disorders and 404 people with normal olfactory function were recruited from the Smell and Taste Center of Beijing Anzhen Hospital between 2018 and 2020. Of them, 344 participants (147 women, 197 men; mean age 37.9 years, SD 12.5, range 17–64 years) with normal olfactory function participated in Experiment 1. In Experiment 2, there were 60 people with normal olfactory function (27 women, 33 men; mean age 38.4 years, SD 12.0, range 23–62 years) and 60 patients with olfactory disorders (25 women, 35 men; mean age 45.7 years, SD 15.1, range 19–71 years). The 60 normal volunteers who participated in Experiment 2 also participated in Experiment 3. The patients were diagnosed with olfactory disorders based on medical history, nasal endoscopic examination and Sniffin’ Sticks olfactory test. The sum of scores of the three subtests including odor threshold, discrimination, and identification constitutes the final score of Sniffin’ Sticks test (TDI). TDI <30.5 indicates olfactory disorder (24). All subjects with normal olfactory function had no complaints of olfactory dysfunction and confirmed by Sniffin’ Sticks olfactory test (TDI ≥30.5). The study was approved by the Institutional Review Board of Beijing Anzhen Hospital (No. 2018087X). All procedures performed in this study involving human participants were in accordance with the Declaration of Helsinki (as revised in 2013). Informed consent was taken from all the patients.
Olfactory function test
Two widely used olfactory tests were selected to evaluate the diagnostic efficacy of the COIT. In the CC-SIT developed by the University of Pennsylvania, odorants are microencapsulated on the test paper (28) and the subject uses a pencil to scratch the microcapsule coating to release the odor, which is then selected from four options. The test consists of 12 odorants, with a maximum score of 12. The other test was the Sniffin’ Sticks test, which comprises felt-tip pen-like devices containing the odorants, called “sticks”, and has three parts, namely OT, OD and OI (24). Each part contains 16 questions, with a maximum score of 48. During the test, the lid of the pen was opened and the pen tip placed approximately 2 cm under the subject’s nostrils for 2–3 s. During the OI test, the subject is given an olfactory stick containing the target odor and asked to select the target odor from four options after sniffing. The steps for using COIT are the same as the Sniffin’ Sticks identification test. A choice must be made even if the subject indicates that he cannot smell the odor or cannot accurately identify the target odor (23,24).
Odorants preparation
Odorants used in the COIT were purchased from the Apple Flavor and Fragrance Group (Shanghai, China). Similar to the Sniffin’ Sticks identification test, we dropped 1 mL of each liquid odorant onto a felt-tip pen (Burghart Messtechnik, Wedel, Germany) (23). Only chocolate needed to be diluted with water at a ratio of 1:1 to ensure a similar odor intensity to the other odorants.
Study design
Our study consisted of three experiments. The goal of Experiment 1 was to develop a COIT based on the Sniffin’ Sticks identification test. A total of 344 people with normal olfactory function participated in this experiment, which was divided into two steps. In the first step, we tested the volunteers with the Sniffin’ Sticks and calculated the correct identification rate for each odor. Those with a correct identification rate <75% were to be replaced with odors that are more familiar to Chinese people. In the second step, we tested 12 common Chinese odors on the volunteers and told them the corresponding objects: chocolate, cream, sesame oil, Osmanthus, jasmine, almond, lychee, bacon, green tea, honey, chrysanthemum and tangerine peel. We then asked the volunteers to select the three most familiar odors and rank them. The odors with higher familiarity were used to develop the COIT (26,39).
In Experiment 2, we validated the COIT against two most widely used olfactory function tests in the world, the Sniffin’ Sticks (response alternatives translated to simplified Chinese, including OT, OD, and OI) and CC-SIT (simplified Chinese version, 12 items), in a group of 120 participants (60 patients, 60 healthy controls). In addition to the score of each test, we also recorded the time taken for each test. The goal of Experiment 3 was to assess the reliability of the COIT. We retested the 60 normal volunteers who had participated in Experiment 2 with the COIT 3 months after Experiment 2.
Statistical analysis
The Pearson correlation coefficient was applied for correlation analysis of the three olfactory function tests and analysis of the test-retest reliability. The paired t-test was used for analysis of the difference between the two COIT tests separated by 3 months. A receiver operating characteristic (ROC) curve was generated to identify the best cutoff point for diagnosing hyposmia and anosmia. Analyses were performed using SPSS statistical software version 17.0 (IBM, Armonk, NY, USA).
Results
Development of the COIT
In Experiment 1 we selected six odors that can be easily recognized by most Chinese people to replace inappropriate odors in the Sniffin’ sticks identification test. First, we tested 344 normal volunteers with the Sniffin’ sticks OI test and calculated the correct recognition rate of the 16 odors. Of these, the correct recognition rate of six odors was <75%, consisting of Leather (54.65%), Cinnamon (36.63%), Licorice (34.88%), Pine resin (36.63%), Apple (51.74%), and Clove (42.44%) (Table 1, Figure 1). We replaced these odors and kept the other 10 odors to develop COIT. In step 2, the volunteers selected 3 of 12 most familiar odors, which we ranked according to their familiarity (e.g., 51.74% of volunteers chose chocolate). The top six odors were chocolate (51.74%), cream (27.33%), sesame oil (49.42%), Osmanthus (29.65%), jasmine (33.14%) and almond (28.49%). These 6 new odors and the remaining 10 odors from the Sniffin’ Sticks identification test constituted the COIT.
Full table
Validity and cutoff value of COIT
In Experiment 2, 60 volunteers with normal olfaction and 60 patients with olfactory dysfunction participated. Specifically, 23 patients suffered from anosmia (TDI <16.5) (24), and 37 suffered from hyposmia (TDI ≥16.5) (24). The correct rate of identification of each item in the COIT was higher than 75% among the volunteers (Figure 2). Table 2 shows the comparison of the three olfactory function tests. We found that the COIT score significantly correlated with both the Sniffin’ Sticks score (r=0.755, P<0.0001, Figure 3A) and CC-SIT score (r=0.7462, P<0.0001, Figure 3B). These results suggested that the COIT can be used to evaluate the olfactory function of Chinese people, and has better cultural applicability.
Full table
Next, a ROC curve was used to evaluate the accuracy of COIT in diagnosing olfactory dysfunction. We also defined the cutoff values of the COIT for diagnosing hyposmia and anosmia in Chinese people. The COIT showed high accuracy to distinguish between normal olfactory function and olfactory disorders [area under the curve (AUC) =0.8896, P<0.0001, Figure 4] and further subdivided olfactory disorders into hyposmia and anosmia (AUC =0.9753, P<0.0001, Figure 5). The evaluation indexes for the cutoff points are given in Table 3. A higher Youden index (sensitivity + specificity − 1) indicated a higher diagnostic ability. As shown in Table 3 normal olfactory function is indicated if the COIT score is ≥12 (specificity 76.7%, sensitivity 86.7%, Youden index 0.634), <7 indicates anosmia (specificity 94.6%, sensitivity 100%, Youden index 0.946), and between 7 and 12 indicates hyposmia.
Full table
Reliability of COIT
In Experiment 3, we quantified the test-retest reliability of the COIT. Specifically, the 60 normal volunteers who participated in Experiment 2 were tested twice with COIT, with an interval of 3 months. The retest COIT scores strongly correlated with those obtained the first time (r=0.8281, P<0.001, Figure 6A), and there was no significant difference between the two test results (t=1.187, P=0.24, Figure 6B). These results indicated that the COIT is highly stable.
Discussion
Our novel COIT showed excellent results for examination of olfactory function in China because all of the 16 odors can be easily recognized by Chinese people. The six odors with a low correct recognition rate in the Sniffin’ Sticks identification test [i.e., Leather (54.65%), Cinnamon (36.63%), Licorice (34.88%), Pine resin (36.63%), Apple (51.74%), and Clove (42.44%)] are unfamiliar to most Chinese people, as they do not use these substances in their daily lives. Therefore, we first asked the volunteers to smell familiar odors and then told them the corresponding substances to ensure correct identification (39). We then asked the volunteers to rank these odors according to their familiarity and in this way, we selected 16 suitable odors to form the COIT, which we then verified in Experiment 2.
The COIT scores were highly correlated with both the Sniffin’ Sticks and the CC-SIT scores. The sensitivity of using the COIT to distinguish between normal olfactory function and olfactory disorders was as high as 86.7%, and was even as high as 100% when subdividing olfactory disorders into hyposmia and anosmia, which fully demonstrated the effectiveness of the COIT. Furthermore, the COIT was highly stable, with a test-retest reliability of 0.8281, which is comparable to many widely used olfactory function tests, such as UPSIT (r=0.92) (21), Sniffin’ Sticks (r=0.73) (23), SOIT (r=0.79) (26) and SDOIT test (r=0.85) (27).
In addition to cultural applicability, the COIT has other characteristics that make it more suitable for use in China. It takes a very short time compared with the Sniffin’ Sticks test. In Experiment 2, the average time for 120 volunteers to complete the Sniffin’ Sticks test was 1,135.3±151.3 s, whereas the COIT only took 167.9±18.4 s. This time-saving aspect makes the COIT very suitable for the busy clinician. Although the CC-SIT test is equally efficient (220.3±87.9 s, Experiment 2), it is a disposable olfactory test tool and the high price has prevented it from being widely used in China, whereas the COIT can be reused. In summary, we believe that the COIT is an accurate, effective and stable olfactory test, suitable for the unique Chinese cultural background.
Acknowledgments
Funding: This study was supported by Beijing Hospitals Authority Clinical Medicine Development of Special Funding Support (XMLX202136), Beijing Hospitals Authority Youth Program (QML20190617), Beijing Science and Technology Nova Program (Z201100006820086), and Natural Science Foundation of China (82000954), Beijing Hospitals Authority’ Mission Plan (SML20190601), Beijing Scholars Program (No. 051), and National Key R&D Program of China (2019YFE0116000).
Footnote
Reporting Checklist: The authors have completed the MDAR checklist. Available at http://dx.doi.org/10.21037/atm-21-913
Data Sharing Statement: Available at http://dx.doi.org/10.21037/atm-21-913
Conflicts of Interest: All authors have completed the ICMJE uniform disclosure form (available at http://dx.doi.org/10.21037/atm-21-913). The authors have no conflicts of interest to declare.
Ethical Statement: The authors are accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. The study was approved by the Institutional Review Board of Beijing Anzhen Hospital (NO.: 2018087X). All procedures performed in this study involving human participants were in accordance with the Declaration of Helsinki (as revised in 2013). Informed consent was taken from all the patients.
Open Access Statement: This is an Open Access article distributed in accordance with the Creative Commons Attribution-NonCommercial-NoDerivs 4.0 International License (CC BY-NC-ND 4.0), which permits the non-commercial replication and distribution of the article with the strict proviso that no changes or edits are made and the original work is properly cited (including links to both the formal publication through the relevant DOI and the license). See: https://creativecommons.org/licenses/by-nc-nd/4.0/.
References
- Philpott CM, Bennett A, Murty GE. A brief history of olfaction and olfactometry. J Laryngol Otol 2008;122:657-62. [Crossref] [PubMed]
- Sullivan RM, Wilson DA, Ravel N, et al. Olfactory memory networks: from emotional learning to social behaviors. Front Behav Neurosci 2015;9:36. [Crossref] [PubMed]
- de Groot JH, Smeets MA, Kaldewaij A, et al. Chemosignals communicate human emotions. Psychol Sci 2012;23:1417-24. [Crossref] [PubMed]
- Gelstein S, Yeshurun Y, Rozenkrantz L, et al. Human tears contain a chemosignal. Science 2011;331:226-30. [Crossref] [PubMed]
- Rowe TB, Shepherd GM. Role of ortho-retronasal olfaction in mammalian cortical evolution. J Comp Neurol 2016;524:471-95. [Crossref] [PubMed]
- Neuland C, Bitter T, Marschner H, et al. Health-related and specific olfaction-related quality of life in patients with chronic functional anosmia or severe hyposmia. Laryngoscope 2011;121:867-72. [Crossref] [PubMed]
- Simopoulos E, Katotomichelakis M, Gouveris H, et al. Olfaction-associated quality of life in chronic rhinosinusitis: adaptation and validation of an olfaction-specific questionnaire. Laryngoscope 2012;122:1450-4. [Crossref] [PubMed]
- Croy I, Nordin S, Hummel T. Olfactory disorders and quality of life--an updated review. Chem Senses 2014;39:185-94. [Crossref] [PubMed]
- Jia Y, Bai S. A study on the quality of life and mental health of sinusitis patients with olfactory disorders. Lin Chung Er Bi Yan Hou Tou Jing Wai Ke Za Zhi 2020;34:149-52. [PubMed]
- Boesveldt S, Postma EM, Boak D, et al. Anosmia-A Clinical Review. Chem Senses 2017;42:513-23. [Crossref] [PubMed]
- Lechien JR, Chiesa-Estomba CM, De Siati DR, et al. Olfactory and gustatory dysfunctions as a clinical presentation of mild-to-moderate forms of the coronavirus disease (COVID-19): a multicenter European study. Eur Arch Otorhinolaryngol 2020;277:2251-61. [Crossref] [PubMed]
- Tong JY, Wong A, Zhu D, et al. The Prevalence of Olfactory and Gustatory Dysfunction in COVID-19 Patients: A Systematic Review and Meta-analysis. Otolaryngol Head Neck Surg 2020;163:3-11. [Crossref] [PubMed]
- Jung HJ, Shin IS, Lee JE. Olfactory function in mild cognitive impairment and Alzheimer's disease: A meta-analysis. Laryngoscope 2019;129:362-9. [Crossref] [PubMed]
- Kouzuki M, Suzuki T, Nagano M, et al. Comparison of olfactory and gustatory disorders in Alzheimer's disease. Neurol Sci 2018;39:321-8. [Crossref] [PubMed]
- Eibenstein A, Fioretti AB, Lena C, et al. Modern psychophysical tests to assess olfactory function. Neurol Sci 2005;26:147-55. [Crossref] [PubMed]
- Gellrich J, Sparing-Paschke LM, Thieme T, et al. Normative data for olfactory threshold and odor identification in children and adolescents. Int J Pediatr Otorhinolaryngol 2019;123:5-9. [Crossref] [PubMed]
- Besser G, Jobs L, Liu DT, et al. The Sniffin' Sticks Odor Discrimination Memory Test: A Rapid, Easy-to-Use, Reusable Procedure for Testing Olfactory Memory. Ann Otol Rhinol Laryngol 2019;128:227-32. [Crossref] [PubMed]
- Bestgen AK, Schulze P, Kuchinke L. Odor Emotional Quality Predicts Odor Identification. Chem Senses 2015;40:517-23. [Crossref] [PubMed]
- Veyseller B, Ozucer B, Karaaltin AB, et al. Connecticut (CCCRC) Olfactory Test: Normative Values in 426 Healthy Volunteers. Indian J Otolaryngol Head Neck Surg 2014;66:31-4. [Crossref] [PubMed]
- Cain WS, Gent J, Catalanotto FA, et al. Clinical evaluation of olfaction. Am J Otolaryngol 1983;4:252-6. [Crossref] [PubMed]
- Doty RL, Shaman P, Dann M. Development of the University of Pennsylvania Smell Identification Test: a standardized microencapsulated test of olfactory function. Physiol Behav 1984;32:489-502. [Crossref] [PubMed]
- Devanand DP, Liu X, Cohen H, et al. Long-Term Test-Retest Reliability of the UPSIT in Cognitively Intact Older Adults. Chem Senses 2019;44:365-9. [Crossref] [PubMed]
- Kobal G, Hummel T, Sekinger B, et al. "Sniffin' sticks": screening of olfactory performance. Rhinology 1996;34:222-6. [PubMed]
- Rumeau C, Nguyen DT, Jankowski R. How to assess olfactory performance with the Sniffin' Sticks test Eur Ann Otorhinolaryngol Head Neck Dis 2016;133:203-6. [Crossref] [PubMed]
- Shiokawa H. The clinical studies on the olfactory test using standard odorous substances. The change of olfactory acuity due to ageing (author's transl). Nihon Jibiinkoka Gakkai Kaiho 1975;78:1258-70. [Crossref] [PubMed]
- Nordin S, Brämerson A, Lidén E, et al. The Scandinavian Odor-Identification Test: development, reliability, validity and normative data. Acta Otolaryngol 1998;118:226-34. [Crossref] [PubMed]
- Murphy C, Anderson JA, Markison S. Psychophysical Assessment of Chemosensory Disorders in Clinical Populations. 1994.
- Doty RL, Marcus A, Lee WW. Development of the 12-item Cross-Cultural Smell Identification Test (CC-SIT). Laryngoscope 1996;106:353-6. [Crossref] [PubMed]
- Cho JH, Jeong YS, Lee YJ, et al. The Korean version of the Sniffin' stick (KVSS) test and its validity in comparison with the cross-cultural smell identification test (CC-SIT). Auris Nasus Larynx 2009;36:280-6. [Crossref] [PubMed]
- Hedner M, Larsson M, Arnold N, et al. Cognitive factors in odor detection, odor discrimination, and odor identification tasks. J Clin Exp Neuropsychol 2010;32:1062-7. [Crossref] [PubMed]
- Nasreddine ZS, Phillips NA, Bédirian V, et al. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc 2005;53:695-9. [Crossref] [PubMed]
- Boesveldt S, Verbaan D, Knol DL, et al. A comparative study of odor identification and odor discrimination deficits in Parkinson's disease. Mov Disord 2008;23:1984-90. [Crossref] [PubMed]
- Koss E, Weiffenbach JM, Haxby JV, et al. Olfactory detection and identification performance are dissociated in early Alzheimer's disease. Neurology 1988;38:1228-32. [Crossref] [PubMed]
- Gu D, Li P. Comparison of application of several psychophysical olfactory test methods in clinic. Lin Chung Er Bi Yan Hou Tou Jing Wai Ke Za Zhi 2014;28:715-7. [PubMed]
- Chen W, Chen S, Kang WY, et al. Application of odor identification test in Parkinson's disease in China: a matched case-control study. J Neurol Sci 2012;316:47-50. [Crossref] [PubMed]
- Yang L, Wei Y, Yu D, et al. Olfactory and gustatory function in healthy adult Chinese subjects. Otolaryngol Head Neck Surg 2010;143:554-60. [Crossref] [PubMed]
- Yuan BC, Lee PL, Lee YL, et al. Investigation of the Sniffin' Sticks olfactory test in Taiwan and comparison with different continents. J Chin Med Assoc 2010;73:483-6. [Crossref] [PubMed]
- Feng G, Zhuang Y, Yao F, et al. Development of the Chinese Smell Identification Test. Chem Senses 2019;44:189-95. [Crossref] [PubMed]
- Cain WS, Krause RJ. Olfactory testing: rules for odor identification. Neurol Res 1979;1:1-9. [Crossref] [PubMed]
(English Language Editor: K. Brown)