Advertisement
Original article| Volume 42, 102070, July 2020

Validation of the Neuronorma battery for neuropsychological assessment in multiple sclerosis

      Highlights

      • We validated the Neuronorma battery for cognitive assessment in multiple sclerosis.
      • Most tests showed medium or large effect sizes between MS patients and controls.
      • The best strategy to define cognitive impairment was based on cognitive domains.
      • Neuronorma battery provides a comprehensive neuropsychological assessment.
      • This battery is available in several countries with reliable normative data.

      Abstract

      Background

      Cognitive dysfunction is prevalent among patients with multiple sclerosis (MS). In recent years, several (generally brief) neuropsychological batteries have been proposed for cognitive assessment. There is a need for comprehensive batteries providing complete cognitive assessment of patients with MS. The Neuronorma battery includes several standardised neuropsychological tests examining the main cognitive domains, and is available in several countries. The aim of this study was to validate the battery for cognitive assessment in a sample of patients with MS and healthy controls, and to find the most appropriate criteria for defining cognitive impairment using this battery.

      Methods

      Five hundred and sixty participants (280 with MS and 280 controls matched for age, sex, and years of education) were included. Inter-group differences were calculated using the Mann-Whitney U test and effect sizes with Cohen's d. Several criteria for definition of cognitive impairment were evaluated, according to different cut-off points, and the number of tests and cognitive domains impaired. Receiver operating characteristic curves with 95% confidence intervals were estimated and they were compared using the DeLong method.

      Results

      Patients with MS showed poorer performance in almost all cognitive tests, with large effect sizes for the Symbol Digit Modalities Test and Judgement of Line Orientation, and moderate effects for Digit Span Backward, the Corsi test, Trail Making Test, Free and Cued Selective Reminding Test, Rey-Osterrieth Complex Figure (recall), verbal fluency (P words), and the Stroop Color-Word Interference Test. The area under the curve was superior for classification by cognitive domain than for the mean scaled score of the tests or the number of tests showing impairment according to different cut-off points for the adjusted scaled scores.

      Conclusions

      Our study validates the Neuronorma battery for cognitive assessment of patients with MS. The battery is currently available in several countries with reliable normative data, and may be useful in both the clinical and the research settings when comprehensive neuropsychological examination is warranted.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Multiple Sclerosis and Related Disorders
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Aranciva F.
        • Casals-Coll M.
        • Sánchez-Benavides G.
        • Quintana M.
        • Manero R.M.
        • Rognoni T.
        • Calvo L.
        • Palomo R.
        • Tamayo F.
        • Peña-Casanova J.
        Spanish normative studies in a young adult population (NEURONORMA young adults project): norms for the Boston naming test and the token test.
        Neurologia. 2012; 27: 394-399
        • Beck A.T.
        • Ward C.H.
        • Mendelson M.
        • Mock J.
        • Erbaugh J.
        An inventory for measuring depression.
        Arch. Gen. Psychiatry. 1961; 4: 561-571
        • Beier M.
        • Gromisch E.S.
        • Hughes A.J.
        • Alschuler K.N.
        • Madathil R.
        • Chiaravalloti N.
        • Foley F.W.
        Proposed cut scores for tests of the brief international cognitive assessment of multiple sclerosis (BICAMS).
        J. Neurol. Sci. 2017; 381: 110-116
        • Benedict R.H.
        • Wahlig Bakshi R
        • Fishman I.
        • Munschauer F.
        • Zidadinov R.
        • Weinstock-Guttman B.
        Predicting quality of life in multiple sclerosis: accounting for physical disability, fatigue, cognition, mood disorder, personality, and behavior change.
        J. Neurol. Sci. 2005; 231: 29-34
        • Benedict R.H.B.
        • Fischer J.S.
        • Archibald C.J.
        • Arnett P.A.
        • Beatty W.W.
        • Bobholz J.
        • Chelune G.J.
        • Fisk J.D.
        • Langdon D.W.
        • Caruso L.
        • Foley F.
        • LaRocca N.G.
        • Vowles L.
        • Weinstein A.
        • DeLuca J.
        • Rao S.M.
        • Munschauer F.
        Minimal neuropsychological assessment of MS patients: a consensus approach.
        Clin. Neuropsychol. 2002; 16: 381-397
        • Benton A.L.
        • Hannay H.J.
        • Varney N.
        Visual perception of line direction in patients with unilateral brain disease.
        Neurology. 1975; 25: 907-910
        • Blesa R.
        • Pujol M.
        • Aguilar M.
        • Santacruz P.
        • Bertran-Serra I.
        • Hernández G.
        • Sol J.M.
        • Peña-Casanova J.
        • NORMACODEM Group
        Clinical validity of the “Mini-Mental state” for Spanish speaking communities.
        Neuropsychologia. 2001; 39: 1150-1157
        • Bora E.
        • Özakbas S.
        • Velakoulis D.
        • Walterfang M.
        Social cognition in multiple sclerosis: a meta-analysis.
        Neuropsychol. Rev. 2006; 26: 160-172
        • Buschke H.
        Selective reminding for analysis of memory and learning.
        J. Verb. Learn Verb. Behav. 1973; 12: 543-550
        • Buschke H.
        Cued recall in amnesia.
        J. Clin. Neuropsychol. 1984; 6: 433-440
        • Calvo L.
        • Casals-Coll M.
        • Sanchez-Benavides G.
        • Quintana M.
        • Manero R.M.
        • Rognoni T.
        • Palomo R.
        • Aranciva F.
        • Tamayo F.
        • Peña-Casanova J.
        Spanish normative studies in young adults (NEURONORMA young adults project): norms for the visual object and space perception battery and judgement of line orientation tests.
        Neurologia. 2013; 28: 153-159
        • Casals-Coll M.
        • Sánchez-Benavides G.
        • Quintana M.
        • Manero R.M.
        • Rognoni T.
        • Calvo L.
        • Palomo R.
        • Aranciva F.
        • Tamayo F.
        • Peña-Casanova J.
        Spanish normative studies in young adults (NEURONORMA young adults project): norms for verbal fluency tests.
        Neurologia. 2013; 28: 33-40
        • Chiaravalloti N.D.
        • DeLuca J.
        Cognitive impairment in multiple sclerosis.
        Lancet Neurol. 2008; 7: 1139-1151
        • Cortés-Martínez A.
        • Matias-Guiu J.A.
        • Pytel V.
        • Montero P.
        • Moreno-Ramos T.
        • Matias-Guiu J.
        What is the meaning of PASAT rejection in multiple sclerosis?.
        Acta Neurol. Scand. 2019; 139: 559-562
        • Culbertson W.C.
        • Zillmer E.A.
        Tower of London.
        Drexel University. TOLDX, North Tonawanda, NY2001 (Multi-Health Systems)
        • DeLong E.T.
        • DeLong D.M.
        • Clarke-Pearson D.L.
        Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach.
        Biometrics. 1988; 44: 837-844
        • Fischer M.
        • Kunkel A.
        • Bublak P.
        • Faiss J.H.
        • Hoffmann F.
        • Sailer M.
        • Schwab M.
        • Zettl U.K.
        • Köhler W.
        How reliable is the classification of cognitive impairment across different criteria in early and late stages of multiple sclerosis?.
        J. Neurol. Sci. 2014; 343: 91-99
        • Folstein M.F.
        • Folstein S.E.
        • McHugh P.R.
        “Mini mental state”: a practical method for grading the cognitive state of patients for the clinician.
        J. Psychiatr. Res. 1975; 12: 189-198
        • Golden C.J.
        Stroop Color and Word Test.
        Stoeling, Chicago, IL1978
        • Ivnik R.J.
        Normative psychology: a professional obligation?.
        Clin. Neuropsychol. 2005; 19: 159-161
        • Kaplan E.
        • Fein D.
        • Morris R.
        • Delis D.
        WAIS-R As a Neuropsychological Instrument.
        The Psychological Corporation, San Antonio, TX1991
        • Kaplan E.
        • Goodglass H.
        • Weintraub S
        The Boston Naming Test.
        2nd ed. Lippincott Williams & Wilkins, Philadelphia, PA2001
      1. Koziol L.F. & Budding D.E. (2009). Subcortical Structures and cognition: Implications For Neuropsychological Assessment. New York: Springer.

        • Krupp L.B.
        • LaRocca N.G.
        • Muir-Nash J.
        • Steinberg A.D.
        The fatigue severity scale. Application to patients with multiple sclerosis and systemic lupus erythematosus.
        Arch. Neurol. 1989; 46: 1121-1123
        • Langdon D.W.
        • Amato M.P.
        • Boringa J.
        • Brochet B.
        • Foley F.
        • Fredrikson S.
        • Hämäläinen P.
        • Hartung H.K.
        • Krupp L.
        • Penner I.K.
        • Reder A.T.
        • Benedict R.H.
        Recommendations for a brief international cognitive assessment for multiple sclerosis (BICAMS).
        Mult. Scler. 2012; 18: 891-898
        • Lezak M.D.
        • Howieson D.B.
        • Bigler E.D.
        • Tranel D.
        Neuropsychological Assessment.
        5th ed. Oxford University Press, New York2012
      2. Martin de la Huerga N., 2019. Extensión del estudio multicéntrico de normalización y validación de instrumentos neurocognitivos y funcionales en sujetos jóvenes (Neuronorma jóvenes-extensión 2) y perfiles cognitivos de pacientes con esclerosis múltiple mediante la batería neuropsicológica Neuronorma. PhD Thesis. Universitat Autónoma de Barcelona. Barcelona, Spain.

        • Matias-Guiu J.A.
        • Cortés-Martínez A.
        • Valles-Salgado M.
        • Oreja-Guevara C.
        • Pytel V.
        • Montero P.
        • Moreno-Ramos T.
        • Matias-Guiu J.
        Functional components of cognitive impairment in multiple sclerosis: a cross-sectional investigation.
        Front. Neurol. 2017; 8: 643
        • Matias-Guiu J.A.
        • Cabrera-Martín M.N.
        • Valles-Salgado M.
        • Pérez-Pérez A.
        • Rognoni T.
        • Moreno-Ramos T.
        • Carreras J.L.
        • Matías-Guiu J.
        Neural basis of cognitive assessment in Alzheimer's disease, amnestic mild cognitive impairment, and subjective memory complaints.
        Am. J. Geriatr Psychiatry. 2017; 25: 730-740
        • Matias-Guiu J.A.
        • Cortés-Martínez A.
        • Montero P.
        • Pytel V.
        • Moreno-Ramos T.
        • Jorquera M.
        • Yus M.
        • Arrazola J.
        • Matías-Guiu J.
        Identification of cortical and subcortical correlates of cognitive performance in multiple sclerosis using voxel-based morphometry.
        Front. Neurol. 2018; 9: 920
        • Matias-Guiu J.A.
        • Cortés-Martínez A.
        • Montero P.
        • Pytel V.
        • Moreno-Ramos T.
        • Jorquera M.
        • Yus M.
        • Arrazola J.
        • Matías-Guiu J.
        Structural MRI correlates of PASAT performance in multiple sclerosis.
        BMC Neurol. 2018; https://doi.org/10.1186/s12883-018-1223-0
        • Matias-Guiu J.A.
        • Cabrera-Martín M.N.
        • Valles-Salgado M.
        • Rognoni T.
        • Galán L.
        • Moreno-Ramos T.
        • Carreras J.L.
        • Matías-Guiu J.
        Inhibition impairment in frontotemporal dementia, amyotrophic lateral sclerosis, and Alzheimer's disease: clinical assessment and metabolic correlates.
        Brain Imaging Behav. 2019; 13: 651-659
        • Oltra-Cucurella J.
        • Sánchez-SanSegundo M.
        • Rubio-Aparicio M.
        • Arango-Lasprilla J.C.
        • Ferrer-Cascales R.
        The association between the number of neuropsychological measures and the base rate of low scores.
        Assessment. 2019; https://doi.org/10.1177/1073191119864646
        • Osterrieth P.A.
        Le test de copie d'une figure complexe: contribution à l’étude de la perception et la mémoire.
        Arch. Psychol. (Geneve). 1944; 30: 286-356
        • Palomo R.
        • Casals-Coll M.
        • Sánchez-Benavides G.
        • Quintana M.
        • Manero R.M.
        • Rognoni T.
        • Calvo L.
        • Aranciva F.
        • Tamayo F.
        • Peña-Casanova J.
        Spanish normative studies in young adults (NEURONORMA young adults project): norms for the rey-osterrieth complex figure (copy and memory) and free and cued selective reminding test.
        Neurologia. 2013; 28: 226-235
        • Partington J.
        • Leiter R.
        Partington's pathways test.
        Psychol. Serv. Center Bull. 1949; 1: 9-20
      3. Peña-Casanova J. (2005). Programa integrado de exploración neuropsicológica. Test Barcelona-Revisado [Integrated program of neuropsychological assessment- Revised Barcelona Test]. Barcelona: Masson.

        • Peña-Casanova J.
        • Blesa R.
        • Aguilar M.
        • Gramunt-Fombuena N.
        • Gómez-Ansón B.
        • Oliva R.
        • Molinuevo J.L.
        • Robles A.
        • Barquero M.S.
        • Antúnez C.
        • Martínez-Parra C.
        • Frank-García A.
        • Fernández M.
        • Alfonso V.
        • Sol J.M.
        • NEURONORMA Study Team
        Spanish multicenter normative studies (NEURONORMA project): methods and sample characteristics.
        Arch. Clin. Neuropsychol. 2009; 24: 307-319
        • Peña-Casanova J.
        • Quiñones-Úbeda S.
        • Quintana-Aparicio M.
        • Aguilar M.
        • Badenes D.
        • Molinuevo J.L.
        • Torner L.
        • Robles A.
        • Barquero M.S.
        • Villanueva C.
        • Antúnez C.
        • Martínez-Parra C.
        • Frank-García A.
        • Sanz A.
        • Fernández M.
        • Alfonso V.
        • Sol J.M.
        • Blesa R.
        • Neuronorma Study Team
        Spanish multicenter normative studies (NEURONORMA project): norms for verbal span, visuospatial span, letter and number sequencing, trail making test, and symbol digit modalities test.
        Arch. Clin. Neuropsychol. 2009; 24: 321-341
        • Peña-Casanova J.
        • Quiñones-Úbeda S.
        • Gramunt-Fombuena M.
        • Aguilar M.
        • Casas L.
        • Molinuevo J.L.
        • Robles A.
        • Rodríguez D.
        • Barquero M.S.
        • Antúnez C.
        • Martínez-Parra C.
        • Frank-García A.
        • Fernández M.
        • Molano A.
        • Alfonso V.
        • Sol J.M.
        • Blesa R.
        • NEURONORMA Study Team
        Spanish multicenter normative studies (NEURONORMA project): norms for Boston naming test and token test.
        Arch. Clin. Neuropsychol. 2009; 24: 343-354
        • Peña-Casanova J.
        • Quintana-Aparicio M.
        • Quiñones-Úbeda S.
        • Aguilar M.
        • Molinuevo J.L.
        • Serradell M.
        • Robles A.
        • Barquero M.S.
        • Villanueva C.
        • Antúnez C.
        • Martínez-Parra C.
        • Frank-García A.
        • Aguilar M.D.
        • Fernández M.
        • Alfonso V.
        • Sol J.M.
        • Blesa R.
        • NEURONORMA Study Team
        Spanish multicenter normative studies (NEURONORMA project): norms for the visual object and space perception battery-abbreviated, and judgement of line orientation.
        Arch. Clin. Neuropsychol. 2009; 24: 355-370
        • Peña-Casanova J.
        • Gramunt-Fombuena N.
        • Quiñones-Úbeda S.
        • Sanchez-Benavides G.
        • Aguilar M.
        • Badenes D.
        • Molinuevo J.L.
        • Robles A.
        • Barquero M.S.
        • Payno M.
        • Antúnez C.
        • Martínez-Parra C.
        • Frank-García A.
        • Fernández M.
        • Alfonso V.
        • Sol J.M.
        • Blesa R.
        • NEURONORMA Study Team
        Spanish multicenter normative studies (NEURONORMA project): norms for the Rey–Osterrieth complex figure (copy and memory), and free and cued selective reminding test.
        Arch. Clin. Neuropsychol. 2009; 24: 371-393
        • Peña-Casanova J.
        • Quiñones-Úbeda S.
        • Gramunt-Fombuena N.
        • Quintana-Aparicio M.
        • Aguilar M.
        • Badenes D.
        • Cerulla N.
        • Molinuevo J.L.
        • Ruiz E.
        • Robles A.
        • Barquero M.S.
        • Antúnez C.
        • Martínez-Parra C.
        • Frank-García A.
        • Fernández M.
        • Alfonso V.
        • Sol J.M.
        • Blesa R.
        • NEURONORMA Study Team
        Spanish multicenter normative studies (NEURONORMA project): norms for verbal fluency tests.
        Arch. Clin. Neuropsychol. 2009; 24: 395-411
        • Peña-Casanova J.
        • Quiñones-Úbeda S.
        • Gramunt-Fombuena N.
        • Quintana M.
        • Aguilar M.
        • Molinuevo J.L.
        • Serradell M.
        • Robes A.
        • Barquero M.S.
        • Payno M.
        • Antúnez C.
        • Martínez-Parra C.
        • Frank-García A.
        • Fernández M.
        • Alfonso V.
        • Sol J.M.
        • Blesa R.
        • NEURONORMA Study team
        Spanish multicenter normative studies (NEURONORMA project): norms for the Stroop color-word interference test and the tower of London-Drexel.
        Arch. Clin. Neuropsychol. 2009; 24: 413-429
        • Peña-Casanova J.
        • Casals-Coll M.
        • Quintana M.
        • Sánchez-Benavides G.
        • Rognoni T.
        • Calvo L.
        • Palomo R.
        • Aranciva F.
        • Tamayo F.
        • Manero R.M.
        Spanish normative studies in a young adult population (NEURONORMA young adults project): methods and characteristics of the sample.
        Neurologia. 2012; 27: 253-260
        • Quiñones-Úbeda S.
        • Peña-Casanova J.
        • Böhm P.
        • Gramunt-Fombuena N.
        • Comas L
        Estudio normativo piloto de la segunda edición del Boston naming test en una muestra española de adultos jóvenes (20 a 49 años).
        Neurologia. 2004; 19 (Preliminary normative data for the second edition of the Boston Naming Test for young Spanish adults): 248-253
        • Ramier A.M.
        • Hécaen H.
        Rôle respectif des atteintes frontales et de la latéralisation lésionnelle dans les déficits de la fluence verbale.
        Rev. Neurol. (Paris). 1970; 132: 17-22
        • Rao S.
        • Cognitive Function Study Group
        A Manual for the Brief Repeatable Battery of Neuropsychological Test in Multiple Sclerosis.
        National Multiple Sclerosis Society, New YorkNY1990
        • Reitan R.M.
        • Wolfson D.
        The Halstead-Reitan neuropsychological test battery.
        Theory and Clinical Interpretation. 2nd ed. Neuropsychology Press, Tucson, AZ1993
        • Rey A.
        L'examen psychologique dans les cas d'encéphalopathie traumatique.
        Arch Psychol (Geneve). 1941; 28: 286-340
        • Rognoni T.
        • Casals-Coll M.
        • Sánchez-Benavides G.
        • Quintana M.
        • Manero R.M.
        • Calvo L.
        • Palomo R.
        • Aranciva F.
        • Tamayo F.
        • Peña-Casanova J.
        Spanish normative studies in young adults (NEURONORMA young adults project): norms for Stroop color-word interference and tower of London-Drexel university tests.
        Neurologia. 2013; 28: 73-80
        • Rosen W.G.
        • Terry R.D.
        • Fuld P.
        • Katzman P.
        • Peck A.
        Pathological verification of ischemia score in differentiation of dementias.
        Ann. Neurol. 1980; 7: 486-488
        • Sánchez-Benavides G.
        • Peña-Casanova J.
        • Casals-Coll M.
        • Gramunt N.
        • Manero R.M.
        • Puig-Pijoan A.
        • Aguilar M.
        • Robles A.
        • Antúnez C.
        • Frank-García A.
        • Fernández-Martínez M.
        • Blesa R.
        • NEURONORMA Study Team
        One-Year reference norms of cognitive change in Spanish old adults: data from the Neuronorma sample.
        Arch. Clin. Neuropsychol. 2016; 31: 378-388
        • Smith A.
        Symbol Digit Modalities Test Manual.
        Western Psychological Services, Los Angeles1973
        • Stroop J.R.
        Studies of interference in serial verbal reaction.
        J. Exp. Psychol. 1935; 18: 643-662
        • Sumowski J.F.
        • Benedict R.
        • Enzinger C.
        • Filippi M.
        • Geurts J.J.
        • Hamalainen P.
        • Hulst H.
        • Inglese M.
        • Leavitt V.M.
        • Rocca M.A.
        • Rosti-Otajarvi E.M.
        • Rao S.
        Cognition in multiple sclerosis: state of the field and priorities for the future.
        Neurology. 2018; 90: 278-288
        • Tamayo F.
        • Casals-Coll M.
        • Sánchez-Benavides G.
        • Quintana M.
        • Manero R.M.
        • Rognoni T.
        • Calvo L.
        • Palomo R.
        • Aranciva F.
        • Peña-Casanova J.
        Spanish normative studies in a young adult population (NEURONORMA young adults project): norms for the verbal span, visuospatial span, letter-number sequencing, Trail Making Test and Symbol Digit Modalities Test.
        Neurologia. 2012; 27: 319-329
        • Teunisse S.
        • Derix M.
        • Crever H.
        Assessing the severity of dementia. Patient and caregiver.
        Arch. Neurol. 1991; 48: 274-277