Review article| Volume 42, 102072, July 2020

Validation of the Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS) in a Colombian Population


      • The BICAMS Colombia is useful to monitor patient cognitive evolution.
      • Cognitive impairment was found in 50% of the Colombian MS sample.
      • Evidences of criterion validity were found for SDMT and BVMT-R, but not for PAMCL.
      • Test-retest reliability was adequate for all three tests included in the BICAMS.


      Background: Cognitive impairment has been recognized as an important factor in multiple sclerosis (MS) in the past few years. One brief, reliable and valid tool to assess cognition in MS is the BICAMS, which encompasses the Symbol Digit Modalities Test (SDMT), the California Verbal Learning Test (CVLT II), and the Brief Visuospatial Memory Test - Revised (BVMT-R). Continuing with the international initiative to validate the BICAMS in different countries, here we present the results obtained from the efforts in validating such test in the Colombian population. Method: 100 healthy controls and 50 MS patients participated in the study, group matched for age, education and gender. Subjects completed all three tests of the BICAMS. Instead of the CVLT-II, the Colombian validated form PAMCL (Prueba de Aprendizaje y Memoria con Codificación Libre) was used. Test-retest measures were obtained for 16 patients in order to test for reliability. Results: Evidence of criterion validity was obtained, MS group performing significantly worse than HC group in all three tests (SDMT: p= .001, d= 0.59; PAMCL: p= .03, d= 0.38; BVMT-R: p<.001, d= 0.58). Test-retest was also obtained, finding significant correlations for all three tests (SDMT: r=0.932, p<.00; BVMT-R: r=0.863, p<.001; PAMCL: r=0.889, p<.001). Standardization of raw scores to uncontrolled scaled scores was done and these scores were then adjusted for age and years of schooling using a multiple linear regression. Conclusions: The BICAMS proved to be a valid and sensitive tool to screen for cognitive impairment in MS patients.


      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Multiple Sclerosis and Related Disorders
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • Ardila A.
        Cultural values underlying psychometric cognitive testing.
        Neuropsychology review. 2005; 15: 185
        • Arango-Lasprilla J.C.
        • Olabarrieta L.
        • Rivera D.
        • Olivera S.
        • De los Reyes C.
        • Calderón J.
        • Quijano M.
        • Utria O.
        Situación actual de la neuropsicológia en Colombia.
        in: Arango-Lasprilla En J.C. Rivera D. Neuropsicología en Colombia, datos normativos, estado actual y retos a futuro. Editorial universidad Autonoma de Manizales, 2015
        • Ayala O.
        Correlatos neurales de la memoria episódica, el pensamiento episódico futuro y el pensamiento contrafáctico episódico en controles y pacientes con esclerosis múltiple remisión recaída.
        (Maestria Thesis) Universidad Nacional de Colombia, 2020
        • Benedict R.H.B.
        Brief Visuospatial Memory Test – Revised: Professional Manual.
        FL: Psychological Assessment Resources Inc, Odessa1997
        • Benedict R.H.B.
        • Zgaljardic D.J.
        Effects During Repeated Administrations of Memory Tests With and Without Alternate Forms Practice Effects During Repeated Administrations of Memory Tests With and Without Alternate Forms.
        Journal of Clinical and Experimental Neuropsychology. 1998; 20: 339-352
        • Benedict R.H.B.
        Effects of using same- versus alternate-form memory tests during short-interval repeated assessments in multiple sclerosis.
        Journal of the International Neuropsychological Society. 2005; 11: 727-736
        • Benedict R.H.B.
        Standards for sample composition and impairment classification in neuropsychological studies of multiple sclerosis.
        Multiple sclerosis (Houndmills, Basingstoke, England). 2009; 15: 777-778
        • Benedict R.H.B.
        • Amato M.P.
        • Boringa J.
        • Brochet B.
        • Foley F.
        • Fredrikson S.
        • Langdon D.
        Brief International Cognitive Assessment for MS (BICAMS): International standards for validation.
        BMC Neurology, 16. 2012; (...): 12-55
        • Cáceres F.
        • Vanotti S.
        • Benedict R.H.B.
        • Workgroup RELACEM
        Cognitive and neuropsychiatric disorders among multiple sclerosis patients from Latin America: Results of the RELACCEM study.
        Multiple Sclerosis and Related Disorders, 3. 2014; : 335-340
        • Calamia M.
        • Markon K.
        • Tranel D.
        Scoring higher the second time around: Meta-analyses of practice effects in neuropsychological assessment.
        Clinical Neuropsychologist. 2012; 26: 543-570
        • Campos-Magdaleno M.
        • Facal D.
        • Lojo-Seoane C.
        • Pereiro A.X.
        • Juncos-Rabadán O.
        Longitudinal assessment of verbal learning and memory in amnestic mild cognitive impairment: Practice effects and meaningful changes.
        Frontiers in Psychology. 2017; 8: 1-10
        • Chelune G.J.
        • Naugle R.I.
        • Lüders H.
        • Sedlak J.
        • Awad I.A.
        Individual Change After Epilepsy Surgery: Practice Effects and Base-Rate Information.
        Neuropsychology. 1993; 7: 41-52
        • Chiaravalloti N.D.
        • DeLuca J.
        Cognitive impairment in multiple sclerosis.
        The Lancet Neurology, 7. 2008; : 1139-1151
        • Corfield F.
        • Langdon D.
        A Systematic Review and Meta-Analysis of the Brief Cognitive Assessment for Multiple Sclerosis (BICAMS).
        Neurology and Therapy. 2018; 7: 287-306
        • Costers L.
        • Gielen J.
        • Eelen P.L.
        • Schependom J.V.
        • Laton J.
        • Remoortel A.V.
        • Vanzeir E.
        • Wijmeersch B.V.
        • Seeldrayers P.
        • Haelewyck M.
        • Haeseleer M.D.
        • Marie-beatrice D.
        • Langdon D.
        • Nagels G.
        Does including the full CVLT-II and BVMT-R improve BICAMS? Evidence from a Belgian (Dutch) validation study.
        Multiple Sclerosis and Related Disorders. 2017; 18: 33-40
        • Delis D.C.
        • Kramer J.H.
        • Kaplan E.
        • Ober B.A.
        California Verbal Learning Test Manual.
        2nd ed. Psychological Corporation, San Antonio, TX2000
        • Duarte L.K.
        Lenguaje, memoria y habilidades visuoconstructivas en el envejecimiento normal: Datos normativos con la Batería Neuronorma Colombia.
        Bdigital.Unal.Edu.Co, 2017: 1-156 (Retrieved from)
        • Duff K.
        • Westervelt H.J.
        • McCaffrey R.J.
        • Haase R.F.
        Practice effects, test-retest stability, and dual baseline assessments with the California Verbal Learning Test in an HIV sample.
        Archives of Clinical Neuropsychology. 2001; 16: 461-476
      1. Espitia, A. (2017). Funciones ejecutivas en el envejecimiento normal : Datos normativos con la batería Neuronorma.Colombia, 1–186. Retrieved from

        • Giedraitienė N.
        • Kizlaitienė R.
        • Kaubrys G.
        The BICAMS battery for assessment of lithuanian-speaking multiple sclerosis patients: Relationship with age, education, disease disability, and duration.
        Medical science monitor: international medical journal of experimental and clinical research. 2015; 21: 3853
        • Goretti B.
        • Niccolai C.
        • Hakiki B.
        • Sturchio A.
        • Falautano M.
        • Minacapelli E.
        • Fenu G.
        The brief international cognitive assessment for multiple sclerosis (BICAMS): normative values with gender, age and education corrections in the Italian population.
        BMC neurology. 2014; 14 (...): 171
        • Gross R.
        • Lublin F.
        Multiple Sclerosis: An Overview.
        in: Miller En A. Handbook of Relapsing-Remitting Multiple Sclerosis. Springer International Publishing, 2017: 1-16
        • Grzegorski T.
        • Losy J.
        Cognitive impairment in multiple sclerosis–a review of current knowledge and recent research.
        Reviews in the Neurosciences. 2017; 28: 845-860
        • Jiménez C.
        • Zarco L.
        • Castañeda C.
        • Otálora M.
        • Martínez A.
        • Rosselli D.
        • Iverson G.L.
        Interpreting change on the WAIS-III/WMS-III in clinical samples.
        Archives of Clinical Neuropsychology. 2015; 16 (2001, 10.1016/S0887-6177(00)00060-3, Estado actual de la esclerosis múltiple en Colombia. Acta Neurologica Colombiana, 31(4), 385–390. 10.22379/2422402256): 183-191
        • Kalb R.
        • Beier M.
        • Benedict R.H.
        • Charvet L.
        • Costello K.
        • Feinstein A.
        • Kostich L.
        Recommendations for cognitive screening and management in multiple sclerosis care.
        Multiple Sclerosis Journal. 2018; 24 (...): 1665-1680
        • McNicholas N.
        • O'Connell K.
        • Yap S.M.
        • Killeen R.P.
        • Hutchinson M.
        • McGuigan C.
        Cognitive dysfunction in early multiple sclerosis: a review.
        QJM: An International Journal of Medicine. 2018; 111: 359-364
        • Negrotto L.
        • Correale J.
        Evolution of multiple sclerosis prevalence and phenotype in Latin America.
        Multiple Sclerosis and Related Disorders. 2018; 22: 97-102
        • O'Connell K.
        • Langdon D.
        • Tubridy N.
        • Hutchinson M.
        • McGuigan C.
        A preliminary validation of the brief international cognitive assessment for multiple sclerosis (BICAMS) tool in an Irish population with multiple sclerosis (MS).
        Multiple sclerosis and related disorders. 2015; 4: 521-525
        • Orchard A.
        Brief international cognitive assessment for multiple sclerosis (BICAMS).
        University of London, 2013
        • Oreja-Guevara C.
        • Blanco T.A.
        • Ruiz L.B.
        • Pérez M.Á.H.
        • Meca-Lallana V.
        • Ramió-Torrentà L.
        Cognitive Dysfunctions and Assessments in Multiple Sclerosis.
        Frontiers in Neurology. 2019; 10
        • Pardini M.
        • Uccelli A.
        • Grafman J.
        • Yaldizli Ö.
        • Mancardi G.
        • Roccatagliata L.
        Isolated cognitive relapses in multiple sclerosis.
        Journal of Neurology, Neurosurgery and Psychiatry. 2014; 85: 1035-1037
        • Penner I.K.
        • Kandziora P.
        • Poettgen J.
        • Heesen C.
        • Lang M.
        • Schreiber H.
        German Validation of the Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS)(P5. 196).
        Neurology. 2015; 84: P5-196
      2. Polman, C. H., Reingold, S. C., Banwell, B., Clanet, M., Cohen, J. A., Filippi, M., Fujihara, K., Havrdova, E., Hutchinson, M., Kappos, L., Lublin, F. D., Montalban, X., & Connor, P. O. (2011). Diagnostic Criteria for Multiple Sclerosis: 2010 Revisions to the McDonald Criteria. 10.1002/ana.22366.

        • Polychroniadou E.
        • Bakirtzis C.
        • Langdon D.
        • Lagoudaki R.
        • Kesidou E.
        • Theotokis P.
        • Papadopoulos G.
        Validation of the Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS) in Greek population with multiple sclerosis.
        Multiple sclerosis and related disorders. 2016; 9 (...): 68-72
        • Rao S.M.
        A manual for the Brief, Repeatable Battery of Neuropsychological Tests in multiple sclerosis.
        Milwaukee: National Multiple Sclerosis Society, 1991
        • Rosselli M.
        • Ardila A.
        The impact of culture and education on non-verbal neuropsychological measurements: A critical review.
        Brain and cognition. 2003; 52: 326-333
        • Sandi D.
        • Rudisch T.
        • Füvesi J.
        • Fricska-Nagy Z.
        • Huszka H.
        • Biernacki T.
        • Bencsik K.
        The Hungarian validation of the Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS) battery and the correlation of cognitive impairment with fatigue and quality of life.
        Multiple sclerosis and related disorders. 2015; 4 (...): 499-504
        • Schoenberg M.R.
        • Rum R.S.
        Towards reporting standards for neuropsychological study results: A proposal to minimize communication errors with standardized qualitative descriptors for normalized test scores.
        Clinical Neurology and Neurosurgery. 2017; 162: 72-79
        • Spedo C.T.
        • Frndak S.E.
        • Marques V.D.
        • Foss M.P.
        • Pereira D.A.
        • Carvalho L.D.F.
        • Gaino S.B.
        Cross-cultural adaptation, reliability, and validity of the BICAMS in Brazil.
        The Clinical Neuropsychologist. 2015; 29 (...): 836-846
        • Smith A.
        Symbol digit modalities test: Manual.
        Western Psychological Services, Los Angeles, CA1982
        • Strauss E.
        • Sherman E.M.S.
        • Spreen O.
        A Compendium of Neuropsychological Tests: Administration, Norms, and Commentary.
        3d ed. Oxford university press, 2006
        • Torres V.L.
        • Vila-Castelar C.
        • Bocanegra Y.
        • Baena A.
        • Guzmán-Vélez E.
        • Aguirre-Acevedo D.C.
        • Lopera F.
        Normative data stratified by age and education for a Spanish neuropsychological test battery: Results from the Colombian Alzheimer's prevention initiative registry.
        Applied Neuropsychology: Adult. 2019; 0: 1-15
        • Urrego M.
        Seguimiento longitudinal del perfil neuropsicológico de una muestra de controles colombianos mayores de 50 años. Urrego 2018.
        Universidad Nacional de Colombia, 2018 (Retrieved from)
        • Van G.D.
        • Van D.H.K.
        • Middelkoop H.A.
        The relation between cognitive functioning and work outcomes in patients with Multiple Sclerosis: a systematic literature review. Current Research in Neurology and Neurosurgery, 2.Vanotti, S., Cores, E. V., Eizaguirre, B., Angeles, M., Rey, R., Villa, A., & Cáceres, F. (2015). Normatization of the symbol digit modalities test-oral version in a Latin American Country.
        Applied Neuropsychology:Adult. 2019; 22: 46-53
        • Vanotti S.
        • Smerbeck A.
        • Benedict R.
        • Caceres F.
        A new assessment tool for patients with multiple sclerosis from Spanish-speaking countries: validation of the Brief International Cognitive Assessment for MS (BICAMS) in Argentina.
        The Clinical Neuropsychologist. 2016; 30: 1023-1031
        • Vanotti S.
        • Caceres F.J.
        Cognitive and neuropsychiatric disorders among MS patients from Latin America.
        Multiple Sclerosis Journal – Experimental, Translational and Clinical. 2017; 3
        • Walker L.A.
        • Osman L.
        • Berard J.A.
        • Rees L.M.
        • Freedman M.S.
        • MacLean H.
        • Cousineau D.
        Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS): Canadian contribution to the international validation project.
        Journal of the neurological sciences. 2016; 362: 147-152
        • Winkelmann A.
        • Engel C.
        • Apel A.
        • Zettl U.K.
        Cognitive impairment in multiple sclerosis.
        Journal of neurology. 2007; 254: II35-II42
        • Woods S.P.
        • Delis D.C.
        • Scott J.C.
        • Kramer J.H.
        • Holdnack J.A.
        The California Verbal Learning Test—Second edition: Test-retest reliability, practice effects, and reliable change indices for the standard and alternate forms.
        Archives of Clinical Neuropsychology. 2006; 21: 413-420