Rater agreement on the ISCSCI motor and sensory scores obtained before and after formal training in testing technique
- PMID: 17874700
- PMCID: PMC2031990
Rater agreement on the ISCSCI motor and sensory scores obtained before and after formal training in testing technique
Abstract
Background/objective: The purpose of this study is to report the results of rater agreement for the International Standards for Neurological Classification of Spinal Cord Injury (ISCSCI) motor and sensory scores before and after training in the testing technique.
Methods: Six raters performed sequential motor and sensory examinations on 5 adolescents with SCI according to the ISCSCI manual. After completion of the first examinations, all raters were provided with a half-day formal training session on testing techniques, after which the raters repeated the examinations. Intraclass correlation coefficients (ICCs) and 95% confidence intervals (CIs) were calculated to provide parameters for ICC interpretation: > 0.90 = high agreement; 0.75 to 0.90 = moderate agreement; < 0.75 = poor agreement.
Results: After training, there was improvement in rater agreement of summed motor scores (MS) from ICC -0.809 to 0.862 and discrimination scores from ICC = 0.786 to 0.892. There was moderate rater agreement for light touch scores (LTS) before and after training. After training, there was improvement in 95% CIs except for ICCs for LTS, but for all ICCs, the lower 95% CI value remained less than 0.75.
Conclusions: Training improved rater agreement on MS and discrimination, but 95% CIs remained unacceptably wide. The positive effect of training in motor and sensory testing techniques is supported by the study data. Unlike previous studies that have suggested the ISCSCI has acceptable reliability for clinical trials, the results of this study do not fully support the use of the ISCSCI for clinical trials without better standardization to establish a lower 95% CI value of at least 0.75.
Similar articles
-
The International Standards for Neurological Classification of Spinal Cord Injury: reliability of data when applied to children and youths.Spinal Cord. 2007 Jun;45(6):452-9. doi: 10.1038/sj.sc.3101987. Epub 2006 Oct 3. Spinal Cord. 2007. PMID: 17016490
-
The international standards for neurological classification of spinal cord injury: intra-rater agreement of total motor and sensory scores in the pediatric population.J Spinal Cord Med. 2009;32(2):157-61. doi: 10.1080/10790268.2009.11760767. J Spinal Cord Med. 2009. PMID: 19569463 Free PMC article.
-
Reliability and repeatability of the motor and sensory examination of the international standards for neurological classification of spinal cord injury.J Spinal Cord Med. 2008;31(2):166-70. doi: 10.1080/10790268.2008.11760707. J Spinal Cord Med. 2008. PMID: 18581663 Free PMC article.
-
Quantitative testing in spinal cord injury: overview of reliability and predictive validity.J Neurosurg Spine. 2012 Sep;17(1 Suppl):141-50. doi: 10.3171/2012.5.AOSPINE1296. J Neurosurg Spine. 2012. PMID: 22985380 Review.
-
Inter- and intra-rater reliability of the Modified Ashworth Scale: a systematic review and meta-analysis.Eur J Phys Rehabil Med. 2018 Aug;54(4):576-590. doi: 10.23736/S1973-9087.17.04796-7. Epub 2017 Sep 13. Eur J Phys Rehabil Med. 2018. PMID: 28901119 Review.
Cited by
-
The International Standards for Neurological Classification of Spinal Cord Injury: Classification Accuracy and Challenges.Top Spinal Cord Inj Rehabil. 2023 Winter;29(1):1-15. doi: 10.46292/sci22-00036. Epub 2023 Feb 15. Top Spinal Cord Inj Rehabil. 2023. PMID: 36819931 Free PMC article.
-
The Correlation between Cervical Fusion Length and Functional Outcomes in Patients with Traumatic Spinal Cord Damage-A Registry-Based Cohort Study.J Clin Med. 2022 Oct 4;11(19):5867. doi: 10.3390/jcm11195867. J Clin Med. 2022. PMID: 36233733 Free PMC article.
-
Implementation of multilingual support of the European Multicenter Study about Spinal Cord Injury (EMSCI) ISNCSCI calculator.Spinal Cord. 2022 Jan;60(1):37-44. doi: 10.1038/s41393-021-00672-y. Epub 2021 Aug 17. Spinal Cord. 2022. PMID: 34404913 Free PMC article.
-
What should be clarified when learning the International Standards to Document Remaining Autonomic Function after Spinal Cord Injury (ISAFSCI) among medical students.Spinal Cord Ser Cases. 2021 Jul 31;7(1):68. doi: 10.1038/s41394-021-00431-4. Spinal Cord Ser Cases. 2021. PMID: 34333517 Free PMC article. Review. No abstract available.
-
Revisiting the Examination of Sharp/Dull Discrimination as Clinical Measure of Spinothalamic Tract Integrity.Front Neurol. 2021 Jul 1;12:677888. doi: 10.3389/fneur.2021.677888. eCollection 2021. Front Neurol. 2021. PMID: 34276538 Free PMC article.
References
-
- American Spinal Injury Association . Standards for Classification of Spinal Injured Patients. Chicago, IL: American Spinal Injury Association; 1982.
-
- American Spinal Injury Association . Standards for Classification of Spinal Injured Patients. Chicago, IL: American Spinal Injury Association; 1992.
-
- Ditunno JF, Donovan WH, Maynard FM. Reference Manual for the International Standards for Neurological and Functional Classification of Spinal Cord Injury. Chicago, IL: American Spinal Injury Association; 1994.
-
- Donovan WH, Wikerson MA, Rossi D, Mechoulam F, Frankowski RF. A test of the ASIA guidelines for classification of spinal cord injuries. J Neurol Rehabil. 1990;4:39–53.
-
- Cohen ME, Ditunno JF, Donovan WH, Maynard FM. A test of the 1992 international standards for neurological and functional classification of spinal cord injury. Spinal Cord. 1998;36:554–560. - PubMed
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Medical