• KSAN
  • Contact us
  • E-Submission

Korean J Adult Nurs : Korean Journal of Adult Nursing

OPEN ACCESS
mobile search button mobile menu button
Search
Advanced Search
ABOUT
BROWSE ARTICLES
EDITORIAL POLICY
FOR CONTRIBUTORS

Articles

Page Path

Original Article

Comparison of the Reliability and Validity of Fall Risk Assessment Tools in Patients with Acute Neurological Disorders

Sung Reul Kim1, Sung-Hee Yoo2, Young Sun Shin3, Ji Yoon Jeon4, Jun Yoo Kim4, Su Jung Kang4, Hea Sook Choi4, Hea Lim Lee4, Young Hee An4
Korean Journal of Adult Nursing 2013;25(1):24-32.
Published online: February 28, 2013

1College of Nursing, Chonbuk National University, Cheonju, Korea.

2College of Nursing, Chonnam National University, Gwangju, Korea.

3Department of Nursing, Changwon National University, Changwon, Korea.

4Department of Nursing, Asan Medical Center, Seoul, Korea.

Corresponding author: Yoo, Sung-Hee. College of Nursing, Chonnam National University, Hak 1-dong, Dong-gu, Gwangju 501-746, Korea. Tel: +82-62-530-4941, Fax: +82-62-220-4544, shyoo@chonnam.ac.kr
• Received: October 9, 2012   • Revised: February 5, 2013   • Accepted: February 17, 2013

© 2013 Korean Society of Adult Nursing

  • 22 Views
  • 0 Download
  • 15 Crossref
  • 11 Scopus
prev next

Full Article

Download PDF Download PDF
  • Purpose
    The aim of the study was to identify the most appropriate fall-risk assessment tool for neurological patients in an acute care setting.
  • Methods
    This descriptive study compared the reliability and validity of three fall-risk assessment tools (Morse Fall Scale, MFS; St Thomas's Risk Assessment Tool in Falling Elderly Inpatients, STRATIFY; Hendrich II Fall Risk Model, HFRM II). We assessed patients who were admitted to the Department of Neurology, Neurosurgery, and Rehabilitation at Asan Medical Center between July 1 and October 31, 2011, using a constructive questionnaire including general and clinical characteristics, and each item from the three tools. We analyzed inter-rater reliability with the kappa value, and the sensitivity, specificity, predictive value, and the area under the curve (AUC) of the three tools.
  • Results
    The analysis included 1,026 patients, and 32 falls occurred during this study. Inter-rater reliability was above 80% in all three tools. and the sensitivity was 50.0% (MFS), 84.4%(STRATIFY), and 59.4%(HFRM II). The AUC of the STRATIFY was 82.8. However, when the cutoff point was regulated as not 50 but 40 points, the AUC of the MFS was higher at 83.7.
  • Conclusion
    These results suggest that the STRATIFY may be the best tool for predicting falls for acute neurological patients.
  • Key Words: Falls; Reliability; Validity; Neurology
  • 1. Advanced Analytics. Inter-rater reliability discussion corner by Kilem L. Gwet-sample size determination 2010;Retrieved May 1, 2011. Web site: http://agreestat.com/blog_irr/sample_size_determination.html.
  • 2. Australian Council for Safety and Quality in Health Care. Preventing falls and harm from falls in older people: Best practice guidelines for Australian hospitals and residential aged care facilities. Safety and Quality Council, Canberra, Australia: Author; 2005.
  • 3. Barker A, Kamar J, Graco M, Lawlor V, Hill K. Adding value to the STRATIFY falls risk assessment in acute hospitals. Journal of Advanced Nursing. 2011;67:450-457.
  • 4. Chapman J, Bachand D, Hyrkas T. Testing of the sensitivity, specificity and feasibility of four falls risk assessment tools in a clinical setting. Journal of Nursing Management. 2011;19:133-142.
  • 5. Eagle DJ, Salama S, Whitman D, Evans LA, Ho E, Olde J. Comparison of three instruments in predicting accidental falls in selected inpatients in a general teaching hospital. Journal of Gerontological Nursing. 1999;25(7):40-45. PMID:10476130
  • 6. Evans D, Hodgkinson B, Lambert L, Wood J, Kowanko I. Falls in acute hospitals: A systematic review. The Joanna Briggs Institute for evidence based nursing and midwifery; 1998. in conjunction with the royal adelaide hospital, adelaide, South Australia. National Library of Australia Cataloguing-in-publication data ISBN Number: 0-9586131-2-5.
  • 7. Friedman SM, Munoz B, West SK, Rubin GS, Fried LP. Falls and fear of falling: Which comes first? A longitudinal prediction model suggests strategies for primary and secondary prevention. Journal of American Geriatric Society. 2002;50:1329-1335.
  • 8. Gu MO, Jeon MY, Eun Y. The development and effect of an tailored falls prevention exercise for older adults. Journal of Korean Academy of Nursing. 2006;36:341-352.
  • 9. Harlein J, Halfens RJ, Dassen T, Lahmann NA. Falls in older hospital inpatients and the effect of cognitive impairment: A secondary analysis of prevalence studies. Journal of Clinical Nursing. 2011;20:175-183.
  • 10. Heinze C, Halfens RJ, Roll S, Dassen T. Psychometric evaluation of the Hendrich Fall Risk Model. Journal of Advanced Nursing. 2006;53:327-332.
  • 11. Hendrich AL, Bender PS, Nyhuis A. Validation of the Hendrich II Fall Risk Model: A large concurrent case/control study of hospitalized patients. Applied Nursing Research. 2003;16:9-21.
  • 12. Hur JY, Kim HJ. Relationship of risk factors, knowledge and attitude to falls in elderly in patients. Journal of Korean Gerontological Nursing. 2009;11:38-50.
  • 13. Jang IS, Kim DJ. Home safety assessment for fall prevention in elderly people in a rural community. Journal of Korean Gerontological Nursing. 2002;4:176-186.
  • 14. Kim EA, Mordiffi SZ, Bee WH, Devi K, Evans D. Evaluation of three fall-risk assessment tools in an acute care setting. Journal of Advanced Nursing. 2007;60:427-435.
  • 15. Lovallo C, Rolandi S, Rossetti AM, Lusignani M. Accidental falls in hospital inpatients: Evaluation of sensitivity and specificity of two risk assessment tools. Journal of Advanced Nursing. 2010;66:690-696.
  • 16. Milisen K, Staelens N, Schwendimann R, Paepe LD, Verhaeghe J, Braes T, et al. Fall prediction in inpatients by bedside nurses using the St. Thomas's Risk Assessment Tool in Falling Elderly Inpatients (STRATIFY) instrument: A multicenter study. Journal of the American Geriatrics Society. 2007;55:725-733.
  • 17. Morse JM, Morse RM, Tylko SJ. Development of a scale to identify the fall-prone patient. Canadian Journal on Aging. 1989;8:366-371.
  • 18. Myers H. Hospital fall risk assessment tools: A critique of the literature. International Journal of Nursing Practice. 2003;9:223-235.
  • 19. Myers H, Nikoletti S. Fall risk assessment: A prospective investigation of nurses' clinical judgement and risk assessment tools in predicting patient falls. International Journal of Nursing Practice. 2003;9:158-165.
  • 20. O'Connell B, Myers H. The sensitivity and specificity of the Morse Fall Scale in an acute care setting. Journal of Clinical Nursing. 2002;11:134-136.
  • 21. Oliver D, Britton M, Seed P, Martin FC, Hopper AH. Development and evaluation of evidence based risk assessment tool (STRATIFY) to predict which elderly inpatients will fall: Case-control and cohort studies. British Medical Journal. 1997;315:1049-1053.
  • 22. Oliver D, Papaioannou A, Giangregorio L, Thabane L, Reizgys K, Foster G. A systematic review and meta-analysis of studies using the STRATIFY tool for prediction of falls in hospital patients: How well does it work? Age and Ageing. 2008;37:621-627.
  • 23. Papaioannou A, Parkinson W, Cook R, Ferko N, Coker E, Adachi JD. Prediction of falls using a risk assessment tool in the acute care setting. BMC Medicine. 2004;2:1.
  • 24. Perell KL, Nelson A, Goldman RL, Luther SL, Prieto-Lewis N, Rubenstein LZ. Fall risk assessment measures: An analytic review. Journal of Gerontology Series A: Biological Sciences and Medical Scienc. s. 2001;56:M761-M766. PMID: 11723150
  • 25. Petitpierre NJ, Trombetti A, Carroll I, Michel JP, Herrmann FR. The FIM instrument to identify patients at risk of falling in geriatric wards: A 10-year retrospective study. Age and Ageing. 2010;39:326-331.
  • 26. Ryu YM, Roche JP, Brunton M. Patient and family education for fall prevention involving patients and families in a fall prevention program on a neuroscience unit. Journal of Nursing Care Quality. 2009;24:243-249.
  • 27. Shin KR, Shin SJ, Kim JS, Kim JY. The effects of fall prevention program on knowledge, self-efficacy, and preventive activity related to fall, and depression of low-income elderly women. Journal of Korean Academy of Nursing. 2005;35:104-112.
Figure 1

Receiver operating characteristic curve for the fall risk assessment tool.

kjan-25-24-g001.jpg
Table 1

General and Clinical Characteristics (N=1,026)

kjan-25-24-i001.jpg

CNS=central nervous system.

Table 2

Inter-rater Reliability of the Fall Risk Assessment Tool

kjan-25-24-i002.jpg

MFS=morse fall scale; STRATIFY=St Thomas's risk assessment tool in falling elderly inpatients; HFRM II=Hendrich II fall risk model.

Table 3

Sensitivity, Specificity, and Predictive Value for the Fall Risk Assessment Tool (N=1,026)

kjan-25-24-i003.jpg

MFS=morse fall scale; STRATIFY=St Thomas's risk assessment tool in falling elderly inpatients; HFRM??Hendrich II fall risk model.

Table 4

AUC and Optimal Cutoff Point for the Fall Risk Assessment Tool

kjan-25-24-i004.jpg

AUC=area under ROC curve; MFS=morse fall scale; STRATIFY=St Thomas's risk assessment tool in falling elderly inpatients; HFRM II=Hendrich II fall risk model.

Figure & Data

References

    Citations

    Citations to this article as recorded by  
    • Effects of Forest Environment on Peak Cough Flow and Dyspnea in Patients with Neurological Disorders
      Jung Woo Shin, Jong Hwan Choi
      Journal of People, Plants, and Environment.2025; 28(2): 209.     CrossRef
    • Changes in Health Risks, Daily Activities and Antipsychotic Use After Humanitude Care for People With Dementia: A Retrospective Study
      Sungjun Kim, Jiyoung Kim, SungWoo Chung, Ju Young Sim
      Journal of Clinical Nursing.2025;[Epub]     CrossRef
    • Sensitivity of Fall Risk Perception and Associated Factors in Hospitalized Patients with Mental Disorders
      Ji Young Kim, Sung Reul Kim, Yusun Park, Jin Kyeong Ko, Eunmi Ra
      Asian Nursing Research.2024; 18(5): 443.     CrossRef
    • Congruency and its related factors between patients' fall risk perception and nurses' fall risk assessment in acute care hospitals
      Jieun Choi, Sujin Lee, Eunjin Park, Sangha Ku, Sunhwa Kim, Wonhye Yu, Eunmi Jeong, Sookhee Park, Yusun Park, Sung Reul Kim
      Journal of Nursing Scholarship.2024; 56(4): 507.     CrossRef
    • Falls in Patients of Medical Institutions in South Korea: A Literature Review
      Jongwon Choi, Woochol Joseph Choi
      Physical Therapy Korea.2023; 30(1): 1.     CrossRef
    • Development and validation of interpretable machine learning models for inpatient fall events and electronic medical record integration
      Soyun Shim, Jae Yong Yu, Seyong Jekal, Yee Jun Song, Ki Tae Moon, Ju Hee Lee, Kyung Mi Yeom, Sook Hyun Park, In Sook Cho, Mi Ra Song, Sejin Heo, Jeong Hee Hong
      Clinical and Experimental Emergency Medicine.2022; 9(4): 345.     CrossRef
    • Factors included in adult fall risk assessment tools (FRATs): a systematic review
      Hendrika de Clercq, Alida Naudé, Juan Bornman
      Ageing and Society.2021; 41(11): 2558.     CrossRef
    • Factors Influencing Falls in High- and Low-Risk Patients in a Tertiary Hospital in Korea
      Young-Shin Lee, Eun-Ju Choi, Yeon-Hee Kim, Hyeoun-Ae Park
      Journal of Patient Safety.2020; 16(4): e376.     CrossRef
    • Predictors of Health-related Quality of Life among Spouses of Older Adults with Dementia in the Community-dwelling
      Hye-Young Jang, Song Yi Han
      Journal of Korean Academy of Community Health Nursing.2019; 30(4): 518.     CrossRef
    • Effects of Fall Prevention Education Program on Attitudes, Prevention Behaviors, and Satisfaction among Elderly Inpatients
      Young Ok Kang, Rhayun Song
      Korean Journal of Adult Nursing.2018; 30(1): 49.     CrossRef
    • Risk factors of falling in patients with neurological diseases
      Michaela Miertová, Ivana Bóriková, Martina Tomagová, Katarína Žiaková
      Kontakt.2018; 20(3): e217.     CrossRef
    • Characteristics and Risk Factors for Falls in Tertiary Hospital Inpatients
      Eun-Ju Choi, Young-Shin Lee, Eun-Jung Yang, Ji-Hui Kim, Yeon-Hee Kim, Hyeoun-Ae Park
      Journal of Korean Academy of Nursing.2017; 47(3): 420.     CrossRef
    • A prediction model of falls for patients with neurological disorder in acute care hospital
      Sung-Hee Yoo, Sung Reul Kim, Yong Soon Shin
      Journal of the Neurological Sciences.2015; 356(1-2): 113.     CrossRef
    • Validation of Fall Risk Assessment Scales among Hospitalized Patients in South Korea using Retrospective Data Analysis
      Young Ok Kang, Rhayun Song
      Korean Journal of Adult Nursing.2015; 27(1): 29.     CrossRef
    • Evaluation of Clinical Usefulness of Delirium Assessment Tools for Elderly Patients after Neurosurgery
      Su-Jung Kim, Jun-Ah Song
      Journal of Korean Gerontological Nursing.2015; 17(1): 38.     CrossRef

    Download Citation

    Download a citation file in RIS format that can be imported by all major citation management software, including EndNote, ProCite, RefWorks, and Reference Manager.

    Format:

    Include:

    Comparison of the Reliability and Validity of Fall Risk Assessment Tools in Patients with Acute Neurological Disorders
    Korean J Adult Nurs. 2013;25(1):24-32.   Published online February 28, 2013
    DOI: https://doi.org/10.7475/kjan.2013.25.1.24
    Download Citation
    Download a citation file in RIS format that can be imported by all major citation management software, including EndNote, ProCite, RefWorks, and Reference Manager.
    Format:
    • RIS — For EndNote, ProCite, RefWorks, and most other reference management software
    • BibTeX — For JabRef, BibDesk, and other BibTeX-specific software
    Include:
    • Citation for the content below
    Comparison of the Reliability and Validity of Fall Risk Assessment Tools in Patients with Acute Neurological Disorders
    Korean J Adult Nurs. 2013;25(1):24-32.   Published online February 28, 2013
    DOI: https://doi.org/10.7475/kjan.2013.25.1.24
    Close

    Figure

    • 0
    Comparison of the Reliability and Validity of Fall Risk Assessment Tools in Patients with Acute Neurological Disorders
    Image
    Figure 1 Receiver operating characteristic curve for the fall risk assessment tool.

    Figure 1

    Comparison of the Reliability and Validity of Fall Risk Assessment Tools in Patients with Acute Neurological Disorders

    General and Clinical Characteristics (N=1,026)

    CNS=central nervous system.

    Inter-rater Reliability of the Fall Risk Assessment Tool

    MFS=morse fall scale; STRATIFY=St Thomas's risk assessment tool in falling elderly inpatients; HFRM II=Hendrich II fall risk model.

    Sensitivity, Specificity, and Predictive Value for the Fall Risk Assessment Tool (N=1,026)

    MFS=morse fall scale; STRATIFY=St Thomas's risk assessment tool in falling elderly inpatients; HFRM??Hendrich II fall risk model.

    AUC and Optimal Cutoff Point for the Fall Risk Assessment Tool

    AUC=area under ROC curve; MFS=morse fall scale; STRATIFY=St Thomas's risk assessment tool in falling elderly inpatients; HFRM II=Hendrich II fall risk model.
    Table 1 General and Clinical Characteristics (N=1,026)

    CNS=central nervous system.

    Table 2 Inter-rater Reliability of the Fall Risk Assessment Tool

    MFS=morse fall scale; STRATIFY=St Thomas's risk assessment tool in falling elderly inpatients; HFRM II=Hendrich II fall risk model.

    Table 3 Sensitivity, Specificity, and Predictive Value for the Fall Risk Assessment Tool (N=1,026)

    MFS=morse fall scale; STRATIFY=St Thomas's risk assessment tool in falling elderly inpatients; HFRM??Hendrich II fall risk model.

    Table 4 AUC and Optimal Cutoff Point for the Fall Risk Assessment Tool

    AUC=area under ROC curve; MFS=morse fall scale; STRATIFY=St Thomas's risk assessment tool in falling elderly inpatients; HFRM II=Hendrich II fall risk model.

    Table 1

    Table 2

    Table 3

    Table 4

    TOP