• KSAN
  • Contact us
  • E-Submission
ABOUT
BROWSE ARTICLES
EDITORIAL POLICY
FOR CONTRIBUTORS

Articles

Original Article

Reliability and Validity of the Assessment Tool for Measuring Communication Skills in Nursing Simulation Education

Korean Journal of Adult Nursing 2016;28(1):95-105.
Published online: February 29, 2016

1Graduate School, College of Nursing, Hanyang University, Seoul

2College of Nursing, Hanyang University, Seoul, Korea

Corresponding author: Hwang, Seon Young College of Nursing, Hanyang University, 222 Wangsimni-ro, Seondong-gu, Seoul 04763, Korea. Tel: +82-2-2220-0702, Fax: +82-2-2220-1163, E-mail: seon9772@hanyang.ac.kr
• Received: December 11, 2015   • Accepted: February 11, 2016

Copyright © 2016 Korean Society of Adult Nursing

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/3.0) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

  • 37 Views
  • 2 Download
  • 16 Crossref
prev next
  • Purpose
    This study was conducted to test whether Health Communication Assessment Tool (HCAT) developed by Campbell et al. in 2013 can be applied to assess Korean nursing students’ communication skills in simulation education.
  • Methods
    The content validity of the Korean version of HCAT (K-HCAT) was evaluated through expert's assessment and a principal component analysis was conducted for testing construct validity. The convergent validity was tested by measuring relationship between the K-HCAT and those of existing communication assessment tool for standardized patient instruction. The evaluation was done by surveying 154 senior students from four different nursing colleges.
  • Results
    The K-HCAT was condensed into 15 items from the original 22 HCAT items. Four factors were extracted from the principal component analysis; factor loadings ranged from .50 to .83; cumulative explained variance was 62.65%. Four factors were entitled as ‘relationship building’, ‘empowering’, ‘empathy/re-sponse’, and ‘education/feedback’. Cronbach's ⍺ for sub-dimensions ranged from .73 to .84. An evaluation of convergent validity showed that the scores of the K-HCAT were moderately correlated with those of an assessment tool for standardized patient instruction.
  • Conclusion
    The K-HCAT can be used as an effective tool for assessing nursing students’ communication skills in various kinds of simulation educations Further research is needed to test the consistency of the K-HCAT.
Table 1.
Item Contents and Reliability of the K-HCAT (N=154)
Factor /Item Item contents M±SD Corrected item-total correction Cronbach's ⍺ if item deleted Cronbach's ⍺
Factor 1 1 Relationship Building ․ The SN introduced her-/himself to patient (and/or family) 4.68±0.56 .41 .84 .84
2 ․ The SN explained the reason for the nurse's visit in patient/family appropriate terms. 4.58±0.58 .70 .80
3 ․ The SN used positive communication including smile to encourage interaction. 4.44±0.61 .62 .81
4 ․ The SN maintained eye contact when talking with patient and/or family. 4.66±0.53 .71 .80
5 ․ The SN communicated what she/he was about to do prior to doing it. 4.65±0.59 .67 .81
10 ․ The SN used appropriate vocal tone and volume for the situation. 4.67±0.49 .70 .80
15 ․ The SN avoided healthcare jargon (vital signs, respiratory, etc.) 4.47±0.62 .53 .82
Factor 2 Empowering       .74
6 ․ The SN listened more than talked. 4.25±0.65 .33 .76
11 ․ The SN spent equal or more time on psychosocial aspects of patient/family care as on clinical (biological) aspects. 3.77±0.83 .61 .64
13 ․ The SN recognized conflict and tried to gain information and find opportunities to minimize or manage it. 3.63±0.80 .58 .64
14 ․ The SN maintained, enhanced, or developed an interpersonal relationship with the patient and/or family member (via communication and professionalism). 4.12±0.75 .58 .64
Factor 3 Empathy·Response       .75
9 ․ The SN recognized and responded appropriately to the patient's and/or family member's nonverbal (frowns, tears, hysteria, silence, etc.)and verbal behaviors. 3.72±0.68 .62 .77
12 ․ The SN inquired about the patient's/family members feelings regarding the situation. 3.83±0.77 .60 .68
Factor 4 Education·Feedback       .73
7 ․ The SN effectively educated the patient and/or family member about the procedure, disease, &/or treatment. 4.53±0.66 .44 .75
8 ․ The SN asked questions to encourage feedback and enhance clarity. 4.10±0.75 .57 .66
Total   4.27±0.32     .85
Table 2.
Result of Factor Analysis (N=154)
No. of item Factor 1 Factor 2 Factor 3 Factor 4
4 0.75      
10 0.75      
15 0.74      
3 0.72      
5 0.65      
2 0.65      
1 0.61      
14   0.83    
13   0.81    
11   0.72    
6   0.50    
12     0.80  
9     0.69  
8       0.81
7       0.52
Eigen value 4.27 2.58 1.31 1.24
Variance 28.49 17.18 8.72 8.26
Cummulative (%) 28.49 45.67 54.39 62.65

Kaiser-Meyer-Olkin test=0.72; Bartlett's test of sphericity=900.11 (p<.001)

Table 3.
Correlations between K-HCAT and Yoo (2001)'s Communication Assessment Tool (N=154)
Variables Categories M±SD Sum±SD Yoo's tool
r (p)
K-HCAT Factor 1 5.35±0.47 32.15±2.87 .76 (<.001)
Factor 2 3.94±0.57 15.77±2.28 .22 (.006)
Factor 3 3.77±0.59 7.55±1.18 .28 (<.001)
Factor 4 4.31±0.56 8.62±1.12 .50 (<.001)
Total 4.27±0.32 64.11±4.91 .74 (<.001)

K-HCAT=korean health communication assessment tool.

  • 1.Park YI, Kim JA, Ko JK, Chung MS, Bang KS, Choe MA, et al. An identification study on core nursing competency. Journal of Korean Academic Society of Nursing Education. 2013;19(4):663-74. http://dx.doi.org/10.5977/jkasne.2013.19.4.663.
  • 2.Lee SO, Eom MR, Lee JH. Use of simulation in nursing education. Journal of Korean Academic Society of Nursing Education. 2007;13(1):90-4.
  • 3.Lim KC. Planning and applying simulation-based practice for the achievement of program outcomes in nursing students. Journal of Korean Academic Society of Nursing Education. 2015;21(3):393-405. http://dx.doi.org/10.5977/jkasne.2015.21.3.393.
  • 4.Kim JH, Park IH, Shin SJ. Systematic review of korean studies on simulation within nursing education. Journal of Korean Academic Society of Nursing Education. 2013;19(3):307-19. http://dx.doi.org/10.5977/jkasne.2013.19.3.307.
  • 5.Kardong-Edgren S, Adamson KA, Fitzgerald C. A review of currently published evaluation instruments for human patient simulation. Clinical Simulation in Nursing. 2010;6(1):e25-e35.
  • 6.Adamson KA, Kardong-Edgren S, Willhaus J. An updated review of published simulation evaluation instruments. Clinical Simulation in Nursing. 2013;9(9):e393-e400.
  • 7.Lee JS, Park SM, Jeon SS, Choi JS, Kim MO, Kim R, et al. Communication experiences between psychiatric nurses and patients. Journal of Korean Academy of Psychiatric and Mental Health Nursing. 2002;11(4):596-608.
  • 8.Cho YE, Kim KS. Effects of assertiveness training program for intensive care units nurses. Journal of Korean Clinical Nursing Research. 2013;19(2):255-64.
  • 9.Campbell S, Daley KSimulation scenarios for nursing educators: making it real. 2nd ed.. New York: Springer Publishing Company; 2012.
  • 10.Han YI. Effects of nursing simulation-based practice education on learning outcome and classes experience in nursing students. Journal of Korean Health Service Management. 2014;8(1):135-50.
  • 11.Hyun KS, Kang HS, Kim WO, Park S, Lee J, Sok S. Development of a multimedia learning DM diet education program using standardized patients and analysis of its effects on clinical competency and learning satisfaction for nursing students. Journal of Korean Academy of Nursing. 2009;39(5):249-58.
  • 12.Kim JY, Hur NR, Jeon HJ, Jung DY. Effects of simulation education on the communication competence, academic self-efficacy, and attitude about the elderly for nursing students: a learning approach based on an elderly-withcognition-disorder scenario. Journal of Korean Academic Society of Nursing Education. 2015;21(1):54-64. http://dx.doi.org/10.5977/jkasne.2015.21.1.54.
  • 13.Hur KH. Construction and validation of a global interpersonal communication competence scale. Journal of Korean Journalism & Communication Studies. 2003;47(6):380-408.
  • 14.Yoo MS. The effectiveness of standardized patient managed instruction for a fundamentals of nursing course. Journal of Nursing Query. 2001;10(1):89-109.
  • 15.Bong EJ. Effect of interpersonal relationships and communication curriculum were utilized group activities on interpersonal relationships and communication self-efficacy among nursing student. Journal of The Korea Contents Association. 2013;13(10):394-402.
  • 16.Campbell SH, Pagano MP, O'Shea ER, Connery C, Caron C. Development of the health communication assessment tool: enhancing relationships, empowerment, and power-sharing skills. Clinical Simulation in Nursing. 2013;9(11):e543-e50.
  • 17.Tabachnick BG, Fidell LSUsing multivariate statistics. Boston: Allyn and Bacon; 2001.
  • 18.Song MR, Kim EM, Yu SJ. Analysis on the competency of nursing students' basic nursing skills. Journal of The Korea Contents Association. 2012;12(6):390-401.
  • 19.Lee SE. Evaluation of the standardized patients managed instruction for a clinical maternity nursing course. Journal of Korean Academic Society of Nursing Education. 2011;17(1):14-24.
  • 20.Sok SR, Kang HS, Kim WO, Hyun KS, Lee J, Park S. Effects and development of clinical competency evaluation using standardized patients among nursing students: based on abdominal surgical patients. Journal of Korean Academic Society of Adult Nursing. 2009;21(5):468-76.
  • 21.Dunn JD. Powerlessness regarding health service barriers: construction of an instrument. International Journal of Nursing Terminologies and Classifications. 1998;9(s2):136-43.
  • 22.Waltz CF, Bausell BRNursing research: design statistics and computer analysis. Philadelphia: FA Davis Company; 1981.
  • 23.Han SS, Lee SCNursing & health statistical analysis. 2nd ed. Seoul: Fornursebook; 2008.
  • 24.Nunnally JC, Bernstein IHPsychometric theory. New York: McGraw-Hill; 1996.
  • 25.Maguire MB, Bremner MN, Yanosky DJ. Reliability and validity testing of pilot data from the TeamSTEPPS® performance observation tool. Journal of Nursing and Care. 2014;3(202):1-6.
  • 26.Lisa KHCommunication for nurses. Korea University Nursing Research Institute, translator. Seoul: Koonja publisher; 2010.
  • 27.Won YH, Kang JY. Intensive care unit nurse's communication experience. Journal of Korean Academic Society of Adult Nursing. 2014;26(3):352-61. http://dx.doi.org/10.7475/kjan.2014.26.3.352.
  • 28.Xu Y, Shen J, Bolstad AL, Covelli M, Torpey M. Evaluation of an intervention on socio-cultural communication skills of international nurses. Nursing Economics. 2010;28(6):386-92.
  • 29.Joo GE, Song KE, Kim HJ. Effects of a standardized patient simulation program for nursing students on nursing competence, communication skill, self-efficacy and critical thinking ability for blood transfusion. Journal of Korean Fundamentals of Nursing. 2015;22(1):49-58. http://dx.doi.org/10.7739/jkafn.2015.22.1.49.
  • 30.Park SY, Kweon YR. The effect of using standardized patients in psychiatric nursing practical training for nursing college students. Journal of Korean Academy of Psychiatric and Mental Health Nursing. 2012;21(1):79-88.

Figure & Data

References

    Citations

    Citations to this article as recorded by  
    • Impact of grit, empathy, and communication competence on the clinical competence of nursing students in the post-COVID-19 era in Korea: a cross-sectional study
      Soo-Hyun Nam, Seurk Park
      Journal of Korean Biological Nursing Science.2025; 27(1): 115.     CrossRef
    • The effects of problem-based learning integrated with the nursing process on clinical reasoning, communication skills attitude and nursing process competency among nursing students: A quasi-experimental study
      Ji Sun Lee, Hae Kyoung Son
      Nurse Education in Practice.2024; 81: 104131.     CrossRef
    • Development and Validation of the Therapeutic Communication Scale in Nursing Students
      Soolgi Han, Jinhee Yoo, Kyonghwa Kang
      Healthcare.2024; 12(3): 394.     CrossRef
    • The Development, Implementation, and Evaluation of a Geriatric Disaster Nursing Simulation Intervention With Supportive Debriefing
      Joo-Young Jin, Yun-Jung Choi
      Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare.2024; 19(5): e84.     CrossRef
    • Communication training program for nurses caring for patients with aphasia: a quasi-experimental study
      Yujin Hur, Younhee Kang
      BMC Nursing.2024;[Epub]     CrossRef
    • Technology-based interactive communication simulation addressing challenging communication situations for nursing students
      Yeseul Jeon, Heeseung Choi, Ujin Lee, Hannah Kim
      Journal of Professional Nursing.2024; 53: 71.     CrossRef
    • The Validity and Reliability of Nursing Assessment Communication-Competence Scale for Clinical Nurses
      Hyojin Kim, Heeyoung Oh
      Journal of Korean Academy of Fundamentals of Nursing.2023; 30(1): 78.     CrossRef
    • Technology-based interactive communication simulation for Korean nurses: A randomized controlled repeated-measures design
      Heeseung Choi, Yeseul Jeon, Ujin Lee, Junggeun Ahn, Hannah Kim
      Nurse Education Today.2023; 128: 105879.     CrossRef
    • The effects of simulation-based education on the communication and clinical judgment of nursing students and nurses: A systematic review and meta-analysis
      Jung Min Park, Sangeun Jun
      The Journal of Korean Academic Society of Nursing Education.2023; 29(3): 203.     CrossRef
    • Effects of simulation problem-based learning based on Peplau's Interpersonal Relationship Model for cesarean section maternity nursing on communication skills, communication attitudes and team efficacy
      Jeongim Lee, Hae Kyoung Son
      Nurse Education Today.2022; 113: 105373.     CrossRef
    • The effects of a home-visit nursing simulation for older people with dementia on nursing students' communication skills, self-efficacy, and critical thinking propensity: Quantitative research
      Yun-Jung Choi, Youn-Joo Um
      Nurse Education Today.2022; 119: 105564.     CrossRef
    • An Integrative Review of Simulation Programs for Nursing Students: Patient and Caregiver-Centered Communication
      Soolgi Han, Jinhee Yoo, Kyongwha Kang
      Korean Journal of Stress Research.2021; 29(3): 168.     CrossRef
    • Testing the Validity and Reliability of the Adapted Health Communication Assessment Tool©
      Tamara Baird, Virginia Ruth Corey, Jenna Sissom, Jennifer Weber, Suzanne Hetzel Campbell
      Clinical Simulation in Nursing.2021; 52: 50.     CrossRef
    • The Effects of Empathy and Gender Role Identity on Communication Competence in Nursing College Students
      Hyun Sook Choi, Kyung Ae Kim, SankBok Lee, Hyeyoung Joung
      Journal of Korean Critical Care Nursing.2020; 13(3): 41.     CrossRef
    • Effect of SEGUE-based communication education on nursing simulation practice: a quasi-experimental design
      Hae Kyoung Son, Dong Hee Kim
      Contemporary Nurse.2019; 55(4-5): 330.     CrossRef
    • Comparison of Standardized Patient and Faculty Agreement in Evaluating Nursing Students’ Assessment and Communication Skills
      Young Ju Kim
      Journal of Korean Academy of Fundamentals of Nursing.2017; 24(3): 189.     CrossRef

    Download Citation

    Download a citation file in RIS format that can be imported by all major citation management software, including EndNote, ProCite, RefWorks, and Reference Manager.

    Format:

    Include:

    Reliability and Validity of the Assessment Tool for Measuring Communication Skills in Nursing Simulation Education
    Korean J Adult Nurs. 2016;28(1):95-105.   Published online February 29, 2016
    Download Citation
    Download a citation file in RIS format that can be imported by all major citation management software, including EndNote, ProCite, RefWorks, and Reference Manager.

    Format:
    • RIS — For EndNote, ProCite, RefWorks, and most other reference management software
    • BibTeX — For JabRef, BibDesk, and other BibTeX-specific software
    Include:
    • Citation for the content below
    Reliability and Validity of the Assessment Tool for Measuring Communication Skills in Nursing Simulation Education
    Korean J Adult Nurs. 2016;28(1):95-105.   Published online February 29, 2016
    Close
    Reliability and Validity of the Assessment Tool for Measuring Communication Skills in Nursing Simulation Education
    Reliability and Validity of the Assessment Tool for Measuring Communication Skills in Nursing Simulation Education

    Item Contents and Reliability of the K-HCAT (N=154)

    Factor /Item Item contents M±SD Corrected item-total correction Cronbach's ⍺ if item deleted Cronbach's ⍺
    Factor 1 1 Relationship Building ․ The SN introduced her-/himself to patient (and/or family) 4.68±0.56 .41 .84 .84
    2 ․ The SN explained the reason for the nurse's visit in patient/family appropriate terms. 4.58±0.58 .70 .80
    3 ․ The SN used positive communication including smile to encourage interaction. 4.44±0.61 .62 .81
    4 ․ The SN maintained eye contact when talking with patient and/or family. 4.66±0.53 .71 .80
    5 ․ The SN communicated what she/he was about to do prior to doing it. 4.65±0.59 .67 .81
    10 ․ The SN used appropriate vocal tone and volume for the situation. 4.67±0.49 .70 .80
    15 ․ The SN avoided healthcare jargon (vital signs, respiratory, etc.) 4.47±0.62 .53 .82
    Factor 2 Empowering       .74
    6 ․ The SN listened more than talked. 4.25±0.65 .33 .76
    11 ․ The SN spent equal or more time on psychosocial aspects of patient/family care as on clinical (biological) aspects. 3.77±0.83 .61 .64
    13 ․ The SN recognized conflict and tried to gain information and find opportunities to minimize or manage it. 3.63±0.80 .58 .64
    14 ․ The SN maintained, enhanced, or developed an interpersonal relationship with the patient and/or family member (via communication and professionalism). 4.12±0.75 .58 .64
    Factor 3 Empathy·Response       .75
    9 ․ The SN recognized and responded appropriately to the patient's and/or family member's nonverbal (frowns, tears, hysteria, silence, etc.)and verbal behaviors. 3.72±0.68 .62 .77
    12 ․ The SN inquired about the patient's/family members feelings regarding the situation. 3.83±0.77 .60 .68
    Factor 4 Education·Feedback       .73
    7 ․ The SN effectively educated the patient and/or family member about the procedure, disease, &/or treatment. 4.53±0.66 .44 .75
    8 ․ The SN asked questions to encourage feedback and enhance clarity. 4.10±0.75 .57 .66
    Total   4.27±0.32     .85

    Result of Factor Analysis (N=154)

    No. of item Factor 1 Factor 2 Factor 3 Factor 4
    4 0.75      
    10 0.75      
    15 0.74      
    3 0.72      
    5 0.65      
    2 0.65      
    1 0.61      
    14   0.83    
    13   0.81    
    11   0.72    
    6   0.50    
    12     0.80  
    9     0.69  
    8       0.81
    7       0.52
    Eigen value 4.27 2.58 1.31 1.24
    Variance 28.49 17.18 8.72 8.26
    Cummulative (%) 28.49 45.67 54.39 62.65

    Kaiser-Meyer-Olkin test=0.72; Bartlett's test of sphericity=900.11 (p<.001)

    Correlations between K-HCAT and Yoo (2001)'s Communication Assessment Tool (N=154)

    Variables Categories M±SD Sum±SD Yoo's tool
    r (p)
    K-HCAT Factor 1 5.35±0.47 32.15±2.87 .76 (<.001)
    Factor 2 3.94±0.57 15.77±2.28 .22 (.006)
    Factor 3 3.77±0.59 7.55±1.18 .28 (<.001)
    Factor 4 4.31±0.56 8.62±1.12 .50 (<.001)
    Total 4.27±0.32 64.11±4.91 .74 (<.001)

    K-HCAT=korean health communication assessment tool.

    Table 1. Item Contents and Reliability of the K-HCAT (N=154)

    Table 2. Result of Factor Analysis (N=154)

    Kaiser-Meyer-Olkin test=0.72; Bartlett's test of sphericity=900.11 (p<.001)

    Table 3. Correlations between K-HCAT and Yoo (2001)'s Communication Assessment Tool (N=154)

    K-HCAT=korean health communication assessment tool.

    TOP