An Investigation of Agreement between Clinical Educators and Peers in Rating Speech Pathology Students’ Interview Skills

Authors

  • Hannah Reece The University of Queensland, Australia, School of Health and Rehabilitation Sciences, Division of Speech Pathology
  • Anne E Hill The University of Queensland, Australia, School of Health and Rehabilitation Sciences, Division of Speech Pathology
  • Adriana Penman The University of Queensland, Australia, School of Health and Rehabilitation Sciences, Division of Speech Pathology

DOI:

https://doi.org/10.18552/ijpblhsc.v6i2.503

Keywords:

agreement, assessment, clinical education, peer feedback, speech pathology

Abstract

Peer assessment and feedback is being used more frequently in health science education as it has been shown to enhance self-directed learning. This study investigated the level of agreement between clinical educators and speech pathology student peers when rating students’ performance during standardised patient interviews. Participating in this study were 104 undergraduate speech pathology students and six clinical educators who were required to rate students’ foundation clinical skills on the Standardised Patient Interview Rating Scale (SPIRS). Students’ skills, including communication, interviewing and professional practice, were rated by a clinical educator and a peer. Data from two separate interviews in weeks 4 and 8 of a clinical placement were analysed to determine the agreement between clinical educators and peers in rating a student on individual items on the SPIRS. Results indicated that there were unacceptable agreement levels between clinical educators and peers in both opportunities of rating. Recommendations for improving agreement between peers and clinical educators were made including increasing explicit training with the rating tool, increased collaboration between clinical educators and student raters, and using peers with more clinical placement experience as raters. Further research is required to investigate the use of peer assessment for both formative and summative purposes in speech pathology student education.

Author Biography

Anne E Hill, The University of Queensland, Australia, School of Health and Rehabilitation Sciences, Division of Speech Pathology

Correspondence to:

Dr Anne E. Hill PhD

The University of Queensland

School of Health and Rehabilitation Sciences

Division of Speech Pathology

St Lucia QLD 4072

AUSTRALIA

 

References

Atwal, A., McIntyre, A., Craik, C., and Hunt, J. (2008) ‘Older adults and carers' perceptions of pre-discharge occupational therapy home visits in acute care’. Age and Ageing [online] 37 (1), 72–76. https://doi.org/10.1093/ageing/afm137 [1 July 2016]

Australian Bureau of Statistics (2009) Future Population Growth and Ageing. (Cat. no. 4102.0). Canberra, Australia: Australian Bureau of Statistics

Barksby, J. (2014) ‘Service users' perceptions of student nurses’. Nursing Times, 110 (19), 23–25

Berk, L. (2017) Development Through the Lifespan. 7th edn. New York: Pearson

Braun, V. and Clarke, V. (2006) ‘Using thematic analysis in psychology’. Qualitative Research in Psychology [online] 3 (2), 77–101 https://doi.org/10.1191/1478088706qp063oa [1 July 2016]

Creswell, J.W. (2013) Qualitative Inquiry and Research Design: Choosing Among Five Approaches. 3rd edn. Thousand Oaks, CA: Sage

Creswell, J.W. (2014) Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. 4th edn. Thousand Oaks, CA: Sage

Csontó, S. (2009) ‘Occupational therapy students' consideration of clients' spirituality in practice placement education’. The British Journal of Occupational Therapy, 72 (10), 442–449 https://doi.org/10.1177/030802260907201005

Davies, R., Hanna, E., and Cott, C. (2011) ‘“They put you on your toes”: Physical therapists' perceived benefits from and barriers to supervising students in the clinical setting’. Physiotherapy Canada, 63 (2), 224–233 https://doi.org/10.3138/ptc.2010-07

Denzin, N. and Lincoln, Y. (2011) ‘The Discipline and Practice of Qualitative Research’. in The SAGE Handbook of Qualitative Research. Ed. by Denzin, N. and Lincoln, Y. 4th edn. Thousand Oaks, CA: Sage, 1–19

du Toit, S. and Wilkinson, A. (2011) ‘Promoting an appreciation for research-related activities: The role of occupational identity’. The British Journal of Occupational Therapy, 74 (10), 489–493 https://doi.org/10.4276/030802211X13182481842029

Fortune, T. and McKinstry, C. (2012) ‘Project-based fieldwork: Perspectives of graduate entry students and project sponsors’. Australian Occupational Therapy Journal, 59 (4), 265–275 https://doi.org/10.1111/j.1440-1630.2012.01026.x

Freeth, D., Reeves, S., Goreham, C., Parker, P., Haynes, S., and Pearson, S. (2001) ‘“Real life” clinical learning on an interprofessional training ward’. Nurse Education Today [online] 21 (5), 366–372 https://doi.org/10.1054/nedt.2001.0567 [1 July 2016]

Hanson, D.J. (2011) ‘The perspectives of fieldwork educators regarding Level II fieldwork students’. Occupational Therapy in Health Care, 25 (2), 164–177 https://doi.org/10.3109/07380577.2011.561420

Health Workforce Australia (2011) Mapping Clinical Placements: Capturing Opportunities for Growth. Adelaide, Australia: Health Workforce Australia

Higgs, J. (2011) Professional and Practice-based Education at Charles Sturt University. Sydney, Australia: 2e The Education for Practice Institute, CSU, Sydney Olympic Park

Kent, F. and Keating, J. (2013) ‘Patient outcomes from a student-led interprofessional clinic in primary care’. Journal of Interprofessional Care 27 (4), 336–338 https://doi.org/10.3109/13561820.2013.767226

Kuan, S. and O'Donnell, J. (2007) ‘Medical students in the emergency department: How do patients view participation in clinical teaching?’ Irish Medical Journal, 100 (8), 560–561

Lewis, S.C. (2003) Elder Care in Occupational Therapy. 2nd edn. Thorofare, NJ: SLACK

Mason, L. R. and Bull, B. J. (2006) ‘Practice placement education in mental health: The educator's experience’. The British Journal of Occupational Therapy [online] 69 (1), 22–30 https://doi.org/10.1177/030802260606900105

Mol, S.S.L., Peelen, J.H., and Kuyvenhoven, M.M. (2011) ‘Patients’ views on student participation in general practice consultations: A comprehensive review’. Medical Teacher, 33 (7), e397–e400 https://doi.org/10.3109/0142159X.2011.581712

Mountain, G.A. (2004) Occupational Therapy with Older People. London: Whurr

NSW Government (2008) Budget Estimates 2008-09 – NSW Treasury. [online] available from <http://www.treasury.nsw.gov.au/budget_papers/Budget_Papers_2008-09/bp3/2008-09_budget_paper_3> [1 July 2016]

Occupational Therapy Australia (2018) Australian Occupational Therapy Competency Standards 2018. [online] available from https://www.occupationaltherapyboard.gov.au/codes-guidelines/competencies.aspx [16 September 2018]

Olivier, M., Oosthuizen, L., and Casteleijn, D. (2007) ‘Occupational therapy students' contribution towards enabling potential in a semi-rural community’. Work 29 (1), 63–68

Opdenakker, R. (2006) ‘Advantages and disadvantages of four interview techniques in qualitative research’. Forum: Qualitative Social Research [online] 7 (4), Article 11. available from <http://www.qualitative-research.net/index.php/fqs/article/view/175/391> [1 July 2016]

Patton, M.Q. (2015) Qualitative Research and Evaluation Methods: Integrating Theory and Practice. 4th edn. Thousand Oaks, CA: Sage

Rodger, S., Fitzgerald, C., Davila, W., Millar, F., Springfield, K., Thomas, Y., … Greber, C. (2011) ‘Consumers' perspectives of quality in student delivered occupational therapy services’. Focus on Health Professional Education [online] 13 (2), 37–52. available from <http://search.informit.com.au.ezproxy2.library.usyd.edu.au/documentSummary;dn=537891909705604;res=IELHEA> [1 July 2016]

Rodger, S., Stephens, E., Clark, M., Ash, S., and Graves, N. (2011) ‘Occupational therapy students’ contribution to occasions of service during practice placements in health settings’. Australian Occupational Therapy Journal, 58 (6), 412–418 https://doi.org/10.1111/j.1440-1630.2011.00971.x

Roots, R.K. and Li, L.C. (2013) ‘Recruitment and retention of occupational therapists and physiotherapists in rural regions: A meta-synthesis’. BMC Health Services Research, 13 (59) https://doi.org/10.1186/1472-6963-13-59

Scheffer, C., Edelhäuser, F., Tauschel, D., Riechmann, M., and Tekian, A. (2010) ‘Can final year medical students significantly contribute to patient care? A pilot study about the perception of patients and clinical staff’. Medical Teacher, 32 (7), 552–557 https://doi.org/10.3109/01421590903437170

Schindler, V.P. and Sauerwald, C. (2013) ‘Outcomes of a 4-year program with higher education and employment goals for individuals diagnosed with mental illness’. Work, 46 (3), 325–336 doi: 10.3233/WOR-121548

Siggins Miller Consultants (2012) Promoting Quality in Clinical Placements: Literature Review and National Stakeholder Consultation. Adelaide, Australia: Health Workforce Australia

Spencer, J., Blackmore, D., Heard, S., McCrorie, P., McHaffie, D., Scherpbier, A., … Southgate, L. (2000) ‘Patient‐oriented learning: A review of the role of the patient in the education of medical students’. Medical Education, 34 (10), 851–857. https://doi.org/10.1046/j.1365-2923.2000.00779.x

The Treasury (2015) 2015 Intergenerational Report Australia in 2055. [online] available from < http://apo.org.au/node/53411 [16 September 2018]

Thomas, Y., Dickson, D., Broadbridge, J., Hopper, L., Hawkins, R., Edwards, A., and McBryde, C. (2007) ‘Benefits and challenges of supervising occupational therapy fieldwork students: supervisors’ perspectives’. Australian Occupational Therapy Journal 54 (S1), s2–s12 https://doi.org/10.1111/j.1440-1630.2007.00694.x

Trail Ross, M.E. (2012) ‘Linking classroom learning to the community through service learning’. Journal of Community Health Nursing [online] 29 (1), 53–60 https://doi.org/10.1080/07370016.2012.645746

Trede, F., McEwen, C., Kenny, A., and O'Meara, P. (2014) ‘Supervisors' experiences of workplace supervision of nursing and paramedic students in rural settings: A scoping review’. Nurse Education Today, 34 (5), 783–788 https://doi.org/10.1016/j.nedt.2013.10.003

Wearne, S.M. (2011) ‘In-practice and distance consultant on-call general practitioner supervisors for Australian general practice?’ The Medical Journal of Australia [online] 195 (4), 224–228. available from <https://www.mja.com.au/journal/2011/195/4/practice-and-distance-consultant-call-general-practitioner-supervisors-australian> [1 July 2016]

World Federation of Occupational Therapists (2016) Revised Minimum Standards for the Education of Occupational Therapists. [online] available from <http://www.wfot.org/Store/tabid/61/CategoryID/1/ProductID/55/Default.aspx> [29 January 2018]

Downloads

Published

2018-11-28

How to Cite

Reece, H., Hill, A. E., & Penman, A. (2018). An Investigation of Agreement between Clinical Educators and Peers in Rating Speech Pathology Students’ Interview Skills. International Journal of Practice-Based Learning in Health and Social Care, 6(2), 64–79. https://doi.org/10.18552/ijpblhsc.v6i2.503