Investigation of the Validity and Reliability of a Placement Quality Survey for Measuring Rural Student Work Integrated Learning Placement Quality

  • Sabrina Winona Pit Western Sydney University
  • Jo Longman
  • Margaret Rolfe
  • Lorraine Smith
  • Lindy McAllister
Keywords: health education, placements, placement quality measures, quality, validation studies

Abstract

This study assessed the validity and reliability of the Placement Quality Survey (PQS) for measuring rural student clinical placement quality among allied health students attending rural placements. Secondly, the association of the PQS with students’ choice of rural placements and rural self-efficacy was determined. Students attending 5–8-week placements completed a paper-based questionnaire and were also invited to complete it again later the same day for reliability testing. Reliability and validity were tested. Analysis of variance was used to investigate relationships between PQS items and composite scores with student discipline, venue of student placement, and rural self-efficacy. Occupational therapy, physiotherapy and speech pathology students (N = 163) participated. From the exploratory factor analysis a single factor was extracted which accounted for 62.1% of the variance. The standard one factor confirmatory factor analysis demonstrated reasonable fit but with the addition of a covariance term provided a good fit. Increased preference for rural placements was demonstrated for eight out of nine nine-item PQS items. Rural self-efficacy increased quality ratings, supporting construct validity. The Cronbach’s alpha indicated a high level of internal consistency. All item-to-item correlations indicated a high level of consistency. Test-retest Pearson’s correlations and intraclass correlation coefficients of repeatability indicated the reliability of the scale over time. This study validated the PQS in a sample of rural allied-health students. The results provided support for reliability. The study addresses the critical need for placement quality data to improve allied health students’ experiences and learning outcomes on placements and encourage systematic quality improvement processes.

References

Australian Health Practitioner Regulation Agency. (2019). Fact sheet for education providers. https://www.ahpra.gov.au/Registration/Student-Registrations/fact-sheet-for-education-providers.aspx

Cusick, A., Heydon, M., Caldwell, K., & Cohen, L. (2014). Finding measures of clinical placements quality for pre-service health services training: Challenges of definition and search strategy construction. BMC Health Services Research, 14, P24. https://doi.org/10.1186/1472-6963-14-S2-P24

Darcy Associates. (2012). Best practice clinical learning environments: Final Report. Retrieved November, 2019 from http://www.health.vic.gov.au/placements/resources/index.htm

Davenport, R., Hewat, S., Ferguson, A., McAllister, S., & Lincoln, M. (2018). Struggle and failure on clinical placement: A critical narrative review. International Journal of Language & Communication Disorders, 53 (2), 218–227. https://doi.org/10.1111/1460-6984.12356

Deaville, J., & Grant, A. (2011). Overcoming the pull factor of convenient urban living – Perceptions of rural general practice placements. Medical Teacher, 33(4), e211–e217. https://doi.org/10.3109/0142159X.2011.557409

Hair, J. F., Anderson, R. E., Tatham, R. L., & Black, W. C. (1998). Multivariate Data Analysis (5th international edn.). Prentice Hall.

Health Workforce Australia. (2011). Rural and remote health workforce innovation and reform strategy: Draft Background Paper. Prepared for Health Workforce Australia by Siggins Miller. Retrieved November, 2019 from https://www.hwa.gov.au/sites/uploads/hwa-rural-and-remote-consultation-draft-background-paper-20110829c.pdf

Hills, C., Quigley, D., Bennett, A., Haughey, F., & McMahon, S. (2019). Core indicators of quality in practice education placement in allied health and social care professions: A scoping review protocol. JBI Database of Systematic Reviews and Implementation Reports, 17(6), 1060–1070. https://doi.org/10.11124/JBISRIR-2017-004031

Isaac, V., Pit, S. W., & McLachlan, C. S. (2018). Self-efficacy reduces the impact of social isolation on medical student’s rural career intent. BMC Medical Education, 18(1), 42. https://doi.org/10.1186/s12909-018-1142-1

Isaac, V., Walters, L., & McLachlan, C. S. (2015). Association between self-efficacy, career interest and rural career intent in Australian medical students with rural clinical school experience. BMJ Open, 5(12), e009574. https://doi.org/10.1136/bmjopen-2015-009574

King, K., Purcell, R., Quinn, S., Schoo, A., & Walters, L. (2016). Supports for medical students during rural clinical placements: Factors associated with intention to practise in rural locations. Rural and Remote Health, 16(2), Article 3791. https://www.rrh.org.au/journal/article/3791

Kline, R.B. (2015). Principles and practice of structural equation modeling (4th ed.). Guilford Press.

Longman, J. M., Barraclough, F. L., & Swain, L. S. (2020). The benefits and challenges of a rural community-based work-ready program for allied health students. Rural and Remote Health, 20(3), Article 5706. d https://doi.org/10.22605/RRH5706

McAllister L. (2016). Quantifying quality clinical placements: Piloting measures of student clinical placement quality to improve student learning experiences. [Unpublished report]. The University of Sydney.

McAllister, L., Nagarajan, S., Scott, L., Smith, L., & Thomson, K. (2018). Developing measures of placement quality in allied health, dentistry, medicine, and pharmacy. International Journal of Practice-based Learning in Health and Social Care, 6(2), 31–47. https://doi.org/10.18552/ijpblhsc.v6i2.493

McAllister, L., Paterson, M., Higgs, J., & Bithell, C. (2010). Innovations in allied health fieldwork education: A critical appraisal. Practice, Education, Work and Society (Vol. 4). Sense.

McCall, L., Wray, N., & McKenna, L. (2009). Influence of clinical placement on undergraduate midwifery students’ career intentions. Midwifery, 25(4), 403–410. https://doi.org/10.1016/j.midw.2007.07.008

Nolte, E., Fry, C.V., Winpenny, E., & Brereton, L. (2011). Use of outcome metrics to measure quality in education and training of healthcare professionals: A scoping review of international experiences (RAND Europe working paper series). https://www.rand.org/pubs/working_papers/WR883.html

SAS Institute. (2020). Support/ Samples & SAS Notes. Usage Note 33323: Producing Bartlett's test of sphericity. https://support.sas.com/kb/33/323.html

Siggins Miller Consultants. (2012). Promoting quality in clinical placements: Literature review and national stakeholder consultation. https://docplayer.net/10887025-Promoting-quality-in-clinical-placements-literature-review-and-national-stakeholder-consultation-final-report.html

Smith, T., Cross, M., Waller, S., Chambers, H., Farthing, A., Barraclough, F., Pit, S. W., Sutton, K., Muyambi, K., King, S., & Anderson, J. (2018). Ruralization of students’ horizons: Insights into Australian health professional students’ rural and remote placements. Journal of Multidisciplinary Healthcare, 11, 85–97. https://doi.org/10.2147/JMDH.S150623

Smith, T., Sutton, K., Pit, S., Muyambi, K., Terry, D., Farthing, A., Courteney, C., & Cross, M. (2018). Health professional students' rural placement satisfaction and rural practice intentions: A national cross‐sectional survey. Australian Journal of Rural Health, 26(1), 26–32. https://doi.org/10.1111/ajr.12375

Statistics How To. (2020). Statistics for the rest of us! Kaiser-Meyer-Olkin (KMO) Test for Sampling Adequacy. https://www.statisticshowto.datasciencecentral.com/kaiser-meyer-olkin/

van der Zwet, J., Zwietering, P. J., Teunissen, P. W., van der Vleuten, C. P. M., & Scherpbier, A. J. J. A. (2011). Workplace learning from a socio-cultural perspective: Creating developmental space during the general practice clerkship. Advances in Health Sciences Education, 16(3), 359–373. https://doi.org/10.1007/s10459-010-9268-x

Wakerman, J., & Humphreys, J. S. (2013). Sustainable workforce and sustainable health systems for rural and remote Australia. Medical Journal of Australia, 199 (5), S14–S17. https://doi.org/10.5694/mja11.11639

Wakerman, J., & Humphreys, J. S. (2019). “Better health in the bush”: Why we urgently need a national rural and remote health strategy. Medical Journal of Australia, 210(5), 202–203. https://doi.org/10.5694/mja2.50041

Walters, L., Seal, A., McGirr, J., Stewart, R., DeWitt, D., & Playford, D. (2016). Effect of medical student preference on rural clinical school experience and rural career intentions. Rural and Remote Health, 16(4), 3698.

Winterton, J., & Turner, J. J. (2019). Preparing graduates for work readiness: An overview and agenda. Education and Training, 61(5), 536–551. https://doi.org/10.1108/ET-03-2019-0044

Published
2020-12-08
How to Cite
Pit, S. W., Longman, J., Rolfe, M., Smith, L., & McAllister, L. (2020). Investigation of the Validity and Reliability of a Placement Quality Survey for Measuring Rural Student Work Integrated Learning Placement Quality. International Journal of Practice-Based Learning in Health and Social Care, 8(2), 41-56. https://doi.org/10.18552/ijpblhsc.v8i2.649
Section
Research Articles

Most read articles by the same author(s)

1 2 > >>