Skip to main content

The potential of a lecture series in changing intent and experience among health professionals to conduct research in a large hospital: a retrospective pre-post design

Abstract

Background

Promoting research capacity within public health can encourage and engage employees to undertake research, utilising their understanding of the complex needs that exist within the public health system to provide more relevant research outcomes. Despite this, there are a number of reasons cited by health care professionals as to why research is not undertaken, and a lack of support for research participation results in missed opportunities for experienced clinical and public health staff to gain research experience, expand the evidence base, and promote and support research. The aim of this study is to identify if education in research, delivered through a series of lectures at a large tertiary referral hospital, results in an increase in the experience and intent to conduct research.

Methods

A series of six lectures to aid in the understanding and development of research were delivered to health employees, health care professionals, students and their associates within a large public Australian hospital. Following these lectures, a validated instrument was developed and asked respondents to assess their research activity, research training history, and experience in conducting research using a retrospective pre/post- test design.

Results

Over half (57.1%) of respondents (n = 49) reported no previous researcher education training prior to the lectures. Following the lectures, reported researcher experience increased significantly in the areas of writing a research protocol, using qualitative research methods, publishing research, writing and presenting a research report, analysing and interpreting results, using quantitative research methods, generating research ideas, and applying for research funding. At 6 months following the lecture series intent to be involved in further research was seen in the areas of submitting an ethics application, analysing qualitative and quantitative research data, and research funding applications.

Conclusions

Six one hour face to face research lectures can improve self-reported levels of intention to become involved in research as well as research experience amongst hospital health care professionals at 6 months. This traditional modality of education should still be considered as relevant strategy in building research capacity as measured innovatively using a retrospective pre/post test methodology.

Peer Review reports

Background

In the health care environment research is fundamental and participation in research education can be beneficial in up-skilling and developing traits for individuals to undertake research projects. Promoting research capacity within public health can encourage and engage employees to undertake research, utilising their background and understanding of the complex needs that exist within the public health system to provide more relevant research outcomes. Studies have also found that the development of a research program results in improved cultural attitudes to research and productivity [1].

Despite this, there are a number of reasons cited by health care professionals as to why research is not undertaken, including time constraints, lack of suitable mentors or role models, lack of development of research skills during training, lack of funding and support from management, and lack of perseverance to complete research projects [1,2,3,4,5]. This lack of support for research participation results in missed opportunities for experienced clinical and public health staff to gain research experience, expand the evidence base within their fields, and promote and support research for others. A change of workplace culture to promote one which is research focused requires a high level of support, both financial and managerial, encouragement, and leadership [6]. Exposure to research in the early parts of health professionals’ careers, removing financial barriers, and allowing for continued participation in research activities can instigate continued research later in their careers [2].

While a great deal of funding goes into researcher development, there is not a lot known about what educational and training techniques can alter researcher behaviour, or the assessment and evaluation of individual strategies and their outcomes [7, 8]. Mentorship, multifaceted interventions, and self-assessment activities have been indicated as possible tools for effective research training, but these options are largely time and personnel reliant and may not be desirable for those who have an early interest in research and want to gain background information [8,9,10].

A simple alternative that is commonly adopted in delivering researcher education material is through lecture format, which is a traditional and cost-effective approach well suited to the public health sector. Some studies suggest that face-to-face lectures offer a still relevant alternative to other forms of education delivery which should continue to be considered as a viable option [11, 12]. It is this approach that was taken at a tertiary referral hospital, to deliver a lecture series in researcher education training. The aim of this study is to identify if training in research, delivered through this series of lectures, results in an increase in experience and intent to conduct research.

Methods

Western Sydney Local Health District (WSLHD) is one of the fastest growing areas of New South Wales (NSW), Australia, with more than 1.3 million residents estimated by 2031. WSLHD employs more than 13,000 staff across several sites, of which Westmead Hospital is the principal tertiary referral hospital. A series of six face to face lectures to aid in the understanding and development of research were delivered to health employees, health care professionals, students and their associates within Westmead Hospital. These were developed and organised by the Research and Education Network which provides support for research and training for WSLHD. The education intervention involved a single face-to-face delivery of a series of lectures 1 hour each in duration, consisting of an introduction, purpose and definition of research, conducting research, ethics and governance, as well as presentation and publication of research. Timing of the lectures was a matter of convenience and did not correspond to the commencement of new staff. The lectures were delivered fortnightly over a period of 10 weeks. The lectures were advertised through staff electronic communication systems and further disseminated to associates of employees through email.

The study had full ethics approval from the Western Sydney Local Health District Human Research Ethics Committee (HREC) LNR/16/WMEAD/457. Attendance to the lecture series was voluntary and participants who attended the lectures agreed to be contacted by email 6 months following completion of the lecture series to complete a 6 page questionnaire. The questionnaire survey instrument comprised of 4 sections each previously validated. The first consisting of demographics [13]. The second measured current research activity and professional qualifications [14] and research training history [13]. The third and fourth sections measured self-assessed experience in and intent to conduct research [10, 15] using a retrospective pre/post-test design where participants complete both pre and post questions at one time point i.e. 6 months following the intervention activity [16]. The questionnaire was piloted amongst 8 WSLHD clinicians and several minor changes were made to help validate the survey. As per the Merriam-Webster dictionary, intent was defined as “the act or fact of intending: purpose”, and experience was defined as “practical knowledge, skill, or practice derived from direct observation of or participation in events or in a particular activity” [17].

A sample of forty eight participants was required based on power calculations to achieve a statistical power of 90% similar to other studies [18, 14, 15].

Data was analysed using SPSS version 25.0 for descriptive analysis and examined for frequency distribution. Cross tabulations were performed using McNemar’s Test to identify associations between groups of data collected, and a value of p < 0.05 was considered statistically significant. Data was de-identified and the Wilcoxon Signed Ranks Test used on matched pair responses from pre/post test self-assessment questions.

Results

The total number who attended one or more lectures in the series in person was 160 people. Of these 126 consented to be contacted after 6 months, with 49 participants completing the survey. The response rate for the study was 38.9%.

Demographic results are presented in Table 1 with the majority of participants female (89.8%) and over two thirds (67.3%) holding postgraduate qualifications (Table 1).

Table 1 Participant Demographics and Research and Education History

As demonstrated in Table 2, the participants came from a wide range of backgrounds with the largest groups reporting a background in Allied Health (43.8%), followed by Nursing (27.1%).

Table 2 Disciplines of Participants

Over half (57.1%) of respondents reported no previous researcher education training prior to the lectures. Of those that had previous researcher education training, the majority (32.7%) had received it in the form of lectures. Using the retrospective pre-test to assess experience prior to attending the lecture series, more than half of participants (60.0%) reported having no experience in writing a research protocol, while at post-test this number had reduced to 39.1% (p < 0.01). A similar reduction in lack of experience was seen in those reporting no experience in the retrospective pre versus post-test for using qualitative research methods (34.8 to 25.6%, p < 0.05), publishing research (65.2 to 50.0%, p < 0.05), writing and presenting a research report (50.0 to 38.6%, p < 0.03), analysing and interpreting results (34.8 to 23.3%, p < 0.03), using quantitative research methods (41.3 to 27.3%, p < 0.01), generating research ideas (24.4 to 10.9%, p < 0.01), and applying for research funding (65.2 to 51.1%, p < 0.04) as seen in Fig. 1.

Fig. 1
figure 1

Change in level of experience across different areas of research

Results concerning intent to be involved with research beyond the 6 month survey point (Fig. 2), showed significance in the areas of submitting an ethics application (20%, p < 0.02), analysing qualitative research data (21%, p < 0.01), analysing quantitative research data (20%, p < 0.02), and applying for research funding (14%, p < 0.03).

Fig. 2
figure 2

Current involvement in research and intent to become involved in research

Discussion

This study assessed changes in experience and intent to conduct research following a training intervention, delivered through a series of traditional lectures. Other forms of lecture education delivery exist, such as through video, active learning, online accessible content, and online module delivery which, dependent on context, may be more effective than traditional face-to-face lectures. The latter may still be relevant as they provide an opportunity for real-time questions and networking with both peers and educators which is essential in a multidisciplinary health environment. In addition to this, in comparison to mentorship and full curriculum development, it is a cost effective approach. Responses showed that more than two thirds (67.3%) of participants were currently involved in research 6 months after completion of the education intervention. There was significance recorded in the intent to become involved in several aspects of further research, indicating an ongoing interest and involvement in research activities following the intervention.

The 6 month interval between the time of lecture delivery and survey was specifically chosen to allow for the development of research activities by participants, which is consistent with other similar published studies [18] although it should be noted that confounders such as participant recall could have affected results. Significant results included intent to become involved in the research areas of ethics application, analysis of both qualitative and quantitative research data, and application for research funding. This represents intent for involvement in a wide range of early research phases.

As research stages can take lengthy periods of time, involvement in later stages of research, such as writing reports or papers for publication, or writing a literature review, may have been limited by the 6 month follow-up. Further involvement in these later stages may be evident if a later follow-up was conducted and this may be a consideration for future studies.

The majority of participants were female (89.8%), which could reflect the staffing patterns of public hospitals, including the workforce in this local government health district which reports 73% female workforce representation [19]. In general, there is a higher representation of women in health care, including the professions of Nursing and Allied Health [20], which may have resulted in some element of gender bias. Although this is representative of the Public Sector workforce in NSW Health which has 74.6% female representation [21]. A limitation of this study is that this heavily female participant cohort may not be reflective of other health districts or in other countries, and this may affect study results in replication of the study in areas where male to female proportions are much greater.

Participants were also older, with almost half (47.9%) above the age of 50 years. It has been reported that previous degrees were less likely to include research methods in their curricula hence the greater interest among older clinicians [22]. Two-thirds of participants had completed postgraduate qualifications, and almost half (46.9%) had graduated more than 15 years ago. Several of these qualifications were reported to include a research component, although fewer than half (42.9%) had undertaken previous researcher training or education. This could indicate that either a proportion of their postgraduate qualifications were not research based, or they did not consider experience in research during these studies as researcher training. In fact, other training including postgraduate education accounted for 12.2% of previous researcher training. The highest reported previous training was received through lectures (32.7%), indicating the popularity of lecture based researcher training.

Significant change in the self-assessed level of experience was seen in a wide range of research areas, indicating the effectiveness of the lecture series in improving researcher experience. The increase seen in writing a research protocol was significant, as this is one of the first stages of research that is undertaken. Prior to the education intervention, more than half of participants (60.0%) reported having no experience in writing a research protocol, which reduced considerably to 39.1% following the lectures. This indicates that the lecture series was effective in educating attendees on the steps required in the core stage of planning and commencing a research project.

The lecture series was not compulsory for any staff, therefore it is likely those who attended had a previous interest in research, which may account for some of their involvement and intent to conduct further research. However, the lectures may have acted as a catalyst in fostering that intent, and providing the knowledge and education to initiate a research project.

The innovative retrospective pre/post-test methodology was used for this study due to its effectiveness, efficiency and ease of administration. Participants rate themselves with a single frame of reference on both pre-test and retrospective post-test which helps to reduce response shift bias [16]. It was also utilised in a busy hospital setting due to its advantage of a single administration and implementation of the study design post-intervention [16]. In the analysis of the data a paired analysis was chosen for its effective simplicity and could be considered a limitation compared to other more complex analysis, such as multivariate modelling.

The response rate for the study was relatively low, at 38.9%. Although this was to be expected as it sits within the range of 33 to 56% as seen in previous Australian surveys [23, 24]. Several steps were taken to try to improve the response rate, including assurance of anonymity, use of a brief and easily accessible survey tool, explanation of the impact of their contribution to the research, and several contact reminder attempts [24]. While further improvement in response rates may have been gained through incentives, telephone or face to face follow up interviews [25], these were not practical options for this study. The choice for a pre/post-test design was made over other, potentially more preferable, experimental designs due to two main factors. The first was the development of the study following the completion of the lecture series, thus removing the possibility of a pre-test prior to the intervention. The second is due to the small number in the study sample which did not allow inclusion of a control group while still maintaining statistical power. Future studies in this area may consider the use of other experimental designs.

While the results of this study do not provide ground breaking advancements, within the context of the current climate of education delivery where there is growing pressure to move away from the face-to-face lecture format, this study demonstrated and helps reinforce that this style of lecture series is still relevant in a modern health education environment.

A further limitation of this study is that the lecture series based format of education delivery was not directly compared to other delivery methods, nor the questions of how and why of success investigated, as these may be useful to consider in future studies.

It might also be useful to conduct further follow up in future studies to identify the long-term effects of the education intervention on the participants’ experience in and intent to conduct research, in particular those aspects of research that take longer time periods to complete, such as grant applications and writing for publication. This could provide a better insight into the effect of the intervention on these areas of research. We also recommend in future research concerning this lecture series and its participants that the inclusion of the type of research that participants engaged in following the intervention should be considered. Further research in delivering the intervention with accompanying support, such as workshops, tutorials, or mentorship, might also be useful in assessing whether such modalities improves experience in and intent to conduct research when compared to lectures alone.

Conclusion

Six one hour face to face research lectures resulted in an improvement in self-reported levels of intention to become involved in research as well as research experience amongst a group of health care professionals within a large tertiary referral hospital at 6 months. This traditional yet still relevant modality of education should still be considered as an effective strategy at building research capacity when measured innovatively using a retrospective pre/post-test methodology.

Abbreviations

NSW:

New South Wales

WSLHD:

Western Sydney Local Health District

References

  1. Kurahara DK, Kogachi K, Yamane M, Ly CL, Foster JH, Masaki-Tesoro T, et al. A pediatric residency research requirement to improve collaborative resident and faculty publication productivity. Hawaii J Med Public Health. 2012;71(8):224–8.

    Google Scholar 

  2. Goldstein H, Guerra E, Regier D. Targeted research training: developing minority psychiatric investigators. Acad Psychiatry. 2014;38(2):191–7.

    Article  Google Scholar 

  3. Moore J, Crozier K, Kite K. An action research approach for developing research and innovation in nursing and midwifery practice: building research capacity in one NHS foundation trust. Nurse Educ Today. 2012;32(1):39–45.

    Article  Google Scholar 

  4. Perry M, Hopson L, House JB, Fischer JP, Dooley-Hash S, Hauff S, et al. Model for developing educational research productivity: the medical education research group. West J Emerg Med. 2015;16(6):947–51.

    Article  Google Scholar 

  5. Howard AJ, Ferguson M, Wilkinson P, Campbell KL. Involvement in research activities and factors influencing research capacity among dietitians. J Hum Nutr Diet. 2013;26(Suppl 1):180–7.

    Article  Google Scholar 

  6. Begley C, McCarron M, Huntley-Moore S, Condell S, Higgins A. Successful research capacity building in academic nursing and midwifery in Ireland: an exemplar. Nurse Educ Today. 2014;34(5):754–60.

    Article  Google Scholar 

  7. Segrott J, McIvor M, Green B. Challenges and strategies in developing nursing research capacity: a review of the literature. Int J Nurs Stud. 2006;43(5):637–51.

    Article  Google Scholar 

  8. Mazmanian PE, Coe AB, Evans JA, Longo DR, Wright BA. Are researcher development interventions, alone or in any combination, effective in improving researcher behavior? A systematic review. Eval Health Prof. 2014;37(1):114–39.

    Article  Google Scholar 

  9. Friesen EL, Comino EJ, Reath J, Derrett A, Johnson M, Davies GP, et al. Building research capacity in south-West Sydney through a primary and community Health Research unit. Australian Journal of Primary Health. 2014;20(1):4–8.

    Article  Google Scholar 

  10. Schmidt DD, Kirby S. A modular approach to rural and remote research education: a project report. Rural Remote Health. 2016;16(1):3609.

    Google Scholar 

  11. Porter AL, Pitterle ME, Hayney MS. Comparison of online versus classroom delivery of an immunization elective course. Am J Pharm Educ. 2014;78(5):96.

    Article  Google Scholar 

  12. Arias JJ, Swinton, John, Anderson, Kay. Online vs. face-to-face: A comparison of student outcomes with random assignment. e-Journal of Business Education and Scholarship Teaching 2018;Vol. 12(No. 2).

  13. Skapetis T, Gerzina T, Hu W. Managing dental emergencies: a descriptive study of the effects of a multimodal educational intervention for primary care providers at six months. BMC Med Educ. 2012;12:103.

    Article  Google Scholar 

  14. Holden L, Pager S, Golenko X, Ware RS. Validation of the research capacity and culture (RCC) tool: measuring RCC at individual, team and organisation levels. Aust J Prim Health. 2012;18(1):62–7.

    Article  Google Scholar 

  15. Smith H, Wright D, Morgan S, Dunleavey J, Moore M. The ‘research spider’: a simple method of assessing research experience. Prim. Health Care Res. Dev. 2002;3(03):139–40.

    Article  Google Scholar 

  16. McDiarmid M, Binns M. Evaluating learning in library training workshops: using the retrospective pretest design. Journal of the Canadian Health Libraries Association/Journal de l'Association des bibliothèques de la santé du Canada. 2005;26(4):105–9.

    Article  Google Scholar 

  17. Merriam-Webster. Dictionary. [Internet] 2019 [cited 2019 Mar 7]. Available from: https://www.merriam-webster.com/dictionary.

  18. Harding KE, Stephens D, Taylor NF, Chu E, Wilby A. Development and evaluation of an allied health research training scheme. J Allied Health. 2010;39(4):e143–8.

    Google Scholar 

  19. WSLHD. Western Sydney Local Health District - Workforce Strategic Framework; 2015-2020 [Internet]. p. 2015 [cited 2018 Jan 25]. Available from: http://www.wslhd.health.nsw.gov.au/search.aspx?keywords=workforce%20strategic%20framework&moduleid=13.

  20. WGEA WGEA-. Australia's gender equality scorecard [Internet]. 2017 [cited 2018 Jan 25]. Available from: https://www.wgea.gov.au/sites/default/files/2016-17-gender-equality-scorecard.pdf.

  21. PSC Public Services Commission- Workforce Profile Report [Internet]. 2017 [cited 2019 Feb 25]. Available from: https://www.psc.nsw.gov.au/ArticleDocuments/3218/Workforce-Profile-2017.pdf.aspx.

  22. Anaf S, A Sheppard L. Mixing research methods in health professional degrees: thoughts for undergraduate students and supervisors; The Qualitative Report. 2007;12(2):184–192.

  23. Watt S, Simpson C, McKillop C, Nunn V. Electronic course surveys: does automating feedback and reporting give better results? Assess Eval High Educ. 2002;27(4):325–37.

    Article  Google Scholar 

  24. Nulty DD. The adequacy of response rates to online and paper surveys: what can be done? Assess Eval High Educ. 2008;33(3):301–14.

    Article  Google Scholar 

  25. Bower P, Wallace P, Ward E, Graffy J, Miller J, Delaney B, et al. Improving recruitment to health research in primary care. Fam Pract. 2009;26(5):391–7.

    Article  Google Scholar 

Download references

Acknowledgements

Dr. Karen Byth, Consultant Statistician, Westmead Hospital WSLHD, for assistance with the statistical analysis of the data.

Mark Smith, Research and Development Manager, Research and Education Network, for assistance with the data procurement.

Researcher Education Committee, WSLHD Research Education Network, for organising, managing, and evaluating the researcher education lecture series.

Funding

Salaries for the authors and incidentals (printing, postage, and phone calls) were provided by NSW Health.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Author information

Authors and Affiliations

Authors

Contributions

MM completed the background research and developed the questionnaire, analysed and interpreted the participant data, and was a major contributor in writing the manuscript. AB guided development of the research study, questionnaire, and protocol, and was a major contributor in writing the manuscript. TS supervised the entirety of the research and was a major contributor in writing the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Michelle McNab.

Ethics declarations

Ethics approval and consent to participate

The study had full ethics approval from the Western Sydney Local Health District HREC LNR/16/WMEAD/457. Attendees at any part the lecture series and who consented to follow up contact were asked to participate in the study. If interested, participants were required to read the participant information form and written consent was provided by clicking “agree” to participate in the study, which was approved by the ethics committee.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

McNab, M., Berry, A. & Skapetis, T. The potential of a lecture series in changing intent and experience among health professionals to conduct research in a large hospital: a retrospective pre-post design. BMC Med Educ 19, 124 (2019). https://0-doi-org.brum.beds.ac.uk/10.1186/s12909-019-1548-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12909-019-1548-4

Keywords