Development of a scale to evaluate medical professional identity formation

Abstract

Background

Medical educators now focus on professional identity formation (PIF), which is a process of psychological development and socialization in the community of practice. This study aimed to develop an instrument to evaluate PIF that can be applied to a large group of medical trainees.

Methods

A self-administered questionnaire was created with items on priorities, behavior standards, attitudes, and emotional control of well-developed physicians, in addition to items on their background and experience in playing the role of a physician. The participants were divided into four respondent groups: 4th- and 6th-year medical students and 2nd-year residents at Kagoshima University, and experienced medical doctors (instructors).

Results

Using factor analysis of data from 318 respondents and respondent group comparison, a developing scale (DS) with 15 items was created.

The DS has a five-factor structure and evaluates self-control as a professional (factor 1), awareness of being a medical doctor (factor 2), reflection as a medical doctor (factor 3), execution of social responsibility (factor 4), and external and internal self-harmonization (factor 5). The mean DS score of the instructors was significantly higher than that of the residents (p < 0.01), the mean score of residents and instructors was significantly higher than that of students (p < 0.01), and the mean score of instructors was significantly higher than that of all other respondents (p < 0.01). Respondent group, but not gender, was a significant variable of the DS. The DS and scores of factors 2 and 4 correlated with 6th-year medical students’ experience in playing the role of a physician during clinical training, and scores of factors 3 and 4 correlated with 2nd-year residents’ experience in playing the role of a physician. There was no significant difference between the mean DS score of 4th- and 6th-year medical students, which might due to less clinical experience among 6th-year medical students or a limitation of the scale to evaluate pre-clinical medical students.

Conclusions

The DS could be a useful indicator of medical trainees’ personal and professional development and socialization. Experience in playing the role of a physician might facilitate medical trainees’ PIF.

Background

In recent years, medical educators have focused on the acquisition of professional identity, or professional identity formation (PIF), as a medical doctor [1,2,3,4,5] as the ultimate goal of medical education [6]. Most medical educators try to teach and assess medical trainees’ measurable behaviors under the framework of competency-based medical education [7]. Jarvis-Selinger described identity formation as an adaptive, developmental process that happens simultaneously at the individual and collective levels and involves psychological development and socialization of the person into appropriate roles and forms of participation in the community’s work [7]. Socialization in the community of practice and acceptance of professional values [8, 9] could be indispensable core features of PIF in medical education. However, medical students and residents face various experiences and difficulties in the process of PIF [4, 10,11,12,13,14,15,16], and it is important for medical educators to understand the PIF of learners in order to help them develop as medical professionals.

Previous research on medical students’ and residents’ values and attitudes used qualitative analysis of reflective writing and interviews. If medical educators intend to follow-up on an individual’s or group’s PIF, compare different groups, or evaluate medical educational programs from the standpoint of PIF, a quantitative assessment tool would be preferable and would broaden research possibilities.

A previous study indicated that Kegan’s human developmental model [17] could apply to medical professions and manifestation in a medical context was discussed [4, 7, 15]. Kegan’s model, which was based on Piaget [18] and other developmental theories [19, 20], indicates a framework for the longitudinal psychological development of the self into a moral and meaning-making entity. Kegan proposed six stages from childhood stage 0 to adult life stage 5, and this life-span development is the process of PIF from self-centered identity to a moral identity characterized by the expectation of a profession [1]. Previous research suggests that medical students and young trainees could be between Kegan’s stages 2 to 4. People at stage 4 understand relationships in terms of different values and expectations, become self-reflective, incorporate external professional values as internal values, and demonstrate reason in full control over emotions. Not all people reach stage 5, and those at stage 5 do not perceive themselves as having a single identity and are open to other influences. An evaluation scale could be developed using items on well-developed (stage 4 and higher) professional attributes as indicators.

The purpose of this study was to develop an instrument to evaluate the degree of maturation, socialization, and acceptance of professional values, which comprise the core features of PIF, and that can be applied to a large group of medical trainees.

Methods

Assessing whether an individual has the core features of PIF requires the evaluation of his/her consistent demonstration of the attitude, values, and behaviors expected of one who has come to think, act, and feel like a physician [21]. The process of developing a scale to evaluate the core features of PIF is based on the following three principles:

1) as demonstrated in a previous cross-sectional qualitative study on military PIF [22], medical trainees’ attitudes and values might develop into those of advanced professionals as their level of education and clinical experience increase, even though trainees in the same program are expected to be at various stages of the PIF process.

2) Respondents’ answers to items on a scale asking about their habitual behaviors, experiences, and recognition and priorities in daily life and in specific situations reflect their conscious and unconscious attitudes and values.

3) One scale that consists of items that estimate the degree of maturation and socialization could evaluate medical trainees’ PIF.

Attitudes and values to be measured and initial item development

One scale to assess the overall degree of PIF was created, according to descriptions of medical trainees’ personal characteristics and behaviors or attitudes manifested in a professional context based on previous studies [7, 15]. This scale was named the developing scale (DS) because it quantifies the state of individual maturation and professional development.

To develop the DS, items describing emotional control in several situations, recognition of professional role, internalization of external values and social requirements, daily reflection and self-evaluation behaviors which would be expected of medical doctors at higher stages of professional development were created. In addition, items evaluating preferences regarding social inclusion, which is typically seen between Kegan’s stage 3 and 5, and items describing stage transition were also included. Since lack of control of emotions and prioritizing one’s own needs and interests (stage 2-specific attributes) should not be characteristics of well-developed professionals, reverse scoring for such candidate items was applied for the DS. Initially, 51 items were listed, and then 31 generally applicable items covering various perspectives of well-developed professional attributes manifested in professional contexts and daily life, consisting of emotional control (3 items), recognition and persuasion of professional role (4 items), internalization of external values and social requirements (8 items), daily reflection and evaluation (5 items), social inclusion (8 items), and stage transition (3 items), were extracted and rewritten for the DS.

A self-administered anonymous questionnaire was created with these items. Each item was scored on a 7-point Likert scale that ranged from 1 (completely inapplicable) to 7 (greatly applicable), and 4 was neutral. Fifteen of the 31 items were reversely coded for data analysis.

The questionnaire also asked about demographic characteristics (gender, age), as well as work experience and position for instructors. Four items for 6th-year medical students and residents asked about experience in playing the role of a physician.

Data collection

From July 2016 to March 2018, the printed questionnaire was distributed by hand to 4th-year medical students about to start their clinical clerkship courses, to 6th-year medical students who finished 1.5 years of all clinical clerkship courses, and to residents in the last month of the 2-year residency program at Kagoshima University. The questionnaire was also distributed by mail to experienced medical doctors working in community hospitals or private clinics in Kagoshima Prefecture who engaged in undergraduate medical education as senior instructors in January 2017. This study was approved by the Graduate School of Medical and Dental Sciences, Kagoshima University (No. 629 July 15, 2016, No. 666 November 18, 2016).

Data analysis for scale development

Exploratory factor analysis with promax rotation and Cronbach’s alpha was carried out to elucidate the proper item set for the DS using items in which instructors obtained the highest mean score among the four respondent groups, which were viewed as essential items for evaluating PIF.

After items for the DS were fixed, the total and factor scores of the DS in the four respondent groups were analyzed to confirm that the scales could differentiate between different groups at different developmental stages. Also, influential factors for the DS, such as age, gender, and experience in playing the role of physician were analyzed.

SPSS version 23. (IBM, New York, NY) was used for all data analyses and calculation of DS factor scores.

Results

Demographic characteristics of the respondents

First, data from 14 respondents (five 4th-year medical students, seven 6th-year medical students, two 2nd-year residents) who chose option 4 (neutral) as the response for 27 items or more (87%) or for 23 sequential items (74%) were excluded as invalid data. A total of 322 respondents (response rate 53.7%) (118 4th-year medical students (47.8%) and 120 6th-year medical students (51.5%) at Kagoshima University School of Medicine, 47 2nd-year residents (73.4%) at Kagoshima University Hospital, and 37 medical doctors (66.1%) at community hospitals and private clinics who served as instructors for medical students) returned the questionnaire with valid responses for analysis. The mean ages of 4th-year medical students, 6th-year medical students, residents, and instructors were 24.2, 25.4, 29.7, and 55.2 years, respectively (Table 1). The ratio of male to female respondents was 1.20 for 4th-year medical students, 1.13 for 6th-year medical students, 2.46 for residents, and 11.3 for instructors, while nine respondents did not provide gender information. The mean length of clinical experience among instructors was 29.3 years (standard deviation 6.2 years, range 15–40 years).

Table 1 Demographic data of the respondents analyzed in this study

DS development

Among the 31 items, instructors had the highest mean scores for 18 items. Combining these 18 items with items describing attributes of stage 4 and 5 and reversely coded items for stage 2, 28 items were used for the next step, and 15 items became possible DS items based on exploratory factor analysis and reliability analysis (Table 2).

Table 2 Items used for the developing scale, and mean item scores for each respondent group

The Kaiser-Meyer Olkin Measure of sampling adequacy for the 15 items was 0.738 and Barlett’s test of sphericity was statistically significant (Chi-square = 932.51, df = 105; p < 0.01), suggesting that there was appropriate common variance and these items were interrelated. Exploratory factor analysis of these items using the scores of 318 respondents indicated a five-factor structure. The initial eigenvalues for factors 1 to 5 were 3.29, 2.20, 1.33, 1.05, and 1.03, respectively. The percentages of variance for factors 1 to 5 were 21.9, 14.7, 8.9, 7.0, and 6.9%, respectively. All items had a component coefficient over 0.4, and the cumulative percentage of all five factors was 59.3%. Cronbach’s alpha of the 15 items was 0.72.

Promax rotated pattern matrix coefficients are shown in Table 3. The names of the five factors were as follows: factor 1: self-control as a professional, factor 2: awareness of being a medical doctor, factor 3: reflection as a medical doctor, factor 4: execution of social responsibility, and factor 5: external and internal self-harmonization. Each factor score was computed using factor loadings and respondents’ scores of all 15 items, and the mean of each factor was standardized to be 0 and the variance was set to 1. Factor scores for each respondent group are shown in Table 4.

Table 3 Pattern matrix components of the five factors of the developing scale after factor analysis using Promax rotation with Kaiser normalization

Table 4 Factor scores of the developing scale for each respondent group

Comparison of DS scores by respondent group

Figure 1 shows the DS score distribution for each respondent group.

Fig. 1

Score distribution of the developing scale (DS) in each respondent group. The DS consists of 15 items (Table 2) scored on a seven-point Likert scale that ranged from 1 (completely inapplicable) to 7 (greatly applicable), and 4 was neutral. The number of respondents (N) and total DS scores ranging from 45 to 100 for each respondent group (4th-year preclinical medical students, 6th-year medical students who finished 1.5 years of all clinical clerkship courses, 2nd-year residents, and medical doctors working in community hospitals or private clinics in Kagoshima Prefecture who engaged in undergraduate medical education as senior instructors [clinical experience mean 29.3, SD 6.2 years]) are shown. N: number of respondents; DS: developing scale; SD: standard deviation

The mean DS score of the instructors was significantly higher than that of the residents (p < 0.01), the mean score of residents and instructors was significantly higher than that of students (p < 0.01), and the mean score of the instructors was significantly higher than that of all other respondents (p < 0.01). The number of respondents with a total score of 81 or higher was 10 (8.7%) for 4th-year medical students, five (4.2%) for 6th-year medical students, eight (17.0%) for residents, and 14 (37.8%) for instructors. The number of respondents with a total score of 91 or higher was none for 4th- and 6th-year medical students, one (2.1%) for residents, and three (8.1%) for instructors. The number of respondents with a total score of 60 or less was 19 (16.5%) for 4th-year medical students, 20 (16.8%) for 6th-year medical students, three (6.4%) for residents, and none for instructors.

Univariate analysis of variance of the DS score indicated that respondent group was a significant independent variable (p < 0.01), but gender was not. Univariate analysis of variance of the DS score in each respondent group indicated that gender and age were not significant independent variables in the four respondent groups, with the exception of age (p < 0.05) in 4th-year medical students.

Experience in playing the role of a physician and DS and factor scores

Table 5 shows the mean scores of the four items related to role recognition (experience in playing the role of a physician and recognition as a physician by others, such as patients and families, senior physicians and supervisors, and nurses and other staff) for 6th-year medical students and residents.

Table 5 Scores of four items related to role recognition of 6th-year medical students (number of respondents was 118) and 2nd-year residents (number of respondents was 47), and correlation with developing scale score and factor scores

Correlation coefficients between those scores and the DS or the five factor scores indicated weak but significant correlations between 6th-year medical students’ scores and factors 2 and 4, and a strongly significant correlation between residents’ scores and factors 3 and 4.

Discussion

This study attempted to develop an instrument to evaluate the degree of personal maturation and professional development in terms of socialization. The DS was designed to evaluate attributes of personally and professionally developed medical trainees and instructors received higher scores.

Exploratory factor analysis of the DS indicated a five-factor structure that explained 59% of the variance, and all five factors were included at the initial phase of item development as anticipated attributes of medical doctors.

The first factor of the DS, self-control as a professional, consisted of items describing uncontrolled emotional or irrational reactions in various situations and is typically seen in a person at Kegan’s stage 2 [17]; this factor was reversely scored for the DS. A previous qualitative study reported that medical students’ reflection on emotional experiences in the first clinical year related to rapid professional development [10], and managing emotions is one of the core components of emotional intelligence. Emotional intelligence is known as a key element of professionalism in health professionals [23,24,25,26], and emotional control is one of the dimensions of resilience that might be another anticipated attribute of health professionals [26, 27].

Scores of the second factor, awareness of being a medical doctor, were significantly higher for residents and instructors than medical students. This result is compatible with the fact that residents and instructors are socially approved licensed doctors in Japan, and indicates that formal qualification is not completely but closely related to actual behavior (item No. 7, 14) and recognition of professional identity (item No. 8).

The third factor, reflection as a medical doctor, indicated attitudes of self-evaluation based on external (patients’ perspectives, item No. 9) and internal values (item No. 11) and long-term significance (item No. 10) of one’s own behavioral standards. The fourth factor, execution of social responsibility, indicated that people obtain social perspectives. The third and fourth factors describe the attributes of autonomous reflective learners and social advocates that are essential for well-developed professionals.

The fifth factor, external and internal self-harmonization, consisted of items describing attributes seen at stage transition and were reversely scored for the DS. High scores in this factor indicated complete integrity of self and external values that characterize a person at Kegan’s stage 5 [17]. Professional trainees must face conflicted values and need to make adjustments throughout the process of PIF [28,29,30], and medical students and residents experience a mismatch between what they do and who they are [15, 31,32,33,34].

Holden et al. developed a six-domain framework of PIF for medical education [35]. The DS items and factors are related to Holden et al.’s five domains of personal characteristics, duties and responsibilities, habits, relationships, and perception and recognition. Since DS score increased as medical training advanced, the DS might serve as a measure of the essential elements of professional medical doctors.

Age, one of the indicators of personal maturation, was related to DS score in 4th-year medical students, but not in more advanced medical trainees and experienced physicians. The DS might evaluate personal development indicated by age before starting clinical training. After that, the DS may evaluate personal and professional development related to clinical experience.

The five factor scores indicated that attributes were not simultaneously developed. Interestingly, 6th-year medical students’ experiences in playing the role of a physician during clinical clerkship courses might induce awareness of being a medical doctor, while residents’ role experiences might facilitate reflection as a medical doctor and execution of social responsibility. Authentic and appropriate professional role experience is a well-known facilitator of PIF [8, 9, 16]. The present results suggest that the impact of experience in playing the role of a physician varies for medical trainees depending on different phases of PIF, and the DS and factor scores could be useful indicators of PIF.

Limitations

Theoretical scale development using qualitative research data and group comparison were used for the DS validation. To clarify that the degree of personal maturation and professional development evaluated by the DS actually expresses the process of PIF, follow-up study of the same respondents is required.

In this research, the DS scores were not significantly different between 4th- and 6th-year medical students. It is well known that an individual’s role in society, or their work identity, facilitates professional identity construction [11, 36]. Sixth-year medical students might not have sufficient clinical experience to show apparent development from 4th-year medical students. In addition, 4th-year medical students responses might be incorrect or different from other respondents because their clinical experiences, such as observation and shadowing, do not require them to exercise clinical responsibility or manage conflict in clinical practice. Conformity of the target group with different experiences also needs to be analyzed to confirm the DS.

All items were written in Japanese and all respondents were located in Kagoshima, Japan. There is a possibility that some of the items may not be appropriate in other cultures. Further research with people in other locations is required.

Conclusions

This is the first report to develop a scale that quantitatively evaluates young medical trainees’ PIF. The DS has a five-factor structure and evaluates self-control as a professional, awareness of being a medical doctor, reflection as a medical doctor, execution of social responsibility, and external and internal self-harmonization. Experience in playing the role of a physician might facilitate medical trainees’ PIF.