Skip to main content
  • Research article
  • Open access
  • Published:

Validation of the Physician Teaching Motivation Questionnaire (PTMQ)

Abstract

Background

Physicians play a major role as teachers in undergraduate medical education. Studies indicate that different forms and degrees of motivation can influence work performance in general and that teachers’ motivation to teach can influence students’ academic achievements in particular. Therefore, the aim of this study was to develop and to validate an instrument measuring teaching motivations in hospital-based physicians.

Methods

We chose self-determination theory as a theoretical framework for item and scale development. It distinguishes between different dimensions of motivation depending on the amount of self-regulation and autonomy involved and its empirical evidence has been demonstrated in other areas of research. To validate the new instrument (PTMQ = Physician Teaching Motivation Questionnaire), we used data from a sample of 247 physicians from internal medicine and surgery at six German medical faculties. Structural equation modelling was conducted to confirm the factorial structure, correlation analyses and linear regressions were performed to examine concurrent and incremental validity.

Results

Structural equation modelling confirmed a good global fit for the factorial structure of the final instrument (RMSEA = .050, TLI = .957, SRMR = .055, CFI = .966). Cronbach’s alphas indicated good internal consistencies for all scales (α = .75 – .89) except for the identified teaching motivation subscale with an acceptable internal consistency (α = .65). Tests of concurrent validity with global work motivation, perceived teaching competence, perceived teaching involvement and voluntariness of lesson allocation delivered theory-consistent results with slight deviations for some scales. Incremental validity over global work motivation in predicting perceived teaching involvement was also confirmed.

Conclusions

Our results indicate that the PTMQ is a reliable, valid and therefore suitable instrument for assessing physicians’ teaching motivation.

Peer Review reports

Background

In its history, education in general and medical education in particular experienced a shift from teacher-centered learning formats - such as lectures - to student-centered forms of learning - such as problem-based-learning [1, 2]. Research in medical education reflects this development with one major focus being on student outcomes and a recent claim for a stronger additional consideration of patient outcomes [3, 4]. Motivational theories with broad empirical support and great influence in the recent decades, such as the social cognitive theory and the self-determination theory, imply that motivation influences task selection, persistence and performance [5, 6]. When students’ learning progress is regarded as an aspect of teaching performance, these theories suggest that not only students’, but also teachers’ motivation might be important to ensure successful student learning. In general, studies from undergraduate education research have demonstrated effects of teacher characteristics on student achievement [7, 8]. More specifically, teachers’ autonomous teaching motivation can also enhance autonomous learning motivation in their students [911], and students’ autonomous learning motivation can positively affect academic performance [12].

However, modern medical curricular developments focus predominantly on students’ cognitive and metacognitive regulation than on enhancing motivation [13]. Teachers’ motivations seem to be even more underrepresented in medical education development and research. In a review of 53 papers concerning faculty development initiatives [14], only four mentioned the assessment of teaching motivation or “enthusiasm”, as an outcome variable [1518]. Furthermore, no validated instrument is currently available to specifically assess physicians’ teaching motivations in undergraduate medical education. In contrast, a review of 68 mostly descriptive articles regarding the characteristics of good clinical teachers in medical education found “demonstrat(ing) enthusiasm for teaching” in 18 articles and as the fifth most frequently mentioned category [19]. Furthermore, we assume in the context of motivation theories that other teacher characteristics described in these studies like “being accessible to students”, “demonstrating commitment to teaching improvement” or “maintaining positive relationships with students” also constitute expressions of teaching motivation.

Self-determination theory

As a theoretical framework for the construction of our teaching motivation questionnaire, we chose the self-determination theory (SDT). It is a macro-theory postulating a multidimensional view of motivation including its antecedents and its consequences across different life domains and currently represents one of the most recognized motivational theories in psychology [6]. SDT distinguishes between three major types of motivation depending on the level of self-regulation and autonomy, respectively, involved. Firstly, intrinsic motivation represents the type of motivation with the highest self-regulation. It gives rise to actions which are done out of pure interest or joy and which are non-instrumental in nature. Secondly, extrinsic motivation comprises three different types of motivation, external regulation, introjected regulation, and identified regulation, whose conjoint characteristic is that related actions are not carried out for the action itself but are instrumental in nature. Thirdly, amotivation is defined as the absence of motivation. With respect to the second category, external regulation represents the least self-regulated subtype of extrinsic motivation and refers to activities solely conducted to obtain rewards or to avoid punishments. Introjected regulation refers to activities with which someone does not completely identify and which are regulated by internal pressures, such as feelings of guilt and shame. Identified regulation refers to actions based on personal values and beliefs. While introjected regulation is accompanied by a feeling of being controlled by internal pressures, identified regulation represents voluntary behaviours driven by conviction.

According to SDT, the more self-regulated an action is, the higher the invested efforts as well as the well-being of the acting person will be. In accordance with these theoretical considerations, empirical findings from the field of work psychology show that more self-regulated types of motivation, especially intrinsic motivation, predict better performance, greater commitment, and more job satisfaction [20]. Furthermore, SDT postulates that motivation types are not static, but permeable. Internalization describes the process of adopting and integrating extrinsic motifs into one’s own individual set of values and thus, achieving a higher level of self-regulation. According to SDT, environments that provides opportunities for experiencing autonomy, competence and social relatedness can facilitate this process as these three factors constitute basic human needs and are important predictors of motivation [6].

The potential of SDT for improving medical education for students as well as faculty staff was acknowledged by Ten Cate et al. who promote a stronger consideration of its principles in the medical curriculum and in faculty development under consideration of educators’ needs [21]. Therefore, the aim of our study was to develop and validate an instrument to detect physicians’ teaching motivation. As modern concepts of validity refer to “the degree to which evidence and theory support the interpretations of test scores entailed by proposed uses of tests” [22], we wished to develop an instrument as specific as possible for teacher-related situations such as the evaluation of faculty development programs or finding incentives for teaching with the aim to provide high-quality teaching.

Methods

In classical conceptualizations, validity has been defined as three separate types, content, construct and criterion validity [23]. For this study, we defined validity following modern conceptualizations in which validity is a unitary concept with construct validity as a core, deriving validity evidence from several sources such as assessments of content validity, the response process, the internal structure of the instrument, its relationships to other variables and its consequences [22, 24]. For this study, we focused on a careful development of the items to ensure content validity. The response process was analysed with participants of the target group. The internal structure was assessed with respect to dimensionality and scale reliabilities. The relationship to other variables was assessed in terms of convergent validity, concurrent criterion validity and incremental concurrent validity over global work motivation. The consequences of testing are discussed in the context of the fields of usage for our instrument.

Development of the PTMQ (Physician Teaching Motivation Questionnaire)

In a first step, we developed items for the intrinsic motivation (12 items), identified regulation (four items), introjected regulation (seven items), external regulation (12 items) and amotivation (five items) subscales. Item development occurred theory-driven based on the definitions of the motivational categories as proposed by SDT [6]. The items for external regulation included three items for career motifs, eight items for social regulation and one item, which did not fit either category but was assumed to constitute an important external motif (“I mostly teach because it belongs to my scope of duties”). As a stem, we used “Please state in how far the following statements with potential reasons to participate in teaching apply for you.” Most items began with “I teach because…” followed by a specific reason that matched the underlying motifs of the subscales. A five-point Likert-scale of agreement was used for the rating of these items from “does not apply at all” (=0) to “fully applies”(=4). A modification of item construction was necessary in several cases. All items for amotivation were formulated starting “I teach although…” (e.g. “I teach although I hardly ever feel like doing it”). While SDT defines amotivation as the absence of motivation and therefore the absence of reasons to do a task, we also formulated items that express a stronger sense of aversion towards teaching. Furthermore, we did not include “I teach, because…” in several items for the intrinsic motivation subscale, when the statement itself already expressed intrinsic motivation, e.g. “I enjoy trying new teaching methods”.

In the next step, we conducted a cognitive debriefing with three physicians working in the Department of Internal Medicine at the University Medical Center Hamburg-Eppendorf to analyse the response process and to further enhance content validity. First, participants filled out the preliminary questionnaire and discussed the comprehensibility of all items. One item for amotivation had to be reformulated. Afterwards, the underlying theoretical framework of the questionnaire was presented and a group discussion was initiated about the items’ adequacy as representations of this framework. Three items for external regulation, which refer to teaching as a work task, were reformulated as participants noted that teaching is part of their implicit or explicit work obligations, so they would have to agree completely which would result in biased values. During the discussion, we agreed with the participants to add “mostly” to these items, e.g. “I teach mostly because teaching is a part of my work tasks.” As a result, all items were found to be comprehensible as well as representative of their theoretical constructs and the domain of work at a university hospital.

SDT also postulates the existence of a motivational category called integrated regulation as a subtype of extrinsic motivation that ranges between identified and intrinsic regulation with respect to the level of self-regulation. Several authors of other instruments based on SDT have refused to include this category [11, 25, 26] because of dissatisfying results of factor analyses where integrated regulation lacked statistical discriminability from intrinsic and identified regulation [27, 28]. Therefore, we did not develop items for this category. The item order of the questionnaire was determined using a random number generator in SPSS.

Further instruments and materials

Global work motivation

We assumed that task-specific motivation, in this study teaching motivation, and global motivation reflecting the same domain (i.e. work) should correlate positively. Therefore, corresponding task-specific teaching motivation scales should correlate with global work motivation scales as teaching motivation represents a part of global work motivation. In order to test this, we included the German version of the Multidimensional Work Motivation Scale (MWMS; [25]) in our questionnaire. The MWMS is a 19-item instrument also based on SDT and has been validated in seven languages and nine countries. Confirmatory factory analyses showed the same factorial structure across all countries, resulting in the subscales intrinsic, identified, introjected, external motivation and amotivation, with external motivation being a higher order factor comprising the subordinate factors extrinsic social and extrinsic material. Internal consistency is good to excellent in all subscales (α = .70 – .94), except for the subscales identified (α = .65) and introjected (α = .55) in the German samples.

For further criterion validation, we included two constructs supported by SDT into the questionnaire: teaching self-efficacy as a theoretic predictor of motivation and teaching involvement as a theoretic outcome of motivation. Since a literature search for validated instruments aimed at hospital-based physicians yielded no results, we developed new scales for both constructs.

Teaching self-efficacy (TSE)

While SDT defines “perceived competence” to be one of the basic human needs giving rise to autonomous motivation, we decided to employ an instrument measuring “self-efficacy”, which is a central construct in the social cognitive theory referring to “beliefs in one’s capabilities to organize and execute the courses of action required to produce given attainments” [29]. While both constructs aim at the belief in one’s ability to master a certain task, perceived competence in SDT stresses the personal meaningfulness and importance of a task from which a person’s need satisfaction depends on [30]. As we assume that physicians rate their personal importance of teaching very differently and that both constructs share a great overlap, we chose to assess self-efficacy for this validation study. Self-efficacy scales have been developed across a wide range of subjects in psychology including teachers’ self-efficacy [31, 32]. In order to assess TSE, we followed Bandura’s guidelines for the construction of scales measuring self-efficacy [33]. Following Bandura’s recommendation to let participants rate their competences when facing difficult and specific situations, we formulated 16 items that represent typical critical situations regularly faced by medical teachers, e.g. time strain, problems with patients and patient selection, interruptions, short-term allocation of teachers to lessons or demotivated students [3438]. A five-point Likert-scale of agreement was used for the rating of these items. Included items were, for example: “Even when I feel stressed or when I am in a bad mood, I teach well” and “Even when students seem tired or demotivated I succeed in motivating them with my teaching”. In the sample of this study, the TSE scale showed a good internal consistency (Cronbach’s α = .87).

Perceived teaching involvement (PTI)

We defined PTI as the endeavour to utilize personal behavioural and cognitive resources actively to achieve good teaching performance. Following our definition, we constructed 15 statements about engaging behaviourally and/or cognitively in teaching before, during and after a lesson indicating efforts to provide high quality teaching, e.g.: “I try to prepare each lesson carefully” and “It is very important for me to provide good teaching”. Our indicators of PTI where partly taken from literature [19] and partly from our own comprehensive practical experience in medical teaching. A five-point Likert-scale of agreement was used for the rating of these items. In the sample of this study, the PTI scale showed a good internal consistency (Cronbach’s α = .87).

Lesson allocation

We further assumed that physicians who voluntarily choose to be involved in teaching show higher values in intrinsic and identified teaching motivation and lower values in external teaching motivation and amotivation in comparison to teachers who were are allocated by coordinators with or without having been asked. Therefore, we asked how allocation to teaching had primarily occurred within the last year. Options for answering were “I applied voluntarily for teaching”, “I was asked whether I would like to take over teaching lessons”, and “I was allocated to teaching lessons without being asked”.

As socio-demographic characteristics, age, gender, occupational position, medical specialty, teaching experience in years, occupational position and status of postdoctoral lecture qualification were gathered. The final questionnaire was distributed in a paper-pencil version to 645 clinical teachers form the departments of internal medicine and surgery who are mostly involved in bedside teaching. At German University Medical Centers, professors, consultants, and all residents are involved in clinical teaching independently of their intended career paths. The Ethics Committee of the Hamburg Chamber of Physicians confirmed the innocuousness of this study and its congruence with the Declaration of Helsinki.

Data analysis

Data preparation

All Likert scales in the following statistical analyses were treated as interval scales [39]. Missing values in the PTMQ, the MWMS as well as the PTI and TSE scales were replaced using the EM-algorithm in SPSS if at least 90 % of answered items in the respective scale were present per participant. When only a smaller percentage of answered items was present in the respective scale, questionnaires were excluded from calculations involving the respective scale.

Item selection and factorial validity

To select items and to test the assumed factorial structure of our instrument, we performed structural equation modelling (SEM) in SPSS AMOS® 22 using maximum likelihood estimation based on the covariance matrix of the items. The presupposition of univariate normal distribution of the PTMQ items was tested based on the recommendations of West et al. [40]. None of the items exceeded a skewness >2 (range from −1.297 to 1.357) and a kurtosis >7 (range from -.934 to 3.266). All tested models were recursive without allowing correlated error variances. Intercorrelations of all factors were allowed. In order to determine the best items for each factor, backwards elimination was used; items were eliminated subsequently if they did not meet the following criteria: factor loadings >.05 and low cross-loadings on other factors. To assess global model fit, the Root Mean Square Error of Approximation (RMSEA), the Standardized Root Mean Square Residual (SRMR), the Tucker-Lewis Index (TLI) and the Comparative Fit Index (CFI) were calculated. Recommended cut-off-values for the RMSEA range from <0.05 to <0.08, for the SRMR from <0.05 to <0.08 and for the CFI and the TLI from ≥0.95 to ≥0.80 (most strict recommendations presented first; [41]). For the assessment of local goodness-of-fit, factor loadings and indicator reliabilities (squared factor loadings) were calculated.

Scale characteristics

Means, standard deviations, intercorrelations and internal consistencies using Cronbach’s α were calculated for the final scales. Internal consistencies were evaluated using the recommendations according to Kline (α ≥0.9 = excellent; 0.7 ≤α <0.9 = good; 0.6 ≤α <0.7 = acceptable; 0.5 ≤α <0.6 = poor; α <0.5 = unacceptable) [42].

Criterion validity

We calculated bivariate correlations of the PTMQ scales with the MWMS scales, the PTI scale, and the TSE scale. Furthermore, a stepwise linear regression with forward selection of the PTMQ scales on PTI was calculated. In order to determine the incremental validity of the PTMQ over global work motivation, we also calculated bivariate correlations of the MWMs scales with PTI and TSE and conducted a stepwise linear regression with forward selection of the MWMS scales on PTI. In order to assess differences of the PTMQ scales dependent on lesson allocation, we first consolidated the two categories “I was asked whether I would like to take over teaching lessons” and “I was allocated without being asked” and compared their means against the category “I applied voluntarily for teaching” using t-tests for independent groups.

Results

Sample

Of the 645 distributed questionnaires, 247 were returned resulting in a response rate of 38.3 %. The characteristics of the sample are displayed in Table 1. Three participants answered less than 90 % of the PTMQ items, four participants of the MWMS items, two participants of the PTI items and nine participants of the TSE items and were therefore excluded from calculations involving the respective scale.

Table 1 Characteristics of the study sample

Factorial structure

Following the structure of the MWMS, we primarily set up a model with the five main factors intrinsic teaching motivation (IntrinsicTM), identified teaching motivation (IdentifiedTM), introjected teaching motivation (IntrojectedTM), the first order factor external teaching motivation (ExternalTM_Model1) and teaching amotivation (TAmotivation). ExternalTM_Model1 comprised a second order factor for external-career teaching motivation (ExternalCareerTM_Model1) and a second order factor for other external items (ExternalOtherTM_Model1) including socially motivated teaching motivation. This resulted in four items for IntrinsicTM, three items for IdentifiedTM, two items for IntrojectedTM, and six items for ExternalTM_Model1 comprising three items for ExternalCareerTM_Model1 and ExternalOtherTM_Model1, respectively (Model 1). However, in this model ExternalCareerTM_Model1 showed a low factor loading of .37 on the first-order factor, while ExternalOtherTM_Model1 displayed a factor loading of 1.00 on the first-order factor. Therefore, we set up a second model with career teaching motivation (CareerTM, formerly ExternalCareerTM_Model1) as a distinct factor and ExternalTM (formerly ExternalOtherTM_Model1) as another distinct factor resulting in six first-order factors (Model 2, see Fig. 1).

Fig. 1
figure 1

Factorial structure of the PTMQ: Factor loadings and indicator reliabilities

As shown in Table 2, Model 2 shows better values for all global goodness-of-fit indicators compared to Model 1. Furthermore, as all global indicators suggest that it is consistent with the observed data, Model 2 was retained as the final structure of the PTMQ. The final items of the PTMQ are provided in Table 3.

Table 2 Global goodness-of-fit indicators for the two tested models
Table 3 PTMQ items, means, standard deviations, skewness and kurtosis

When excluding CareerTM, all factors show their highest positive or least negative intercorrelations, respectively, with the factors closest to them in terms of amount of self-regulation, with decreasing positive or increasing negative intercorrelations, respectively, with factors more distinct in terms of self-regulation (Fig. 1). Deviating from this pattern, CareerTM only shows significant intercorrelations with its closest factors ExternalTM and IntrojectedTM, but no other significant intercorrelations. As for local goodness-of-fit, indicator reliabilities range from .26 until .96 with three items showing values <.40 (items 6 and 6 from the IdentifiedTM factor and item 14 from the ExternalTM factor; Fig. 1). All factor loadings were highly significant (p <.001).

Scale characteristics

Table 4 presents the means, standard deviations, intercorrelations, and internal consistencies of the PTMQ scales. IdentifiedTM shows the highest means in our sample, followed by IntrinsicTM. IntrojectedTM and TAmotivation show the smallest means. All internal consistencies except for the IdentifiedTM scale are good as indicated by Cronbach’s α, while IdentifiedTM shows an acceptable internal consistency. The intercorrelations between the scales show the same pattern as the factor intercorrelations.

Table 4 Means, standard deviations, intercorrelations and internal consistencies of the PTMQ scales

Convergent validity with global work motivation

As shown in Table 5, IntrinsicTM, CareerTM and TAmotivation have their highest positive correlations with those scales of the MWMS which correspond in terms of content. IdentifiedTM shows the highest correlation with the intrinsic subscale of the MWMS, IntrojectedTM with the external-material subscale of the MWMS, and ExternalTM with the external-material subscale of the MWMS.

Table 5 Correlations of 1. the PTMQ scales with the MWMS scales, PTI and TSE and 2. the MWMS scales with PTI and TSE

Concurrent criterion validity

The more the subscales of the PTMQ represent a self-regulated type of motivation, the higher positive correlations they show with PTI. In contrast, IntrojectedTM, ExternalTM, and TAmotivation show higher negative correlations the less these subscales represent a self-regulated type of motivation as postulated by SDT with the exception of CareerTM, which shows no significant correlation with PTI. The same pattern can be found for TSE with smaller correlations. In contrast, the MWMS scales show either lower or non-significant correlations with both PTI and TSE.

A stepwise multiple regression of PTI on the PTMQ scales with forward selection shows significant positive β-coefficients for IntrinsicTM and IdentifiedTM (Table 6). These two variables together explain 34.8 % of the variance in PTI as derived from the corrected R2. A stepwise multiple regression of PTI on the MWMS scales with forward selection only shows a significant positive β-coefficient for the MWMS identified scale, explaining 8 % of the variance derived from the uncorrected R2.

Table 6 Stepwise multiple regressions with 1. PTI on the PTMQ scales and 2. PTI on the MWMS scales

With respect to lessons’ allocation, physicians who stated to have primarily applied voluntarily for teaching in the year prior to this study show significantly higher values in IntrinsicTM and IdentifiedTM and significantly lower values in ExternalTM and TAmotivation as hypothesized (Table 7). They also show significantly lower values in IntrojectedTM, but no significant differences were found for CareerTM.

Table 7 T-tests of means in the PTMQ scales dependent on lesson allocation

Discussion

Since our initial literature search resulted in no validated instruments for the teaching motivation of hospital-based physicians, we developed and validated a new instrument, the Physician Teaching Motivation Questionnaire (PTMQ). It is based on the multidimensional conceptualization of motivation described by the self-determination theory [6]. The PTMQ’s factorial structure, its reliability, concurrent criterion validity and incremental validity support its suitability to assess physicians’ teaching motivation. Subsequently, we will discuss specific results und issues related to the PTMQ’s validation.

All global goodness-of-fit indicators suggest a good fit of the factorial structure of the PTMQ with the data. However, as item selection and the assessment of the fit indicators were conducted with the same sample and method, the factorial structure should be examined in further samples.

Cronbach’s alphas indicate good internal consistencies for all scales except for IdentifiedTM whose internal consistency must be denoted as “acceptable” following a standard classification recommendation [35]. However, our analyses of criterion validity indicate that the IdentifiedTM scale is nevertheless useful and in compliance with SDT. Also in compliance with SDT, bivariate correlations show positive and the second highest correlations with PTI and TSE, respectively, after IntrinsicTM. Furthermore, the regression analysis shows that IdentifiedTM adds incremental variance over IntrinsicTM to the explanation of PTI. The means of the PTMQ were highest for IdentifiedTM, followed by IntrinsicTM and lowest for IntrojectedTM and TAmotivation. This structure was also found for global work motivation measured by the MWMS in five of seven samples with different languages and countries [22]. Furthermore, the MWMS subscales show descending means depending on the degree of self-regulation of the subscale. With the exception of a low mean for IntrojectedTM and the highest mean for IdentifiedTM, we also found descending means from the higher self-regulated subscales to TAmotivation.

With respect to convergent criterion validity, all scales of the PTMQ show their highest or second highest correlations with the respective MWMS scales. As for criterion validity, they also show patterns of correlations with PTI and TSE that are consistent with SDT, with the exception of CareerTM. Furthermore, the type of lesson allocation is associated with the motivational dimensions as hypothesized. No association was found for CareerTM.

As an indicator of incremental validity, our results show that the PTMQ is far superior in predicting teaching involvement and that it shows higher and/or significant correlations with perceived teaching competence in comparison to global work motivation (MWMS). The fact that only two of our six teaching motivation scales contribute significantly to variance explanation in our criteria can be explained by the high intercorrelations of our factors. While the use of only seven items to predict teaching involvement is economic, this also raises the question how useful the other scales are and whether they are a necessary part of our newly developed instrument. This cannot be answered by our findings sufficiently. As other criterion variables could display considerable correlations, we recommend to use all scales. High scale intercorrelations were also found for measurements of global work motivation [25, 43]. However, in these validation papers, the instruments and their subscales were not validated using multiple regressions, so the results of our regression analysis cannot be compared.

While formulas have been suggested to calculate a relative autonomy index based on the substraction of values in the controlled and autonomous motivation subscales [44], little evidence for an underlying continuum structure was found in Rasch analyses [45]. Therefore, we do not recommend the consolidation of all subscales.

The PTMQ subscale CareerTM constitutes an exception in terms of its factor and scales intercorrelations as well as with respect to its criterion correlation patterns. Originally conceptualized as part of extrinsic teaching motivation and in consistence with this, it intercorrelates most highly with the ExternalTM factor of the PTMQ. However, our initial factor analysis indicated that it constitutes a separate factor. Furthermore, it shows no significant correlations with neither PTI nor TSE in contrast to the ExternalTM scale that correlates significantly negative with both criteria. An explanation for this deviation might be that career motivation is a multidimensional construct comprising underlying factors that include different degrees of intrinsic and extrinsic motivation, respectively. This assumption is supported by a study differentiating between intrinsic and extrinsic career motivation in which the number of publications of medical faculty members was positively associated with intrinsic career motivation and negatively associated with extrinsic career motivation [46]. Items for intrinsic career motivation included striving for personal challenge, increasing one’s knowledge and being given the opportunity to be creative and free of supervision, while extrinsic items included striving for money, social status and leadership. Therefore, it seems plausible that our items for CareerTM do not distinguish between intrinsic and extrinsic career motivations. The underlying antagonistic career motivations might neutralize each other, which could result in the missing relationships with other PTMQ scales as well as with PTI, TSE and lessons’ allocation. Another explanation for the deviating scale characteristics of CareerTM might be that career in our sample was not perceived as a motivating factor [35] as at German Medical Faculties in University Hospitals all residents are involved in clinical teaching independently of their intended career paths. Therefore, the intercorrelations between CareerTM, PTI, TSE and lesson allocation might be different in populations or academic cultures where financial or career-related incentives with respect to teaching are in effect.

The PTMQ might be a suitable instrument for adding an additional teacher-centred dimension to the evaluation of teaching in a clinical context as proposed by Ten Cate et al. [21]. It could be used especially for the evaluation of quality-ensuring and -enhancing measures such as new learning formats, new curricula, teacher trainings and other means of faculty development. Low levels of the autonomous subscales IntrojectedTM and IdentifiedTM and high levels of ExternalTM and TAmotivation will indicate deficits in the motivational status and detect the necessity to develop self-regulation-enhancing measures, which target the satisfaction of the basic needs as proposed by SDT, autonomy, perceived competence and relatedness. While the causality has yet to be clarified, examples of such measures related to basic need satisfaction were suggested by Engbers et al. [47]. Even if these or other measures might not immediately affect student evaluations, empirical findings show that this will increase the well-being of employees [6], which is an important factor to prevent issues such as burn-out [48]. Apart from the practical use of our questionnaire, we suggest to use it in research that is targeted at developing and evaluating autonomy-enhancing measures.

Limitations of this study

One important limitation of this study is that all data were collected cross-sectionally by means of self-reports which bears the risk of common method variance (CMV) issues. These can arise when participants of a study present the source for the independent and the dependent variables at the same time. While some authors argue that CMV issues are exaggerated [49], Richardson et al. found in a simulation study that even in the presence of CMV, “the absolute correction accuracy of all (control) techniques tended to be low“[50]. Apart from this, the fact that several of the correlations of the MWMS scales with PTI and TSE in our study were not significant indicates that our significant findings are less likely to be artefacts [50]. In general, there is good reason to assume that the subjectivity of our criteria due to self-report might be a smaller issue for TSE than PTI. Self-efficacy has been conceptualized as an explicitly subjective construct and numerous studies, including academic and general occupational contexts, prove its predictive value for performance as an outcome of motivation, independent from objective measures of competence [5157].

Furthermore, our PTI and TSE measuring instruments have not been validated beforehand. However, our literature search yielded no validated instruments measuring PTI and TSE in the field of medical education. It can be assumed that instruments aimed at measuring work-related global constructs such as commitment, turnover intention, emotional exhaustion or job effort are not suitable for relationship measurements with respect to specific occupational tasks like teaching. The low or non-significant correlations, respectively, of the MWMS scales – although the MWMS has been validated profoundly across several countries – with the PTMQ underscore the necessity of instruments tailored to physicians’ teaching activities. Even though great effort and care has been put in the development of all scales, our interpretations about the concurrent validity with respect to PTI and PTC have to be looked at with great caution.

In this study, the sample consisted of physicians from internal medicine and surgery only. However, the PTMQ has been designed for hospital-based physicians in general and should be suitable for other specialties as well. Furthermore, while the sample included physicians who teach students, there are no known theoretical obstacles to applying the PTMQ to teachers teaching residents and fellows. Our response rate of 38.3 % might raise some doubt about potentially biased results. Surveys with physicians generally tend to have lower response rates than surveys with other populations [58]. Furthermore, questionnaires for physicians with more than 1000 words had lower response rates (38.0 %) than those below 1000 words (59.4 %) [59]. Our questionnaire included 2520 words. Response rates varied from e.g. 13.3 % of surgeons in one hospital to 78.9 % of internists another hospital. Samples with low response rates might be assumed to show higher degrees of autonomous and lower degrees of controlled motivation in comparison to their populations. Hence, it seems more likely that physicians with less autonomous teaching motivation did not respond. However, we found no correlations between response rates and any of our motivational dimensions. Nevertheless, our data should be interpreted with caution. With respect to the factorial structure of our questionnaire, no potential bias seems evident due to the response rate.

Future research

One advantage of using the same instrument consistently across different institutions, departments and countries lies in the comparability of the results. Therefore, it is generally beneficial to establish instruments, which have been validated for different research questions. Hence, translations of the PTMQ into other languages and corresponding validations seem promising. Further research is also needed to determine the research questions and the study designs for which the PTMQ is suitable. For example, in order to determine the PTMQ’s suitability for studies with a pre-post-design such as evaluations of faculty development programs, teacher trainings and other interventions, future studies should investigate the instrument’s sensitivity to change.

In this study, teaching involvement was measured using a self-rating instrument. In future studies, more objective data on the impact of teaching motivation on teaching involvement should be gathered. Furthermore, it should be investigated whether the PTMQ can predict teaching quality, students’ learning motivation and, as a consequence, students’ learning advances. Additionally, the characteristics of the CareerTM scale and its associations with different outcomes in different samples should be further explored. If future studies in other settings should also find that this scale shows no significant associations with relevant criteria, a modification of this scale would be necessary. In such a case, we would recommend to develop items, which distinguish between intrinsic and extrinsic career motivations with respect to teaching. Most modern learning formats as well as curriculum and faculty development programs are student-centered in conception and focus on student-centered outcomes when being evaluated. Ten Cate et al. point out that this one-sided perspective might cause conflicts with physicians’ teaching motivations [21]. Therefore, future studies should explore both perspectives, identify potential areas of conflict and provide solutions for them.

Conclusions

Assessments of factorial validity, internal consistency, concurrent convergent validity and incremental validity indicate generally a good usability of the PTMQ as an instrument to measure teaching motivation in hospital-based physicians.

Ethics

The study was performed in accordance with the Declaration of Helsinki and the Ethics Committee of the Chamber of Physicians, Hamburg, confirmed the innocuousness of the study protocol.

References

  1. Spencer JA, Jordan RK. Learner centred approaches in medical education. BMJ. 1999;318:1280–3.

    Article  Google Scholar 

  2. Barrows HS. Problem-based learning in medicine and beyond: a brief overview. New Dir Teach Learn. 1996;1996:3–12.

    Article  Google Scholar 

  3. Chen FM, Bauchner H, Burstin H. A call for outcomes research in medical education. Acad Med. 2004;79:955–60.

    Article  Google Scholar 

  4. Cook DA, West CP. Perspective: reconsidering the focus on “outcomes research” in medical education: a cautionary note. Acad Med. 2013;88:162–7.

    Article  Google Scholar 

  5. Bandura A. Social foundations of thought and action: a social cognitive theory. Englewood Cliffs: Prentice-Hall, Inc; 1986.

    Google Scholar 

  6. Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol. 2000;55:68–78.

    Article  Google Scholar 

  7. Wayne AJ, Youngs P. Teacher characteristics and student achievement gains: a review. Rev Educ Res. 2003;73:89–122.

    Article  Google Scholar 

  8. Zumwalt K, Craig E. Teachers’ characteristics: research on the indicators of quality. In: Cochrane-Smith M, Zeichner KM, editors. Studying teacher education: the report of the AERA Panel on Research and Teacher Education. Mahwah: Lawrence Erlbaum Associates Publishers; 2005. p. 157–260.

    Google Scholar 

  9. Kunter M, Klusmann U, Baumert J, Richter D, Voss T, Hachfeld A. Professional competence of teachers: effects on instructional quality and student development. J Educ Psychol. 2013;105:805–20.

    Article  Google Scholar 

  10. Radel R, Sarrazin P, Legrain P, Wild TC. Social contagion of motivation between teacher and student: analyzing underlying processes. J Educ Psychol. 2010;102:577–87.

    Article  Google Scholar 

  11. Roth G, Assor A, Kanat-Maymon Y, Kaplan H. Autonomous motivation for teaching: how self-determined teaching may lead to self-determined learning. J Educ Psychol. 2007;99:761–74.

    Article  Google Scholar 

  12. Kusurkar RA, Ten Cate TJ, Vos CM, Westers P, Croiset G. How motivation affects academic performance: a structural equation modelling analysis. Adv Health Sci Educ. 2013;18:57–69.

    Article  Google Scholar 

  13. Kusurkar RA, Croiset G, Mann KV, Custers E, Ten Cate O. Have motivation theories guided the development and reform of medical education curricula? A review of the literature. Acad Med. 2012;87:735–43.

    Article  Google Scholar 

  14. Steinert Y, Mann K, Centeno A, Dolmans D, Spencer J, Gelula M, et al. A systematic review of faculty development initiatives designed to improve teaching effectiveness in medical education: BEME Guide No. 8. Med Teach. 2006;28:497–526.

    Article  Google Scholar 

  15. Bird J, Hall A, Maguire P, Heavy A. Workshops for consultants on the teaching of clinical communication skills. Med Educ. 1993;27:181–5.

    Article  Google Scholar 

  16. Irby DM, Vontver LA, Stenchever MA. Improving teaching in a multisite clerkship. Faculty-development workshops. J Reprod Med. 1982;27:307–10.

    Google Scholar 

  17. Skeff KM, Stratos GA, Bergen MR, Regula Jr DP. A pilot study of faculty development for basic science teachers. Acad Med. 1998;73:701–4.

    Article  Google Scholar 

  18. Skeff KM, Stratos GA, Bergen MR, Sampson K, Deutsch SL. Regional teaching improvement programs for community-based teachers. Am J Med. 1999;106:76–80.

    Article  Google Scholar 

  19. Sutkin G, Wagner E, Harris I, Schiffer R. What makes a good clinical teacher in medicine? A review of the literature. Acad Med. 2008;83:452–66.

    Article  Google Scholar 

  20. Gagné M, Deci EL. Self-determination theory and work motivation. J Organ Behav. 2005;26:331–62.

    Article  Google Scholar 

  21. Ten Cate TJ, Kusurkar RA, Williams GC. How self-determination theory can assist our understanding of the teaching and learning processes in medical education. AMEE guide No. 59. Med Teach. 2011;33:961–73.

    Article  Google Scholar 

  22. American Education Research Association, American Psychological Association. Standards for educational and psychological testing. Washington: American Education Research Association; 1999.

    Google Scholar 

  23. Cronbach LJ, Meehl PE. Construct validity in psychological tests. Psychol Bull. 1955;52:281–302.

    Article  Google Scholar 

  24. Downing SM. Validity: on the meaningful interpretation of assessment data. Med Educ. 2003;37:830–7.

    Article  Google Scholar 

  25. Gagné M, Forest J, Vansteenkiste M, Crevier-Braud L, Broeck AV, Aspeli AK, et al. The Multidimensional Work Motivation Scale: validation evidence in seven languages and nine countries. Eur J Work Organ Psychol. 2014;24:1–19.

    Google Scholar 

  26. Fernet C. Development and validation of the Work Role Motivation Scale for School Principals (WRMS-SP). Educ Admin Q. 2011;47:307–31.

    Article  Google Scholar 

  27. Mallett C, Kawabata M, Newcombe P, Otero-Forero A, Jackson S. Sport Motivation Scale-6 (SMS-6): a revised six-factor sport motivation scale. Psychol Sport Exerc. 2007;8:600–14.

    Article  Google Scholar 

  28. Tremblay MA, Blanchard CM, Taylor S, Pelletier LG, Villeneuve M. Work Extrinsic and Intrinsic Motivation Scale: its value for organizational psychology research. Can J Behav Sci. 2009;41:213–26.

    Article  Google Scholar 

  29. Bandura A. Self-efficacy: the exercise of control. New York: Worth Publishers; 1997.

    Google Scholar 

  30. Rodgers WM, Markland D, Selzler AM, Murray TC, Wilson PM. Distinguishing perceived competence and self-efficacy: an example from exercise. Res Q Exerc Sport. 2014;85:527–39.

    Article  Google Scholar 

  31. Schwarzer R, Hallum S. Perceived teacher self-efficacy as a predictor of job stress and burnout: mediation analyses. Appl Psychol. 2008;57:152–71.

    Article  Google Scholar 

  32. Caprara G, Barbaranelli C, Borgogni L, Petitta L, Rubinacci A. Teachers’, school staff’s and parents’ efficacy beliefs as determinants of attitudes toward school. Eur J Psychol Educ. 2003;18:15–31.

    Article  Google Scholar 

  33. Bandura A. Guide for constructing self-efficacy scales. In: Pajares F, Urdan T, editors. Self-efficacy beliefs of adolescents. Greenwich: IAP; 2006. p. 307–37.

    Google Scholar 

  34. Dybowski C, Harendza S. “Teaching is like nightshifts …”: a focus group study on the teaching motivations of clinicians. Teach Learn Med. 2014;26:393–400.

    Article  Google Scholar 

  35. Dybowski C, Harendza S. Bedside teaching: general and discipline-specific teacher characteristics, criteria for patient selection and difficulties. GMS Z Med Ausbild. 2013;30:Doc23.

    Google Scholar 

  36. Gierk B, Harendza S. Patient selection for bedside teaching: inclusion and exclusion criteria used by teachers. Med Educ. 2012;46:228–33.

    Article  Google Scholar 

  37. Celenza A, Rogers IR. Qualitative evaluation of a formal bedside clinical teaching programme in an emergency department. Emerg Med J. 2006;23:769–73.

    Article  Google Scholar 

  38. Berger TJ, Ander DS, Terrell ML, Berle DC. The Impact of the demand for clinical productivity on student teaching in academic emergency departments. Acad Emerg Med. 2004;11:1364–7.

    Article  Google Scholar 

  39. Norman G. Likert scales, levels of measurement and the “laws” of statistics. Adv Health Sci Educ. 2010;15:625–32.

    Article  Google Scholar 

  40. West SG, Finch JF, Curran PJ. Structural equation models with nonnormal variables: problems and remedies. In: Hoyle RH, editor. Structural equation modeling: concepts, issues, and applications. Thousand Oaks: Sage Publications, Inc; 1995. p. 56–75.

    Google Scholar 

  41. Kriston L, Gunzler C, Harms A, Berner M. Confirmatory factor analysis of the German version of the International Index of Erectile Function (IIEF): a comparison of four models. J Sex Med. 2008;5:92–9.

    Article  Google Scholar 

  42. Kline P. The handbook of psychological testing. London: Routledge; 2000.

    Google Scholar 

  43. Gagné M, Forest J, Gilbert M-H, Aubé C, Morin E, Malorni A. The Motivation at Work Scale: validation evidence in two languages. Educ Psychol Meas. 2010;70:628–46.

    Article  Google Scholar 

  44. Grolnick WS, Ryan RM. Autonomy in children’s learning: an experimental and individual difference investigation. J Pers Soc Psychol. 1987;52:890–8.

    Article  Google Scholar 

  45. Chemolli E, Gagne M. Evidence against the continuum structure underlying motivation measures derived from self-determination theory. Psychol Assessment. 2014;26:575–85.

    Article  Google Scholar 

  46. Barnett RC, Carr P, Boisnier AD, Ash A, Friedman RH, Moskowitz MA, et al. Relationships of gender and career motivation to medical faculty members’ production of academic publications. Acad Med. 1998;73:180–6.

    Article  Google Scholar 

  47. Engbers R, Fluit CMG, Bolhuis S, Sluiter R, Stuyt PJ, Laan RJM. Relations between policy for medical teaching and basic need satisfaction in teaching. Adv Health Sci Educ. 2014;20:1–12.

  48. Vansteenkiste M, Neyrinck B, Niemiec CP, Soenens B, De Witte H, Van den Broeck A. On the relations among work value orientations, psychological need satisfaction and job outcomes: a self-determination theory approach. J Occup Organ Psychol. 2007;80:251–77.

    Article  Google Scholar 

  49. Spector PE. Method variance in organizational research: truth or urban legend? Organ Res Meth. 2006;9:221–32.

    Article  Google Scholar 

  50. Richardson HA, Simmering MJ, Sturman MC. A tale of three perspectives: examining post hoc statistical techniques for detection and correction of common method variance. Organ Res Meth. 2009;12:762–800.

    Article  Google Scholar 

  51. Plant J, van Schaik S, Sliwka D, Boscardin C, O’Sullivan P. Validation of a self-efficacy instrument and its relationship to performance of crisis resource management skills. Adv Health Sci Educ. 2011;16:579–90.

    Article  Google Scholar 

  52. Canrinus E, Helms-Lorenz M, Beijaard D, Buitink J, Hofman A. Self-efficacy, job satisfaction, motivation and commitment: exploring the relationships between indicators of teachers’ professional identity. Eur J Psychol Educ. 2012;27:115–32.

    Article  Google Scholar 

  53. Alivernini F, Lucidi F. Relationship between social context, self-efficacy, motivation, academic achievement, and intention to drop out of High School: a longitudinal study. J Educ Res. 2011;104:241–52.

    Article  Google Scholar 

  54. Pajares F. Self-efficacy beliefs in academic settings. Rev Educ Res. 1996;66:543–78.

    Article  Google Scholar 

  55. Fletcher WL, Hansson RO, Bailey L. Assessing occupational self-efficacy among middle-aged and older adults. J Appl Gerontol. 1992;11:489–501.

    Article  Google Scholar 

  56. Stajkovic AD, Luthans F. Self-efficacy and work-related performance: a meta-analysis. Psychol Bull. 1998;124:240–61.

    Article  Google Scholar 

  57. Bandura A, Cervone D. Self-evaluative and self-efficacy mechanisms governing the motivational effects of goal systems. J Pers Soc Psychol. 1983;45:1017–28.

    Article  Google Scholar 

  58. Asch DA, Jedrziewski MK, Christakis NA. Response rates to mail surveys published in medical journals. J Clin Epidemiol. 1997;50:1129–36.

    Article  Google Scholar 

  59. Jepson C, Asch DA, Hershey JC, Ubel PA. In a mailed physician survey, questionnaire length had a threshold effect on response rate. J Clin Epidemiol. 2005;58:103–5.

    Article  Google Scholar 

Download references

Acknowledgements

We thank all study participants from the medical schools Charité Universitätsmedizin Berlin, Klinikum der Universität München (LMU), Universitätsklinikum Düsseldorf, Universitätsmedizin Göttingen, Universitätsklinikum Hamburg-Eppendorf, and Universitätsklinikum Heidelberg. We thank Dr. Levente Kriston for statistical advice.

Funding

There was no funding for this study.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sigrid Harendza.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

CD and SH designed the study. CD performed the statistical analyses and drafted the manuscript. SH coordinated the study and the data acquisition. Both authors read and approved the final manuscript.

Authors’ information

Not applicable.

Availability of data and materials

Not applicable.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dybowski, C., Harendza, S. Validation of the Physician Teaching Motivation Questionnaire (PTMQ). BMC Med Educ 15, 166 (2015). https://0-doi-org.brum.beds.ac.uk/10.1186/s12909-015-0448-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12909-015-0448-5

Keywords