Skip to main content
Download PDF

Development and validation of the critical thinking disposition inventory for Chinese medical college students (CTDI-M)

BMC Medical Education volume 19, Article number: 200 (2019) Cite this article

Abstract

Background

This study aimed to develop and conduct psychometric testing of the Critical Thinking Disposition Inventory to measure the critical thinking disposition of Chinese medical college students.

Methods

The study was conducted in two stages: (a) item generation, reliability analysis and exploratory factor analysis (EFA) and (b) confirmatory factor analysis (CFA) and testing of psychometric properties (Cronbach’ s alpha, test-retest reliability and convergent validity). The subjects included 1035 Chinese medical college students. The test-retest reliability of the instrument was determined at a two-week interval (n = 61). A general linear regression model was developed to examine the predictive effects of gender, age and major on CT disposition. The data were analysed with SPSS 22.0 and Amos 21.0 during item development and the reliability and validity analyses. Vista was utilized for parallel analysis during the principal axis analysis.

Results

Eighteen final items were sorted into 3 factors, which were identified as “Open-mindedness”, “Systematicity/Analyticity” and “Truth-seeking”, with cumulative variance of 41.37, 46.00 and 49.59%, respectively. The Cronbach’s alpha was 0.924, and the factors’ alphas ranged from 0.824 to 0.862. The correlational analysis indicated significant correlations between the subscales of the CTDI-CM and the total scores of the CTDI-CV, indicating modest evidence for the convergent validity of the CTDI-CM. Gender, age and education significantly predicted the CT disposition of Chinese medical students. Open-mindedness and Systematicity/Analyticity were higher for medical students than for nursing students.

Conclusions

This study presents a reliable and valid instrument for clinical thinking disposition. Future studies should explore other predictive factors of CT dispositions (e.g., cognitive/motivational) and criterion validity.

Peer Review reports

Background

Critical thinking is increasingly needed to produce adaptive and flexible learners in the information age (Dwyer, Hogan, & Stewart, 2014). The importance of being ‘critical’ for medical students and practitioners has also been increasingly emphasized [1]. The Delphi Report presented in 1990 by experts from the US and Canada defined critical thinking (CT) as the ability to apply cognitive skills (interpretation, analysis, inference, evaluation, explanation, and self-regulation) and the disposition towards CT (being open-minded or intellectually honest) [2, 3]. Critical thinking has frequently been referred to as individuals’ cognitive ability to think and make correct decisions independently and to utilize rational/logical thought [4, 5].

Increasing attention has been paid to the individual differences in critical thinking disposition, which is defined as the tendency or attitude to utilize a particular skill voluntarily and the willingness to make the effort to apply it [6], or, simply put, the attitude towards critical thinking. Dispositions towards critical thinking are vital to critical-thinking performance [7] and professional clinical judgement [8]. Practically, both disposition and ability are necessary for critical thinking [9]. The assessment of CT dispositions may help to identify targets to promote critical thinking through training programmes in both professional and educational contexts.

The most widely used measurement tool in China for this purpose is the translated version of the California Critical Thinking Disposition Inventory (CCTDI) [10, 11]. The CCTDI is designed for the general adult working population at all levels and for students in grades 10 and above. The CCTDI includes seven subscales: “Inquisitiveness”, “Systematicity”, “Analyticity”, “Truth-seeking”, “Open-mindedness”, “Self-confidence” and “Maturity” [12]. Yeh et al. translated the CCTDI into Chinese and administered it to a sample of nursing undergraduate students in Taiwan. Compared to the English CCTDI (alpha = 0.79), the overall alpha (0.71) of the Chinese CCTDI was inferior, and the internal consistencies (Cronbach’s α) of three subscales were inadequate (Open-mindedness = 0.34, Analyticity = 0.40, and systematicity = 0.47) [11]. In addition, the content validity of these three subscales was moderate (CVI = 0.50 to 0.67) compared to the English CCTDI subscales (CVI = 0.82 to 1). Peng et al. developed a conceptually equivalent version of the CCTDI, the CTDI-CV (Critical Thinking Disposition Inventory-Chinese Version), which showed more satisfactory subscale alphas ranging from 0.54 to 0.77 and an overall alpha of 0.90. The CVIs for the “Open-mindedness”, “Analyticity” and “Systematicity” subscales were improved to 0.90–1. However, the Cronbach’s α (Chinese CCDTI = 0.46, CTDI-CV = 0.57) and the CVI (Chinese CCDTI = 0.70, CTDI-CV = 0.60) of the “Maturity” subscale were lower for both the Chinese CCTDI and the CTDI-CV than for the English CCTDI (alpha = .64, CVI = .90) [10]. In another translated Chinese version of the CCTDI for university students, the Cronbach’s α of the “Open-mindedness” (0.39), “Systematicity” (0.43) and “Maturity” (0.45) subscales were also not satisfactory [13]. The conceptualizations and measurement of CT dispositions in the Chinese-speaking population merit further exploration.

An important factor that may explain the diversity of the psychometric characteristics of versions of the CCTDI is cultural sensitivity. According to a literature review, Asian students tend to show less critical thinking dispositions compared with students from non-Asian countries [14,15,16].

  1. (1).

    Analyticity and Systematicity are the cognitive components of CT dispositions that are culturally sensitive. “Analyticity” means the use of evidence and the anticipation of possible consequences to resolve problems. “Systematicity” means being organized, focused and diligent in resolving problems. In comparison with American university students, the percentage of students with lower than moderate levels of “Analyticity” and “Systematicity” is greater in the Chinese population [13]. Specifically, for Chinese medical undergraduates, the average score for “Systematicity” was at the lowest level of all subscales of CT dispositions [17]. The Systematicity of Chinese nursing students was at a moderate level [10]. A previous study suggested that Western cultures tend to be analytic, whereas traditional Chinese societies tend to be holistic and synthetic, which is manifested in language [18], thinking models of medicine [19] and preferences for dialectical proverbs and dialectical resolution of social contradictions [20]. Since the cognitive components of CT dispositions are crucial for effective critical thinking, cultural differences in thinking patterns need to be considered in the context of Chinese culture.

  2. (2).

    “Inquisitiveness”, “Truth-seeking” and “Open-mindedness” are the motivation components of CT dispositions. CT ability is presumed to be significantly related to learning motivation [21]. First, Inquisitiveness refers to the inclination to be curious and eager to learn knowledge that may not be of immediate use. This may encourage learners to engage in deep and creative reasoning [22]. Second, the average score for Truth-seeking was at the lowest level of all subscales of CT dispositions among Chinese medical undergraduates [17]. The Truth-seeking of Chinese nursing students was at a moderate level [10]. Asian university students tended to learn for pragmatic purposes compared to American university students, who tend to possess an attitude that values truth [23]. While Open-mindedness and Truth-seeking have been deemed important in good critical thinkers, only Truth-seeking significantly predicts Chinese students’ critical thinking performance, and their responses are more concerned with seeking solutions from authorities or preconceptions rather than seeking independent evidence or reasoning [24]. Third, in comparison with American university students, the proportion of students displaying a lower than moderate level of Open-mindedness is greater in the Chinese population [13]. Open-minded people in Asian culture may be more inclined to accept contradictory propositions and avoid social conflicts. These cultural diversities may explain the low internal consistency of “Open-mindedness” for the CCTDI in Chinese nursing students [11]. Therefore, the motivation components of CT dispositions should focus on these culturally sensitive traits and examine how these traits may influence medical performance.

  3. (3).

    “Self-confidence” and “Maturity” are the personality components of CT dispositions. The Self-confidence subscale measures individuals’ confidence in their thinking and reasoning processes. Emotionally taxing situations, threats to self-identity (e.g., gender prejudice) or inappropriate priorities of values challenge the self-confidence of critical thinkers and impair their self-reflection ability [3]. Thus, Self-confidence is particularly important to CT dispositions. The Maturity scale assesses the disposition towards judicious decision-making and thus requires self-reflection, which develops gradually from adolescence to adulthood. Chinese students who exhibit a lower than moderate level of Maturity constitute a greater proportion compared with American university students [13]. More research is needed to develop specialized instruments for the Chinese context.

Empirically, critical thinking is valued both for nursing [25] and clinical expertise [4]. Critical thinking can improve diagnostic skills and reduce errors in management [4]. Critical thinking constitutes not only logical thinking ability but also problem-solving ability, which is content dependent [26]. For instance, CT enhances the capacity to transfer knowledge and skills obtained from the classroom to the clinical context [27]. As a result, CT skills have been emphasized by the Global Minimum Essential Requirements (GMER) as one of the seven student competence domains [28]. The competences contained in the GMER define the learning outcomes of medical graduates that are required for medical practice [29]. These domains have been assessed with an objective structured clinical examination (OSCE) that defined competence in critical thinking and research as the ability to generate and test hypotheses with scientific methods [30]. Although critical thinking competencies are generic abilities, CT behaviours may be more effectively learned or taught in specific discipline settings [31]. Therefore, knowledge about the individual differences of CT dispositions specific to the medical discipline could facilitate the teaching of critical thinking. In contrast to the two Chinese versions of the CCTDI that were directed at nursing students only, the current study also included medical students during the development of the CT disposition assessment tool.

An instrument for measuring critical thinking dispositions developed independently for Chinese medical students aims to (1) increase the content validity of specific factors of CT disposition (i.e., Open-mindedness, Analyticity, Systematicity and Maturity) and (2) identify those traits with greater cultural differences and evaluate the criterion validity of their measurement.

Methods

Participants and procedures

Phase 1 development and factor analysis of the critical thinking disposition inventory for Chinese medical college students (CTDI-CM)

  1. (1).

    A total of 161 clinical medicine undergraduate students, 10 educational specialists and 10 psychological specialists were recruited. An open-ended questionnaire (“What are the aspects of critical thinking disposition for medical college students?”) was completed. Ultimately, 177 surveys were deemed valid and analysed (male: n = 157, age = 22.03 ± 7.84; female: n = 20, age = 23.45 ± 8.41). A total of 264 preliminary items were obtained (Table 1). Based on the conceptual framework from the literature review and the results of the open-ended questionnaire, 97 items were extracted and entered into a half-open-ended questionnaire.

  2. (2).

    A total of 199 undergraduate students (clinical medicine = 138, nursing = 61) and 20 educational/ psychological specialists were recruited. A 97-item half-open-ended questionnaire resulting from the responses of the open-ended questionnaire as well as a complementary open-ended question (“Please list other dispositions not included in the questionnaire________.”) was completed. The participants were required to rate each item in terms of its relevance (yes/no) to the content of CT dispositions. Ultimately, 209 surveys were deemed valid and analysed (male: n = 99, age = 23.26 ± 9.72; female: n = 110, age = 23.45 ± 8.41). The items (n = 61) endorsed by more than 50% of respondents as reflecting the conceptualization of CT disposition were identified and entered into a closed-ended questionnaire (Table 1).

  3. (3).

    A total of 431 undergraduate students (clinical medicine = 299, preventive medicine/medical laboratory science = 71, nursing = 61) and 20 educational/psychological specialists were recruited. A closed-ended 61-item questionnaire of CT dispositions was completed (Table 1). Participants were required to complete the questionnaire on a five-point Likert-type scale (1 = disagree strongly; 2 = disagree somewhat; 3 = neutral; 4 = agree somewhat; 5 = agree strongly). Ultimately, 442 surveys were deemed valid and analysed (male: n = 342, age = 21.35 ± 5.41; female: n = 100; age = 24.08 ± 8.61). Among this sample, 61 participants (majoring in nursing) completed the scale at a two-week interval. An 18-item questionnaire resulted from exploratory factor analysis (EFA).

Table 1 The (semi-)open-ended and closed-ended questionnaire of Critical Thinking Disposition for Chinese medical college students (CTDI-CM)
Full size table

Phase 2 confirmation of factor structure of the CTDI-CM

Confirmatory factor analysis (CFA)

An independent sample of 441 undergraduate students and 641 medical graduate students (age = 26.73 ± 3.96) (enrolled in 2012) was recruited. The aims of the phase 2 data collection were (1) to confirm the factor structure of the 18-item CT disposition scale for Chinese medical students (CTDI-CM) and (2) to examine the generalization capacity of the CTDI-CM. Participants were required to complete the questionnaire on a five-point Likert-type scale (1 = disagree strongly; 2 = disagree somewhat; 3 = neutral; 4 = agree somewhat; 5 = agree strongly). A total of 420 surveys were deemed valid for undergraduate students (clinical medicine = 278, preventive medicine/medical laboratory science = 81, nursing = 61) (male: n = 323, age = 20.50 ± 1.08; female: n = 97, age = 21.17 ± 1.43), and 641 surveys were deemed valid for graduate students (major not recorded during data collection due to technical problem) (male: n = 397, age = 27.09 ± 3.94; female: n = 244, age = 26.16 ± 3.95).

Convergent validity

A total of 289 medical undergraduate students (enrolled in 2014) (age = 19.57 ± 1.63) were recruited (male: n = 264, age = 19.63 ± 1.67; female: n = 23, age = 18.87 ± 0.81). Three versions of the CT disposition scales (CTDI-CM, CTDI-CV, CCTDI) were completed to estimate the convergent validity of the CTDI-CM. Only comparisons between the CTDI-CM and the CTDI-CV were reported due to the lack of a scoring system for the CCTDI.

The current study was approved by the ethics committee of the university. The data collection in each phase was conducted after the enrolment of each student (from April to June) and before the school year began (Fig. 1). This was intended to alleviate the learning effects of college course studies and academic training on CT disposition. Verbal informed consent was obtained from each participant prior to the surveys. All of the participants’ information was confidential, and the participants could withdraw from the study at any time on a voluntary basis. The sample size had sufficient power to detect significant differences revealed by the power analysis.

Fig. 1
figure 1

Development of CTDI-CM and reliability/validity steps

Full size image

Statistics

Statistical analysis was conducted using the Statistical Package for the Social Sciences (SPSS) 22.0 for Windows (SPSS, Chicago, IL, USA).

Development of CTDI-CM and item analysis

The remaining 18 items (Table 1) survived the two criteria of item analysis. (1) Item discriminability. A critical ratio (CR) index was used to quantify the difference of each item for the 27% highest-scoring group versus the 27% lowest-scoring group. Two independent-sample t tests with a CR value exceeding 3 indicated good item discriminability [32]. (2) Item homogeneity test. Item-total statistics were computed to examine the content homogeneity between items, with a value over 0.3 indicating that the item correlated well with the total scale [33].

Reliability analysis of the CTDI-CM

(1) For internal consistency, Cronbach’s alpha coefficient was calculated for the scores of each subscale and the total scale based on the assumption that the CTDI-CM measures the single trait of CT disposition. The questionnaire had substantial internal consistency according to the following rules of thumb: > 0.9 as excellent, > 0.8 as good, > 0.7 as acceptable, > 0.6 as questionable, > 0.5 as poor and < 0.5 as unacceptable [34]. (2) Item-to-total correlations were examined with the recommended value of up to 0.3 [35]. (3) Test-retest reliability was analysed by the intra-class correlation coefficients (ICCs) with a two-week interval, which was long enough to avoid confounding effects of practice and allow for a natural change in the construct. ICC provides an estimate of the reproducibility (stability) of the assessments according to the following criteria: > 0.6 indicates good reliability and > 0.74 indicates excellent reliability [36].

Validity analysis of the CTDI-CM

Exploratory factor analysis (EFA)

Principal axis factor analysis was performed to identify the latent variables of CT dispositions. The Kaiser-Meyer-Olkin (KMO) measure and Bartlett’s Test of Sphericity were examined for the adequacy of the factor analysis. Factors were extracted based on Kaiser’s (1960) eigenvalues-greater-than-1 rule and the scree test after a direct oblimin rotation solution. The validation procedures were implemented with SPSS 22.0. To replicate these results, we also conducted parallel analysis, which is recommended as a statistically based and more validated procedure for determining the number of components [37]. The parallel analysis was conducted with ViSta (visual statistics system) (https://www.uv.es/visualstats/Book/DownloadBook.html) [38]. Parallel analysis using Monte Carlo simulations of permutations of 1000 randomly generated datasets was conducted. The eigenvalue of the raw data exceeding the eigenvalue of the 95th percentile (and mean) of random data could be extracted as a factor [37].

Confirmatory factor analysis (CFA)

CFA analyses were performed using IBM SPSS Amos 21.0. CMIN/DF(≈2), GFI (goodness-of-fit index) ≥ 0.90, AGFI (adjusted goodness-of-fit index) ≥ 0.80, CFI (comparative fit index) ≥ 0.90 and 0.05 ≤ RMSEA (root-mean-square error of approximation) ≤ 0.08 are typically considered to indicate goodness of the model fit [39].

Convergent validity

The intercorrelations among the scores of the subscales of the CTDI-CV and the CTDI-CM were computed. Pearson’s correlation coefficient was estimated, with a significance level of p < 0.05 for statistical testing. Pearson’s r with a positive value greater than 0.70 is recommended (Terwee et al., 2007). To replicate the results, we also performed regression analyses for convergent validity with the CTDI-CM subscales as the predictors and the CTDI-CV total score as the outcome variable, with a positive beta coefficient of 0.40–0.59 as recommended [40].

GLM analysis of CT dispositions of Chinese medical college students

The general linear regression model (model 1) was utilized to estimate the significant predictive factor of CT dispositions, with gender (male = 1; female = 2), age and education (undergraduate student = 1; graduate student = 2) as independent variables and the subscale scores of the CTDI-CM (Open-mindedness, Systematicity/Analyticity, Truth-seeking) as dependent variables. The information on major for graduate students was omitted during the data collection. Thus, we only report the comparison between the two majors (medical vs. nursing) in undergraduate students.

Results

Item and reliability analysis

We obtained an 18-item questionnaire on Chinese medical college students’ critical thinking dispositions. Item analyses showed that the items of the CTDI-M were recognized by the respondents as relevant to CT disposition. Additionally, these items could discriminate those with higher versus lower levels of CT disposition (Fig. 2) (Ps < 0.003, Bonferroni corrected).

Fig. 2
figure 2

Item discriminability analysis of CTDI-CM (between-group comparison: higher versus lower CT dispositions)

Full size image

The item-total analysis confirmed the homogeneity of content among items (Table 2). The results also showed that the questionnaire had excellent internal consistency (0.776~0.965) and two-week test-retest reliability of the CDTI-CM (0.808~0.965) (Table 3).

Table 2 Item-Total Statistics of CTDI-CM
Full size table
Table 3 Reliability analysis of CTDI-CM
Full size table

Validity analysis

The Kaiser-Meyer-Olkin (KMO) measure of sampling adequacy was 0.946, which was greater than 0.5 (and close to one), indicating satisfactory factor analysis. Bartlett’s Test of Sphericity (χ2 = 3410.42, P < 0.001) (less than 0.05) suggested the appropriateness of the factor analysis model. The principal axis factor analysis identified a three-factor model, with the eigenvalues of 3 factors exceeding one (Table 4). The scree test confirmed the three-factor model of CT dispositions (Fig. 3). The first factor (Open-mindedness) explained 41.37% of the accumulated variance with seven items (with an eigenvalue of 7.95), which indicated an open attitude and willingness to listen to and consider other people’s ideas and suggestions before arriving at conclusions. The second factor (Systematicity/Analyticity) explained 46.00% of the accumulated variance with six items (with an eigenvalue of 1.32), which indicated the traits of being painstaking and careful and demonstrating effective decision-making and problem-solving. The third factor (Truth-seeking) explained 49.59% of the accumulated variance with five items (with an eigenvalue of 1.12), which indicated the state of active curiosity, active engagement in thinking, and avoiding the negative effects of mental state. To replicate these results, three factors were extracted through parallel analysis after comparison of the actual data eigenvalues with the eigenvalues extracted from random data (Fig. 4). Additionally, CFA indicated the goodness of the three-factor model fit: CMIN/DF (2.103), GFI (0.930 ≥ 0.90), CFI (0.956 ≥ 0.90), AGFI (0.909 ≥ 0.80) and RMSEA (0.05 ≤ 0.051 ≤ 0.08).

Table 4 Factor Loadings of Each Item of CTDI-CM (Critical Thinking Disposition Inventory for Chinese medical students)
Full size table
Fig. 3
figure 3

Scree plot of principal axis factor analysis of CTDI-CM

Full size image
Fig. 4
figure 4

Parallel analysis for factor analysis of CTDI-CM

Full size image

The convergent validity was examined by correlating the subscales of the CTDI-CM with the CTDI-CV. Open-mindedness on the CTDI-CM was positively correlated with Maturity and Self-confidence on the CTDI-CV (r = 0.170, P < 0.005, n = 282). The Systematicity/Analyticity of the CTDI-CM was positively correlated with self-confidence (r = 0.215, P < 0.001, n = 282) on the CTDI-CV and negatively correlated with Inquisitiveness on the CTDI-CV (r = − 0.219, P < 0.001, n = 284). Truth-seeking on the CTDI-CM was positively correlated with self-confidence on the CTDI-CV (r = 0.200, P < 0.005, n = 280) and negatively correlated with Inquisitiveness (r = − 0.318, P < 0.001) and Analyticity (r = − 0.129, P < 0.05, n = 179) on the CTDI-CV. However, there was no significant correlation between the total scores of the CTDI-CV and the CTDI-CM (r = 0.028, P = 0.643) (Table 5). The VIF (2.237, 3.755 and 3.630) and tolerance scores (0.447, 0.266 and 0.275) indicated no multicollinearity among the predictors.

Table 5 Inter-correlations among the scores of subscales of CTDI-CV and CTDI-CMa
Full size table

The predictors of CT dispositions: gender, age, education and major

The multivariate general linear model (GLM) (model 1) indicated that education significantly predicted three CT dispositions (Open-mindedness, Systematicity/Analyticity, and Truth-seeking) (P < 0.001, partial η2 = 0.023, 0.033, 0.034) (Table 6). Similarly, age (P < 0.001, partial η2 = 0.021, 0.014, 0.013) and gender (P < 0.001, partial η2 = 0.014, 0.013, 0.012) significantly predicted the CT dispositions of medical students. Furthermore, an independent-sample t-test between medical and nursing students revealed that the mean scores for Open-mindedness and Systematicity/Analyticity were higher for medical students than for nursing students (Table 7).

Table 6 Multiple regression coefficients of the independent variables (subscales of CTDI-CM) and the dependent variable (CDTI-CV scale)
Full size table
Table 7 Comparison of mean scores of Critical Thinking Dispositions between medical and nursing students (mean ± SD)
Full size table

Discussion

This study provided a preliminary instrument to measure the critical thinking dispositions of Chinese medical college students and presented its psychometric properties. The critical thinking dispositions of Chinese medical college students include Open-mindedness, Systematicity/Analyticity and Truth-seeking. Open-mindedness targets the openness to different viewpoints and possibilities before making a decision. Systematicity/Analyticity involves values such as fairness and truth and the skills to strive for sound and unbiased judgements. Truth-seeking refers to the enthusiasm for true knowledge and active engagement in thinking. The present study revealed that the Chinese version of the CDTI-CM for medical college students showed acceptable psychometric properties.

Comparison among different versions of inventories for critical thinking dispositions

Since non-cognitive factors may have a great impact on participants’ critical thinking, such as culture and motivation [41], we compared the psychometric properties of the CTDI-CM with the Chinese CCTDI (California Critical Thinking Dispositions Inventory) [11] and the CTDI-CV (Critical Thinking Disposition Inventory-Chinese Version) [10], which were developed to be conceptually or semantically equivalent to the original CCTDI, respectively. While the Chinese CCTDI verified construct validity for the Truth-seeking, Open-mindedness, Systematicity and Maturity subscales [11], the content validity (alpha = 0.34) of Open-mindedness for the Chinese CCTDI was less satisfactory than the current study (alpha = 0.86). Additionally, the criterion validity analysis revealed that Open-mindedness on the CTDI-CV was irrelevant to the three factors of the CTDI-CM. Thus, the content validity of the CTDI-CM is different from that of the CTDI-CV. Open-mindedness (CTDI-CM) means being open to divergent views and prudent in decision making and, most importantly, not being submissive to authority. By contrast, Open-mindedness (CTDI-CV) addresses the tolerance of divergent world views/cultures and readiness to monitor one’s own cognitive bias. The attitude towards authorities may differentiate the content of the two measurements. Indirect evidence showed that Chinese undergraduate nursing students are not as open-minded as their American student counterparts [42] and have ambivalent attitudes towards this disposition [43]. Chinese students, as obedient learners, may be more submissive to their teachers and dependent on rules, which may hinder their willingness to be open-minded [44]. Consequently, the inclination towards open-mindedness may lead to more solid decision-related reasoning and prevent nurses from making medical errors when they implement doctors’ clinical decisions. Therefore, the content of the Open-mindedness factor of the CTDI-CM may be more suitable to detect the potential inclination of these individuals.

Furthermore, the results provided only modest support for the convergent validity of the CTDI-CM with the CTDI-CV. (1) Open-mindedness on the CTDI-CM is significantly correlated with Maturity on the CTDI-CV. A plausible explanation is that open-mindedness may depend on self-reflection, which shows different developmental trajectories between young adults of different cultures. However, the developmental characteristics of Open-mindedness merit further exploration. (2) Systematicity/Analyticity and Truth-seeking on the CTDI-CM were positively related to self-confidence on the CTDI-CV and negatively related to Inquisitiveness on the CTDI-CV. The latter result may reflect the different emphases of Inquisitiveness (CTDI-CV) and Truth-seeking (CTDI-CM). Inquisitiveness represents eagerness to explore the unknown and interest in mechanisms behind phenomena, while Truth-seeking and Systematicity/Analyticity measure cognitive operations following informal and formal logical rules. Therefore, the motivation aspect of CT dispositions was less emphasized in the CTDI-CM than in the CTDI-CV, which explains the inverse relationship between the two groups of factors. Chinese philosophy and Confucius’ teaching emphasize thinking as reflection in the context of relationships and identification with the interests of the whole [44], which may help to explain the negative relationship between Inquisitiveness (CTDI-CV) and Systematicity/Analyticity (CTDI-CM).

Compared with a previous study [11], the test-retest analysis of the CTDI for medical students yielded more stable results across two assessment occasions (2 weeks apart) in the current study. All correlations were statistically significant, ranging from 0.808 to 0.965 with an overall correlation of 0.881. In addition, the results supported the internal consistency reliability of the Chinese version of the CTDI for medical students, which performed better than the two Chinese versions of the CCTDI [10, 11]. These results confirm the current inventory as a reliable instrument for measuring the critical thinking disposition.

The predictors of CT dispositions

In health care, medicine and nursing may both require high critical thinking dispositions, which can lead to increased quality of care and better treatment outcomes. Our results suggest that medical students performed better on Open-mindedness and Systematicity/Analyticity than nursing students, which contrasts with previous findings. A survey conducted with the Chinese version of the CTDI (CTDI-CV) indicated that general performance for critical thinking ability in medicine and nursing was positive (overall score > 280) [10]. Dispositional differences using the CCTDI among several majors [(practice disciplines, i.e., nursing, education, business) and nonpractice disciplines (i.e., English, history, psychology)] were found in a previous study, with nursing students achieving among the highest scores [45]. Another study found that the average scores for the CTDI-CV and Analyticity in nursing were higher than those of medical students [46]. Due to the imbalance of the sample size of nursing versus medical students, further studies are needed to explore the differences in CT dispositions among majors.

Limitations

There are limitations of the current study that await further exploration. First, direct comparison of three Chinese versions of the critical thinking disposition inventory should be considered. Furthermore, due to the limitations of time and resources, we did not obtain external measures of the constructs, such as academic or professional performance, which should be addressed in the future to improve the criterion validity. Second, like most studies on critical thinking disposition, the current study was descriptive without analysing the causes of different critical thinking dispositions across cultures, such as teaching and learning strategies. Further studies may utilize active learning approaches such as problem-based learning (PBL) [47, 48] and intervention programmes that target motivation components, such as self-awareness and mindfulness [9], to confirm the effectiveness and validity of the CDTI-CM. Third, we mainly focused on demographic variables that may affect the critical thinking disposition. More studies are necessary to broaden the understanding of other relevant factors (e.g., motivational and cognitive variables) of the CT disposition. Finally, the self-reported disposition may be subject to demand characteristics and social desirability, which are common to CT disposition scales. Future studies require the development of more reliable tests, such as behavioural and cognitive tasks (e.g., a cognitive reflection test, which can measure Analyticity), and comparison of these different measures of critical thinking.

Conclusions

The current study developed a questionnaire (CTDI-CM) to evaluate the critical thinking dispositions of Chinese medical students. The CTDI-CM includes three factors, Open-mindedness, Systematicity/Analyticity and Truth-seeking, which measure the motivation and cognitive components of the CT dispositions of medical college students. The CTDI-CM was confirmed to be a reliable and valid CT measurement. Age, gender and major were significant predictors of the CT dispositions of Chinese medical college students.

Abbreviations

AGFI:

Adjusted goodness-of-fit index

CCTDI:

California Critical Thinking Disposition Inventory

CFA:

Confirmatory factor analysis

CFI:

Comparative fit index

CR:

Critical ratio

CT:

Critical thinking

CTDI-CM:

Critical Thinking Disposition Inventory for Chinese Medical College Students

CTDI-CV:

(Critical Thinking Disposition Inventory-Chinese Version)

CVI:

Content validity index

EFA:

Exploratory factor analysis

GFI:

Goodness-of-fit index

GLM:

General linear model

GMER:

Global Minimum Essential Requirements

ICCs:

Intra-class correlation coefficients

KMO:

Kaiser-Meyer-Olkin

RMSEA:

Root-mean-square error of approximation

References

  1. Gupta M, Upshur R. Critical thinking in clinical medicine: what is it? J Eval Clin Pract. 2012;18(5):938–44.

    Article  Google Scholar 

  2. Athari ZS, Sharif SM, Nasr AR, Nematbakhsh M. Assessing critical thinking in medical sciences students in two sequential semesters: does it improve? J Educ Health Promot. 2013;2:5.

    Article  Google Scholar 

  3. Papp KK, Huang GC, Lauzon CL, Delva D, Fischer M, Konopasek L, et al. Milestones of critical thinking: a developmental model for medicine and nursing. Acad Med. 2014.

  4. Harasym PH, Tsai T, Hemmati P. Current trends in developing medical Students’ critical thinking abilities. Kaohsiung J Med Sci. 2008;24(7):341–55.

    Article  Google Scholar 

  5. Shirkhani S, Fahim M. Enhancing critical thinking in foreign language learners. Procedia - Soc Behav Sci. 2011;29:111–5.

    Article  Google Scholar 

  6. Aizikovitsh-Udi E, Radakovic N. Teaching probability by using Geogebra dynamic tool and Implemanting critical thinking skills. Procedia - Soc Behav Sci. 2012;46(0):4943–7.

    Article  Google Scholar 

  7. Hajhosseiny M. The effect of dialogic teaching on students’ critical thinking disposition. Procedia - Soc Behav Sci. 2012;69:1358–68.

    Article  Google Scholar 

  8. Jenicek M, Croskerry P, Hitchcock DL. Evidence and its uses in health care and research: the role of critical thinking. Med Sci Monitor. 2011;17(1):A12–7.

    Article  Google Scholar 

  9. Krupat E, Sprague JM, Wolpaw D, Haidet P, Hatem D, O'Brien B. Thinking critically about critical thinking: ability, disposition or both? Med Educ. 2011;45(6):625–35.

    Article  Google Scholar 

  10. Peng M, Wang G, Chen J. Validity and reliability of the Chinese critical thinking disposition inventory. Chin J Nurs. 2004;39(9):644–7.

    Google Scholar 

  11. Yeh ML. Assessing the reliability and validity of the Chinese version of the California critical thinking disposition inventory. Int J Nurs Stud. 2002;39(2):123–32.

    Article  Google Scholar 

  12. Facione NC, Facione PA, Sanchez CA. Critical thinking disposition as a measure of competent clinical judgement: the development of the California critical thinking disposition inventory. J Nurs Educ. 1994;33(8):345–50.

    Article  Google Scholar 

  13. Luo Q, Yang X. Revision for CCTDI (Chinese version). Psychol Dev Educ. 2001;(3):47–51.

  14. Jenkins SD. Cross-cultural perspectives on critical thinking. J Nurs Educ. 2011;50(5):268–74.

    Article  Google Scholar 

  15. Li X, Li X, Lǜ A. A comparative study on critical thinking ability of college nursing students in China. Japan and Samoa CHINESE NURSING RESEARCH. 2006;20(6B):1521–3.

    Google Scholar 

  16. Salsali M, Tajvidi M, Ghiyasvandian S. Critical thinking dispositions of nursing students in Asian and non-Asian countries: a literature review. Glob J Health Sci. 2013;5(6):172–8.

    Article  Google Scholar 

  17. Xie Z, Cao W, Zhang W, Zhu H, Zhang W. Critical thinking dispositions and related factors among medical undergraduates. China Higher Med Educ. 2014(10):31–2.

  18. Tang T. Thought discrepancies - on language and culture between Chinese and westerners. Journal Hainan Normal University. 2004;17(72):93–6.

    Google Scholar 

  19. Wang X, Sun H, Zhang A, Sun W, Wang P, Wang Z. Potential role of metabolomics apporoaches in the area of traditional Chinese medicine: as pillars of the bridge between Chinese and Western medicine. J Pharmaceut Biomed. 2011;55(5):859–68.

    Article  Google Scholar 

  20. Nisbett RE. The influence of culture: holistic versus analytic perception. Trends Cogn Sci. 2005;9(10):467–73.

    Article  Google Scholar 

  21. Dwyer CP, Hogan MJ, Stewart I. An integrated critical thinking framework for the 21st century. Think Skills Creat. 2014;12:43–52.

    Article  Google Scholar 

  22. Albergaria-Almeida P. Critical thinking, questioning and creativity as components of intelligence. Procedia - Soc Behav Sci. 2011;30:357–62.

    Article  Google Scholar 

  23. Peng K, Nisbett RE. Culture, dialectics, and reasoning about contradiction. Am Psychol. 1999;54(9):741.

    Article  Google Scholar 

  24. Ku KYL, Ho IT. Dispositional factors predicting Chinese students’ critical thinking performance. Pers Indiv Differ. 2010;48(1):54–8.

    Article  Google Scholar 

  25. Spencer C. Critical thinking in nursing: teaching to diverse groups. Teach Learn Nurs. 2008;3(3):87–9.

    Article  Google Scholar 

  26. Aizikovitsh E, Amit M. Evaluating an infusion approach to the teaching of critical thinking skills through mathematics. Procedia - Soc Behav Sci. 2010;2(2):3818–22.

    Article  Google Scholar 

  27. Kermansaravi F, Navidian A, Kaykhaei A. Critical thinking dispositions among junior, senior and graduate nursing students in Iran. Procedia - Soc Behav Sci. 2013;83(0):574–9.

    Article  Google Scholar 

  28. Shiau SJ, Chen CH. Reflection and critical thinking of humanistic care in medical education. Kaohsiung J Med Sci. 2008;24(7):367–72.

    Article  Google Scholar 

  29. Wojtczak A, Schwarz MR. Global minimum essential requirements: road to competence-oriented assessment of medical education programs. Educación Médica. 2003.

  30. Stern DT, Wojtczak A, Schwarz MR. Global minimum essential requirements in medical education. Med Teach. 2002;24(2):130–5.

    Article  Google Scholar 

  31. Kenimer EA. The identification and description of critical thinking behaviours in the practice of clinical laboratory science, part 1: design, implementation, evaluation, and results of a national survey. J Allied Health. 2002;31(2):56–63.

    Google Scholar 

  32. Mosier CI, McQuitty JV. Methods of item validation and abacs for item-test correlation and critical ratio of upper-lower difference. Psychometrika. 1940;5(1):57–65.

    Article  Google Scholar 

  33. Field A. Discovering statistics using IBM SPSS statistics. 2nd ed. London: SAGE Publication; 2013.

    Google Scholar 

  34. George D, Mallery P. SPSS for Windows step by step: A simple guide and reference 11.0 update. 4th ed. Boston, MA, USA: Allyn & Bacon; 2003.

  35. Kuo S, Hou W, Chang C, Liao Y, Cheng S, Chou Y, et al. Development and psychometric testing of the Chinese version of the resilience scale for southeast Asian immigrant women who divorced in Taiwan. PLoS One. 2019;14(2):e211451.

    Article  Google Scholar 

  36. Cicchetti DV, Sparrow SA. Developing criteria for establishing interrater reliability of specific items: applications to assessment of adaptive behaviour. Am J Ment Defic. 1981;86(2):127–37.

    Google Scholar 

  37. O'Connor BP. SPSS and SAS programs for determining the number of components using parallel analysis and velicer's MAP test. Behav Res Methods Instrum Comput. 2000;32(3):396–402.

    Article  Google Scholar 

  38. Ledesma RD, Valero-Mora P. Determining the number of factors to retain in EFA: an easy-to-use computer program for carrying out parallel analysis. Practical Assessment. Res Eval. 2007;12(2):1–11.

    Google Scholar 

  39. Maccallum RC, Austin JT. Applications of structural equation modelling in psychological research. Annu Rev Psychol. 2000;51(1):201–26.

    Article  Google Scholar 

  40. Jans-Beken L, Lataster J, Leontjevas R, Jacobs N. Measuring gratitude: a comparative validation of the Dutch gratitude questionnaire (GQ6) and short gratitude, resentment, and appreciation test (SGRAT). Psychol Belg. 2015;55(1):19–31.

    Article  Google Scholar 

  41. Fábián GN. Non-critical thinking: what if not thinking? Procedia - Soc Behav Sci. 2015;186:699–703.

    Article  Google Scholar 

  42. Yeh ML, Chen HH. Comparison affective dispositions towards critical thinking across Chinese and American baccalaureate nursing students. J NURS RES. 2003;11(1):39–46.

    Article  Google Scholar 

  43. Tiwari A, Avery A, Lai P. Critical thinking disposition of Hong Kong Chinese and Australian nursing students. J Adv Nurs. 2003;44(3):298–307.

    Article  Google Scholar 

  44. Li L, Wegerif R. What does it mean to teach thinking in China? Challenging and developing notions of ‘Confucian education’. Think Skills Creat. 2014;11(0):22–32.

    Article  Google Scholar 

  45. Walsh CM, Hardy RC. Dispositional differences in critical thinking related to gender and academic major. J Nurs Educ. 1999;38(4):149–55.

    Google Scholar 

  46. Ling B, Yaqing Z, Ying C, Ping W, Li-sha L. Analysis on current status and related factors of critical thinking ability in nursing and med-ical undergraduates. Chinese J School Doctor. 2010;9B(27):1369–72.

    Google Scholar 

  47. Ozturk C, Muslu GK, Dicle A. A comparison of problem-based and traditional education on nursing students’ critical thinking dispositions. Nurse Educ Today. 2008;28(5):627–32.

    Article  Google Scholar 

  48. Yu D, Zhang Y, Xu Y, Wu J, Wang C. Improvement in critical thinking dispositions of undergraduate nursing students through problem-based learning: a crossover-experimental study. J Nurs Educ. 2013;52(10):574–81.

    Article  Google Scholar 

Download references

Acknowledgements

We are deeply grateful for the comments of Dr. Mark Battersby to the manuscript. In addition, we appreciate for the helpful discussions with Dr. Dongping Gao during preparation of the manuscript.

Funding

This study was supported by a grant from the Medical Education Branch of Chinese Medical Association and the Medical Education Professional Committee of Chinese Association of Higher Education in 2010 (2010-02-33), the project of teaching reform research of Army Medical University (2014B06) and the Project of Innovation and Entrepreneurship Training for College Students (201590031003).

Availability of data and materials

The datasets within the current study are available upon request from the corresponding author.

Author information

Authors and Affiliations

  1. Department of Basic Psychology, School of Psychology, Army Medical University, Chongqing, 400038, China

    Xiaoxia Wang, Tianhao Huang, Renqiang He, Weina Hao & Li Zhang

  2. Department of Psychological Nursing, School of Nursing, Army Medical University, Chongqing, 400038, China

    Xiaoxiao Sun

Authors
  1. Xiaoxia Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaoxiao Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tianhao Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Renqiang He
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Weina Hao
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Li Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

XXW made substantial contributions to the study design and conception, analysed the data and wrote the manuscript. XXS made substantial contributions to the data collection and interpretation. THH made substantial contributions to data collection and interpretation and revised the manuscript critically. RQH made substantial contributions to the data collection, analysis and interpretation. WNH made substantial contributions to the data collection, analysis and interpretation. LZ developed the study design and made substantial contributions to the study conception. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Li Zhang.

Ethics declarations

Ethics approval and consent to participate

The project and the informed consent procedures were approved by the Ethics Committee of Army Medical University. The consent procedures included the following items, which were explained to potential participants: (1) participation in the study was voluntary, and the participants were allowed to withdraw at any time during the study; (2) the purpose and methodology of the study and the expected duration of participation; (3) the questionnaires would be used only for scientific use, and the research records identifying the participants will be maintained confidentiality. Verbal consents from the participants were obtained at the time of recruitment.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, X., Sun, X., Huang, T. et al. Development and validation of the critical thinking disposition inventory for Chinese medical college students (CTDI-M). BMC Med Educ 19, 200 (2019). https://0-doi-org.brum.beds.ac.uk/10.1186/s12909-019-1593-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12909-019-1593-z

Keywords

BMC Medical Education

ISSN: 1472-6920

Contact us