Skip to main content

Table 2 Individual item analysis was performed to assess item IDI, ITC and difficulty

From: Development and validation of the ACE tool: assessing medical trainees’ competency in evidence based medicine

Step*

Item

IDI

ITC

Novice pass rate (%)

Intermediate pass rate (%)

Advanced pass rate (%)

Overall pass rate (%)

P-value+

1

1

0.70

0.15

41

96

71

69

0.0001

1

2

0.74

0.15

58

94

70

74

0.0001

2

3

0.84

0.15

83

91

79

84

0.059

2

4

0.61

0.19

65

41

74

60

0.0001

3

5

0.70

0.06

57

88

65

70

0.0001

3

6

0.42

0.03

15

97

19

43

0.0001

3

7

0.49

0.15

52

33

61

49

0.0003

3

8

0.66

0.04

83

17

96

66

0.0001

3

9

0.81

0.14

75

72

95

81

0.0001

3

10

0.67

0.20

56

47

93

66

0.0001

3

11

0.59

0.14

38

88

52

59

0.0001

4

12

0.79

0.17

67

84

84

79

0.003

4

13

0.76

0.16

79

54

94

76

0.0001

4

14

0.40

0.16

62

7

51

40

0.0001

4

15

0.37

0.17

32

37

40

36

0.49

  1. Chi-square analysis for difference in pass rates between EBM-novice, intermediate and advanced groups. IDI = item discrimination index, ITC = item-total correlation.
  2. *Items 1 and 2 relate to EBM step 1 (asking the answerable question), items 3 and 4 relate to step 2 (searching the literature), items 5–11 relate to step 3 (critical appraisal) and items 12–15 relate to step 4 (applying the evidence to the patient scenario).