Skip to main content

Table 2 Comparison of types of errors in the A-type MCQs between the AI platforms in pre-clerkship phase and at graduation

From: Artificial intelligence and medical education: application in classroom instruction and student assessment using a pharmacology & therapeutics case study

Types of errors

Sage Poe©

Chart GPT©

Claude-Instant©

Pre-clerkship (n = 5)

At graduation (n = 5)

Pre-clerkship (n = 5)

At graduation (n = 5)

Pre-clerkship (n = 5)

At graduation (n = 5)

Pharmacokinetics

Item construction defect

5b, c, d, e, f

4 ac, ad, ae, ag

None

None

5 au

None

More than one correct option

None

1s

1s

None

None

None

Appropriateness to learners’ level controversial

3 b, c, e

1ac

2 r, t

1an

None

None

Mechanisms of action

Item construction defect

None

None

2 q, u

1aL

None

None

More than one correct option

1a

1ab

None

3am, ao, ap

None

None

Appropriateness to learners’ level controversial

None

None

1v

None

None

None

Adverse drug reactions

Item construction defect

None

None

None

None

None

None

More than one correct option

1g

1ah

1z

2aq, ar

None

None

Appropriateness to learners’ level controversial

1h

None

None

None

None

None

Indications

Item construction defect

None

None

1z

None

1 p

None

More than one correct option

3 i, k, l

2 a.i., ak

2 y, aa

1as

4 m, n, o, p

None

Appropriateness to learners’ level controversial

2 j, k

1aj

None

None

1 n

None

  1. a-lisinopril (test item #1); b-bioavailability and metabolized by liver (item #6); c-renal elimination and long half-life (item# 7); d-metabolized by both liver and kidney (item #8); e-rapid onset of action and short duration (item #9); f- transdermal patch and duration of action (item #10); g-lisinopril and losartan (item #13); h-verapamil and orthostatic hypotension (item #15); i-lisinopril and losartan (item # 16); j-carvedilol for heart failure with reduced ejection fraction (item #17); k-lisinopril and losartan for stroke prevention (item #18); L-hydralazine and methyldopa (item #20); m-lisinopril and losartan (item #17); n-HT Rx in night shift worker (item #18); o- treatment of hypertension and chronic kidney disease (item #19); p- treatment of hypertension and hyperlipidemia (item #20); q-metoprolol and its effects on blood vessels (item #4); R-longest half-life among antihypertensives (item # 6); s- four possible correct answers (item #7); t-immediate and extended-release preparations (item # 8); u- antihypertensive drug to be taken with food (item #9); v-highest bioavailable antihypertensive drug (item #10); x-losartan and ramipril cause hyperkalemia (item#11); y-losartan and ramipril can be used for treating hypertension and heart failure (item #16); z- hypertension with angina and amlodipine (item #17); aa-losartan and ramipril in hypertension and diabetic Nephropathy (item #18); ab-lisinopril and losartan (item #4); ac-high bioavailability and metabolized by liver (item #6); ad-eliminated by kidneys and long half-life (item #7); ae-metoprolol metabolized by both liver and kidneys (item #8); af-rapid onset and short duration (item #9); ag-transdermal patch and longer duration (item #10); ah-lisinopril and losartan (item #13); ai-hydrochlorothiazide, lisinopril and losartan are indicated for hypertension and diabetes mellitus (item #16); aj-losartan as antihypertensive drug for preventing recurrent stroke (item #19); ak-methyldopa and hydralazine can be used in preeclampsia (item #20); al-ramipril inhibits RAAS (item #2); am-losartan and candesartan blocks type II receptors (item #3); an-doxazosin with longest duration of action (item #6); ao-ramipril and losartan contra-indicated in renal impairment (item #8); ap-losartan, ramipril and spironolactone cause hyperkalemia (item # 13); ar- hydrochlorothiazide and hydrochlorothiazide/triamterene can result in photosensitivity (item # 15); as-losartan and ramipril reduce morbidity and mortality in heart failure (item #16); and au-The question should be what type of pharmacokinetic characteristics best describes the respective drug (items #6 to #10)