Inter-rater reliability and content validity of measurement tool for portfolio assessments used in the Introduction to Clinical Medicine course at Ewha Womans University College of Medicine: a methodological study (doi:10.7910/DVN/ZNTIWJ)

View:

Part 1: Document Description
Part 2: Study Description
Part 5: Other Study-Related Materials
Entire Codebook

Document Description

Citation

Title:

Inter-rater reliability and content validity of measurement tool for portfolio assessments used in the Introduction to Clinical Medicine course at Ewha Womans University College of Medicine: a methodological study

Identification Number:

doi:10.7910/DVN/ZNTIWJ

Distributor:

Harvard Dataverse

Date of Distribution:

2025-01-01

Version:

1

Bibliographic Citation:

Dong-Mi Yoo; Jae Jin Han, 2025, "Inter-rater reliability and content validity of measurement tool for portfolio assessments used in the Introduction to Clinical Medicine course at Ewha Womans University College of Medicine: a methodological study", https://doi.org/10.7910/DVN/ZNTIWJ, Harvard Dataverse, V1

Study Description

Citation

Title:

Inter-rater reliability and content validity of measurement tool for portfolio assessments used in the Introduction to Clinical Medicine course at Ewha Womans University College of Medicine: a methodological study

Identification Number:

doi:10.7910/DVN/ZNTIWJ

Authoring Entity:

Dong-Mi Yoo (Department of Medical Education, College of Medicine, The Catholic University of Korea)

Jae Jin Han (Department of Medical Education & Thoracic Surgery, Ewha Womans University College of Medicine)

Distributor:

Harvard Dataverse

Access Authority:

Dong-Mi Yoo

Depositor:

Cho, A Ra

Date of Deposit:

2024-12-02

Holdings Information:

https://doi.org/10.7910/DVN/ZNTIWJ

Study Scope

Keywords:

Medicine, Health and Life Sciences

Abstract:

This study aims to examine the reliability and validity of measurement tool for portfolio assessments in medical education. Specifically, it investigated scoring consistency among raters and assessment criteria appropriateness by the expert panel. A cross-sectional observational study was done from September to December 2018 for the Introduction to Clinical Medicine course at the Ewha Womans University College of Medicine. Data were collected for 5 randomly selected portfolios scored by a and 6 trained raters. An expert panel assessed the validity of 12 assessment items using the content validity index (CVI). Statistical analysis included Pearson correlation coefficients for rater alignment, intraclass correlation coefficient (ICC)for inter-rater reliability, and CVI for item-level validity.

Methodology and Processing

Sources Statement

Data Access

Other Study Description Materials

Other Study-Related Materials

Label:

Dataset 1. Research data for the inter-rater reliability of portfolio assessment..xlsx

Notes:

application/vnd.openxmlformats-officedocument.spreadsheetml.sheet

Other Study-Related Materials

Label:

Dataset 2. Research data for the inter-rater reliability of content validity..xlsx

Notes:

application/vnd.openxmlformats-officedocument.spreadsheetml.sheet

Other Study-Related Materials

Label:

Supplement 1. The criteria for “Introduction to Clinical Medicine” portfolio assessment.docx

Notes:

application/haansoftdocx