Replication Data and Supplementary Material for: Performance of Generative AI in Brazilian Portuguese Medical Exam (doi:10.7910/DVN/OLKIL3)

View:

Part 1: Document Description
Part 2: Study Description
Part 5: Other Study-Related Materials
Entire Codebook

Document Description

Citation

Title:

Replication Data and Supplementary Material for: Performance of Generative AI in Brazilian Portuguese Medical Exam

Identification Number:

doi:10.7910/DVN/OLKIL3

Distributor:

Harvard Dataverse

Date of Distribution:

2025-02-10

Version:

1

Bibliographic Citation:

Panse Silveira, Paulo Sergio; Gomes Rabelo, Amanda, 2025, "Replication Data and Supplementary Material for: Performance of Generative AI in Brazilian Portuguese Medical Exam", https://doi.org/10.7910/DVN/OLKIL3, Harvard Dataverse, V1

Study Description

Citation

Title:

Replication Data and Supplementary Material for: Performance of Generative AI in Brazilian Portuguese Medical Exam

Identification Number:

doi:10.7910/DVN/OLKIL3

Authoring Entity:

Panse Silveira, Paulo Sergio (Faculdade de Medicina da Universidade de São Paulo)

Gomes Rabelo, Amanda (Hospital Israelita Albert Einstein)

Distributor:

Harvard Dataverse

Access Authority:

Panse Silveira, Paulo Sergio

Depositor:

Panse Silveira, Paulo Sergio

Date of Deposit:

2025-02-10

Holdings Information:

https://doi.org/10.7910/DVN/OLKIL3

Study Scope

Keywords:

Computer and Information Science, Medicine, Health and Life Sciences

Abstract:

<p> This dataset contains the supplementary material and replication data associated with the article <em>"Performance of Generative AI in Brazilian Portuguese Medical Exam"</em> by Truyts et al., 2025. <p> The dataset includes two components: <br> (A) raw and processed data along with R and Python scripts used to generate the tables, figures, and statistical analyses in the article; <br> and (B) the original exam questions in Portuguese, their English translations, and evaluations by three physician observers. <br> <br> Additional analyses and visualizations not included in the manuscript are also provided. </p>

Notes:

The article was coauthored by: </p> <ul> <li>César Augusto Madid Truyts (Einstein Global Advanced Technologies for Equity, Hospital Israelita Albert Einstein, São Paulo, Brazil)</li> <li>Amanda Gomes Rabelo (Einstein Global Advanced Technologies for Equity, Hospital Israelita Albert Einstein, São Paulo, Brazil)</li> <li>Gabriel Mesquita de Souza (Einstein Global Advanced Technologies for Equity, Hospital Israelita Albert Einstein, São Paulo, Brazil)</li> <li>Daniel Scaldaferri Lages (Departamento de Pacientes Graves, Hospital Israelita Albert Einstein, São Paulo, Brazil)</li> <li>Adriano José Pereira (Einstein Global Advanced Technologies for Equity, Hospital Israelita Albert Einstein, São Paulo, Brazil)</li> <li>Uri Adrian Prync Flato (Departamento de Pacientes Graves, Hospital Israelita Albert Einstein, São Paulo, Brazil)</li> <li>Eduardo Pontes dos Reis (Stanford Center for Artificial Intelligence in Medicine and Imaging, Stanford University, USA)</li> <li>Joaquim Edson Vieira (Departamento de Anestesiologia e Cirurgia, Faculdade de Medicina, Universidade de São Paulo, Brazil)</li> <li>Paulo Sergio Panse Silveira (Departamento de Informática Médica e Patologia, Faculdade de Medicina, Universidade de São Paulo, Brazil)</li> <li>Edson Amaro Junior (Faculdade Israelita de Ciências da Saúde Albert Einstein, Hospital Israelita Albert Einstein, São Paulo, Brazil)</li> </ul>

Methodology and Processing

Sources Statement

Data Access

Other Study Description Materials

Other Study-Related Materials

Label:

Data and Scripts.pdf

Text:

Raw and reorganized data used to produce the tables and graphs in the associated article.

Notes:

application/pdf

Other Study-Related Materials

Label:

Data.zip

Text:

Companion material: extract to the same folder where the appendix PDF is located.

Notes:

application/zip

Other Study-Related Materials

Label:

Exam Questions.pdf

Text:

Questions reproduced from the original medical residency entrance exam of the Hospital das Clínicas da Faculdade de Medicina da Universidade de São Paulo (HCFMUSP): original version in Portuguese, English translation, and a summary of the evaluation of the AI’s performance.

Notes:

application/pdf

Other Study-Related Materials

Label:

Figures.zip

Text:

Companion material: extract to the same folder where the appendix PDF is located.

Notes:

application/zip

Other Study-Related Materials

Label:

ScriptsPy.zip

Text:

Companion material: extract to the same folder where the appendix PDF is located.

Notes:

application/zip

Other Study-Related Materials

Label:

ScriptsR.zip

Text:

Companion material: extract to the same folder where the appendix PDF is located.

Notes:

application/zip