|
View: |
Part 1: Document Description
|
|
Citation |
|
|---|---|
|
Title: |
Replication Data for: The Limits (and Strengths) of Single-Topic Experiments |
|
Identification Number: |
doi:10.7910/DVN/QX0BSK |
|
Distributor: |
Harvard Dataverse |
|
Date of Distribution: |
2024-09-07 |
|
Version: |
1 |
|
Bibliographic Citation: |
Rainey, Carlisle, 2024, "Replication Data for: The Limits (and Strengths) of Single-Topic Experiments", https://doi.org/10.7910/DVN/QX0BSK, Harvard Dataverse, V1 |
|
Citation |
|
|
Title: |
Replication Data for: The Limits (and Strengths) of Single-Topic Experiments |
|
Identification Number: |
doi:10.7910/DVN/QX0BSK |
|
Authoring Entity: |
Rainey, Carlisle (Florida State University) |
|
Producer: |
<i>Political Analysis</i> |
|
Distributor: |
Harvard Dataverse |
|
Access Authority: |
Rainey, Carlisle |
|
Depositor: |
Rainey, Carlisle |
|
Date of Deposit: |
2024-04-24 |
|
Holdings Information: |
https://doi.org/10.7910/DVN/QX0BSK |
|
Study Scope |
|
|
Keywords: |
Social Sciences |
|
Abstract: |
Abstract: We examine the generalizability of single-topic studies, focusing on how often their confidence intervals capture the typical treatment effect from a larger population of possible studies. We show that the confidence intervals from these single-topic studies capture the typical effect from a population of topics at well below the nominal rate. For a plausible scenario, the confidence interval from a single-topic study might only be half as wide as an interval that captures the typical effect at the nominal rate. We highlight three important conclusions. First, we emphasize that researchers and readers must take care when generalizing the inferences from single-topic studies to a larger population of possible studies. Second, we demonstrate the critical importance of similarity across topics in drawing inferences and encourage researchers to consider designs that explicitly estimate and leverage similarity. Third, we emphasize that, despite their limitations, single-topic experiments have some important advantages. |
|
Methodology and Processing |
|
|
Sources Statement |
|
|
Data Access |
|
|
Other Study Description Materials |
|
|
Related Publications |
|
|
Citation |
|
|
Title: |
Forthcoming, Political Analysis Preprint DOI: https://doi.org/10.31235/osf.io/zaykd |
|
Identification Number: |
add DOI# here when available. If not available, please delete all text in this field before saving |
|
Bibliographic Citation: |
Forthcoming, Political Analysis Preprint DOI: https://doi.org/10.31235/osf.io/zaykd |
|
Label: |
install-packages.R |
|
Text: | |
|
Notes: |
type/x-r-syntax |
|
Label: |
limits.Rproj |
|
Text: | |
|
Notes: |
application/octet-stream |
|
Label: |
make-figures.R |
|
Text: | |
|
Notes: |
type/x-r-syntax |
|
Label: |
master.R |
|
Text: | |
|
Notes: |
type/x-r-syntax |
|
Label: |
README.pdf |
|
Text: | |
|
Notes: |
application/pdf |
|
Label: |
figure1.png |
|
Text: | |
|
Notes: |
image/png |
|
Label: |
figure2.png |
|
Text: | |
|
Notes: |
image/png |