Replication data for: How Robust Standard Errors Expose Methodological Problems They Do Not Fix, and What to Do About It (doi:10.7910/DVN/26935)

View:

Part 1: Document Description
Part 2: Study Description
Part 3: Data Files Description
Part 4: Variable Description
Part 5: Other Study-Related Materials
Entire Codebook

Document Description

Citation

Title:

Replication data for: How Robust Standard Errors Expose Methodological Problems They Do Not Fix, and What to Do About It

Identification Number:

doi:10.7910/DVN/26935

Distributor:

Harvard Dataverse

Date of Distribution:

2014-08-04

Version:

7

Bibliographic Citation:

King, Gary; Roberts, Margaret, 2014, "Replication data for: How Robust Standard Errors Expose Methodological Problems They Do Not Fix, and What to Do About It", https://doi.org/10.7910/DVN/26935, Harvard Dataverse, V7, UNF:5:Bc1yVsbYLpjnS0Bx6FDnNA== [fileUNF]

Study Description

Citation

Title:

Replication data for: How Robust Standard Errors Expose Methodological Problems They Do Not Fix, and What to Do About It

Identification Number:

doi:10.7910/DVN/26935

Authoring Entity:

King, Gary (Harvard University)

Roberts, Margaret (Harvard University)

Distributor:

Harvard Dataverse

Distributor:

Harvard Dataverse

Date of Deposit:

2014-08-04

Date of Distribution:

2014

Holdings Information:

https://doi.org/10.7910/DVN/26935

Study Scope

Keywords:

Social Sciences

Abstract:

"Robust standard errors" are used in a vast array of scholarship to correct standard errors for model misspecification. However, when misspecification is bad enough to make classical and robust standard errors diverge, assuming that it is nevertheless not so bad as to bias everything else requires considerable optimism. And even if the optimism is warranted, settling for a misspecified model, with or without robust standard errors, w ill still bias estimators of all but a few quantities of interest. Even though this message is well known to methodologists, it has failed to reach most applied researchers. The resulting cavernous gap between theory and practice suggests that considerable gains in applied statistics may be possible. We seek to help applied researchers realize these gains via an alternative perspective that offers a productive way to use robust standard errors; a new general and easier-to-use "generalized information matrix test" statistic; and practical illustrations via simulations and real examples from published research. Instead of jettisoning this extremely popular tool, as some suggest, we show how robust and classical standard error differences can provide effective clues about model misspecification, likely biases, and a guide to more reliable inferences. <br /><br /> See also: <a href="http://gking.harvard.edu/category/research-interests/methods/unifying-statistical-analysis" target="_blank">Unifying Statistical Analysis</a>

Methodology and Processing

Sources Statement

Data Access

Notes:

<b>One data file is impacted by a copyright license</b>: <br /><br /> MilnerButhe2.tab<br /><br /> Some of the data from the article we replicated by Tim Buthe and Hellen Millner data is proprietary; to obtain it, you must contact them directly.

<a href="http://creativecommons.org/publicdomain/zero/1.0">CC0 1.0</a>

Other Study Description Materials

Related Publications

Citation

Title:

Forthcoming, Political Analysis <br /><br /> King, Gary, and Margaret Roberts. 2014. How Robust Standard Errors Expose Methodological Problems They Do Not Fix, and What to Do About It. Political Analysis: <a href="http://j.mp/InK5jU" target="_blank">Link to article</a>

Bibliographic Citation:

Forthcoming, Political Analysis <br /><br /> King, Gary, and Margaret Roberts. 2014. How Robust Standard Errors Expose Methodological Problems They Do Not Fix, and What to Do About It. Political Analysis: <a href="http://j.mp/InK5jU" target="_blank">Link to article</a>

File Description--f2491887

File: Article for ISQ (aid).tab

  • Number of cases: 800

  • No. of variables per record: 27

  • Type of File: text/tab-separated-values

Notes:

UNF:5:QGsV/5PPLSLY3pzMxA605g==

File Description--f2491888

File: DreherandJensenJLEreplication.tab

  • Number of cases: 1276

  • No. of variables per record: 62

  • Type of File: text/tab-separated-values

Notes:

UNF:5:qIf4rZS3jLHzECxcgMaOgg==

File Description--f2493899

File: MilnerButhe2.tab

  • Number of cases: 2673

  • No. of variables per record: 67

  • Type of File: text/tab-separated-values

Notes:

UNF:5:/jhzaGz9a1paDAHaSZ4iLw==

Some of the data from the article we replicated by Tim Buthe and Hellen Millner data is proprietary; to obtain it, you must contact them directly.

Variable Description

List of Variables:

Variables

year

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:xngZfSd5FgW2rSjIZZoLIw==

country

f2491887 Location:

Variable Format: character

Notes: UNF:5:PmO2lW1R8ljrSNXmq0KPMA==

arms

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:d8VbOyr9bsKGPonEax3vzA==

freedom

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:NqETLn6t/OrN+elt1wQePw==

graft

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:PX2MzFNOHqWUeOPHGs/NPQ==

lncolony

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:rlSvixXpKEaDS31dIJcExA==

lndist

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:jrixymvZLu9ZDeOOS1ABNQ==

lngdp

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:YO6Jk9VGwCECagyUdH8a4g==

lnpop

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:rdAgBHZ9uF2FBqZLlyzaMg==

lnpopsq

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:OxS2ltVl4vnvEQHEGiEHhA==

militexp

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:Uucp3T6IBEtEp0TC3eesVw==

terror

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:3SqkBJjkLKrHIcj2ljDCyg==

year83

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:LpNfmBgtg5rIzOHYibJJeQ==

year86

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:TOoBXPqv9/r7EZeOWJzuug==

year89

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:cFEQZ7rTVIjwelfdb3vrog==

year92

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:kRs8JcBz4AclaU9fS7coqA==

africash

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:8B8P6NKF3FtUQUyslvoSLw==

asiash

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:k6EQVYhE58Q8/AmiPEVYFQ==

caribbsh

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:Lw7tVx4eKoCMphpNpDAekg==

idash

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:LygKb1GH4oCEHLmFjx0qXQ==

multish

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:FqzSIIuGwiDfjCMpMDscdQ==

undpsh

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:WqCSdDevq8JM2acPilp79Q==

unicefsh

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:XmwLrk/Mdvyru1xeu1W+9g==

untash

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:AebPjLnJ0D+iIWN0d0834A==

pqliboth

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:ZeD6TGmsgrNEUlFjpmVVXQ==

icrgcorrupt

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:92jshKvjAshkYu5v4BzV/g==

intamsh

f2491887 Location:

Variable Format: numeric

Notes: UNF:5:XglZW6Joc8E9dMLfud4AHQ==

un_per_l

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:Gh1GM6QnjJu+nGXsceUyHw==

country

f2491888 Location:

Variable Format: character

Notes: UNF:5:4DvyiRVrelY0mHC187I8kw==

year

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:+22iuZJ+An9YrCazsnbkCQ==

sum

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:VLeWm1WhZVA1l8SI/m9MDg==

id

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:XcbTWAlTU6csYcyun8WWFQ==

gdp_r_wk

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:hWdISe7T/Tt7P+BhIPIHSA==

sum_ii

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:ReD/+TJyBQZOgLRv/a1jcQ==

sum_i

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:pHibz4ZDpoEpPnfXA01isQ==

pc

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:M9hABn3qZUIsJFur/pdWtw==

sb

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:KdVb1z25UFo3AgLvK9egoA==

pa

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:cnBoa3H5O0Wav/qMbDLwZw==

t19974

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:dEDVhaT0FejD3OxK2dO4VA==

t19981

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:KTNQkOTBz0W8UZfPi8d97Q==

t19982

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:6g/4ZJDxQVk48loKKltFCw==

t19983

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:SZ8pJ+xXJCbIL4kPG+bI0A==

t19984

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:8ZxLJY9r6Qa1tjXbVK1AvQ==

t19991

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:JFHQP2x5b6zzxoCLBAio6g==

t19992

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:XeEePF5KEozGYa+62fIzVg==

t19993

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:Hyp9XTenVUp/JN91kDiUDQ==

t19994

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:sJ7bfdEklhQDICaFnmJcmg==

t20001

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:rap8J2TuoodXbdzO08Dlxw==

t20002

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:XkUn0TKjDCgNmAl81Rym+g==

t20003

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:xXo42Hl9I9fBwfkgK6GBJg==

t20004

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:SYsgmVB77lmN5xjxlZh1Pg==

t20011

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:DhuYBcgrrmAbPXWfXa0gDA==

t20012

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:FVSiKnMSdjUSoZyTzhpEww==

t20013

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:hW3SrhILUYKuazylbXzrfw==

t20014

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:Zn3JGNwREq4sJ1JX+DNM6Q==

t20021

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:QOj70p+9pzq2tZ8RxJaUyw==

t20022

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:3w7XL/TCNQnYPNkDitZBgA==

t20023

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:FpP6a1smkoDrUIDVa9L31g==

t20024

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:UrezAv73fi3nn8BubdCh8w==

t20031

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:I/OD5GIDx4jDywrzWZUopg==

t20032

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:cnRtw1k07nr27wbSljNQLA==

gg_l

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:XUjuJYyhavdDQVOnRDpgwQ==

mg_l

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:ctQJIftKMnr9+PAIur2idg==

def_gdp_l

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:JWyJ7l8WecqTJ4/bkzcb8g==

gge_gdp_l

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:sMI8NJeGaw41FMeGLGEMGw==

sum_ii_l

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:LcYvVhr5rddg3JWdAeWieQ==

sum_i_l

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:A/qeUTxv4MVhQKOioZXbSw==

sum_l

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:otEdtvECyrYBG20sVLYUtA==

libor_l

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:01OiTUZsfSdPscVszi04Mg==

res_c_l

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:bik5X/963ky69GGBcRzr1g==

gg_oecd_l

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:tRPg2hrcceNnfA603rTGcQ==

cab_gdp_l

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:Mz6FhduyrKJDDlOBhY9WSg==

imf_c_liab_l

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:OTEPVFGcBxVfURHXsUkn9A==

sum_tra

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:J06HFV5HwDXmHkIPn0l+oA==

sum_not_tra

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:Xvk6njoxn7Ttrbkd9B5PbA==

election_av

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:G8qxtTzTsk5HYBm36hW3BQ==

un_el_av

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:72FYrTL5LtVDvifa/Thrdw==

cum_ca_l

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:hBVkVf1O6jqJN/Cu476iqA==

cum_uk_l

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:5X+3gxYGNV0Ds2medb0pxA==

cum_fr_l

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:XYckPJOuK/5O6O7TwToWvA==

cum_ge_l

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:9rhk0r8kfUmDVu2fA6/yoQ==

cum_it_l

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:rQqz2zsys75QM4K6WJ3rdg==

cum_ja_l

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:rfQh5B0GR/Z4DtR2P0Zcng==

ca_el_av

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:PFjJeCYqAu9q9GpyBHtH7Q==

uk_el_av

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:TrCt3haNqqPx4VmOaXloGA==

fr_el_av

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:5btD4GZKagvLtRCBkVldtA==

ge_el_av

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:S0C5o0IkandxXjuMwEKv6A==

it_el_av

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:DIF+ho/9l9xBZsvcBNKc5A==

ja_el_av

f2491888 Location:

Variable Format: numeric

Notes: UNF:5:oTS4hECIcV6fwRNGIEyF0A==

Other Study-Related Materials

Label:

bootstrapIM.nb.R

Text:

Notes:

text/plain; charset=US-ASCII

Other Study-Related Materials

Label:

bootstrapIM.normal.R

Text:

Notes:

text/plain; charset=US-ASCII

Other Study-Related Materials

Label:

bootstrapIM.poisson.R

Text:

Notes:

text/plain; charset=US-ASCII

Other Study-Related Materials

Label:

ButheMilner.R

Text:

replicates the Buthe and Milner (2008) example from the paper.

Notes:

text/plain; charset=US-ASCII

Other Study-Related Materials

Label:

DreherJensen.R

Text:

replicates the Dreher and Jensen (2007) example from the paper

Notes:

text/plain; charset=US-ASCII

Other Study-Related Materials

Label:

Neumayer_ISQ_2003.R

Text:

replicates the Neumayer (2003) example from the paper

Notes:

text/plain; charset=US-ASCII

Other Study-Related Materials

Label:

ReadMe.txt

Text:

ReadMe file related to this data

Notes:

text/plain; charset=UTF-8

Other Study-Related Materials

Label:

vcovSACCchange.R

Notes:

type/x-r-syntax