Michal Krawczyk, Ernesto Reuben
Cited by*: None Downloads*: None

This article reports results of a field experiment in which two hundred e-mails were sent to authors of recent articles in economics that had promised to send the interested reader supplementary material, such as alternative econometric specifications, "upon request." The e-mails were sent either by a researcher affiliated at Columbia University, New York or the University of Warsaw, Poland; furthermore, the authors' position (assistant professor) was specified in half the e-mails only. Overall, 64% of the approached authors responded to our message, of which two thirds (44% of the entire sample) delivered the requested materials. The frequency and speed of responding and delivering were very weakly affected by the position and affiliation of the sender. Gender of affiliation of the author, number of citations or journal impact factory or the type of object in question seemed to make no difference. However, authors of published articles were much more likely to share than authors of working papers.
Christopher Mann
Cited by*: 1 Downloads*: 7

Survey researchers have long been concerned with the question of whether participation in preelection surveys increases voter turnout. This article presents findings from three large-scale field experiments conducted during the 2002 general election in Maryland, New York, and Pennsylvania. Unlike early studies, which found that participation in preelection surveys increased voter turnout, this study finds no significant effect. The author argues that the rigorous experimental methodology and large sample size in these three experiments should allay concern that survey participation affects turnout.
John A List
Cited by*: 18 Downloads*: 3

We employ a two-step modified count data model to determine the county-level attributes that are conducive to attracting new foreign plants. Our estimation results indicate that previous counts of foreign direct investment, market size and accessibility, and land area are positively related to Foreign Direct Investment (FDI) occurrences; while higher input costs deter new foreign firm entry. Contrary to anecdotal evidence, our results suggest that stringent environmental regulations do not have a negative impact on FDI inflows. These findings have significant implications for policymakers, as flows of FDI are expected to increase dramatically given the economic integration of our global economy.
Faith Fatchen, John A. List, Francesca Pagnotta
Cited by*: Downloads*:

In recent years, field experiments have reshaped policy worldwide, but scaling ideas remains a thorny challenge. Perhaps the most important issue facing policymakers today is deciding which ideas to scale. One approach to attenuate this information problem is to augment traditional A/B experimental designs to address questions of scalability from the beginning. List 2024 denotes this approach as “Option C” thinking. Using early education as a case study, we show how AI can overcome a critical barrier in Option C thinking – generating viable options for scaling experimentation. By integrating AI-driven insights, this approach strengthens the link between controlled trials and large-scale implementation, ensuring the production of policy-based evidence for effective decision-making.
Erwin Bulte, Andreas Kontoleon, John A List, Ty Turley, Maarten Voors
Cited by*: 9 Downloads*: 46

We implement a public goods game and a social intervention modeled after a public goods game in rural Sierra Leone near the Gola Forest Reserve. We also collect demographic, economic and forest conservation data on households in the area. We use this data to assess the mapping of social preferences from the artefactual field experiment (AFE) into real world behavior. We find evidence of heterogeneity in shifting factors between the AFE, the field experiment, and conservation outcomes. We also find evidence that social controls like war violence and witchcraft may explain some of this correlation.
Jeffrey A Flory, Andreas Leibbrandt, John A List
Cited by*: 0 Downloads*: 109

Workplace misbehaviors are often governed by explicit monitoring and strict punishment. Such enforcement activities can serve to lessen worker productivity and harm worker morale. We take a different approach to curbing worker misbehaviour - bonuses. Examining more than 6500 donor phone calls across more than 80 workers, we use a natural field experiment to investigate how different wage contracts influence workers' propensity to break workplace rules in harmful ways. Our findings show that even though standard relative performance pay contracts, relative to a fixed wage scheme, increase productivity, they have a dark side: they cause considerable cheating and sabotage of co-workers. Yet, even in such environments, by including an unexpected bonus, the employer can substantially curb worker misbehavior. In this manner, our findings reveal how employers can effectively leverage bonuses to eliminate undesired behaviors induced by performance pay contracts.
John A List, Paramita Sinha, Michael H Taylor
Cited by*: 33 Downloads*: 116

Critics of stated preference methods argue that hypothetical bias precludes survey techniques from providing reliable economic values for non-market goods and services, rendering estimation of the total economic benefits of public programs fruitless. This paper explores a relatively new methodology to obtain the total value of non-market goods and services-choice experiments-which conveniently provide information on the purchase decision as well as the characteristic value vector. The empirical work revolves around examining behavior in two very different field settings. In the first field study, we explore hypothetical bias in the purchase decision by eliciting contributions for a threshold public good in an actual capital campaign. To extend the analysis a level deeper, in a second field experiment we examine both the purchase decision and the marginal value vector via inspection of consumption decisions in an actual marketplace. In support of the new valuation design, both field experiments provide some evidence that hypothetical choice experiments combined with ""cheap talk"" can yield credible estimates of the purchase decision. Furthermore, we find no evidence of hypothetical bias when estimating marginal attribute values. Yet, we do find that the ""cheap talk"" component might induce internal inconsistency of subjects' preferences in the choice experiment.
Juan-Camilo Cardenas, Jeff P Carpenter
Cited by*: 1 Downloads*: 13

No abstract available
Craig E Landry, John A List
Cited by*: 35 Downloads*: 17

While contingent valuation remains the only option available for measurement of total economic value of nonmarketed goods, the method has been criticized due to its hypothetical nature. We analyze field experimental data to evaluate two ex ante approaches to attenuating hypothetical bias, directly comparing value statements across four distinct referenda: hypothetical, "cheap talk," "consequential," and real. Our empirical evidence suggests two major findings: hypothetical responses are significantly different from real responses; and responses in the consequential and cheap talk treatments are statistically indistinguishable from real responses. We review the potential for each method to produce reliable results in the field.
Dean S Karlan
Cited by*: 1 Downloads*: 28

Questions remain as to whether results from experimental economics are generalizable to real decisions in nonlaboratory settings. Furthermore, questions persist about whether social capital helps mitigate information asymmetries in credit markets. I examine whether behavior in two laboratory games, Trust and a Public Goods, predicts loan repayments to a Peruvian group-lending microfinance program. Since this program relies on social capital to enforce repayment, this tests the external validity of the games. Individuals identified as "trustworthy" by the Trust Game are indeed less likely to default on their loans. No similar support is found for the game's identification of "trusting" individuals.
Eric Bettinger, Robert Slonim
Cited by*: 13 Downloads*: 8

Economic research examining how educational intervention programs affect primary and secondary schooling focuses largely on test scores although the interventions can affect many other outcomes. This paper examines how an educational intervention, a voucher program, affected students' altruism. The voucher program used a lottery to allocate scholarships among low-income applicant families with children in K-8th grade. By exploiting the lottery to identify the voucher effects, and using experimental economic methods, we measure the effects of the intervention on childrens altruism. We also measure the voucher programs effects on parents' altruism and several academic outcomes including test scores. We find that the educational intervention positively affects students' altruism towards charitable organizations but not towards their peers. We fail to find statistically significant effects of the vouchers on parents' altruism or test scores.
Eric Floyd, John A List
Cited by*: 2 Downloads*: 49

The gold standard in the sciences is uncovering causal relationships. A growing literature in economics utilizes field experiments as a methodology to establish causality between variables. Taking lessons from the economics literature, this study provides an "A-to-Z" description of how to conduct field experiments in accounting and finance. We begin by providing a user's guide into what a field experiment is, what behavioral parameters field experiments identify, and how to efficiently generate and analyze experimental data. We then provide a discussion of extant field experiments that touch on important issues in accounting and finance, and we also review areas that have ample opportunities for future field experimental explorations. We conclude that the time is ripe for field experimentation to deepen our understanding of important issues in accounting and finance.
John A List, Michael K Price
Cited by*: 3 Downloads*: 6

This study showcases the usefulness of field experiments to the study of environmental and resource economics. Our focus pertains to work related to field experiments in the area of 'behavioral' environmental and resource economics. Within this rubric, we discuss research in two areas: those that inform i) benefit cost analysis and ii) conservation of resources. Within each realm, we show how field experiments have been able to test the relevant theories, provide important parameters to construct new theories, and guide policymakers. We conclude with thoughts on how field experiments can be used to deepen our understanding of important areas within environmental and resource economics.
John A List
Cited by*: 0 Downloads*: 111

Not applicable.
David Lucking-Reiley
Cited by*: 76 Downloads*: 16

William Vickrey's predicted equivalences between first-price sealed-bid and Dutch auctions, and between second-price sealed-bid and English auctions, are tested using field experiments that auctioned off collectible trading cards over the Internet. The results indicate that the Dutch auction produces 30-percent higher revenues than the first-price auction format, a violation of the theoretical prediction and a reversal of previous laboratory results, and that the English and second-price formats produce roughly equivalent revenues.
Omar Al-Ubaydli, Faith Fatchen, John A List
Cited by*: None Downloads*: None

Field experiments are a useful empirical tool that can be deployed in any sub-discipline - including institutional economics - to enhance the sub-discipline's empirical insights. However, we here argue that there exist fundamental barriers to the use of field experiments in understanding the impact of institutions on economic growth. Despite these obstacles, we present some significant scholarly contributions that merit exposition, while also proposing some future methods for using field experiments within institutional economics. While field experiments may be limited in answering questions in institutional economics with macroeconomic outcomes, there is great potential in employing field experiments to answer micro founded questions.
Damon Clark, David Gill, Victoria Prowse , Mark Rush
Cited by*: None Downloads*: None

Will college students who set goals for themselves work harder and achieve better outcomes? In theory, setting goals can help present-biased students to mitigate their self-control problem. In practice, there is little credible evidence on the causal effects on goal setting for college students. We report the result of two field experiments that involved almost four thousand college students in total. One experiments asked treated students to set goals for performance in the course; the other asked treated students to set goals for a particular task (completing online practice exams). Task-based goals had robust positive effects on the level of task completion, and task-based goals also increased course performance. We also find that performance-based goals had positive but small effects on course performance. We use a theoretical framework that builds on present bias and loss aversion to interpret our results. Since task-based goal setting is low-cost, scalable and logistically simple, we conclude that our findings have important implications for educational practice and future research.
John A List
Cited by*: 5 Downloads*: 6

This paper pits neoclassical theory against prospect theory by investigating several clean tests of the competing hypotheses. Consistent with previous work, the field experimental data suggest that prospect theory adequately organizes behavior among inexperienced consumers, whereas consumers with intense market experience behave largely in accordance with neoclassical predictions. The data indicate that the convergence in values occurs entirely because of lower Hicksian equivalent surplus values.
Andreas Lange, John A List, Michael K Price
Cited by*: 35 Downloads*: 33

This study explores the economics of charitable fund-raising. We begin by developing theory that examines the optimal lottery design while explicitly relaxing both risk-neutrality and preference homogeneity assumptions. We test our theory using a battery of experimental treatments and find that our theoretical predictions are largely confirmed. Specifically, we find that single and multiple prize lotteries dominate the voluntary contribution mechanism both in total dollars raised and the number of contributors attracted. Moreover, we find that the optimal fund-raising mechanism depends critically on the risk postures of potential contributors and preference heterogeneity.
John A List, Ian Muir, Gregory Sun
Cited by*: None Downloads*: None

This study investigates how to use regression adjustment to reduce variance in experimental data. We show that the estimators recommended in the literature satisfy an orthogonality property with respect to the parameters of the adjustment. This observation greatly simplifies the derivation of the asymptotic variance of these estimators and allows us to solve for the efficient regression adjustment in a large class of adjustments. Our efficiency results generalize a number of previous results known in the literature. We then discuss how this efficient regression adjustment can be feasibly implemented. We show the practical relevance of our theory in two ways. First, we use our efficiency results to improve common practices currently employed in field experiments. Second, we show how our theory allows researchers to robustly incorporate machine learning techniques into their experimental estimators to minimize variance.