Erwin Bulte, Simon Levin , John A List, Steven Pacala
Cited by*: 1 Downloads*: 2

n/a
John A List, David H Reiley
Cited by*: 142 Downloads*: 82

Field experiments have grown significantly in prominence over the past decade. In this essay, we provide a summary of the major types of field experiments, explore their uses, and describe a few examples. We show how field experiments can be used for both positive and normative purposes within economics. We also discuss more generally why data collection is useful in science, and more narrowly discuss the question of generalizability. In this regard, we envision field experiments playing a classic role in helping investigators learn about the behavioral principles that are shared across different domains.
Glenn W Harrison, John A List
Cited by*: 644 Downloads*: 105

Experimental economists are leaving the reservation. They are recruiting subjects in the field rather than in the classroom, using field goods rather than induced valuations, and using field context rather than abstract terminology in instructions. We argue that there is something methodologically fundamental behind this trend. Field experiments differ from laboratory experiments in many ways. Although it is tempting to view field experiments as simply less controlled variants of laboratory experiments, we argue that to do so would be to seriously mischaracterize them. What passes for "control" in laboratory experiments might in fact be precisely the opposite if it is artificial to the subject or context of the task. We propose six factors that can be used to determine the field context of an experiment: the nature of the subject pool, the nature of the information that the subjects bring to the task, the nature of the commodity, the nature of the task or trading rules applied, the nature of the stakes, and the environment that subjects operate in.
John A List
Cited by*: 49 Downloads*: 123

Laboratory experiments have been used extensively in economics in the past several decades to lend both positive and normative insights into a myriad of important economic issues. This study discusses a related approach that has increasingly grown in prominence of late--field experiments. I argue that field experiments serve as a useful bridge between data generated in the lab and empirical studies using naturally-occurring data. In discussing this relationship, I highlight that field experiments can yield important insights into economic theory and provide useful guidance to policymakers. I also draw attention to an important methodological contribution of field experiments: they provide an empirical account of behavioral principles that are shared across different domains. In this regard, at odds with conventional wisdom, I argue that representativeness of the environment, rather than representative of the sampled population, is the most crucial variable in determining generalizability of results for a large class of experimental laboratory games.
John A List
Cited by*: None Downloads*: None

Once believed to be an impossibility, field experiments in economics now occupy a central place in the empiricist's quiver. In the past few decades alone field experiments have taken on much greater import in academe, across organizations, as well as for policymakers. But is this emergence simply a fad that will soon return field experiments to obscurity? I argue in this article that there is something fundamental about the emergence of field experiments, as controlling the assignment mechanism in the field provides unparalleled power to both understand the "effects of causes" and the "causes of effects." This knowledge generation then begins to uncover the generalizability and scalability of knowledge. Quite the opposite of a withering tool that will be gone tomorrow, I urge economists to "double down" on this comparative advantage and in doing so I provide four methodological paths which I hope will cement the promise and growth of field experiments in the social sciences.
Jeff P Carpenter, Glenn W Harrison, John A List
Cited by*: 16 Downloads*: 73

No abstract available
Steven D Levitt, John A List
Cited by*: 58 Downloads*: 52

This study presents an overview of modern field experiments and their usage in economics. Our discussion focuses on three distinct periods of field experimentation that have influenced the economics literature. The first might well be thought of as the dawn of "field" experimentation: the work of Neyman and Fisher, who laid the experimental foundation in the 1920s and 1930s by conceptualizing randomization as an instrument to achieve identification via experimentation with agricultural plots. The second, the large-scale social experiments conducted by government agencies in the mid-twentieth century, moved the exploration from plots of land to groups of individuals. More recently, the nature and range of field experiments has expanded, with a diverse set of controlled experiments being completed outside of the typical laboratory environment. With this growth, the number and types of questions that can be explored using field experiments has grown tremendously. After discussing these three distinct phases, we speculate on the future of field experimental methods, a future that we envision including a strong collaborative effort with outside parties, most importantly private entities.
John A List, Imran Rasul
Cited by*: 3 Downloads*: 46

We overview the use of field experiments in labor economics. We showcase studies that highlight the central advantages of this methodology, which include: (i) using economic theory to design the null and alternative hypotheses; (ii) engineering exogenous variation in real world economic environments to establish causal relations and learning about the underlying mechanisms; and (iii) engaging in primary data collection and often working closely with practitioners. To highlight the potential for field experiments to inform issues in labor economics, we organize our discussion around the individual life cycle. We therefore consider field experiments related to the accumulation of human capital, the demand and supply of labor, behavior within firms, and close with a brief discussion of the nascent literature of field experiments related to household decision-making.
Omar Al-Ubaydli, John A List
Cited by*: 2 Downloads*: 88

This is a review of the literature of field experimental studies of markets. The main results covered by the review are as follows: (1) Generally speaking, markets organize the efficient exchange of commodities; (2) There are some behavioral anomalies that impede efficient exchange; (3) Many behavioral anomalies disappear when traders are experienced.
Omar Al-Ubaydli, John A List
Cited by*: None Downloads*: None

This is a review of the literature of field experimental studies of markets. The main results covered by the review are as follows: (1) Generally speaking, markets organize the efficient exchange of commodities; (2) There are some behavioral anomalies that impede efficient exchange; (3) Many behavioral anomalies disappear when traders are experienced.
John A List, Robert D Metcalfe
Cited by*: 3 Downloads*: 14

Field experiments represent a relatively new area in economics to understand the causal links from one variable to another. They have been used by academics to help answer interesting and policy-relevant questions in the developed world relating to educational attainment, tax avoidance, consumer finance, negative externalities, charitable giving, and labour market contracts. In this paper we bring together the key ideas behind the different variants of field experiments, how field experiments have been used to test theory, their limitations, and the new areas currently being opened up by field experiments.
Jonathan E Alevy, Craig E Landry, John A List
Cited by*: 4 Downloads*: 46

A pillar of behavioral research is that preferences are constructed during the process of choice. A prominent finding is that uninformative numerical "anchors" influence judgment and valuation. It remains unclear whether such processes influence market equilibria. We conduct two experiments that extend the study of anchoring to field settings. The first experiment produces evidence that some consumers' valuations can be anchored in novel situations; there is no evidence that experienced agents are influenced by anchors. The second experiment finds that anchors have only transient effects on market outcomes that converge to equilibrium predictions after a few market periods.
James Andreoni, Michael Kuhn, John A List, Anya Samek, Charles Sprenger
Cited by*: 0 Downloads*: 119

Time preferences have been correlated with a range of life outcomes, yet little is known about their early development. We conduct a field experiment to elicit time preferences of nearly 1,000 children ages 3-12, who make several inter temporal decisions. To shed light on how such primitives form, we explore various channels that might affect time preferences, from background characteristics to the causal impact of an early schooling program that we developed and operated. Our results suggest that time preferences evolve substantially during this period with younger children displaying more impatience than older children. We also find a strong association with race: black children, relative to white or Hispanic children, are more impatient. Interestingly, parents of black children are also much more impatient than parents of white and Hispanic children. Finally, assignment to different schooling opportunities is not significantly associated with child time preferences.
John A List
Cited by*: None Downloads*: None

In 2019 I put together a summary of data from my field experiments website that pertained to framed field experiments. Several people have asked me if I have update. In this document I update all figures and numbers to show the details for 2021. I also include the description from the 2019 paper below.
Fuhai Hong, Tanjim Hossain, John A List
Cited by*: 3 Downloads*: 35

Exploiting findings that losses loom larger than gains, studies have shown that framing manipulations can increase productivity of workers. Using a natural field experiment that exogenously manipulates wage bonuses within contests in a Chinese high-tech manufacturing facility, we show that how loss aversion affects worker behavior critically depends on the incentive scheme as well as the framing manipulation. Four sets of two identical teams competed against each other to win a bonus given to the team, within a set, with the higher average hourly productivity over the week. In each set, the bonus was framed as a reward or gain for one team and as a punishment or loss for the other. Average weekly productivity was slightly higher under the loss treatment, but this increase was statistically insignificant. However, the team under the loss treatment was at least 35% more likely to win the contest. As teams' payoffs are based on relative productivity under a contest, framing effect is much stronger in terms of relative productivity. Finally, workers seemingly responded to the bonus by increasing the quality of production as well as quantity-defect rate fell as productivity increased.
John A List
Cited by*: 4 Downloads*: 3

This study examines data drawn from the game show Friend or Foe?, which is similar to the classic prisoner's dilemma tale: partnerships are endogenously determined, players work together to earn money, after which, they play a one-shot prisoner's dilemma game over large stakes: varying from $200 to (potentially) more than $22,000. If one were to conduct such an experiment in the laboratory, the cost to gather the data would be well over $350,000. The data reveal several interesting insights; perhaps most provocatively, they suggest that even though the game is played in front of an audience of millions of viewers, there is some evidence consistent with a model of discrimination. The observed patterns of social discrimination are unanticipated, however. For example, there is evidence consistent with the notion that certain populations have a general "distaste" for older participants.
Erwin Bulte, Andreas Kontoleon, John A List, Ty Turley, Maarten Voors
Cited by*: 0 Downloads*: 35

The experimental literature has shown the tendency for experimental trading markets to converge to neoclassical predictions. Yet, the extent to which theory explains the equilibrating forces in markets remains under-researched, especially in the developing world. We set up a laboratory in 94 villages in rural Sierra Leone to mimic a real market. We implement several treatments, varying trading partners and the anonymity of trading. We find that when trading with co-villagers average efficiency is somewhat lower than predicted by theory (and observed in different contexts), and markets do not fully converge to theoretical predictions across rounds of trading. When participants trade with strangers efficiency is reduced more. Anonymizing trade within the village does not affect efficiency. This points to the importance of behavioral norms for trade. Intra-village social relationships or hierarchies, instead, appear less important as determinants of trading outcomes. This is confirmed by analysis of the trader-level data, showing that individual earnings in the experiment do not vary with one's status or position in local networks.
Greg Allenby, Russell Belk, Catherine Eckel, Robert Fisher, Ernan Haruvy, John A List, Yu Ma, Peter Popkowski Leszczyc, Yu Wang, Sherry Xin Li
Cited by*: None Downloads*: None

We offer a unified conceptual, behavioral, and econometric framework for optimal fundraising that deals with both synergies and discrepancies between approaches from economics, consumer behavior, and sociology. The purpose is to offer a framework that can bridge differences and open a dialogue between disciplines in order to facilitate optimal fundraising design. The literature is extensive, and our purpose is to offer a brief background and perspective on each of the approaches, provide an integrated framework leading to new insights, and discuss areas of future research.
Jeffrey A Flory, Uri Gneezy, Kenneth Leonard, John A List
Cited by*: 0 Downloads*: 88

Research on competitiveness at the individual level has emphasized sex as a physiological determinant, focusing on the gap in preference for competitive environments between young men and women. This study presents evidence that women's preferences over competition change with age such that the gender gap, while large for young adults, disappears in older populations due to the fact that older women are much more competitive. Our finding that tastes for competition appear just as strong among older women as they are among men suggests a simple gender-based view of competitiveness is misleading; age seems just as important as sex. These findings are consistent with one of the most commonly cited views on the deeper origins of gender differences: that they stem at least in part from human evolution.
Steffen Andersen, Seda Ertac, Uri Gneezy, John A List, Sandra Maximiano
Cited by*: 35 Downloads*: 2

Recent literature presents evidence that men are more competitively inclined than women. Since top-level careers usually require competitiveness, competitiveness differences provide an explanation for gender gaps in wages and differences in occupational choice. A natural question is whether women are born less competitive or whether they become so through the process of socialization. To pinpoint when in the socialization process the difference arises, we compare the competitiveness of children in matrilineal and patriarchal societies. We find that while there is no difference at any age in the matrilineal society, girls become less competitive around puberty in the patriarchal society.