Papers - John A List

Basil Halperin, Benjamin Ho, John A List, Ian Muir

Cited by*: None Downloads*: None

We use a theory of apologies to analyze a nationwide field experiment involving 1.5 million Uber ridesharing consumers who experienced late rides. Several insights emerge. First, apologies are not a panacea: the efficacy of an apology and whether it may backfire depend on how the apology is made. Second, across treatments, money speaks louder than words - the best form of apology is to include a coupon for a future trip. Third, in some cases sending an apology is worse than sending nothing at all, particularly for repeated apologies. For firms, caveat venditor should be the rule when considering apologies.

John A List, Jeffrey A Livingston, Susanne Neckermann

Cited by*: None Downloads*: None

In the face of worryingly low performance on standardized test, offering students financial incentives linked to academic performance has been proposed as a potentially cost-effective way to support improvement. However, a large literature across disciplines finds that extrinsic incentives, once removed, may crowd out intrinsic motivation on subsequent, similar tasks. We conduct a field experiment where students, parents, and tutors are offered incentives designed to encourage student preparation for a high-stakes state test. The incentives reward performance on a separate low-stakes assessment designed to measure the same skills as the high-stakes test. Performance on the high-stakes test, however, is not incentivized. We find substantial treatment effects on the incented tests but no effect on the non-incented test; if anything, the incentives result in worse performance on the non-incented test. We also find evidence supporting the conclusion that the incentives crowd out intrinsic motivation to perform well on the non-incented test, but this effect is only temporary. One year later, students who had been in the incentives treatments perform better than those in the control on the same non-incented test.

John A List

Cited by*: None Downloads*: None

No abstract available

Marvin Cardoza, Justin Holz, John A List, Alejandro Zentner, Joaquin Zentner

Cited by*: None Downloads*: None

This paper uses a natural field experiment to examine the effectiveness of specific nudges on tax compliance amongst firms and the self-employed in the Dominican Republic. In collaboration with the Dominican Republic's tax authority, we designed messages for more than 28,000 self-employed workers and over 56,000 firms. Leveraging administrative tax data, we find evidence that our nudges (increasing the salience of prison sentences or public disclosure of tax evaders) have large effects on increasing tax compliance, primarily working through the channel of decreasing claimed tax exemptions. Interestingly, we find that firms are more impacted than the self-employed, and that firm size is critically linked to nudge effectiveness: larger firms are considerably more influenced by nudges than smaller firms. We find this latter result noteworthy given the paucity of evidence showing significant behavioral impacts of nudges amongst the largest players in a market. Overall, our messages increased tax revenue by $193 million (roughly 0.23% of the Dominican Republic's GDP in 2018), with over $100 million constituting income that the government would not have received without our field experimental nudges.

Omar Al-Ubaydli, John A List, Claire Mackevicius, Min Sok Lee, Dana L Suskind

Cited by*: None Downloads*: None

Policymakers are increasingly turning to insights gained from the experimental method as a means to inform large scale public policies. Critics view this increased usage as premature, pointing to the fact that many experimentally-tested programs fail to deliver their promise at scale. Under this view, the experimental approach drives too much public policy. Yet, if policymakers could be more confident that the original research findings would be delivered at scale, even the staunchest critics would carve out a larger role for experiments to inform policy. Leveraging the economic framework of Al-Ubaydli et al. (2019), we put forward 12 simple proposals, spanning researchers, policymakers, funders, and stakeholders, which together tackle the most vexing scalability threats. The framework highlights that only after we deepen our understanding of the scale up problem will we be on solid ground to argue that scientific experiments should hold a more prominent place in the policymaker's quiver.

Bharat Chandar, Uri Gneezy, John A List, Ian Muir

Cited by*: None Downloads*: None

Even though social preferences affect nearly every facet of life, there exist many open questions on the economics of social preferences in markets. We leverage a unique opportunity to generate a large data set to inform the who's, what's, where's, and when's of social preferences through the lens of a nationwide tipping field experiment on the Uber platform. Our field experiment generates data from more than 40 million trips, allowing an exploration of social preferences in the ride sharing market using bid data. Combining experimental and natural variation in the data, we are able to establish tipping facts as well as provide insights into the underlying motives for tipping. Interestingly, even though tips are made privately, and without external social benefits or pressure, more than 15% of trips are tipped. Yet, nearly 60% of people never tip, and only 1% of people always tip. Overall, the demand-side explains much more of the observed tipping variation than the supply-side.

Omar Al-Ubaydli, John A List

Cited by*: None Downloads*: None

This is a review of the literature of field experimental studies of markets. The main results covered by the review are as follows: (1) Generally speaking, markets organize the efficient exchange of commodities; (2) There are some behavioral anomalies that impede efficient exchange; (3) Many behavioral anomalies disappear when traders are experienced.

Omar Al-Ubaydli, John A List, Dana L Suskind

Cited by*: None Downloads*: None

Policymakers are increasingly turning to insights gained from the experimental method as a means of informing public policies. Whether-and to what extent-insights from a research study scale to the level of the broader public is, in many situations, based on blind faith. This scale-up problem can lead to a vast waste of resources, a missed opportunity to improve people's lives, and a diminution in the public's trust in the scientific method's ability to contribute to policymaking. This study provides a theoretical lens to deepen our understanding of the science of how to use science. Through a simple model, we highlight three elements of the scale-up problem: (1) when does evidence become actionable (appropriate statistical inference); (2) properties of the population; and (3) properties of the situation. We argue that until these three areas are fully understood and recognized by researchers and policymakers, the threats to scalability will render any scaling exercise as particularly vulnerable. In this way, our work represents a challenge to empiricists to estimate the nature and extent of how important the various threats to scalability are in practice, and to implement those in their original research.

Annika List, John A List, Anya Samek

Cited by*: None Downloads*: None

Social scientists for years have documented the pervasiveness of discrimination in product and labor markets. While the literature has recently attempted to measure the nature of such discrimination, much less work has been done exploring the origins of discrimination. We make a modest step in this direction by reporting data from a field experiment attempting to measure discrimination amongst 3-5 years olds. Using a design that isolated discriminatory behaviors in economic games, we find that both White and Hispanic children send more resources to Black children than White children, whereas black children send equal amounts. This provides a first glimpse that suggests preferences amongst the young do not show similar patterns as preferences of adults.

Alec Brandon, John A List, Robert D Metcalfe, Michael K Price, Florian Rundhammer

Cited by*: None Downloads*: None

This study considers the response of household electricity consumption to social nudges during peak load events. Our investigation considers two social nudges. The first targets conservation during peak load events, while the second promotes aggregate conservation. Using data from a natural field experiment with 42,100 households, we find that both social nudges reduce peak load electricity consumption by 2 to 4% when implemented in isolation and by nearly 7% when implemented in combination. These findings suggest an important role for social nudges in the regulation of electricity markets and a limited role for crowd out effects.

Andreas Leibbrandt, John A List

Cited by*: None Downloads*: None

Labor force composition and the allocation of talent remain of vital import to modern economies. For their part, governments and companies around the globe have implemented equal employment opportunity (EEO) regulations to influence labor market flows. Even though such regulations are pervasive, surprisingly little is known about their impacts. We use a natural field experiment conducted across 10 U.S. cities to investigate if EEO statements in job advertisements affect the first step in the employment process, application rates. Making use of data from nearly 2,500 job seekers, we find considerable policy effects, but in an unexpected direction: the presence of an EEO statement dampens rather than encourages racial minorities willingness to apply for jobs. Importantly, the effects are particularly pronounced for educated job seekers and in cities with white majority populations. Complementary survey evidence suggests the underlying mechanism at work is "tokenism", revealing that EEO statements backfire because racial minorities avoid environments in which they are perceived as regulatory, or symbolic, hires rather than being hired on their own merits. Beyond their practical and theoretical importance, our results highlight how field experiments can significantly improve policy making. In this case, if one goal of EEO regulations is to enhance the pool of minority applicants, then it is not working.

John A List

Cited by*: None Downloads*: None

Last year I put together a summary of data from my field experiments website that pertained to natural field experiments. Several people have asked me if I have an update. In this document I update all figures and numbers to show the details for 2020. I also include the description from the 2019 paper below.

Erwin Bulte, John A List, Daan van Soest

Cited by*: None Downloads*: None

Social scientists have recently explored how framing of gains and losses affects productivity. We conducted a field experiment in peri-urban Uganda, and compared output levels across 1000 workers over isomorphic tasks and incentives, framed as either losses or gains. We find that loss aversion can be leveraged to increase the productivity of labor. The estimated welfare costs of using the loss contract are quite modest -- perhaps because the loss contract is viewed as a (soft) commitment device.

Yan Chen, Peter Cramton, John A List, Axel Ockenfels

Cited by*: None Downloads*: None

We review past research and discuss future directions on how the vibrant research areas of market design and behavioral economics have influenced and will continue to impact the science and practice of management in both the private and public sectors. Using examples from various auction markets, reputation and feedback systems in online markets, matching markets in education, and labor markets, we demonstrate that combining market design theory, behavioral insights, and experimental methods can lead to fruitful implementation of superior market designs in practice.

Avner Ben-Ner, John A List, Louis Putterman, Anya Samek

Cited by*: None Downloads*: None

An active area of research within the social sciences concerns the underlying motivation for sharing resources and engaging in other pro-social actions. In this paper we ask: do parents model social preference behavior to children, and do children emulate this behavior? We develop a theoretical framework to examine this question, and conduct an experiment with 147 3 to 5 year old children and their parents, using dictator games to measure generosity. We find (1) evidence of parental teaching/modeling in the case of fathers and in that of parents of relatively generous children, and (2) an emulation effect such that children who initially share less than half of their endowment subsequently share more the more they see a parent or other adult share. We find little correlation between baseline sharing of children and the parents, with the possible exception of the oldest children.

Matilde Giaccherini, David H Herberich, David Jimenez-Gomez, John A List, Giovanni Ponti, Michael K Price

Cited by*: None Downloads*: None

This paper uses a field experiment to estimate the effects of prices and social norms on the decision to adopt and efficient technology. We find that prices and social norms influence the adoption and decision along different margins: while prices operate on both the extensive and intensive margins, social norms operate mostly through the extensive margin. This has both positive and normative implications, and suggests that economics and psychology may be strong complements in the diffusion process. To complement the reduced form results, we estimate a structural model that points to important household heterogeneity: whereas some consumers welcome the opportunity to purchase and learn about the new technology, for others the inconvenience and social pressure of the ask results in negative welfare. As a whole, our findings highlight that the design of optimal technological diffusion policies will require multiple instruments and a recognition of household heterogeneity.

John A List

Cited by*: None Downloads*: None

This review summarizes the historical place of the seminal contribution of Kahneman et al. (1990), from origins to theory to catalyst of an entire area of scholarship. This new literature has produced evidence both in concert with the original KKT conclusions as well as evidence refuting certain insights from KKT. The general theme of my summary is that even imperfect papers can have deep impact, both within and outside the academy; a lesson that today's critics should consider as young experimentalists continue to fight the tyranny of the top 5.

John A List, Zacharias Maniadis, Fabio Tufano

Cited by*: None Downloads*: None

The sciences are in an era o fan alleged "credibility crisis'. In this study, we discuss the reproducibility of empirical results, focusing on economics research. By combining theory and empirical evidence, we discuss the import of replication studies, and whether they improve our confidence in novel findings. The theory sheds light on the importance of replications, even when replications are subject to bias. We then present a pilot meta-study of replication in experimental economics, a subfield serving as a positive benchmark for investigating the credibility of economics. Our meta-study highlights certain difficulties when applying meta-research (Ioannidis et al., 2015) and systematizing the economics literature.

Greer K Gosnell, John A List, Robert D Metcalfe

Cited by*: None Downloads*: None

Increasing evidence indicates the importance of management in determining firms' productivity. Yet, causal evidence regarding the effectiveness of management practices is scarce, especially for high-skilled workers in the developed world. In an eight-month field experiment measuring the productivity of captains in the commercial aviation sector, we test four distinct management practices: (i) performance monitoring; (ii) performance feedback; (iii) target setting; and (iv) prosocial incentives. We find that these management practices -particularly performance monitoring and target setting- significantly increase captains' productivity with respect to the targeted fuel-saving dimensions. We identify positive spillovers of the tested management practices on job satisfaction and carbon dioxide emissions, and captains overwhelmingly express desire for deeper managerial engagement. Both the implementation and the results of the study reveal an uncharted opportunity for management researchers to delve into the black box of firms and rigorously examine the determinants of productivity amongst skilled labor.

Lenka Fiala, John Eric Humphries, Juanna S Joensen, Uditi Karna, John A List, Gregory Veramendi

Cited by*: None Downloads*: None

Leveraging data from Sweden and Chicago, we study the educational pipeline for STEM and economics majors to better understand the determinants of the gender gap, and when these determinants arise. We present three findings. First, females are less likely to select STEM courses in high school, despite equal or better preparation. Second, there are important gender differences in preferences and beliefs, even conditional on ability. Third, early differences in preferences and beliefs explain more of the gaps in high school sorting than other candidate variables. High school sorting then explains a large portion of the gender difference in college majors.