Papers - Natural

John A List, Zacharias Maniadis, Fabio Tufano

Cited by*: 0 Downloads*: 3

In his comment, Mitesh Kataria (2014) makes three main points about a specific part of our paper (Maniadis, Tufano, and List 2014), namely about Tables 2 and 3. In our paper, we employ these tables in order to illustrate the idea that very inconclusive post-study probabilities that a tested phenomenon is true may result from novel, surprising findings. The main arguments in Kataria (2014) are the following: First, if P(H0) is unknown, as is often the case with economic applications, the post-study probability can lead to even worse inference than the Classical significance test, depending on the quality of the prior. Second, the simulation in Maniadis et al. (2014) ignores previous assessments of P(H0) and instead utilizes a selective empirical setup that favors the use of post-study probabilities. [Third,] contrary to what Maniadis et al. (2014) argue, their results do not allow for drawing general recommendations about which approach is the most appropriate. (Kataria 2014, abs.) We believe that our work might have been misunderstood by Kataria. Moreover, it seems that some of his claims are not supported by relevant empirical evidence.

Yan Chen, Xin Li, Jeffrey K MacKie-Mason

Cited by*: 13 Downloads*: 11

We implemented the first web-based online field experiments of fund-raising. We embedded our experiment in the Internet Public Library to test four mechanisms: Voluntary Contribution (VCM), Premium, Seed Money and Matching. Although the gift size is not significantly different across mechanisms, the Seed and Matching mechanisms each generate significantly higher user click-through response rate than the Premium mechanism. Because this is one of the earliest embedded, web-based field experiments, we report our methodology findings in some detail. Cookies work better as participant assignment techniques than pop-up windows and elicitation of geographic information. Participant clickstream data that nominally demonstrate a desire to donate is a poor predictor of actual giving.

Omar Al-Ubaydli, John A List

Cited by*: 2 Downloads*: 1

Economists are increasingly turning to the experimental method as a means to estimate causal effects. By using randomization to identify key treatment effects, theories previously viewed as untestable are now scrutinized, efficacy of public policies are now more easily verified, and stakeholders can swiftly add empirical evidence to aid their decision-making. This study provides an overview of experimental methods in economics, with a special focus on developing an economic theory of generalizability. Given that field experiments are in their infancy, our secondary focus pertains to a discussion of the various parameters that they identify, and how they add to scientific knowledge. We conclude that until we conduct more field experiments that build a bridge between the lab and the naturally-occurring settings of interest we cannot begin to make strong conclusions empirically on the crucial question of generalizability from the lab to the field.

John A List

Cited by*: None Downloads*: None

Social scientists have increasingly turned to the experimental method to understand human behavior. One critical issue that makes solving social problems difficult is "scaling" the idea from a small group to a larger group in more diverse situations. The urgency of scaling policies impacts us every day, whether it is protecting the health and safety of a community or enhancing the opportunities of future generations. Yet, a common result is that when we scale ideas most experience a "voltage drop": upon scaling, the benefit-cost profile depreciates considerably. To combat voltage drops, we must optimally generate policy-based evidence. Optimality requires answering two crucial questions: what information to generate and in what sequence. The economics underlying the science of scaling provides insights into these questions, which are in some cases at odds with conventional approaches. For example, there are important situations wherein I advocate flipping the traditional social science research model to an approach that, from the beginning, produces the type of policy-based evidence that the science of scaling demands. To do so, I propose augmenting efficacy trials by including relevant tests of scale in the original discovery process, which forces the scientist to naturally start with a recognition of the big picture: what information do I need to haves caling confidence?

John A List

Cited by*: None Downloads*: None

Presentation Slides

Alan S Gerber, Donald P Green, Matthew N Green

Cited by*: 6 Downloads*: 3

Political campaigns currently make extensive use of direct mail, particularly in state and local races, yet its effects on voter behavior are not well understood. This essay presents the results of large-scale randomized field experiments conducted in Connecticut and New Jersey during state and municipal elections of 1999. Tens of thousands of registered voters were sent from zero to nine pieces of direct mail. The target populations included party registrants with a strong history of voter participation, independents, and a random subset of registered voters. Our results indicate partisan campaign mail does little to stimulate voter turnout and may even dampen it when the mail is negative in tone.

Adriaan R Soetevent

Cited by*: Downloads*:

This paper examines the impact of payment choice on charitable giving with a door-to-door fund-raising field experiment. Respondents can donate cash only, use debit only, or have both options. Cash donations have lower visibility vis-a-vis solicitors than debit card donations. When debit replaces cash, participation drops by 87 percent. Conditional on participation, donors in the Debit-only treatment give more than donors in Cash-only. In Cash&Debit, almost all donors prefer cash; participation decreases compared to Cash-only. Physical attractiveness of both female and male solicitors increases contributions. Solicitor self-confidence has a negative impact.

Michael Kremer, Dan Levy

Cited by*: 16 Downloads*: 9

This paper examines a natural experiment in which students at a large state university were randomly assigned roommates through a lottery system. We find that on average, males assigned to roommates who reported drinking in the year prior to entering college had one quarter-point lower GPA than those assigned to non-drinking roommates. The 10th percentile of their college GPA is half a point lower than among males assigned non-drinking roommates. For males who themselves drank frequently prior to college, assignment to a roommate who drank frequently prior to college reduces GPA by two-thirds of a point. Since students who drink frequently are particularly influenced by frequent-drinking roommates, substance-free housing programs could potentially lower average GPA by segregating drinkers. The effect of initial assignment to a drinking roommate persists and possibly even grows over time. In contrast, students' college GPA is not influenced by roommates' high school grades, admission test scores, or family background. Females' GPAs are not affected by roommates' drinking prior to college. Overall, these findings are more consistent with models in which peers change preferences than models in which they change endowments.

Stefano Carattini, Kenneth Gillingham, Xiangyu Meng, Erez Yoeli

Cited by*: None Downloads*: None

Observability has been demonstrated to influence the adoption of pro-social behavior in a variety of contexts. This study implements a natural field experiment to examine the influence of observability in the context of a novel pro-social behavior: peer-to-peer solar. Peer-to-peer solar offers an opportunity to households who cannot have solar on their homes to access solar energy from their neighbors. However, unlike solar installations, peer-to-peer solar is an invisible form of pro-environmental behavior. We implemented a set of randomized campaigns using Facebook ads in the Massachusetts cities of Cambridge and Somerville, in partnership with a peer-to-peer company, to study social media users' interest in peer-to-peer solar through clicks on the ads. In the campaigns, treated customers were informed that they could share "green reports" online, providing information to others about their greenness. We find that interest in peer-to-peer solar increases by up to 30% when "green reports," which would make otherwise invisible behavior visible, are mentioned in the ads.

Tanjim Hossain, John Morgan

Cited by*: 47 Downloads*: 65

Many firms divide the price a consumer pays for a good into two pieces---the price for the item itself and the price for shipping and handling. With fully rational customers, the exact division between the two prices is irrelevant---only the total price matters. We test this hypothesis by selling matched pairs of CDs and Xbox games in a series of field experiments on eBay. In theory, the ending auction price should vary inversely with the shipping charge to leave the total price paid constant. Contrary to the theory, we find that charging a high shipping cost and starting the auction at a low opening price leads to higher numbers of bidders and higher revenues when the shipping charge is not excessive. We show that these results can be accounted for by boundedly rational bidding behavior such as loss-aversion with separate mental accounts for different attributes of the price or disregard for shipping costs.

Stefano Carattini, Robert Dur, John A. List

Cited by*: None Downloads*: None

Many policies that are generally considered socially desirable by the scientific community, based on modeling and causal empirical analyses, are not very widespread. The main driver is often lack of public support at baseline ("ex ante"). Yet, there is evidence that when voters hold biased beliefs ex ante about a given policy, experiencing the policy firsthand may lead them to correct their beliefs and increase public support. If it was widely documented that opposition to sound policies in part dissipates when voters experience a given policy, then more policy-makers may be inclined to experiment with policies that scientists recommend but that are unpopular ex ante. Systematically combining policy evaluation with causal analysis of public support would allow scholars to create a body of knowledge on the conditions under which policies become more (or less) popular after implementation and what are the drivers of changes in beliefs and public support.

Fadi Hassan, Paolo Lucchino

Cited by*: 0 Downloads*: 30

More than 1.3 billion people worldwide have no access to electricity and this has first-order effects on several development dimensions. In this paper we focus on the link between access to light and education. We randomly distribute solar lamps to 7th grade pupils in rural Kenya and monitor their educational outcomes throughout the year at quarterly frequency. We find that access to lights through solar lamps is a relevant and effective input to education. Our identification strategy accounts for spillovers by exploiting the variation in treatment at the pupil level and in treatment intensity across classes. We find a positive and significant intention-to-treat effect as well as a positive and significant spillover effect on control students. In a class with the average treatment intensity of our sample (43%), treated students experience an increase in math grades of 0.88 standard deviations. Moreover, we find a positive marginal effect of treatment intensity on control students: raising the share of treated students in a class by 10% increases grades of control students by 0.22 standard deviations. We exploit household geolocation to disentangle within-class and geographical spillovers. We show that geographical spillovers do not have a significant impact and within-school interaction is the main source of spillovers. Finally, we provide suggestive evidence that the mechanism through which lamps affect students is by increasing co-studying at school especially after sunset.

John A List, Jason F Shogren

Cited by*: 24 Downloads*: 1

Examining panel data on bidding behavior in over forty second-price auction markets with repeated trials, we observe that (i) posted prices influence the behavior of the median naive bidder; (ii) posted prices do not affect the behavior of the median experienced bidder or the bidder for familiar goods; and (iii) anticipated strategic behavior wanes after two trials. The results suggest that while affiliation might exist in auctions for new goods, the repeated trial design with nonprice information removes the correlation of values and provides the experience that bidders need to understand the market mechanism.

David Laibson , John A List

Cited by*: 2 Downloads*: 114

There are many great ways to incorporate behavioral economics in a first-year undergraduate economics class-i.e., the course that is typically called "Principles of Economics." Our preferred approach integrates behavioral economics throughout the course (e.g., see Acemoglu, Laibson, and List 2015). With the integrated approach, behavioral content plays a role in many of the chapters of the principles of economics curriculum, including chapters on optimization, equilibrium, game theory, intertemporal choice, probability and risk, social preferences, household finance, the labor market, financial intermediation, monetary policy, economic fluctuations, and financial crises. We prefer the integrated approach because it enables the behavioral insights to show up where they are conceptually most relevant. By illustration, it is best to combine a discussion of downward nominal wage rigidity (i.e., the idea that workers strongly resist nominal wage declines) with the overall discussion of the labor market. Whether or not an instructor integrates behavioral economics throughout the principles of economics course, it makes sense to pull central materials together and dedicate a lecture (or more) to a focused discussion of behavioral economics. This note describes our approach to such a lecture, emphasizing six key principles of behavioral economics. Our choice of content for a behavioral lecture is motivated by three factors. First, we include ideas that are conceptually important. Second, we include material that is practically important and personally relevant to our students-we have found that such content resonates long after the course ends. Third, we include content that relates to what has been (or will be) taught in the rest of the course, and therefore serves as a complement. We want students to see that behavioral economics is an integrated part of economics, not a freak show that is isolated from "the standard ingredients" in the rest of the economics course. This paper summarizes our approach to such a focused behavioral lecture. In Section I, we define behavioral economics and place it in historical context. In Section II, we introduce six modular principles that can be used to teach behavioral economics. We provide PowerPoint notes on our home pages, which instructors should feel free to edit and use.

Rama Katkar, David Lucking-Reiley

Cited by*: 7 Downloads*: 13

Sellers in eBay auctions have the opportunity to choose both a public minimum bid amount and a secret reserve price. We ask, empirically, whether the seller is made better or worse off by setting a secret reserve above a low minimum bid, versus the option of making the reserve public by using it as the minimum bid level. In a field experiment, we auction 50 matched pairs of Pokemon cards on eBay, half with secret reserves and half with equivalently high public minimum bids. We find that secret reserve prices make us worse off as sellers, by reducing the probability of the auction resulting in a sale, deterring serious bidders from entering the auction, and lowering the expected transaction price of the auction. We also present evidence that some sellers choose to use secret reserve prices for reasons other than increasing their expected auction prices.

Richard C Bishop, Kevin J Boyle, Richard T Carson, David Chapman, Matthew DeBell, Colleen Donovan, W. Michael Hanemann, Barbara Kanninen, Matthew Konopka, Raymond J Kopp, Jon A Krosnick, John A List, Norman Meade, Robert Paterson, Stanley Presser, Nora Scherer, V. Kerry Smith, Roger Tourangeau, Michael Welsh, Jeffrey M Wooldridge

Cited by*: 0 Downloads*: 78

No abstract available

Uri Gneezy, John A List

Cited by*: 262 Downloads*: 31

Recent discoveries in behavioral economics have led scholars to question the underpinnings of neoclassical economics. We use insights gained from one of the most influential lines of behavioral research -- gift exchange -- in an attempt to maximize worker effort in two quite distinct tasks: data entry for a university library and door-to-door fundraising for a research center. In support of the received literature, our field evidence suggests that worker effort in the first few hours on the job is considerably higher in the "gift" treatment than in the "non-gift treatment." After the initial few hours, however, no difference in outcomes is observed, and overall the gift treatment yielded inferior aggregate outcomes for the employer: with the same budget we would have logged more data for our library and raised more money for our research center by using the market-clearing wage rather than by trying to induce greater effort with a gift of higher wages.

John A List

Cited by*: None Downloads*: None

"Putting Economic Research into Practice at Businesses (to Inform Science and Major Social Challenges)" Slides from ASSA NABE

Puppe Clemens, Sebastian Kube, Michel Marechal

Cited by*: 18 Downloads*: 25

We study the role of reciprocity in a labor market field experiment. In a recent paper, Gneezy and List (2006) investigate the impact of gift exchange in this context and find that it has only a transient effect on long run outcomes. Extending their work to examine both positive and negative reciprocity, we find consonant evidence in the positive reciprocity condition: the gift does not work well in the long run (if at all). Yet, in the negative reciprocity treatment we observe much stronger effects: a wage reduction has a significant and lasting negative impact on efforts. Together, these results highlight the asymmetry of positive and negative reciprocity that exists in the field, and provide an indication of the relative importance of each in the long run.

Syon Bhanot, Gordon Kraft-Todd, David Rand, Erez Yoeli

Cited by*: None Downloads*: None

We partnered with the School District of Philadelphia (SDP) to run a randomized experiment testing interventions to increase teacher participation in an annual feedback survey, an uncompensated task that requires a teacher's time but helps the educational system overall. Our experiment varied the nature of the incentive scheme used, and the associated messaging. In the experiment, all 8,062 active teachers in the SDP were randomly assigned to receive one of four emails using a 2x2 experimental design; specifically, teachers received a lottery-based financial incentive to complete the survey that was either "personal" (a chance to win one of fifteen $100 gift cards for themselves) or "social" (a chance to win one of fifteen $100 gift cards for supplies for their students), and also received email messaging that either did or did not make salient their identity as an educator. Despite abundant statistical power, we find no discernible differences across our conditions on survey completion rates. One implication of these null results is that from a public administration perspective, social rewards may be preferable since funds used for this purpose by school districts go directly to students (through increased expenditure on student supplies), and do not seem less efficacious than personal financial incentives for teachers.