Omar Al-Ubaydli, John A List
Cited by*: Downloads*:

This is a review of the literature of field experimental studies of markets. The main results covered by the review are as follows: (1) Generally speaking, markets organize the efficient exchange of commodities; (2) There are some behavioral anomalies that impede efficient exchange; (3) Many behavioral anomalies disappear when traders are experienced.
Omar Al-Ubaydli, Jason Chien-Yu, John A List
Cited by*: Downloads*:

The "voltage effect" is defined as the tendency for a program's efficacy to change when it is scaled up, which in most cases results in the absolute size of a program's treatment effects to diminish when the program is scaled. Understanding the scaling problem and taking steps to diminish voltage drops are important because if left unaddressed, the scaling problem can weaken the public's faith in science, and it can lead to a misallocation of public resources. There exists a growing literature illustrating the prevalence of the scaling problem, explaining its causes, and proposing countermeasures. This paper adds to the literature by providing a simple model of the scaling problem that is consistent with rational expectations by the key stakeholders. Our model highlights that asymmetric information is a key contributor to the voltage effect.
Brian Albrecht, Omar Al-Ubaydli, Peter Boettke
Cited by*: Downloads*:

Economists well understand that the work of Friedrich Hayek contains important theoretical insights. It is less often acknowledged that his work contains testable predictions about the nature of market processes. Vernon Smith termed the most important one the 'Hayek hypothesis': that gains from trade can be realized in the presence of diffuse, decentralized information, and in the absence of price-taking behavior and centralized market direction. Vernon Smith tested this prediction by surveying data on laboratory experimental markets and found strong support. We extend Smith's work first by showing how subsequent theoretical advances provide a theoretical foundation for the Hayek Hypothesis. We then test the hypothesis using recent field experimental market data. Using field experiments allows us to test several other predictions from Hayek, such as that market experience increases the realized gains from trade. Generally speaking, we find support for Hayek's theories.
Omar Al-Ubaydli, John A List
Cited by*: Downloads*:

Natural field experiments investigating key labour market phenomena such as unemployment have only been used since the early 2000s. This paper reviews the literature and draws three primary conclusions that deepen our understanding of unemployment. First, the inability to monitor workers perfectly in many occupations complicates the hiring decision in a way that contributes to unemployment. Second, the inability to determine a worker's attributes precisely at the time of hiring leads to discrimination on the basis of factors such as race, gender, age and ethnicity. This can lead to systematically high and persistent levels of unemployment for groups that face discrimination. Third, the importance of social and personal dynamics in the workplace can lead to short-term unemployment. Much of the knowledge necessary for these conclusions could only be obtained using natural field experiments due to their ability to combine randomized control with an absence of experimenter demand effects.
Omar Al-Ubaydli, John A List, Claire Mackevicius, Min Sok Lee, Dana L Suskind
Cited by*: Downloads*:

Policymakers are increasingly turning to insights gained from the experimental method as a means to inform large scale public policies. Critics view this increased usage as premature, pointing to the fact that many experimentally-tested programs fail to deliver their promise at scale. Under this view, the experimental approach drives too much public policy. Yet, if policymakers could be more confident that the original research findings would be delivered at scale, even the staunchest critics would carve out a larger role for experiments to inform policy. Leveraging the economic framework of Al-Ubaydli et al. (2019), we put forward 12 simple proposals, spanning researchers, policymakers, funders, and stakeholders, which together tackle the most vexing scalability threats. The framework highlights that only after we deepen our understanding of the scale up problem will we be on solid ground to argue that scientific experiments should hold a more prominent place in the policymaker's quiver.
Omar Al-Ubaydli, John A List, Dana L Suskind
Cited by*: Downloads*:

Policymakers are increasingly turning to insights gained from the experimental method as a means of informing public policies. Whether-and to what extent-insights from a research study scale to the level of the broader public is, in many situations, based on blind faith. This scale-up problem can lead to a vast waste of resources, a missed opportunity to improve people's lives, and a diminution in the public's trust in the scientific method's ability to contribute to policymaking. This study provides a theoretical lens to deepen our understanding of the science of how to use science. Through a simple model, we highlight three elements of the scale-up problem: (1) when does evidence become actionable (appropriate statistical inference); (2) properties of the population; and (3) properties of the situation. We argue that until these three areas are fully understood and recognized by researchers and policymakers, the threats to scalability will render any scaling exercise as particularly vulnerable. In this way, our work represents a challenge to empiricists to estimate the nature and extent of how important the various threats to scalability are in practice, and to implement those in their original research.
Omar Al-Ubaydli, John A List
Cited by*: 5 Downloads*: 89

A commonly held view is that laboratory experiments provide researchers with more "control" than natural field experiments, and that this advantage is to be balanced against the disadvantage that laboratory experiments are less generalizable. This paper presents a simple model that explores circumstances under which natural field experiments provide researchers with more control than laboratory experiments afford. This stems from the covertness of natural field experiments: laboratory experiments provide researchers with a high degree of control in the environment which participants agree to be experimental subjects. When participants systematically opt out of laboratory experiments, the researcher's ability to manipulate certain variables is limited. In contrast, natural field experiments bypass the participation decision altogether and allow for a potentially more diverse participant pool within the market of interest. We show one particular case where such selection is invaluable: when treatment effects interact with participant characteristics.
Omar Al-Ubaydli, John A List, Dana L Suskind
Cited by*: 3 Downloads*: 87

No abstract available
Omar Al-Ubaydli, Peter Boettke
Cited by*: 2 Downloads*: 21

The work of Friedrich Von Hayek contains several testable predictions about the nature of market processes. Vernon Smith termed the most important one the "Hayek hypothesis:" equilibrium prices and the gains from trade can be achieved in the presence of diffuse, decentralized information, and in the absence of price-taking behavior and centralized market direction. Vernon Smith tested this by surveying data on laboratory experimental markets and found strong support. We repeat this exercise using field experimental market data. Using field experiments allows us to test several other predictions. Generally speaking, we find support for Hayek's theories.
Omar Al-Ubaydli, John A List
Cited by*: 2 Downloads*: 88

This is a review of the literature of field experimental studies of markets. The main results covered by the review are as follows: (1) Generally speaking, markets organize the efficient exchange of commodities; (2) There are some behavioral anomalies that impede efficient exchange; (3) Many behavioral anomalies disappear when traders are experienced.