Scholarly article on topic 'Beliefs and actions in the trust game: Creating instrumental variables to estimate the causal effect'

Beliefs and actions in the trust game: Creating instrumental variables to estimate the causal effect Academic research paper on "Political Science"

CC BY
0
0
Share paper
Academic journal
Games and Economic Behavior
OECD Field of science
Keywords
{"Social capital" / "Trust game" / "Instrumental variables" / "Belief elicitation"}

Abstract of research paper on Political Science, author of scientific article — Miguel A. Costa-Gomes, Steffen Huck, Georg Weizsäcker

Abstract In many economic contexts, an elusive variable of interest is the agent's belief about relevant events, e.g. about other agents' behavior. A growing number of surveys and experiments asks participants to state beliefs explicitly but little is known about the causal relation between beliefs and actions. This paper discusses the possibility of creating exogenous instrumental variables for belief statements, by informing the agent about exogenous manipulations of the relevant events. We conduct trust game experiments where the amount sent back by the second player (trustee) is exogenously varied. The procedure allows detecting causal links from beliefs to actions under plausible assumptions. The IV-estimated effect is significant, confirming the causal role of beliefs.

Academic research paper on topic "Beliefs and actions in the trust game: Creating instrumental variables to estimate the causal effect"

GAMES and ^Economic JBehavior

Accepted Manuscript

Beliefs and actions in the trust game: Creating instrumental variables to estimate the causal effect

Miguel A. Costa-Gomes, Steffen Huck, Georg Weizsäcker

PII: DOI:

Reference: To appear in: Received date:

S0899-8256(14)00149-3 10.1016/j.geb.2014.10.006 YGAME 2365

Games and Economic Behavior 8 August 2013

Please cite this article in press as: Costa-Gomes, M.A., et al. Beliefs and actions in the trust game: Creating instrumental variables to estimate the causal effect. Games Econ. Behav. (2014), http://dx.doi.org/10.1016/j.geb.2014.10.006

This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

Highlights

• We create an exogenous instrumental variable in the laboratory to examine whether beliefs are causal for actions.

• We do this in the context of a trust game where trustors' beliefs about trustees' returns are shocked exogenously.

• We elicit beliefs about returns and compare OLS and IV estimates for the relation between beliefs about returns and investments.

• We find that there is a causal relation between beliefs and trust.

Beliefs and actions in the trust game: Creating instrumental variables to estimate the causal effect1

Miguel A. Costa-Gomes2 (University of St Andrews) Steffen Huck3 (WZB Berlin & UCL) Georg Weizsäcker4 (Humboldt University Berlin & DIW Berlin)

September 2014

Abstract: In many economic contexts, an elusive variable of interest is the agent's belief about relevant events, e.g. about other agents' behavior. A growing number of surveys and experiments ask participants to state beliefs explicitly but little is known about the causal relation between beliefs and actions. This paper discusses the possibility of creating exogenous instrumental variables for belief statements, by informing the agent about exogenous manipulations of the relevant events. We conduct trust game experiments where the amount sent back by the second player (trustee) is exogenously varied. The procedure allows detecting causal links from

1 We thank Orazio Attanasio, Charles Bellemare, J org Breitung, Christoph Breunig, Samuele Centorrino, Syn-gjoo Choi, Brendan Kline, Costas Meghir, Lars Nesheim, Thomas Siedler and audiences at Alicante, Autonoma de Barcelona, CEU Budapest, City University, DIW Berlin, Exeter, Glasgow, Innsbruck, Jena, Lausanne, Paris I, Royal Holloway, UCL and WZB for their comments. We are grateful for financial support from the U.K. Economic and Social Research Council (ESRC-RES-1973), the European Research Council (ERC-263412) and the ELSE centre at UCL. The experimental sessions were conducted with the excellent support of Rong Fu, Tom Rutter, Brian Wallace and Mark Wilson.

2 University of St Andrews, School of Economics & Finance, Castlecliffe, The Scores, Fife, United Kingdom, KY16 9AR. Phone: +44 1334 462445. E-mail: miguel.costa-gomes@st-andrews.ac.uk

3Corresponding author. WZB - Berlin Social Science Center, Reichpietschufer 50, 10785 Berlin, Germany. Phone:

+49 30 25491 421. E-mail: huck@wzb.eu

4Humboldt University Berlin, School of Business and Economics, Spandauer Str. 1, 10178 Berlin. Phone: +49 30

2093 5700. E-mail: weizsaecker@hu-berlin.de.

beliefs to actions under plausible assumptions. The IV-estimated effect is significant, confirming the causal role of beliefs.

Keywords: Social capital, trust game, instrumental variables, belief elicitation JEL Classification: C72, C81, C91, D84

1 Introduction

In subjective expected utility theory and related models, the agent's expectations can be viewed as a pure as-if construct, meaning that expectations are no more than an elegant way of summarizing choice data. Choice is represented by a hypothetical function of expectations—for example, the expected utility function—and choice is thus the fundamental concept. Any assumption that one may make about expectations is really an assumption about the nature of choice. A much more literal interpretation of expectations is that they are real, meaning that they are independent entities that have some physical incarnation and that can in principle be accessed directly, for example by asking people to state them. Much can be said in favour of such a literal interpretation of expectations, not least that humans are able to express expectations even about variables that are irrelevant for their choices. But if expectations are independent entities, one should be able to influence them and thereby measure their effects on choice. This leads to the straightforward empirical question whether choices are driven by beliefs. We address this question in the context of trust games.

The question of causality of beliefs has important consequences for policy interventions. Many policy campaigns target beliefs—e.g. asserting the reality of climate change, or bolstering investor confidence—to bring about behavioral change. But empirically, the role of beliefs needs to be examined. Researchers have increasingly turned to belief elicitation procedures where the agents state their expectations explicitly. Trust game experiments (following Berg et al 1995) provide a frequent context for such methods. Fehr et al (2003), Bellemare and Kroger (2007), Sapienza et al (2007) and Naef and Schupp (2009), among others, ask their experimental participants to state expectations on how much money other participants will return if trusted. They find a strong correlation as well as much explanatory power when regressing the level of trust on stated expectations. Yet it remains unanswered whether the variance in trust arises because of the variance in stated beliefs or whether the co-variation in the two variables is driven by other, omitted variables that capture unobservable differences between the participants. For example, particpants who are

likely to trust others may also be relatively trustworthy and may project their own type onto others. The player's type would be an omitted variable that creates an endogeneity problem for the data analyst. A natural reason for such a type-driven correlation between beliefs and actions is the perception of social norms. Among the experimental participants who are assigned the role of trustors, presumably some view a high investment in the game as the "right" thing to do, given that it maximizes social surplus. The social norm's perception may depend on unobservable factors like the participants' education, cultural influences or even the framing employed in the experiment. These unobservables likely influence both beliefs and actions. The same participant who invests a large amount may thus also predict that the participant in the other player role will return a large amount because this, too, is arguably the "right" thing to do. A positive correlation between beliefs and actions would arise—without implying anything about a causal influence of one variable on the other.5

Such a correlation is not necessarily a "behavioral" phenomenon but can arise as an equilibrium outcome of a natural game of incomplete information. We develop a simple illustration of this in Appendix A. Players interact in a mini trust game with just two actions for each player: whether to trust or not, and whether to reciprocate or not. Both players are aware of the social norm that prescribes trust and its reciprocation but there prevails some uncertainty about whether deviations from the norm will be sanctioned. Players receive correlated signals about the likelihood of sanctions. The appendix shows that even with relatively little correlation between the players' signals the Bayesian Nash equilibrium involves a strong correlation between the trustor's own action and her belief about the opponent's action. The driver of both variables is the trustor's perception of the likelihood of sanctions (a variable that is omitted in most empirical analyses). The example also shows that despite the strong correlation between the trustor's belief and action, an exogenous shift of the trustor's belief about the opponent's action has a relatively small effect on her action. It would therefore be misleading to interpret the strong correlation between beliefs and actions as

evidence that one drives the other.

5A downward bias may arise due to measurement error in the explanatory variable. Under classical errors-in-variables assumptions, our instrumental variable would address this issue but we do not pursue this argument further.

This example only suggests one particular omission in the analyst's model—yet many other omitted variables apart from social norms might have an effect on actions and beliefs. The example's message is merely that the players may well have good reasons (here, play an equilibrium in a larger game) to exhibit correlations between beliefs and actions that the researcher may mis-interpret as a causal relation. To measure the effect of a belief change on actions, one needs more powerful observations than simple correlations.

In Section 2, we describe a technique to measure the effect in the context of a trust game, involving the artificial creation of an instrumental variable. The creation of instrumental variables in the laboratory is a technique employed previously by Ham et al (2005) and Gill and Prowse (2014)—they measure the causal role of endogenous variables other than beliefs and for different dependent variables. Our game is a simultaneous-move version of Berg et al's (1995) trust game and the instrument is a zero-mean random shift that exogenously increases or reduces the trustee's level of re-payment. The realization of the random shift is known to the trustor, thus affecting her belief about the final level of re-payment and potentially affecting her action. The trustee is informed of the existence of the shift and of its distribution. However, she is not informed about the realization of the shift, and her behavior remains unaffected by the realization.6 The trustor's belief about the trustee's behavior (her chosen level of re-payment prior to its manipulation through the shift) should therefore also be unaffected by the realization of the shift. Our data confirm these predictions. At the same time, the beliefs about the payoff-relevant event—the level of re-payment including the shift—react strongly to the exogenous variation, which is necessary to apply an IV estimation. Regarding the "exclusion restriction" requirement of IV, that the instrument influences the actions only via the beliefs about the level of re-payment, we argue that it is natural to make this assumption because the instrument is an element of the statistic that the belief is formed about (the level of re-payment), and does not enter the interaction in any other way.

To check for the validity of the design, the trust game is played under two different conditions—

6 An experimental procedure that is related to ours is to replace one player's choice by an exogenous random move as has been done in several experimental studies on reciprocity. See, in the context of the trust game, Cox (2004) among others. In short, these studies mainly differ from ours because they replace the trustor's action by a random move, whereas we manipulate the trustee's move.

with and without the instrument. The no-instrument condition is a control that serves two key purposes: it allows checking whether the introduction of the instrumentation technique has any undesirable influences on the data generating process and it generates the benchmark "naive" estimate of the connection between beliefs and actions. Consistent with the previous literature, we find a strong correlation between the two variables. Crucially, the IV results indicate a causal link between beliefs and actions. Exogenous belief variation has a strong and significant impact on choices. The average marginal (proportional) effect of beliefs on actions is 0.5 which is insignificantly smaller than the non-instrumented analysis suggests.

These findings constitute, to our knowledge, the first evidence supporting that first-order beliefs drive actions in the trust game. From a methodological point of view, our paper emphasizes the issue of causality in belief elicitation studies. Causal links between beliefs and actions were implicitly suggested not only in experiments with belief elicitation (McKelvey and Page, 1990, Offerman et al, 1996, Croson, 2000, Huck and Weizsacker, 2002, Nyarko and Schotter, 2002, and many later studies) but also in survey studies that use stated expectations about relevant market variables (see Manski, 2004, and Attanasio, 2009, for useful overviews). Both literatures contain rich sets of observations that are consistent with a causal influence of beliefs on actions, but the endogeneity of beliefs and actions is rarely addressed in the analyses.7 8

7Notable exceptions are the papers by Bellemare, Kroger and van Soest (2008, 2011) and Bellemare et al (2011) who estimate structural econometric models that include covariance between beliefs and actions, and Smith (2013) who studies experimental public goods games and uses lagged actions by the opponent as instruments for stated beliefs. Bellemare, Kroger and van Soest study first-order beliefs of proposers (2008) and responders (2011) in the ultimatum game. Bellemare et al (2011) study second-order beliefs in a sequential game akin to the trust game. Their structural models allow the parameters of an agent's other-regarding preference to be jointly determined with beliefs—an endogeneity that is confirmed in the data. Smith's (2013) IV regressions in public goods games also point at a substantial endogeneity of actions and beliefs. Our results indicate only a milder endogeneity problem in the trust game.

8A further important set of close relatives to our paper are field experiments that vary informational conditions in different economic contexts, see e.g. Jensen (2010) and Dupas (2011). Another related literature is summarized in Guiso et al (2006, 2009) showing evidence of a causal role of culture on both actions and beliefs.

2 Experimental design: Instrumental variables for belief statements

Our experimental design revolves around a continuous trust game with two players. We study two versions of this game, the game with instrument (Condition I) and the game without instrument (Condition NI). In addition to the choice data we collect the trustors' beliefs about the actions played by the trustees.

Condition NI serves as a control. First, it allows for a validity check of the instrument: whether or not it affects behavior in undesirable ways. In field studies that involve IV methods, this is less of a concern as the instrument is usually part of the natural decision making environment. But with an artificial instrument we must check that the instrumentation technique is neutral in the sense that its presence alone does not distort the data generating process.

Second, and no less important, Condition I provides the main comparison benchmark for our IV results: it is the usual laboratory environment for trust games. Condition I's non-instrumented estimates will also be reported but are only partially relevant because the instrumentation generates additional variance in beliefs. Under the hypothesis that an omitted variable is at work, a non-instrumented analysis on the data from Condition I yields a biased (attenuated) estimate of the relationship of interest.

We note that in all experimental sessions subjects also played a second type of trust game with binary actions. This game, too, was played in a variant with and a variant without an instrument. However, as documented extensively in the paper's previous version (Costa-Gomes et al, 2010), the instrument employed in the binary trust game failed our tests for invasiveness and hence we focus here on the continuous trust game.9

9The instrument used there is different from the instrument used in the continuous trust game and causes undesirable biases in beliefs. Specifically, 25% of elicited beliefs in the binary game are justifiable only by prior beliefs that lie outside the probability simplex. In the paper's earlier version we also carefully examine whether the continuous game data can be analysed separately from the binary data. The experimental design involves four types of trust games (either continuous or binary and either with or without an instrument) and the protocol was such that each subject played just two games (without feedback) ensuring that she would play once in a binary and once in a continuous game, once with and once without an instrument, and once as a trustor and once as a trustee. We detected no

For the collection of belief statements, we employ a quadratic scoring rule that is incentive compatible in the sense of theoretically eliciting the mean of the subjectively expected distribution, under the assumption that subjects are risk neutral.10

We conducted our experimental sessions at University College London and at the University of York, with a roughly equal number of subjects in each treatment at each location, as reported in Table 1. In all, 434 experimental subjects participated in our sessions. Subjects earn points by playing two games and one belief elicitation task, which are then converted into money at an exchange rate of 2.5 pence per point, resulting in an average variable payment of £13.12.11 Sessions lasted about 90 minutes from the moment the subjects were seated until leaving the laboratory after collecting their payments.

spillover from the binary game onto the continuous trust game data.

10 The quadratic scoring rule has been used by numerous studies. Belief elicitation procedures usually do not

generate large distortions of choice data (see, e.g., Costa-Gomes and Weizsacker, 2008) but some studies contain evidence on intrusive effects (Croson, 2000, and Rutstrom and Wilcox, 2009, Gachter and Renner, 2010). In our experiment, the danger of such an intrusion appears small, not least as we elicit beliefs after the choices. Nevertheless we readily admit that our method of payment could be cleaner as our subjects could in principle use their belief statements to hedge their positions. But such behavior would require considerable sophistication and risk aversion; existing evidence from controlled experiments (Blanco et al, 2010, Armantier and Treich, 2013) does not produce clear evidence that subjects rationally hedge in belief elicitation tasks. For recent discussions of belief elicitation

methods see Armantier and Treich (2013) and Trautmann and van de Kuilen (2014).

11 In addition, there was a show-up fee of £5 at UCL and £4 at York, chosen in each case so as to coincide with

the show-up fee of a different experiment being run at the respective lab at the same time.

Condition # York subjects # UCL subjects # Total subjects

I 124 120 244

NI 94 96 190

Table 1: Overview of experimental conditions

2.1 The continuous trust game and the shift instrument

Each of two players initially receives an "account" that contains 100 points. The trustor, here labelled "participant X", chooses the share ai of her points that are to be transferred to the trustee, "participant Y". The transfer is productive—every point that the trustor sends is tripled on the way to the trustee. Simultaneously, i.e. without knowing the trustor's transfer, the trustee decides how much to transfer back from the total that she has in her account after X's transfer. The trustee, like the trustor, makes a decision about a relative "transfer share" a2, not an absolute amount.

The transfer shares ai and a2 are restricted to lie in the interval [0.2,0.8]. Thus the trustor can transfer between 20 and 80 points, which are tripled and added to the trustee's amount, resulting in an account balance for the trustee between 160 and 340 points. Of these points, the trustee can transfer back a share of between 0.2 and 0.8 but has to do so without knowing the exact balance in her account.

The instrumental variable is a shift z that increases or decreases the trustee's transfer share by a value between —0.2 and 0.2, drawn from a uniform probability distribution over the 41 values on the grid {—0.2, —0.19,..., 0,..., 0.19, 0.2}. Both participants are informed that the trustee's transfer share ai is added to the zero-mean random variable z. The trustor is, in addition, informed about the realized value of z, while the trustee is not.

For example, suppose that upon being informed that the realization of the shift z is 0.05, the trustor transfers a share ai = 0.5 of her initial balance of 100 points. This would lead to intermediate account balances of 50 and 250 points for the trustor and trustee, respectively. Suppose further that the trustee decides to transfer ai = 0.25. Hence, the actual transfer to the trustor would be a share of 0.3 (= 0.25 + 0.05) of the trustee's intermediate balance, leading to final balances of 125 and 175 points for the trustor and trustee, respectively. The game's rules are illustrated in Figure 1.

y f(ai)

l 32 + 2 l

Figure 1: Illustration of the continuous trust game with instrument. Player 2 knows only the distribution of z and chooses action a>2. Player 1 knows the distribution of z and the value of z before choosing action ai and belief statement bi. f (ai) indicates that player 2's account balance depends on ai.

We explained the shifter z to participants as follows (for full instructions, see Appendix C):

"There is one important detail about the transfer out of Participant Y's account. The computer adjusts the share that is actually transferred from Participant Y's account to Participant X's account. More specifically, the computer will adjust Y's transfer share in a random way, increasing or reducing it by up to 20 percentage points. That is, the computer will generate a number that we call "CHANGE TO Y's TRANSFER SHARE" by picking a random percentage number among -20%, -19%, ..., 0%, ..., +19%, +20%. Each of the whole-numbered percentages in this range is equally likely."

The instructions continue by giving a further illustration of the instrumental variable and its effects on payoffs.

After making their choices, the trustor is asked to report her belief statement about the trustee's "adjusted transfer share", i.e. about the sum <22 = a2 +z. The belief statement is rewarded according to the quadratic scoring rule

■Kb = A - c(d2 - bi)2,

where bi is Participant X's belief statement about Participant Y's transfer share, and the parameter values are A = c = 250 points.12 This elicitation procedure applies both when the game is played with and without the instrument—when played without the instrument, the trustor is simply asked about the trustee's transfer ai. At the time when participants choose the actions in the game, none of them is made aware of the subsequent belief elicitation task.

Importantly, the instrument z is generated independently of all other relevant random variables. This property justifies the exogeneity assumption required for IV. Consider the bivariate linear projection of the trustor's transfer share ai on her stated beliefs bi:

ai = 3 0 + fii bi + u (1)

The "exclusion restriction" for OLS requires that while the error term u is potentially confounded with bi e.g. due to omitted variables, the instrumental variable z is orthogonal to u. (In the regressions of the next section, we use Tobit instead of OLS models, but the same logic applies for Tobit. See e.g. Angrist and Pischke (2009) for a wider discussion of exclusion restrictions.)i3 The exclusion restriction is key for the causal inference—indeed we designed the experiment to make it maximally plausible. Since z is independently generated in the laboratory, we can rule out that u has an influence on z, or that any omitted variable may co-determine u and z. It remains an assertion that z does not influence u. We regard this as a reasonable assertion because z is a summand of ai, which is the statistic that beliefs bi are formed about, and because z does not elsewhere enter the interaction. Section 3 will contain results that demonstrate that belief statements are indeed strongly responsive to z. In fact, participants respond in a way that is fully consistent with the hypothesis that they simply add z to their beliefs about ai .

12Under the assumption of risk neutral subjective expected utility the agent maximizes A — c f (02 — bi )2dF(02)

where F is the subjective distribution function of random variable 0,2. Reporting the mean of the distribution is

optimal, as indicated by the first-order condition, —2c f (O2 — bi )dF(O2 ) = 0 ^^ bi = f O2dF(O2).

13In order to see how this property helps in finding the causal link between bi and ai, consider the simple logic

of two-stage least squares regression: the analyst regresses ai on z, resulting in a slope coefficient 3a z, and also

regresses bi on z, resulting in a coefficient 3b z. If the only way in which z influences ai is through its effect on bi

(i.e. c and u are orthogonal), it follows that the effect of bi on ai must be times as large as the effect of c on

bi. That is, the causal effect of bi on ai is consistently estimated by

We insert a note of caution about the simultaneous-move game: the trust game is usually played as a sequential game, where the trustor observes the trustee's action before her own move. In such a sequential format reciprocal motives can influence the trustee's decision process (see e.g. the results by Servatka et al, 2008). In our game, the anticipation of reciprocal behavior is impossible. More generally, using the simultaneous trust game simplifies the trustor's belief about the trustee's transfer. (In the sequential version the trustor's beliefs would specify such a distribution for each possible action of her own.)

3 Results

3.1 Preliminaries: Data pooling, descriptive summary and checks for invasiveness of the instrument procedure

Data Pooling. We first determine whether there are any statistically significant differences between the data collected at UCL and at York, and whether there are any order effects on either actions or stated beliefs (recall that each participant played two versions of the trust game). The absence of major differences allows us to pool the data and simplify the subsequent analysis.

Initially, we pair the two treatments in which the game was played under the same instrument condition at each of the locations, thereby testing for order effects. The absence of such order effects leads us to pool the data and test for laboratory effects, by comparing the data collected at the two different locations. We apply Kolmogorov-Smirnov's two-sample exact test to both players' transfer shares and to the trustor's belief statements and find no statistically significant order or laboratory effects, for any of the player roles or for any instrument condition.14 Therefore, in the subsequent data analysis we use the pooled data played under each instrument condition.

Data summary and checks for invasiveness. As part of the data summary, we examine whether the presence of an instrument has undesired effects on how subjects play the games. More specifically,

14The twelve tests on the order and laboratory effects all produced p-values above 0.1, with the exception of the test for order effects on the trustee's transfer share in the instrument condition run at York, for which we obtain a p-value of 0.003. Since our data analysis focuses on the trustors, this rejection is not problematic.

we check that the mere introduction of the instrument does not affect the behavioral variables except through the channel of influencing the beliefs. We focus on the trustor's data as the trustee's role in this study is accessory and only serves the purpose of generating an uncertain re-payment.

Our first step is to use the beliefs stated under Condition I (the beliefs about the trustee's "adjusted" transfer share after manipulation through the instrument) to construct the underlying beliefs about the behavior of the human opponent. Wethen check whether these inferred underlying beliefs are "admissible", i.e., whether one could hold such beliefs about the trustee's transfer share. More concretely, suppose that upon being informed that the shift is equal to z the trustor states that her expectation of <22 is a share equal to bi. Her underlying belief is then inferred to be bi — z and the stated belief bi is deemed "admissible" if the underlying belief bi — z is in [0.2, 0.8], the interval of transfer shares the trustee can choose from. A stated belief whose underlying belief falls outside this interval is "inadmissible" and indicates a potential confusion on behalf of the trustor subject. We find that only 5 subjects' beliefs (4% of trustors in Condition I) are "inadmissible", a low percentage.15 For consistency, we exclude these 5 subjects from the analysis, unless mentioned otherwise.

Next, we check whether the instrument has any undesirable effect on the choice variables. The shift's expected value is zero, and thus we check that none of the choice variables exhibits a significant change in means between the treatments with and without the shift. In the game without shift (Condition NI) the transfer shares of the trustors follow a familiar tri-modal pattern that has been observed in many other trust game experiments, with substantial proportions of participants choosing the lowest possible transfer (here, a transfer share of 0.2, chosen by 32.6%), or the midpoint of the action space (0.5 transfer share, chosen by 19.0%) or the highest possible transfer share (0.8, chosen by 14.7%). The remaining observations are dispersed between these three modes. As can be seen in Table 2, the sample mean of the trustor's transfer share is 0.427, with a standard deviation of 0.218. For comparison, in the game with instrument (Condition I)

15 Note that expressing an inadmissible belief is a strictly dominated decision, and that their low frequency is actually lower than the frequencies of dominated actions in games, see e.g. Costa-Gomes and Crawford (2006). Additional evidence of a high level of logical consistency of trustors' stated beliefs is provided by the frequencies of observing multiples of 5% in the data, referred to at the end of this subsection.

the frequencies of transfer shares that lie on the points of the simple three-point grid {0.2, 0.5, 0.8} are 29.9%, 7.7% and 19.7%, and the mean transfer share is 0.435 (std. dev. 0.226).i6

16Note that, in Condition I, if the shift z weakly exceeds 0.14 it is a dominant strategy for the trustor to transfer a share of 0.8 because the amount that she transfers is multiplied by three and she is guaranteed to receive at least 0.34 of this total amount. In the 22 instances with shifts greater than or equal to 0.14, the trustors comply with this prediction 7 times. This is in line with other trust game data where trustors are often found not to trust fully even if it were to pay; see, for example, Bohnet et al. (2005) or Huck et al (2012).

Condition NI I (All) I ("admissible" data)

Trustor's transfer share 0.427 0.435 0.440

(0.218) (0.226) (0.227)

Trustee's transfer share 0.306 0.303 0.303

(0.144) (0.150) (0.150)

Trustor's belief about - 0.330 0.331

adjusted transfer share Ô2 (0.185) (0.178)

Trustor's belief about 0.350 - -

transfer share a2 (0.132)

Shift z - -0.008 -0.013

(0.121) (0.119)

Table 2: Means and standard deviations of behavioral variables and shift

We conclude that with the single exception of observing fewer transfer shares at level 0.5, the features of the action data under both conditions are very similar. In particular, their means are close to identical and a Mann-Whitney test cannot reject the null hypothesis that the distributions are constant, at any conventional level. The same holds true for the trustees' transfer shares.

Now consider the trustor's belief about the trustee's transfer share. In Condition NI, its mean is 0.350 (std. dev. 0.132), away from its target by less than 5 percentage points. The corresponding numbers for the game with the instrument, Condition I, are close in terms of mean (0.330) but the presence of the instrument induces additional variance in the belief statements—as it should because the shift is random and a rational subject adds the shift to her belief about the opponent. The size of the variance difference is very close to the predicted effect under the assumption that the subjects add the shift to their beliefs.17

Figure 2 provides further evidence that subjects connect underlying beliefs and shifts in an additive way. In the figure, the thick (lower) line represents the target of the belief statements, which is given by the mean behavior of trustees in Condition I plus a trustor's specific value of z. This line's slope is equal to 1 and the set of points on the line corresponds to the set of ex-post optimal belief statements that the trustors would express if their beliefs were rational expectations about a2. For different underlying beliefs about a2, optimality requires different levels of belief statements but unvariably with a slope of 1. As the figure shows, a prominent feature of the data is that the large majority of (bi,z)-pairs indeed lie on straight lines with slope 1: 79.5% of observations in Figure 2 are (bi,z)-pairs consistent with the hypothesis that the corresponding participant adds their value of z to a belief about a2 that lies on the grid

17 Under the assumption that the participants in Condition I arrive at their belief statements by simply adding the shift variable z to their (exogenous) belief about a 2, the two variables "belief about a2" and z are independent and their sum of variances is thus equal to the variance of their sums. Counterfactually assuming that subjects in Condition NI were to observe the same realizations of z and add them to their beliefs, one can analogously construct a variance of "hypothetical beliefs about ~a,2" in Condition NI, and compare it to the observed variance of beliefs about a2 in Condition I. The comparison supports the hypothesis that beliefs about the underlying a2 are constant: the standard deviation of simulated beliefs in Condition NI is 0.181, very close to the standard deviation of stated beliefs in Condition I (0.178).

{0.2,0.25,0.3,0.35,...}.18 The thin (upper) line is the Tobit regression line generated from the depicted data. The fact that the regression line has a slope coefficient of 0.841 (std. err. 0.116) that is statistically indistinguishable from 1 is also consistent with the prediction that participants add the instrument to an underlying belief. Finally, a comparison of the second and third columns of Table 2 shows that the exclusion of the inadmissible data does not have much of an effect on the sample statistics.

In sum, the data analyses in this subsection show that introducing the instrument has no undesirable side effects on the distributions of the behavioral variables and that any differences conform to the theoretical predictions of the instrument's effects. We therefore conclude that we can proceed to the IV analysis of data from Condition I and compare its results to the benchmark data from Condition NI.

3.2 Regression analysis: The causal effects of beliefs

In this subsection we present the regression results to assess the causality of beliefs for actions. We write trustor i's transfer share a^ as a linear function of her stated belief bii and a vector of control variables xi of self-reported demographic information, socio-economic indicators, cognitive skills, and measures of trust:

ali = ßo + ßi bii + ßixi + ui (2)

Since ali is censored at 0.2 and 0.8 we regard it as a latent variable that underlies the observed value aii,19

18For comparison, in Condition NI, 90.5% of stated beliefs about the transfer share are multiples of 5%. Stated beliefs about the "adjusted transfer share" ~5,i in Condition I are multiples of 5% in only 39.3% of all cases, indicating that many subjects form a well-defined underlying belief on the grid and then add z. For further comparison, Costa-Gomes and Weizsäcker (2008) also find in their 3x3 games that subjects state beliefs that are multiples of 5 percentage points around 90% of the time.

19In Condition NI, 31 and 14 observations out of a total of 95 are at the lower and upper limits, respectively. In

Condition I, 35 and 23 out of a total of 117 observations are at the lower and upper limits, respectively.

Figure 2: Trustors' stated beliefs upon observing transfer shifts z. Thick (lower) line: theoretical prediction under rational expectations (slope 1, "target" as described in main text). Thin (upper) line: Tobit regression line (slope 0.841, std. err. 0.116, 95% conf. int. [0.610,1.072]).

0.2 if a*u < 0.2

ai if 0.2 < ai, < 0.8

0.8 if ai, > 0.8

For the instrumentation in Condition I we also write trustor i's stated belief bi, as a linear function of the transfer shift z, and control variables.20 While it would be desirable to do a nonlinear IV analysis of the connection between actions and beliefs, the number of observations only allows us a simple linear specification—with nonlinear models any statistical inference with acceptable levels of power is beyond reach with our data.2i We first use a two-limit censored To bit model to estimate the relation between the trustors' transfer shares ai, and their stated beliefs (as in expression (??)) in the NI data, both with and without control variables. This is the analysis that one would carry out in order to establish causality in the absence of endogeneity problems. The results are in Table 3 (standard errors in parentheses; detailed control variables estimates in Table 1A of Appendix B). The Tobit estimates show a strong correlation of trustors' stated beliefs and their transfer shares, with an average marginal effect of 0.722, see column (1).22 The corresponding slope coefficient of the linear latent variable ai, is 1.317 (std. err. 0.288), but the average marginal effect (calculated via post-regression analysis) takes into account also the effect of data censoring at transfer shares of 0.2 and 0.8. That is, on average for all observations, including those at the boundary, an increase in the belief of 10 percentage points translates into an increase of 7.2 percentage points in the transfer share. In the regression with controls, the estimated effect is even larger, with a slope of 1.638 (std. err. 0.308) that translates into an average marginal effect

20The dependent variable is doubly censored at 0 and 1 but these two belief values appear in less than 5% of the observations.

21 Under the assumption of self-interested expected-value maximization, the predicted correspondence between beliefs and actions is a nonlinear step function where trustor i chooses the minimal possible share 0.2 if bii lies below one third and the maximal share 0.8 otherwise. Empirically, 43% and 31% of observations in condition NI and condition I, respectively, conform with this prediction.

22In this and subsequent tables, the goodness of fit is measured by R2, denoting the correlation between predicted and the observed values of the dependent variable. The difference in the number of observations between columns (1) and (2) is due to non-response values in the personal questionnaire.

of 0.89, see column (2).23

23The estimates in Appendix B show that age has a statistically significantly negative effect on the transfer share, while the subject's father's level of education, living with a partner, and having a loan as the main source of income have significantly positive coefficients. However, none of these four effects extends to the data from Condition I.

Transfer Share in Condition NI

(1) (2)

Tobit Tobit

Belief statement 0.722 (0.126) 0.890 (0.123)

Personal controls no yes

# of Obs. 95 92

R2 0.214 0.402

Table 3: Average Marginal Effects of Trustors' Beliefs on Trustors' on Trustors' Transfer Shares (std errors in parentheses).

A "naive" attribution of these statistical connections to a causal effect would thus suggest that beliefs are a strong driver of trust. The paper's main question is whether this attribution can be corroborated by the IV results. Table 4 has the IV Tobit results from Condition I, showing that the answer is affirmative. As indicated in column (3) of Table 4, the IV average marginal effect from a regression without control variables is estimated at 0.519, with an estimated slope coefficient of 1.004 (std. err. 0.389). This is insignificantly smaller than the non-instrumented estimated in Condition NI, indicating that no strong endogeneity exists.24 A further indication that there is no strong endogeneity problem is that the the size of the IV-estimated effect is very similar to that of the shift itself: In a Tobit regression of an on z (see Table A3 in Appendix B) we estimate an average marginal effect of 0.422 (std. err. 0.168). However, the most important aspect of the IV results of Table 4 is that the IV-estimated effect of beliefs is substantial and significantly different from zero. To the best of our knowledge this is the first direct evidence that the correlation between first-order beliefs and actions in an experimental trust game is indeed causal.

24To obtain a statistical test for the comparison, we use the estimated standard deviations of both slope coefficient estimates. The estimates are independent and asymptotically normal. Under the null hypothesis of equal slope coefficients, the standard deviation of the difference between the slope estimates is thus estimated as a/0.3892 + 0.2882 = 0.484. The estimated slope difference of 1.317 — 1.004 = 0.313 is within one estimated standard deviation around zero and has a t-value of ^^fgf = 0.647. Comparing the coefficients from regressions with controls, the analogous standard deviation is V0.4082 + 0.3082 = 0.511 and the slope difference has a t-value of o 511" =

Transfer Share in Condition I

(1) (2) (3) (4)

Tobit Tobit IV Tobit IV Tobit

Belief statement 0.489 (0.102) 0.536 (0.104) 0.519 (0.171) 0.513 (0.190)

Personal controls no yes no yes

# of Obs. 117 116 117 116

R2 0.149 0.254 0.149 0.254

Table 4: Average Marginal Effects of Trustors' Beliefs on Trustors' Transfer Shares in Condition I (std errors in parentheses).

The results also show that within Condition I, there is no discernible difference in the results of Tobit versus IV Tobit. This is another indication that there cannot be a strong omitted-variable problem. One may worry about the observation that the Tobit coefficients differ between Conditions NI and I. The difference is insignificant, however, in a Tobit regression that includes all main and interaction effects of conditions and belief statements.25

4 Conclusion

The paper makes two contributions. First, adding to the related literature discussed in the Introduction, it establishes that there is a causal link between first-order beliefs and actions in an investment/trust game. The finding confirms the implicit supposition of such a link in many previous analyses of stated beliefs. The question of causality between beliefs in other people's trustworthiness and actions is potentially relevant for many applied policy issues. Every situation is different, however, and we point out that our "positive" evidence may not generalize to contexts outside the clean laboratory environment.

Second, the paper further develops and discusses a new method for laboratory experiments— artificially created instruments—that can also be employed to examine other questions. It has always been the hallmark of experimental economics to manipulate directly the explanatory variables of interest, allowing causal insight. Indeed, this is the main reason for why experiments have become so popular. But in some contexts, the explanatory variable of interest is by its very nature an endogenous variable, and thus cannot be fully controlled even by an experimenter. Yet in such contexts, one can at least influence the explanatory variable of interest to some degree, by way of using instrumental variables. Under standard linearity assumptions, this suffices to measure causal links. Non-linear specifications may follow in subsequent research, as may the combination of exogenous randomization with structural-model estimations. Similar procedures to ours may also be applied in studies where the explanatory variable of interest is of a different nature, but is 25 To the extent that there is a difference between the two treatments, it could be generated by reciprocity: under Condition NI, trustors may want to be kind to their opponents if they expect them to be kind as well. In Condition I, part of the belief is driven by the computer draw, so a reciprocal agent may respond less to this belief.

likewise endogenous to the choice process: for example, information about past outcomes, responses to attitudinal questions, happiness reports or even neurological data. To our knowledge, Ham et al (2005) and Gill and Prowse (2014) are the only previous paper that employ a truly exogenous instrumental variable created in a laboratory—they study the effects of cash balances in auction bidding and, respectively, of past successes in tournament games.26

An unusual feature of our study is that we explicitly question the link between expectations and actions—yet traditionally expectations are, at least under subjective expected utility, not viewed as a concept that is separate from actions. We acknowledge that we do not offer an alternative definition of expectations or a general decision-theoretic view on the topic, instead we simply take belief statements as our data. But the statistical establishment of a causal link between expectations and actions is at least pragmatic. Indeed the empirical link may be the only thing that matters for a policy maker who runs a campaign to change expectations in order to accomplish a behavioral change.

References

Angrist, J., and S. Pischke (2009), Mostly harmless econometrics: An empiricist's companion, Princeton University Press.

Armantier, O., and N. Treich (2013), "Eliciting beliefs: Proper scoring rules, incentives, stakes and hedging", European Economic Review 62, 17-40.

Attanasio, O. (2009), "Expectations and perceptions in developing countries: Their measurement and their use", American Economic Review (Papers and Proceedings) 99, 87-92.

26In the literature on field experiments, artificial instruments have been employed to measure the effect of information (Duflo and Saez, 2003) or technology adoption (Devoto et al, 2012) or to avoid selection effects in subsequent experimental interaction of participants (List and Millimet, 2008).

Bellemare, C., and S. Kroger (2007), "On representative social capital", European Economic Review 51, 181-202.

Bellemare, C., S. Kroger and A. van Soest (2008), "Measuring inequity aversion in a heterogeneous population using experimental decisions and subjective probabilities", Econometrica 76, 815-839.

Bellemare, C., S. Kroger and A. van Soest (2011), "Preferences, intentions, and expectation violations: A large-scale experiment with a representative subject pool" , Journal of Economic Behavior & Organization 78, 39-365.

Bellemare, C., A. Sebald and M. Strobel (2011), "Measuring the willingness to pay to avoid guilt: Estimation using equilibrium and stated belief models", Journal of Applied Econometrics 26, 437-453.

Berg, J., J. Dickhaut and K. McCabe (1995), "Trust, reciprocity, and social history", Games and Economic Behavior 10, 122-142.

Blanco, M., D. Engelmann, A.K. Koch and H. Normann (2010), "Belief elicitation in experiments: Is there a hedging problem?", Experimental Economics 13, 412-438. Bohnet, I., H. Harmgart, S. Huck and J.R. Tyran (2005), "Learning trust", Journal of the European Economic Association 3, 322-329.

Costa-Gomes, M., and V. Crawford (2006), "Cognition and behavior in two-person guessing games: An experimental study", American Economic Review 96, 1737-1768.

Costa-Gomes, M., and G. Weizsacker (2008), "Stated beliefs and play in normal form games", Review of Economic Studies 75, 729-762.

Cox, J. (2004), "Howto identify trust and reciprocity," Games and Economic Behavior 46, 260-281.

Croson, R. (2000), "Thinking like a game theorist: Factors affecting the frequency of equilibrium play," Journal of Economic Behavior and Organization 41, 299-314.

Devoto, F., E. Duflo, P. Dupas, W. Pariente and V. Pons (2012), "Happiness on tap:

Piped water adoption in urban Morocco", American Economic Journal: Economic Policy, 4, 68-99.

Duflo, E., and E. Saez (2003), "The role of information and social interactions in retirement plan decisions: Evidence from a randomized experiment", Quarterly Journal of Economics 118, 815-842.

Dupas, P. (2011), "Do teenagers respond to HIV risk information? Evidence from a field experiment in Kenya", American Economic Journal: Applied Economics 3, 1-34.

Gachter, S., and E. Renner (2010), "The effects of (incentivized) belief elicitation in public goods experiments", Experimental Economics 13, 364-377.

Gill, D., and V. Prowse (2014), "Gender differences and dynamics in competition: The role of luck", Quantitative Economics 5, 351-376.

Guiso, L., P. Sapienza and L. Zingales (2006), "Does culture affect economic outcomes?", Journal of Economic Perspectives 20, 23-48.

Guiso, L., P. Sapienza and L. Zingales (2009), "Cultural biases in economic exchange?", Quarterly Journal of Economics 124, 1095-1131.

Fehr, E., U. Fischbacher, B.v. Rosenbladt, J. Schupp and G.G. Wagner (2003), "A nation-wide laboratory examining trust and trustworthiness by integrating behavioral experiments into representative surveys", IEW Working Paper 141.

Ham, J.C., J.H. Kagel and S.F. Lehrer (2005), "Randomization, endogeneity and laboratory experiments: the role of cash balances in private value auctions" , Journal of Econometrics 125, 175-205.

Huck, S., G. Lunser and J.R. Tyran (2012), "Competition fosters trust", Games and Economic Behavior 76, 195-209.

Huck, S., and G. Weizsaicker (2002), "Do players correctly estimate what others do? Evidence of conservatism in beliefs", Journal of Economic Behavior and Organization 47, 71-85.

Jensen, R. (2010), "The (perceived) returns to education and the demand for schooling", Quarterly Journal of Economics 125, 515-548.

List, J.A., and D.L. Millimet (2008), "The market: Catalyst for rationality and filter of irrationality", B.E. Journal of Economic Analysis & Policy (Frontiers), Vol. 8, Article 47.

Manski, C.F. (2004), "Measuring expectations", Econometrica 72, 1329-1376.

McKelvey, R.D., and T. Page(1990), "Public and private information: An experimental study of information pooling", Econometrica 58, 1321-1339.

Naef, M., and J. Schupp (2009), "Measuring trust: Experiments and surveys in contrast and combination", mimeo, Royal Holloway.

Nyarko, Y., and A. Schotter (2002), "An experimental study of belief learning using real beliefs," Econometrica 70, 971-1005.

Offerman, T., J. Sonnemans, and A. Schram (1996), "Value orientations, expectations and voluntary contributions in public goods," Economic Journal 106, 817-845.

Rutstrom, E.E., and N.T. Wilcox (2009), "Stated beliefs versus inferred beliefs: A methodological inquiry and experimental test" , Games and Economic Behavior 67, 616632.

Sapienza, P., A. Toldra-Simats and L. Zingales (2013), "Understanding Trust", Economic Journal, 123, 1313-1332.

Servatka, M., S. Tucker, and R. Vadovic (2008), "Strategic use of trust", mimeo, University of Canterbury.

Smith, A. (2013), "Estimating the causal effect of beliefs on contributions in repeated public good games", Experimental Economics, 16, 414-425.

Trautmann, S.T., and G. van den Kuilen (2014), "Belief elicitation: A horse race among truth serums", The Economic Journal, forthcoming.

5 Appendix A: An example of naive inference under omitted variables and equilibrium play

In this section we give an example of how the correlation between belief statements and actions can be misleading in the presence of omitted variables. To arrive at a "misleading" effect, we imagine that a researcher observes the full data (choices and belief statements about the opponent's choices) but ignores the possibility of a social norm, or any other unobserved variable, that could drive behavior and belief statements. The players, in contrast, are aware of the full model and play the unique Bayes-Nash Equilibrium (BNE) of the game.

The example builds on a 2x2 mini trust game, where player 1 can either trust (ai = 1) or not (ai = 0) and player 2 can reciprocate (a2 = 1) or not (a2 = 0). The players are aware of a social norm that prescribes trust and reciprocation (ai = a2 =1). A random event specifies whether violations of the social norm are sanctioned: in state w = 1, violations are sanctioned, and we assume that this state arises with probability If lo = 1 occurs, player ¿'s utility is penalized by a term Yi if she does not comply with the norm but plays ai =0 instead. The punishment parameter Yi is known to the player herself but not to her opponent, who only knows the distribution of Yi to be uniform over [0,1]. If w =0, no punishment applies.

A possible justification for such a probabilistic social norm enforcement is that with probability ^ the interaction does not remain anonymous. For example, an outside observer (say, the experimenter) may impose a punishment yi on non-cooperative play. Or, the players meet afterwards and may be compelled to reveal their play in the game. In this case, the punishment parameter Yi would reflect the extent of embarrassment. The payoffs (ni, n) in the two states are as follows.

w = 0 Player 2 a 2=0 «2=1 w=1 Player 2 a 2=0 «2=1

Player 1 «1=0 «1=1 0,0 0,0 Player 1 «1=0 «1=1 —7i, -72 "71,0

-1,2 1,1 -1,2-72 1,1

We assume that the two punishment terms Yi and y2 are i.i.d. uniformly distributed on the interval [0,1]. The worst feasible punishment, Yi = 1, makes the non-cooperative action ai = 0

weakly dominated for player i, under state w = 1. The smallest possible punishment for player 2, Y2 = 0, makes player 2's non-cooperative action a2 =0 weakly dominant (independent of w). Player 1's optimal action depends on w, too, but as usual in the trust game it also depends on her belief about a2—for a large expected return, it pays to trust.

While players do not know the true state w for sure, they each receive a signal Si that has precision That is, Pr(s,; = l\u) = 1) = Pr(s,; = 0|w = 0) = for i = 1,2. Their information about w is therefore correlated: players know that it is more likely than not that the opponent receives the same signal. The probability of the opponent having the same signal is | (and the correlation coefficient between the two players' signals is

In this Bayesian game, a player's type is given by her signal Si and her punishment payoff Yi. We assume for simplicity that the punishments (yi,Y2) are independent of the signals (si, S2). It is then straightforward to determine the players' optimal choice probabilities: for any signal Si and any belief about the opponent's strategy, we first ask what values of Yi make it optimal for the player to choose the cooperative action ai = 1. The answer yields a cutoff value 7i(si), such that for yi > 7i(si), the player chooses ai = 1. Each player i employs two such cutoffs, one for each signal realization, Si £ {0,1}. Player i also entertains a belief about the opponent's cooperation: Pr(aj = 11Si) = Xsej0 1} Pr(sj = STj |Si)(1 — Pr(Yj < 7j(sj))). This belief determines player i's two cutoffs, and the BNE solution is then found by solving for a set of four cutoffs that form a fixed point. To find the solution, we aggregate over the possible range of punishment parameters and denote the choice probabilities under the players' equilibrium strategies by r = Pr(ai = 11s 1 = 0) = 1 — 7i(si = 0), s = Pr(ai = 1|si = 1) = 1 — 7i(si = 1), t = Pr(a2 = 1|s2 = 0) = 1 — 72(S2 = 0), and u = Pr(a2 = 1|s2 = 1) = 1 — 72(s2 = 1). To find e.g. the cutoff value 7i(si = 1) that makes player 1 indifferent upon signal si = 1, we solve

E [ni (ai = 0|si = 1,7i (si =1))] = E[n i(ai =1|si = 1, Yi(si = 1))]

-(-7i(si = l)) = Pr(a2=0|si=l).(-l)+Pr(a2=l|si = l).l which can be rewritten as:

3 8 10 1

s = — — t -\--u--

2 9 9 2

Formulating analogous expressions for r, t and u allows to solve for the unique equilibrium values

3 t - i u -

5 ' 5 ' 2 J

{r = 0,s = |,f = \,u= We see that in equilibrium, both players react strongly to their signals

as s exceeds r and u exceeds t, both by a considerable margin.27

Now consider a naive researcher who wants to infer the causal effect of player 1's beliefs on her actions. We define a naive researcher as one who is not aware that the information structure determines the players' beliefs and actions. Rather, the researcher views the players' beliefs as exogenous and does not require that they are in equilibrium. The researcher collects player-1 data on actions and belief statements about player-2 actions, which we assume are reported truthfully, generated by the full model with social norms. The researcher will therefore observe two different belief statements: first, when player 1 receives the signal si =1, she reports the belief that her opponent cooperates with probability

, 5 4 11

rr «2 = 1 Si = 1 ) = —11 -\--1 = -.

v 1 ' 9 9 30

Under this signal realization si = 1, we saw above that her actions are cooperative with probability

Second, when player 1 receives the signal si = 0 she reports that her opponent cooperates with

probability

^ 4 5 1 Pr(a2 =l|si =0)= gU + -t= -,

and her actions under this signal realization are cooperative with probability 0. The data on player 1 that the researcher observes can therefore be summarized in the following table (where the cell entries indicate the relative frequency of the four possible belief-action pairs):

Player 1 Belief statements

bs i = bs i =i

Actions «1=0 2 10 l 2

«1=1 3 10 0

As the naive researcher ignores the existence of the social norm, he will also wrongly assign

27The equilibrium is in (essentially) pure strategies, as a player with a given type has a strict best response, except for the zero-probability event that her realized value ji makes her indifferent, i.e. ji = tfi (si).

causal effects: we assume that he attributes any change in actions exclusively to changes in beliefs. (We also assume that the researcher is not puzzled by the fact that not all actions are best responses to stated beliefs. One could write down a simple error model of what the researcher has in mind, but this would not add much beyond the verbal statement in the sentence before these parentheses.) He therefore believes that if he could intervene and influence players' beliefs, he would also influence players' actions as prescribed by the frequencies in the data matrix. In particular, let us suppose that he thinks he could convince all members of the player-1 population who hold the belief of ^ (i.e. one half of the population) to increase their belief by These player Is would then hold the same belief as the other half of the population. After such an intervention, the naive researcher would expect the actions to change in accordance to the difference between the columns of the above data matrix. He would thus expect the following data after the intervention:

Player 1 Belief statements

= 30 6si =1

Actions «1=0 2 5 0

«1=1 3 5 0

But what would the actual effects be of such an intervention, given the true model? To find the answer, the researcher could use a simple announcement: he could address all player 1s whose belief statement is explaining to them that in one out of 20 times, their opponent would be replaced by a robot that always cooperates.28 In the above equilibrium, and starting from the belief a player with signal si =0 would indeed arrive at a belief that the opponent cooperates with probability as one can easily check:

Pr(opponent cooperatesjsi = 0) = — Pr(«2 = l|si = 0) + —

191 " 1 11

203 + 20 = 30

28To be precise, the announcement must be made after the researcher observes the player 1's intended actions and belief statements, but before the game is played. Importantly, for this example, the researcher must not inform player 2 about this intervention, because she would otherwise change her equilibrium behavior. Here in the theoretical example such trickery may be acceptable for the sake of exposition. In our experiments, both players are told about the possibility of intervention, so that no deception is used.

Under the true model, what would be the effect of the announcement on player 1 's cooperation rate? What the naive researcher misses is that even under the above announcement, a player 1 with signal si = 0 would still assign a low probability to the event that a non-cooperative action would be penalized. She would therefore still find the non-cooperative action ai =0 relatively attractive—the omitted variable thus reduces the beneficial effect of the belief shift.

To find the size of the effect, we consider the relevant cutoff 71 (si = 0), afterthe announcement. The indifference condition is:

E[ni (ai = Q|si = 0,71 (si = 0))] = E[ni (ai = 1|si = 0, 71 (si = 0))]

3("7i(si = 0))

1, ~ , ess 19,1 2, 1

7i(si = 0)) = -(---) + -!

— (Pr(a2 = l|si = 0)1 + (1 - Pr(a2 = l|si = 0))(-l)) + -1

7i (si = 0) =

Thus only a proportion of Pr(71 > |) = ^ of the players with si = 0 would cooperate and the new data matrix after the announcement is

Player 1 Belief statements bsi = ^ bsi = £

Actions «1=0 3 5 0

«1=1 2 5 0

We conclude that by looking at the frequencies instead of measuring the effect, the naive researcher would considerably overestimate the causal link between beliefs and actions. Under the true model, only one fifth of the announcement's recipients would change their actions.