Quasi-magical thinking and superrationality for Bayesian agents

As part of our objective and subjective rationality model, we want a focal agent to learn the probability that others will cooperate given that the focal agent cooperates () or defects (). In a previous post we saw how to derive point estimates for and (and learnt that they are the maximum likelihood estimates):

, and

where is the number of times Alice displayed behavior and saw Bob display behavior . In the above equations, a number like is interpreted by Alice as “the number of times I cooperated and Bob ‘responded’ with a defection”. I put ‘responded’ in quotations because Bob cannot actually condition his behavior on Alice’s action. Note that in this view, Alice is placing herself in a special position of actor, and observing Bob’s behavior in response to her actions; she is failing to put herself in Bob’s shoes. Instead, she can realize that Bob would be interested in doing the same sort of sampling, and interpret more neutrally as “number of times agent 1 cooperates and agent 2 defects”, in this case she will see that for Bob, the equivalent quantity is .

With this simple theory of mind that realizes that Bob is also capable of agency, the proper interpretation for (; I am introducing subscripts to avoid overloading notation) becomes “how often an agent cooperates given that the other agent cooperates (defects)”. The proper estimate becomes:

, and

Note that Alice is now double counting the symmetric events and . If the real proportion of cooperation in the population is then in the limit of the theory-of-mind estimates still converge to the rational and .

What if the agent employs quasi-magical thinking, i.e. know that their actions do not affect the decision of others but behave as if they do? If we follow Masel (2007) then quasi-magical thinking is equivalent to Alice updating her beliefs not only with the result of Bob’s action, but also her simulation of what she would have done. As an example, everytime she sees a or event, she also counts as event since she would have cooperated in that case. This gives us the estimates:

, and

As before, we look at the limit of with true proportion of cooperation $r$:

and

In other words, regardless of the true probability of cooperation, this quasi-magical thinking agent will believe that her partner is 50% more likely to cooperate with her if she cooperates.

I chose the subscript suggestively. In a more general treatment, Alice can choose by how much she weighs her simulated self-action against Bob’s real action. If we let be a measure of self-absorption or the weight she attributes to herself and to Bob then the estimates become:

, and

With the limit of large given by:

and

In words, an -self-absorbed quasi-magical thinking agent will believe her partner to be more likely to cooperate with her if she cooperates regardless of the real proportion of cooperation . If we consider a completely self-absrobed agent () then we recover Hofstadter’s superrationality: an agent so dogmatic that he assumes that every other agents will always arrive at the same exact conclusion as him for what behavior to pursue.

If Alice suffers from the quasi-magical delusions, but otherwise acts rationally on her beliefs then we can calculate how she will behave. Suppose that she is -self-absrobed, thinks that she is playing the cooperate-defect game , and is out to maximize her expected utility. She will cooperate if:

A superrational agent will always cooperate. For other agents, cooperation will be risk dominant (equivalent to ) strategy when:

Note that by setting tag-mutation rate we recover the condition for cooperation in set structured populations. Can we think of set-structured populations in cognitive terms as a type of quasi-magical thinking? A group-think delusion or just a mathematical coincidence?

Masel, J. (2007). A Bayesian model of quasi-magical thinking can explain observed cooperation in the public good game Journal of Economic Behavior & Organization, 64 (2), 216-231 DOI: 10.1016/j.jebo.2005.07.003