Quasi-magical thinking and superrationality for Bayesian agents
May 13, 2013 5 Comments
As part of our objective and subjective rationality model, we want a focal agent to learn the probability that others will cooperate given that the focal agent cooperates () or defects (
). In a previous post we saw how to derive point estimates for
and
(and learnt that they are the maximum likelihood estimates):
, and
where is the number of times Alice displayed behavior
and saw Bob display behavior
. In the above equations, a number like
is interpreted by Alice as “the number of times I cooperated and Bob ‘responded’ with a defection”. I put ‘responded’ in quotations because Bob cannot actually condition his behavior on Alice’s action. Note that in this view, Alice is placing herself in a special position of actor, and observing Bob’s behavior in response to her actions; she is failing to put herself in Bob’s shoes. Instead, she can realize that Bob would be interested in doing the same sort of sampling, and interpret
more neutrally as “number of times agent 1 cooperates and agent 2 defects”, in this case she will see that for Bob, the equivalent quantity is
.
With this simple theory of mind that realizes that Bob is also capable of agency, the proper interpretation for (
; I am introducing subscripts to avoid overloading notation) becomes “how often an agent cooperates given that the other agent cooperates (defects)”. The proper estimate becomes:
, and
Note that Alice is now double counting the symmetric events and
. If the real proportion of cooperation in the population is
then in the limit of
the theory-of-mind estimates still converge to the rational
and
.
What if the agent employs quasi-magical thinking, i.e. know that their actions do not affect the decision of others but behave as if they do? If we follow Masel (2007) then quasi-magical thinking is equivalent to Alice updating her beliefs not only with the result of Bob’s action, but also her simulation of what she would have done. As an example, everytime she sees a or
event, she also counts as
event since she would have cooperated in that case. This gives us the estimates:
, and
As before, we look at the limit of with true proportion of cooperation $r$:
and
In other words, regardless of the true probability of cooperation, this quasi-magical thinking agent will believe that her partner is 50% more likely to cooperate with her if she cooperates.
I chose the subscript suggestively. In a more general treatment, Alice can choose by how much she weighs her simulated self-action against Bob’s real action. If we let
be a measure of self-absorption or the weight she attributes to herself and
to Bob then the estimates become:
, and
With the limit of large given by:
and
In words, an -self-absorbed quasi-magical thinking agent will believe her partner to be
more likely to cooperate with her if she cooperates regardless of the real proportion of cooperation
. If we consider a completely self-absrobed agent (
) then we recover Hofstadter’s superrationality: an agent so dogmatic that he assumes that every other agents will always arrive at the same exact conclusion as him for what behavior to pursue.
If Alice suffers from the quasi-magical delusions, but otherwise acts rationally on her beliefs then we can calculate how she will behave. Suppose that she is -self-absrobed, thinks that she is playing the cooperate-defect game
, and is out to maximize her expected utility. She will cooperate if:
A superrational agent will always cooperate. For other agents, cooperation will be risk dominant (equivalent to
) strategy when:
Note that by setting tag-mutation rate we recover the condition for cooperation in set structured populations. Can we think of set-structured populations in cognitive terms as a type of quasi-magical thinking? A group-think delusion or just a mathematical coincidence?
Masel, J. (2007). A Bayesian model of quasi-magical thinking can explain observed cooperation in the public good game Journal of Economic Behavior & Organization, 64 (2), 216-231 DOI: 10.1016/j.jebo.2005.07.003
Pingback: Evolving useful delusions to promote cooperation | Theory, Evolution, and Games Group
Pingback: Cooperation through useful delusions: quasi-magical thinking and subjective utility | Theory, Evolution, and Games Group
Pingback: Cataloging a year of blogging: from behavior to society and mind | Theory, Evolution, and Games Group
Pingback: Useful delusions, interface theory of perception, and religion. | Theory, Evolution, and Games Group
Pingback: Rationality, the Bayesian mind and its limits | Theory, Evolution, and Games Group