Showing posts with label game theory. Show all posts
Showing posts with label game theory. Show all posts

Tuesday, August 02, 2016

The electorate as negotiators

The invention of the democratic republic requires the development of the institution of the political party, which mediates between the ruling class and the voters. One way to mediate is by political philosophy or ideology, but that's not the only way; the point of political parties is to explore all the different ways of mediation, and find the ones that are successful. The process is complex: there are struggles within the ruling class (and sometimes struggles between classes for rule) and struggles within the electorate, and all the different forces are partially reconciled in the political parties.

The electorate can more-or-less "passively" accept its role: the political parties position themselves in relation to the ruling class and the electorate, and each person picks the option they like best or dislike the least. If we take this view of the role of the voters in a republic, then Hillary Clinton is the best choice for everyone who has not yet been completely screwed over by neoliberalism, and Donald Trump is the best choice for those who have been completely screwed over by neoliberalism: they're screwed anyway, and Trump might at least shake things up and create opportunities. (Trump is the best choice for racist assholes regardless of class, but that's a side issue.)

I don't like this view of the electorate, which shouldn't come as much of a shock. I have two alternative views. As a revolutionary communist, elections are just one of the many arenas of struggle to develop revolutionary momentum. Presently, revolutionary momentum is at best miniscule, and at worst backwards, so the upcoming election does not offer much to be gained or lost in this regard.

As a progressive reformer (and I can be both, why not?) I urge a somewhat more active role for the electorate. The voters are negotiating: they are actively trying to change the character and nature of the parties and the nominees. In order to negotiate, a participant absolutely must convince their opponent that they can walk away from the table. If the car salesman knows that I absolutely must have a car by the end of the day, I'm guaranteed to get screwed. She knows I can't walk away; she need only make sure it's not impossible for me to sign.

As negotiators, we absolutely cannot say that we must vote for Clinton because Trump. Instead, we must convince Clinton and the Democratic party that if we don't get enough of what we want, we will walk away from the table, Trump or no Trump. When we say Clinton because Trump, we are saying to the car salesman that we must have a car by the end of the day. We are begging Clinton to screw us over once she's president.

Of course, as negotiators, Clinton and the Democratic party, to serve their capitalist masters, must argue that we must vote for Clinton because Trump, to convince us that we must have a car by the end of the day, and thus concede as little as possible to the electorate. Hillary Clinton would love to go to Wall Street and say, "I delivered your agenda."

Scary, no? But that's how negotiation works. It's a pure strategy chicken game. And if you credibly promise to swerve, you will lose every time.

So I don't give a shit whether Jill Stein is or is not an anti-vaxxer. Jill Stein is not going to become president, and the Green party is not going to be a major player; if they were, I would actually participate in the party and remove the stupid from the platform.

The point is that I will vote (because not voting is dumb), but I'm going to credibly promise to not vote for Clinton if she doesn't promise to enact a progressive agenda, not just a less regressive agenda than Trump. And if Trump does become president because Clinton doesn't come through, well, presidents don't have absolute power, and there are ways to limit and resist Trump's power (cough Bill Clinton cough).

Progressives should want Wall Street to say support Clinton because Trump, that even though Clinton had to seriously compromise the neoliberal capitalist agenda, Trump would have been even worse.

So when you tell me to vote Clinton because Trump, or that I'm "wasting" my vote if I don't vote for either Clinton or Trump, you're telling me that you'll let Clinton promote whatever neoliberal horrors she chooses, because she knows your vote does not depend on her policies.

If we can't have a revolution, let's at least negotiate, not bend over.

Saturday, July 16, 2016

Burning down the house

Regardless of the appropriateness of the comment, there is a substantive dimension to Burt Likko's criticism of a Black Lives Matter speaker's call to "dismantle the system". The question obliquely posed in the post, and discussed at more length in the comments, is whether it is desirable to dismantle the system.

Likko does not give us the context of the speech, so we don't know the speaker's intended meaning. We don't know what system the speaker refers to, and what he means to dismantle it. The phrase might well just be a rhetorical flourish, without specific meaning. But, in keeping with tenor of Likko's post and the subsequent comments, let's take the phrase to mean a radical overthrow of the capitalist system in favor of some variant of socialism. Aislinn Pulley's article, The System That Killed Alton Sterling and Philando Castile Cannot Be Reformed seems to support this interpretation.

I am a communist, and Likko and the majority of commenters at Ordinary Times seem to be sane Republicans, so it's perhaps unsurprising that I favor "dismantling the system" and Likko and his commenters do not. But declaring our preferences, or conducting an abstract normative discussion, misses the main points.

Under what objective circumstances will people actually dismantle the capitalist system? As human beings embedded in the capitalist system that might be dismantled, and who will (if we survive) inherit what follows, how can we think about the question effectively, and, on due consideration, what can we actually do about the issue?

The first question is mostly descriptive, not normative. The capitalist system will be dismantled when and if dismantling the capitalist system is in the interest a sufficiently large number of people, they become aware of this interest, and they have the will to gain the power necessary to dismantle the system.

In this sense, choosing to dismantle or preserve is a pure (as opposed to mixed) chicken game. To simplify for the sake of analysis, we can assume there are two "players": the bourgeoisie and the proletariat (and their respective allies). Because they are the existing ruling class, we say that the bourgeoisie "moves first"; thus their dominant strategy is to preserve the system. The proletariat "moves second", and because the consequences of trying to dismantle the system are worse than preserving it, the proletariat also chooses to preserve.

The goal of the sensible revolutionary is not to try to convince the proletariat to dismantle capitalism anyway and make themselves worse off in the short run; this strategy will never work. Instead, the goal is to change the game so that by dismantling the system the proletariat is better off in the short run.

The goal of the sensible capitalist is to not only preserve capitalism, but to keep the game a chicken game. They must convince the proletariat that they would be worse off by dismantling the system than by preserving it, however much privilege the capitalist class exercises. They have two classes of strategy to do so: increase the reward to the proletariat to preserve the system, or increase the punishment for attempting to dismantle the system.

The best strategy for the revolutionary is to sap the will of the bourgeoisie to impose punishment. The Soviet Union fell precisely when the Soviet Communist Party lost the will to punish the people for dismantling Soviet communism. (As it turned out, quite a lot of people were actually worse off, but thems the breaks. As some wag put it, "Everything the communists told us about communism was a lie; unfortunately, everything they told us about capitalism was the truth.")

Another strategy for the revolutionary is provoke the bourgeoisie into reducing the reward for the proletariat to preserve the system, or goad them into punishing the proletariat even if they preserve the system. This is the strategy that ISIS is using: to provoke western governments into repressing Muslims so severely that they have nothing to lose by dismantling the system, presumably in favor of some sort of Islamic theocracy.

Provocation poses considerable risk: if the proletariat believes that actions of revolutionary justify the consequent punishment by the bourgeoisie, the proletariat believes they have more to lose by dismantling the system. Hence kidnappings, bombings, and other acts of "terrorism" are so counter-productive for a communist revolutionary as to be dismissed out of hand. State repression against this kind of "terrorism" will be seen by the proletariat as justified.

Instead, the provocations must be so obviously righteous per se that the bourgeoisie lose credibility by attempting to blame the revolutionaries. The "riots" in Ferguson show the value of this strategy: protesting the actual police murder of a citizen and the state repression of black communities in the area is so obviously righteous that when they violently suppressed theses protests, the bourgeois state lost a lot of credibility by blaming the violent suppression on the organizers and victims.

All of these theoretical and descriptive considerations aside, it is actual human beings who act in political conflict, and human beings act in no small part according to moral reasoning.

The key moral question is not whether capitalism is better than socialism. For some people, capitalism is better; for others socialism would be better.

The real moral questions, the questions that each individual must ask him- or herself, are these: What am I willing to do to preserve or dismantle the system? What am I willing to suborn, to tolerate, to rationalize? Are there tactics that even if I have good reason to believe would be effective I still would not use or tolerate?

These question are made more complex because we must also contemplate them in light of the answers my opponents would give. We can see that the bourgeoisie and their allies are willing to use and tolerate assassination, murder, rape, torture, mass incarceration, the mass slaughter of civilians in war, the systematic repression of black communities, etc. ad nauseam, and they use and tolerate these means under the mantle of their own authority and thus bear full moral responsibility.

These questions cannot be answered out loud; more precisely, no one should ever trust someone's public answer. I pose them only for my own and my readers' private reflection.

As a revolutionary, I must consider my own actions in light of these answers the bourgeoisie has made manifest.

It is of course possible and not unreasonable to support the capitalist system while opposing these acts, calling them evil (a label I definitely endorse). By all means, work against the evils while supporting the system. But I recommend a sense of urgency: the longer these evils persist, the more the exhortations to work within the system ring hollow and shrill.

Tuesday, July 01, 2014

Political economy, the Chicken Game, and hard work

The Chicken Game (a.k.a. hawk/dove or snowdrift) is a particular game theoretic payoff matrix:

Cooperate Defect
Cooperate (4,4) (5,2)
Defect(2,5) (1,1)

If player 1 chooses to cooperate, player 2 should defect, and vice versa. However, if player 1 chooses to defect, player 2 should cooperate, and vice versa. So there's no dominant strategy.

In the dialectic between capitalists and workers, for capitalists, "Cooperate" means paying high wages; "Defect" means paying low wages; similarly, for workers, "Cooperate" means working hard, "Defect" means slacking off. If both defect, if capitalists pay low wages and workers slack off, then the workers will starve (because they don't have enough money to buy food), and civilization will collapse. Contrawise, if both cooperate, there is a higher overall payoff (4+4=8) than if one cooperates and the other defects (5+2=7). However, because the individual payoff is better, there is an incentive for one player to defect if the other cooperates. In essence, whoever gets to defect "first" (or most credibly) will win; there's no incentive (as there is in the Prisoner's Dilemma) for one player to defect if the other has already defected.

Thus we can create the political economy payoff matrix:
Capital
LaborHigh Wages Low Wages
Work Hard Erehwon Capitalism
Slack OffSocialism Disaster

Let me be blunt: workers are no more altruistic than capitalists. If high wages are more or less guaranteed, workers will consume more leisure — leisure is a normal good, n'est pas? Economically, the effect of laissez faire capitalism is to make sure the workers consume as little leisure as possible. And, economically, the effect of socialism (the first stage of communism, the dictatorship of the proletariat, as distinct from welfare-state capitalism) is that workers will consume more leisure: they will, as compared to capitalism, slack off.

(It may be more socially efficient under capitalism to have workers work harder than is strictly economically efficient; we don't want the workers to get the idea that they deserve leisure. And it is arguable that many of the problems of Communism of the Parties (USSR/PRC) was caused by their attempt (probably necessary to resist the capitalist West's unapologetic desire to annihilate communism and commit genocide against the USSR and PRC) to "square the circle" and try to get both hard work and high wages.)

The project of socialists and communists, therefore, should not be to argue that socialism and communism will get us to some sort of utopia where and the workers get paid well and everyone works as hard as they do under capitalism. That's an economic contradiction. Instead, we should valorize leisure.

One theme of capitalism is to valorize hard work. Most of our common phrases for hard work — initiative, can-do spirit, commitment — are positive. Most of our common phrases for leisure — slacking, laziness, goofing off — are negative. They may be vices we indulge ourselves in, but they are vices nonetheless. But why should this be so? Why should hard work be good for its own sake? Some goals require hard work instrumentally (I work harder as a student than I ever did as a middle-class professional, for a third the pay) but why should goals that require hard work be considered better just because they require hard work? Why is the Dude a bum just because he works only enough to live and indulge his relatively inexpensive passion for bowling? (The Big Lebowski works only because it subverts the preexisting trope of hard work and wealth good/laziness and poverty bad; the film would make no sense under communism. In contrast, Downton Abbey is sterile and boring because it fails to subvert the trope.)

Valorization of anything is only partly a project to convince people to value it. Valorization is more importantly a social construct to justify the punishment and coercion of those who do not valorize it. If hard work is a value, then those who do not work hard are "vicious"* and deserve to suffer. (Similarly, sobriety is a virtue; those who are not sober deserve to suffer just because they are not sober.) Hence the major argument and justification for capitalism's tendency to keep wages low is that low wages promote the virtue of hard work. If the working class received higher wages, they would not work as hard (at least not for long), and would therefore descend into the vice and decadence of lazy, unproductive activity. The capitalists are just virtuously trying to save the working class from their own vice! How can we not give such a project our most enthusiastic applause? And how can we not condemn (true) socialism as inherently and ineluctably vicious?

*virtue : virtuous :: vice : vicious

I say fuck hard work.

Not only should hard work not be a virtue, it should be something of a vice. If you want to indulge yourself in the vice of hard work, well, you're an adult and can do as you please, but don't act like you're any more proud of your hard work than you are of any of your other vices. We want a society where it's good that people have a lot of leisure.

Monday, April 14, 2014

Finance and poker

I used to play poker. I don't much play anymore, mostly because I don't have any time or money, but also because people playing poker at casinos are no longer unskilled enough to for me to consistently make money.

Poker is a curious game. It is reasonably well-understood that in theory, "optimal" play in poker guarantees that (absent a rake) you will always break even in the long run, regardless of how well or poorly your opponent plays. Thus, to win at poker, you have to figure out how your opponent is playing non-optimally, and play in the corresponding non-optimal way that will give you positive odds. For example, many inexperienced players play too loosely and passively — they play too many hands that have negative odds, and they don't raise enough when they have positive odds. To take advantage of them, an experienced player will play tightly and aggressively, playing only hands with positive odds and almost always then raising.* Note that the "expert" is playing sub-optimally: "optimal" play requires playing marginally positive hands passively, and bluffing some hands with negative odds. But playing that way will simply break even in the long run, even against sub-optimal play. If the other players understand her tight-aggressive strategy, they will simply fold with mediocre hands whenever she raises.

*One fictional trope that I find amusingly unrealistic is the depiction of the "expert" player as one who can bluff his opponents into folding with better hands. In reality, the real expert will make a lot more money by convincing her opponents to call with worse hands; her bluffs are calculated to fail, to convince opponents to call more. Hence, she will usually show her opponents her (infrequent) successful bluffs and hide her winning hands (and hint they were bluffs).

Another thing that happens all too often in reality is experienced players getting upset with new players for playing poorly. Stupid! You want to
encourage poor play and take advantage of it. Poker is not a game of skill in calculating odds; it is a game of psychological observation and manipulation. If you can't manipulate a newbie, you are not even an intermediate player, much less an expert.

There is one situation in poker when playing correctly has positive odds: when you are no-limit heads-up (you can bet any amount you want, up to your total, and you playing against one opponent), and you have at least double the amount of money he has. Then you just go more or less all in on every hand*, counting on the fact that your opponent has to beat you twice, whereas you have to beat him only once. If the blind (forced opening bet) is large, and it is usually very large near the end of a tournament when the last two players are fighting for first place, your opponent can't wait for a good hand to call you.

*IIRC, the exactly correct strategy is to bet so that if you do lose, you equalize your and your opponent's stacks after the next blind.

If you go to a poker tournament, and you play the optimal strategy, you will lose the tournament. On average, you will neither win nor lose, but there will be a player who figures out the sub-optimal play of other players and takes advantage of them (or who plays sub-optimally, with fatter tails*, and gets lucky), and then beats you by brute force at the end.

*i.e. hey have a higher probability of either going broke quickly or getting rich quickly, with a lower probability of breaking even.

Finance is the same way. The "optimal" strategy is to create a portfolio such that no matter what happens in the economy, your investment earns, in the long run, the same rate as general economic growth (1-4% per year). You'll never* lose with this strategy, but neither can you win: you will never* become relatively wealthier than someone who plays a sub-optimal strategy and either outsmarts other investors, or who just gets lucky. And when any other player gets substantially more than you, he can beat you down by brute force simply by being irrational longer than you can stay solvent.

*Well, rarely; even an optimal strategy has a little room on the tails.

One charming bit of naivete I see in economists is the idea that economics is fundamentally about the optimal allocation of resources to maximize social production. In some abstract theoretical universe this might be true, but in reality, economics is about power; it is about winning. Hence, people, especially people with a lot of money, are not trying to not lose, they are trying to win. They are trying to defeat their opponents. Hence, they cannot play conservatively, i.e. not to lose; even if their strategy is just naively sub-optimal, there are enough other people that some of them will get lucky and win big. The "conservative" strategy cannot (rarely) win big; the whole point is to balance big losers against big winners, and small losers against small winners. This asymmetry becomes even more pronounced in finance, because the big winners get to actually change the rules. Most notably, the rich socialize their own losses and privatize their gains. This tendency causes the financial market to crash (since the rich have no downside risk, they can make bets with negative long-term odds but the potential for short-term gains). Everyone, even the "conservative" investor, loses everything (or at least all his gains), and then state makes up the losses of the rich. ("Sure got a nice economy there. Be a shame if it were to burn down.")

The typical capitalist apologetic for this system is that it promotes innovation. The apologetic is half right. Unlike poker, real life has not only risk, but uncertainty. We have to make wildly speculative bets to create fundamentally new things. Everyone laughs at Pets.com, but whoda thunk that a search engine and a discount bookstore would be the primary drivers of internet technology, productivity, and economic growth? The probability of any individual speculation paying off is so low, according to the apologetics, that the payoff must be correspondingly large, and that we cannot punish failure by economic "death." Otherwise, no one would ever take speculative bets, and we would have no (or very little) innovation.

However, there are two flaws in the capitalist apologia. First, the reward for winning speculative bets is not increased consumption (Bill and Melinda Gates and their family could not and have no intention of actually themselves consuming $50 billion of goods and services), but political power: the power to tell people (i.e. the workers) what to do and not to do.* There is no need to reward successful innovators with political power; there are plenty of alternatives, such as social status.

*It you think that power is actually held by our elected representatives in the official government, you are hopelessly naive.

Either people "naturally" (i.e. without special, artificially constructed incentives) want to be innovative, or they do not. (More generally, they might or might not want the fruits of innovation more than they dislike the process of innovation.) If we do not naturally want to be innovative, why should we as a society encourage such behavior? If we naturally do want to be innovative, then instead of creating powerful positive incentives, it is sufficient to only remove negative incentives: do not punish people for trying to innovate and failing.

(The other apologia for capitalism is that most people are stupid, lazy, and irrational; they must be ruled for their own good. "Democracy" is at worst a sham and at best just a check on the most egregious corruption of the elite. As a democrat, I reject this premise, for what I think are good reasons.)

That's why I am coming to believe that finance should be entirely public, run by the government. The government can afford to play conservatively, i.e. to play to not lose. Most of our economy, the economy of food, clothes, houses, electricity, water, cars, gasoline, etc., is a game we want to play to not lose. For the rest, encourage small-scale innovation by removing the negative incentive of losing a year's pay trying to innovate: give everyone a free year to try something innovative (a person would have to prove only that she is not going to sit around for a year watching TV); if they're successful, give them some publicity and another year or two to continue being innovative. If they're unsuccessful, they've lost nothing. For the "big bets," innovations that are beyond the scope of the individual or small group, we should vote; why should a private person individually decide how to innovate with the labor of thousands or millions?

Such a society might not be as innovative as full-throttle innovate-or-die capitalism, but I think it will still have substantial innovation and would definitely be a happier society for everyone.

Monday, May 20, 2013

Cheating is... good!?

Why I Let My Students Cheat On Their Game Theory Exam:
On test day for my Behavioral Ecology class at UCLA, I walked into the classroom bearing an impossibly difficult exam. Rather than being neatly arranged in alternate rows with pen or pencil in hand, my students sat in one tight group, with notes and books and laptops open and available. They were poised to share each other’s thoughts and to copy the best answers. As I distributed the tests, the students began to talk and write. All of this would normally be called cheating. But it was completely OK by me.

Sunday, February 03, 2013

Choices

In "A World Of Choice," chapter 1 of No One Makes You Shop at Wal-Mart (via Brad DeLong), Tom Slee shows that the simple aggregation of individual choices can lead to socially undesirable outcomes: outcomes that the individuals exercising their choices themselves see as undesirable. How can this be? The answer is, fundamentally, externalities: everyone's choices affect everyone else's outcomes. Alice's choices affect Bob and Carol's outcomes and choices, Bob's choices affect Alice and Carol, and Carol's affect Alice and Bob. The simplest model of the tension between individual and collective choices is the Prisoner's Dilemma, but Slee shows that much more complicated games can exhibit the same tension. (Yoram Bauman also has a good example using pollution as an externality.) What's important about the Prisoner's Dilemma and Slee's example is that the externalities in both are intrinsic parts of the game. Either we must have true collective decision-making, or we must accept the apparently undesirable outcomes of purely individual decision-making as a consequence of the principle.

Collectivism, i.e. collective decision-making, means that a social group makes a single decision as a whole. The advantage of collectivism is that externalities, both physical externalities such as pollution and game-theoretic externalities like those from the Prisoner's Dilemma, can be included and addressed in the collective decision. The disadvantage of collectivism is that the social decisions are never consensual. Some people will always dissent from the collective decision. In Slee's case (go read it, it's not that long, and I'm too lazy to summarize), some people will not find the variety of the downtown department stores or the experience of walking downtown to be desirable; they are happier overall with only Wal-Mart than they were with only the two downtown department stores. Collectivism is also subject to institutional capture, where some minority gains a disproportionate influence over the collective decision-making process. The analysis of individualism and collectivism is non-trivial.

As noted above, even in a majoritarian system, the long-run collective benefit of the majority will almost always operate to the detriment of some minority. On the one hand, this oppression of the minority is not always bad: clearly, the collective decision to prohibit murder and rape oppresses the interests of killers and and rapists, and most people are fine with that outcome. To simply assert the absolute categorical injustice of the majority imposing its will on a minority contradicts our intuitions and expectations about justice. On the other hand, absolute majoritarianism contradicts strong intuitions and expectations about the value individualism and even eccentricity. There's some wiggle room there: we can have a majoritarian approval of a general principle that leads to specific outcomes that the majority would disapprove of. For example, the majority approves of the general principle of free speech even if the majority would disapprove of some specific outcomes, such as blatantly racist speech. Still, we cannot wholly escape the tension between the benefit of the majority and the benefit of the minority and individual.

Institutional capture is another problem with collectivism. A collective decision must be enforced with actual and threatened violence, and those within the institutions of enforcement can more easily gain influence over the decision-making process itself. Because enforcement is always directed to the specific, to charge the majority themselves with direct enforcement blurs or erases the distinction between the general and the specific necessary to protect the minority and individual. The problem of institutional capture underlies, I think, the main thrust of anarchism: the value of collective decision-making is outweighed by the tendency of the "state," i.e. the set of cooperating institutions with a monopoly on the legitimate use of violence, to capture the decision-making process for the disproportionate or exclusive benefit of the members of those institutions. Like the tension between the majority and minority, we cannot avoid tension between the institutional and majoritarian.

Both anarchism, left and right, as well as intentional institutionalization of a minority in the collective decision-making process are untenable. Even stripped of their vagueness, hypocrisy, and internal contradictions, left- and right-anarchism are impossible simply because people spontaneously institutionalize the use of violence; the "state" did not drop down from outer space to oppress humanity. Minority institutionalization, whether of the minority capitalist ruling class of large property owners or of a bureaucratic and intellectual elite such as a Communist Party is certainly possible, but it is inevitable that those individuals who form the elite will make decisions that, at first disproportionally and later exclusively, benefit only themselves. There is no simple, easy way to cut the Gordian knot of politics.

Friday, October 07, 2011

Communitarianism and sacrifice

One definition of communitarianism is that the individual should in some sense sacrifice her individual good for the good of society. Thus, in opposition, individualism entails that the individual should not sacrifice her individual good for the good of society. If, for example, society needs more shoes, the communitarian would say that an individual should not pursue the occupation she prefers, but should make shoes; the individualist says that the individual should do what she prefers, and if society is left without enough shoes, too bad for society. It's more complicated than that, of course: if society wants more shoes, it can somehow raise the level of compensation so that the individual, because of that compensation, wants to make shoes. The difference is who must "give way" to the other: communitarianism says that the individual must "give way" to society; individualism says that society must "give way" to the individual.

There are two problems with this definition. First, there is no such actual, concrete thing as "society". Society is just a label we give to some abstract sense of the preferences, desires and opinions of a group of individuals. It's a useful abstraction, but both communitarianism and individualism according to the definitions above really can't avoid the fallacy of reification. More importantly, the word "sacrifice" is both ill-defined and its negative connotation subtly biases the discussion.

In one sense, sacrifice just means giving something up. In this sense, all mutually exclusive choices entail sacrifice. If I choose vanilla ice cream, I must sacrifice the chocolate; if I choose chocolate, I must sacrifice vanilla. Sacrifice in this sense is trivially unavoidable: until we can live forever and have everything we want, everyone must constantly make sacrifices.

Ayn Rand offers a better definition of sacrifice: A Randian sacrifice is giving up a greater value for a lesser value*. If I choose vanilla over chocolate because I prefer vanilla, I am giving up a lesser value for a greater, and thus not making a Randian sacrifice. Rand has an objective definition of value, so in her account someone can be fooled into making a Randian sacrifice; in a subjectivist account of value, a Randian sacrifice must be physically coerced**. But Rand's definition introduces a subtle paradox.

*I could cite this, but I'm lazy, and I don't think that Rand defines sacrifice this way is controversial.
**The proof of this statement (and the enthymeme necessary to make a Randian sacrifice logically possible) is left as an exercise for the reader.

Rather than look at the tension between the individual and "society", I think it's more illuminating to look at tensions between individuals; in this sense "society" becomes the collection of agreements (which become institutionalized in real societies) that individuals make. The Prisoner's Dilemma* illuminates the paradox.

*Chicken games are, I suspect, more common in practice, but the Prisoner's Dilemma illustrates the paradox more clearly, and I suspect that Chicken games can be reduced to win-win games.

Ex hypothesi, each individual values the choice to defect more than the choice to cooperate. Regardless of what the other agent chooses, each agent finds it better to defect than to cooperate. In a strict, "local" sense, the choice to cooperate entails a Randian sacrifice: mutual cooperation requires that both agents choose to abandon the greater value of defection for the lesser value of cooperation. And yet mutual cooperation is preferable to mutual defection: By mutually defecting, both agents are making a Randian sacrifice of the greater value of mutual cooperation for the lesser value of mutual defection. Where there is an apparent paradox, we are not thinking clearly.

We don't necessarily want to resolve all Prisoner's Dilemma games in favor of mutual cooperation*, but sometimes we do want to resolve them. The essence, then, of political philosophy is whether to resolve Prisoner's Dilemma games in favor of mutual cooperation, and if so, which ones to resolve and how to resolve them.

*as Yoram Bauman points out in The Cartoon Introduction to Economics, mutual defection in price competition, for example, can have positive social benefits.

Which brings us back around to pragmatism vs. moralism. The pragmatist looks at a Prisoner's Dilemma game, and after resolving all the games-within-games, decides that as best he can tell, mutual cooperation is better than mutual defection because the outcome is better. The problem then becomes to determine what social structures and institutions are necessary to achieve mutual cooperation.

There are two kinds of "moralists". The "individualist" moralist says that the local sacrifice is inherently immoral, regardless of the benefits of mutual cooperation. Better mutual defection than the sacrifice necessary for mutual cooperation. The "collectivist" moralist says that because mutual cooperation is better than mutual defection, cooperation is better than defection, regardless of what the other agent does. This philosophy just leads to victimization. (And it is, I think, this sort of asymmetric cooperation that dominates Rand's thinking and lends real weight to her critique.) Amazingly enough, those who most heavily promote the intrinsic moral value of cooperation seem to end up "forced" into defecting themselves.

Because of the fallacy of reification, naive definitions of individualism and collectivism lose coherence. Because there is no such real thing as "society", the question of whether the individual should or should not sacrifice his interests to those of society doesn't make sense. What makes sense is when individuals should sacrifice their interests to those of other individuals, and the fundamental distinction is between pragmatism and moralism. Pragmatism says that individuals should give up their local interests to others when their global, mutual interests outweigh the local losses, i.e. make a Randian sacrifice in the local sense to avoid a Randian sacrifice in a global sense. Moralism says that regardless of the mutual benefit, the structures necessary to ensure that outcome are never justified.

Monday, May 09, 2011

The dishonest minority

Bruce Schneier is writing a book (which I will buy as soon as its available):
All complex systems contain parasites. In any system of cooperative behavior, an uncooperative strategy will be effective -- and the system will tolerate the uncooperatives -- as long as they're not too numerous or too effective. Thus, as a species evolves cooperative behavior, it also evolves a dishonest minority that takes advantage of the honest majority. If individuals within a species have the ability to switch strategies, the dishonest minority will never be reduced to zero. As a result, the species simultaneously evolves two things: 1) security systems to protect itself from this dishonest minority, and 2) deception systems to successfully be parasitic.

Humans evolved along this path. ...

The term "dishonest minority" is not a moral judgment; it simply describes the minority who does not follow [some?] societal norm[s]. Since many societal norms are in fact immoral, sometimes the dishonest minority serves as a catalyst for social change. Societies without a reservoir of people who don't follow the rules lack an important mechanism for societal evolution. Vibrant societies need a dishonest minority; if society makes its dishonest minority too small, it stifles dissent as well as common crime.
I am a strong proponent of applying systems theory, meta-systems theory and evolution to politics and economics. I very much admire Schneier, an expert in security of every sort.

Tuesday, October 26, 2010

Game theoretic paradoxes

Arrow's Impossibility Theorem
Liberal Paradox

Intuitively, I don't find these two paradoxes especially surprising: we know from the Prisoner's Dilemma that local game-theoretic decision procedures don't necessarily lead to global Pareto optimality. Which is to say, I suspect, any social system must employ higher-level, abstract elements such as constitutions, contracts, and "altruism" or friendliness (where individuals' preferences substantially and directly positively value other individuals' well-being). Furthermore, since there are no deterministic solutions at any level, these abstract elements must evolve rather than being imposed analytically.

Saturday, July 10, 2010

Kantian moral sense and social evolution

A social "game" such as driving is a Prisoner's Dilemma game: If everyone drives safely, everyone is better off, but if everyone else is driving safely then there is an additional benefit to driving dangerously (and the costs of driving dangerously are externalized to the other drivers). Even if they prefer to drive safely, and even if they drive safely because that's supposedly the "right thing to do" in a Kantian sense, the negative consequences of driving safely while others are driving dangerously with no immediate consequences tend to select against safe driving.

Adding surveillance and enforcement (traffic tickets, governors on cars) changes the driving game to a win-win game: even those who would prefer to drive dangerously drive safely to avoid the immediate negative consequences, which should outweigh the positive benefits (e.g. getting to one's destination more quickly).

On the one hand, adding surveillance and enforcement would seem to undermine developing a Kantian moral sense, i.e. driving safely because it's the "right thing to do" rather than because it's beneficial, or driving safely because one directly prefers the mutual benefit to an exploitative benefit. Once we implement surveillance and enforcement, we cannot determine if any individual is driving safely for the "right" reasons (duty or mutual benefit) or the "wrong" reasons (avoidance of immediate consequences). In one sense, we simply don't care why anyone is driving safely; we'd rather have people driving safely for the "wrong" reasons than not driving safely at all. But in another sense, a surveillance and enforcement mechanism tends to develop a Kantian moral sense by selection.

Assume that one's preferences about driving exhibit heritable variation. Therefore, there will be three "memes" present in the population with some distribution:
  1. Directly prefers to drive safely (Kantian good)
  2. Directly prefers to drive unsafely, but indirectly prefers to drive safely because of enforcement (selfish good)
  3. Directly prefers to and actually does drive unsafely (bad)

It should be clear that variation in these memes is step-wise: It takes one "variation" to move from 1 to 2, 2 to 3 (or the reverse direction); it takes two "variations" to move from 1 to 3 or 3 to 1.

Without enforcement, there is of course no case 2, and thus there is no direct selection pressure against preferring to drive dangerously. Furthermore, since there is no direct selection pressure against driving dangerously, there will be selection pressure against driving safely: if there are enough people driving dangerously, driving safely just slows you down without reducing the risk of accident or injury. (Driving dangerously externalizes the risk of accident to all the drivers, not just oneself; accident or injury thus does not differentially select against driving dangerously.) Since there's a differential selection pressure against safe driving, we could expect that without enforcement almost everyone will drive dangerously. Anyone who'd driven in a country without strict traffic enforcement will immediately empirically confirm this prediction.

Adding enforcement, then, creates an immediate selection pressure against actually driving dangerously (assuming that traffic tickets exert a mimetic selection pressure), and one must of course first prefer to drive dangerously to actually drive dangerously. Therefore, the meme for preferring to and actually driving dangerously will be selected against.

Directly preferring to but not actually driving dangerously will not, of course, be selected against. However, this meme will vary in two directions: directly preferring to drive safely, and preferring to and actually driving dangerously. Assuming that variation is uniform (the probabilities of each meme varying to either adjacent meme is the same), then we will end up with an equal number of Kantian and selfish good drivers, with a smaller number of bad drivers.

If the variation is even a little bit non-uniform (i.e. selfish good drivers are more likely to become Kantian good drivers than bad drivers, and Kantian good drivers are less likely to become selfish good drivers) then the prevalence of Kantian good drivers becomes proportionally higher. We can expect non-uniform variation, because internal rational consideration itself acts as a selection mechanism.

In a non-Prisoner's Dilemma type game, however, selection pressures do not act so obviously.

In win-win games (where there's no tension between mutual and selfish benefit) we cannot distinguish between a Kantian and selfish moral good; everyone will do the right thing, and we can't determine if they do so because it's because "the right thing to do" or because it's in their immediate "selfish" benefit. In lose-lose games, a preference for mutual benefit does not apply, and it's difficult to make the case that everyone always losing should ever be a Kantian moral duty.

(Consider, for example, a proposed Kantian moral duty to express one's sexuality only by heterosexual intercourse. The detriment to some homosexual person who suppresses his natural sexuality to conform to this Kantian ideal seems obvious, and not only is there no benefit to me — I don't care how or with whom some stranger has sex — but because I value other people's happiness, this ideal poses a loss to me. The game is lose-lose; the opposite game — have safe, sane and consensual sex in any manner and with anyone you desire — is win-win. One reason I dislike Kantian ethics (even though it can be "fixed up" by reinterpreting a Kantian moral duty as preferring a mutual benefit over an unstable exploitative benefit) is precisely that the discourse of the "right thing to do" independent of any benefit lends some credence to the establishment of lose-lose games as Kantian duties. Indeed if the "right thing to do" really were independent of any sense of benefit, then there must be at least one moral duty beneficial to no one.)

Where we get into some complexity in a evolution/selection analysis is where — as in academic ethics, or professional football — we have a more abstract game which decides between two different zero-sum games. In this case, we must not just select against those who play the "wrong" game, but also not select as strongly against those who play the "right" zero-sum game and lose. Or, better yet, transform the game into one of mutual benefit, or create a more abstract game where the mutual benefits outweigh the losses from the less abstract game.

Surveillance and moral development

Bruce Schneier directs us to Emrys Westacott's Philosophy Now article: Does Surveillance Make Us Morally Better?. Westacott's article displays the usual confusion and problems with a Kantian approach to morality.

Westacott describes his interpretation of Kantian morality:
According to Kant, our actions are right when they conform to the moral rules dictated to us by our reason, and they have moral worth insofar as they are motivated by respect for that moral law. In other words, my actions have moral worth if I do what is right because I want to do the right thing. If I don’t steal someone’s iPod (just another kind of Apple, really) because I think it would be wrong to do so, then I get a moral pat on the back and am entitled to polish my halo. If I don’t steal the iPod because I’m afraid of getting caught, then I may be doing the right thing, and I may be applauded for being prudent, but I shouldn’t be given any moral credit.
On this account, becoming morally better does not entail learning to do the right thing (whatever that might happen to be) but learning to have the correct motivation for doing the right thing.

Westacott gives us two scenarios to compare and contrast the value of surveillance. First, he presents an elaborate scenario escalating surveillance of driving habits, ending with practically indefeasible surveillance and enforcement of traffic laws. He finds the outcome amenable,
At the end of the process, there are no more tearaways or drunk drivers endangering innocent road users. Driving is more relaxing. There are fewer accidents, less pain, less grief, less guilt, reduced demands on the health care system, lower insurance premiums, fewer days lost at work, a surging stock market, [not to mention whiter teeth and relief from the heartbreak of psoriasis] and so on.

Westacott, however, worries that while "increased surveillance may carry certain utilitarian benefits, but the price we pay is a diminution of our moral character. ... [S]urveillance... stunts our growth as moral individuals." "We give up pursuing the holy grail of Kant’s ideal, and settle for a functional but uninspiring pewter mug." He realizes, however, that these worries are, at least in this case, probably misguided: The "inconceivability of most kinds of wrongdoing is a platform we want to be able to take for granted, and surveillance is a legitimate and effective means of building it. So, far from undermining the saintly ideal, surveillance offers a fast track to it."

Westacott wants to dig deeper, though, and presents an alternative scenario where the pragmatic outcome is not so clear, comparing two colleges with different responses to academic cheating:
For instance, imagine you are visiting two colleges. At Scrutiny College, the guide proudly points out that each examination room is equipped with several cameras, all linked to a central monitoring station. Electronic jammers can be activated to prevent examinees from using cell phones or Blackberries. The IT department writes its own cutting-edge plagiarism-detection software. And there is zero tolerance for academic dishonesty: one strike and you’re out on your ear. As a result, says the guide, there is less cheating at Scrutiny than on any other campus in the country. Students quickly see that cheating is a mug’s game, and after a while no-one even considers it.

By contrast, Probity College operates on a straightforward honour system. Students sign an integrity pledge at the beginning of each academic year. At Probity, professors commonly assign take-home exams, and leave rooms full of test takers unproctored. Nor does anyone bother with plagiarism-detecting software such as Turnitin.com. The default assumption is that students can be trusted not to cheat.

Which college would you prefer to attend? Which would you recommend to your own kids?
Presumably, Westacott believes we would endorse Probity College. He offers two additional scenarios — surveillance at work and surveillance of one's children — which make the same point: we intuitively believe that there are situations where that inculcating the right "moral" attitude is much more important than actually enforcing the correct behavior.

As long-time readers will know, I've discussed some deep problems with this Kantian account of morality.

In what sense is the right thing to do different from the beneficial (at least in some sense of "beneficial") thing to do? If these two accounts really were different, then there must be something that is right without being beneficial in any sense, an attitude I flatly reject on humanist grounds: the humanist good by definition is what is in some sense beneficial to human beings. If the right thing to do is equivalent to some sense of benefit, then how can we determine whether anyone us acting because it's the right thing to do rather than because of the benefit? And even if someone were to do the do the right thing because it's the right thing to do, there must be some subjective benefit: they are satisfying their desire to do the right thing because it is right.

Of course, a bit of charity can fix some problems in the Kantian view. Specifically, one could interpret the view as deprecating certain kinds of benefits, such as short-term, individualistic benefits and the avoidance of negative consequences, while promoting other kinds of benefits, such as long-term mutual benefit and the emotional benefit of adherence to duty. Neither Kant nor his interpreters are completely stupid (Kant himself made an important contribution to scientific cosmology). The problem is that it's just as much work constructing an exegesis that makes Kant accurate as it would be to construct a more accurate moral philosophy (while still acknowledging Kant's contributions as important groundwork).

Westacott commits an intellectual sin all too common in philosophy: he presents a dichotomy without giving us much of a framework for resolving that dichotomy. Indeed he draws only the conclusion that "not just that Kant may have a point, but that most of us implicitly recognize this point." But why does academic surveillance intuitively retard our moral development, while traffic surveillance not only fail to retard our "moral development" but actually promote it? As Hamlet noted,
Assume a virtue, if you have it not.
That monster, custom, who all sense doth eat,
Of habits devil, is angel yet in this,
That to the use of actions fair and good
He likewise gets a frock or livery,
That aptly is put on. Refrain to-night,
And that shall lend a kind of easiness
To the next abstinence: the next more easy;
For use almost can change the stamp of nature,
And either curb the devil, or throw him out
With wondrous potency.
Why should it be good to assume the virtue of safe driving while bad to assume the virtue of academic probity?

One approach is (unsurprisingly) game theory. Safe/Dangerous driving is a true Prisoner's Dilemma/Snowdrift/Chicken game. If everyone drives safely, then everyone is better off: we have laminar traffic flow and a low risk of death or injury from accidents. If everyone drives dangerously, everyone is worse off: we have turbulent traffic flow and a relatively higher risk of death and injury. If everyone else is driving dangerously, there's little benefit to driving safely: other drivers' habits still make traffic turbulent, and one is typically at risk from other drivers' behavior than one's own. (One may furthermore even suffer a net loss: time is valuable, and driving safely in a dangerous environment can slow one down considerably.) If everyone else is driving safely, there's an individual benefit to driving dangerously: one can exploit the overall laminar traffic flow to one's own time benefit. Since other drivers' behavior determines risk, the additional risk is mostly externalized to others.

Furthermore, the benefits of everyone driving safely are clear and nearly universal. Even those who would prefer to drive dangerously while everyone else drives safely know that they are better off driving safely than they would be if everyone drove dangerously.

Kant does indeed have at least the beginning of a point: I would approve more of a person who drives safely because they value the mutual benefit of a safe and efficient traffic system than I do of a person who doesn't care about the mutual benefit and merely drives safely to avoid the penalties of enforcement. On the other hand, I have the pragmatic problem of trusting other people to actually drive safely, and convincing them to trust me to drive safely. I'd like to know that people are virtuous, but I can't expect them to be suckers; I can't expect them to allow their feelings of virtue to make them targets of exploitation. I can't trust someone who claims, however strenuously, only that they do indeed have a Kantian motive — a person who does not have a Kantian motive would certainly lie about having one. Paradoxically, I can effectively persuade people that I have a Kantian motive by supporting a non-Kantian enforcement mechanism: only someone with a Kantian motive has nothing to lose by enforcement, and I'm happy if someone without a Kantian motive "insincerely" supports enforcement. Contrawise, if there is no enforcement, I won't drive safely even if I do have a Kantian motive — at least in the sense of valuing the mutual benefit — because the mutual benefit will not occur just because I personally drive safely.

Compare and contrast the driving scenario with the academic ethics scenario. From the perspective of the individual students, academic ethics is not a Prisoner's Dilemma/Snowdrift game, it is a zero-sum game. Some students will get A's at the expense of those who get B's, at the expense of those who get C's, D's and F's. Those who who get lower grades will have a lower economic, academic and social reward, and those who actually fail will incur sometimes enormous economic expense (pass or fail, tuition is non refunded and one still has to pay back one's student loans). All cheating does is change the distribution of the benefits and expenses, not their overall magnitude. Of course there are larger social benefits to having an honest academia, but these social benefits are cold comfort to a failed student repaying twenty thousand of dollars in student loans with a low-wage, low-status job.

Furthermore, I would speculate that cheating or the desire to cheat is more prevalent at the lower end of the spectrum of academic performance. People who would otherwise fail are tempted to cheat their way to a C; those who would normally get A's and B's would seem less interested in cheating. A and B students seem inclined to go into professions where actual competence matters. A C student who cheats his way to an A would be quickly found out when his competence fails; he is better off in a selfish, non-Kantian sense with an honest C than a dishonest A. Similarly, even if someone who could honestly earn a B cheats his way to an A, he might still fail to develop even B-level competence; his dishonest A will be worse than his honest B. If there's rampant cheating among the D and F students, only the honest C students have a perverse incentive to cheat to get the C they honestly deserve.

The difference between C students and D/F students (and those who don't go to college) is primarily an arbitrary status difference: graduates had the financial and social wherewithal to actually pay for college and spend four years not working. The actual competence gained by just passing — primarily self-discipline and basic literacy — can be more easily and more inexpensively gained and demonstrated in other ways. Likewise, the difference between A and B students is primarily a status difference: both — if honest — are adequately competent, and I doubt (but I might be mistaken) that there is little empirical distinction between the post-academic performance of A and B students.

If the distinction is primarily arbitrary status, not actual competence, then there is little immediate reason to prefer those who gain status by one means or another; being a high status graduate through cheating is just as good (in an immediate sense) as being a "honestly" high status graduate; since status is not correlated with competence, we could just as easily use height or hair color. Insofar as immediate competence matters, academic honesty is self-enforcing (or has external enforcement); we do not need to appeal to a Kantian moral sense just as we do not need to appeal to a Kantian moral sense to not drop bowling balls on our feet.

It's notable that individual performance-simulating cheating in the private workplace is nearly non-existent; "cheating" there is mostly using work time for non-work-related activities. In the workplace, performance is directly measurable; if the job gets done, it's done, and employers are typically unconcerned with how it got done. If you have a task that has already been done elsewhere, it is perfectly acceptable to simply pay for and import the fully-complete task in toto. Likewise, collaboration — usually a big "no-no" in academia — is actively encouraged in the workplace: the point is not to measure the individual's performance, but to get the job done.

Westacott presents honor codes as somehow more Kantian, but this position is suspect. Honor codes do entail some surveillance, and entail consequences if cheating is somehow discovered. Indeed, honor codes simply move some of the surveillance to the student body itself, and rely on the superior students immediate self-interest in reporting cheating: an A student has nothing to gain by even tolerating others' cheating, much less assisting it. We can no more determine under an honor code than strict surveillance whether the motivation for compliance is due to to a Kantian moral sense or avoidance of the immediate consequences of cheating. We're inculcating a Kantian moral sense — in the sense of doing something by sheer duty — by making the student body responsible not for compliance but implementation.

As I mentioned earlier, there are larger social considerations to inculcating a sense of honesty in not only college students, but also the general population. But simply expecting a Kantian moral sense — in either the sense of preferring mutual benefit or acting from a sense of duty — without taking any direct, immediate steps to physically inculcate that sense seems to rely on magical thinking; when effective, a Kantian moral sense always relies on some method, which might be covert, of direct enforcement.

There's another dimension to the issue specifically of surveillance and enforcement that Westacott's additional examples put in a sharper light.
Or compare two workplaces. At Scrutiny Inc., all computer activity is monitored, with regular random audits to detect and discourage any inappropriate use of company time and equipment, such as playing games, emailing friends, listening to music, or visiting internet sites that cause blood to flow rapidly from the brain to other parts of the body. At Probity Inc., on the other hand, employees are simply trusted to get their work done. Scrutiny Inc. claims to have the lowest rate of time-theft and the highest productivity of any company in its field. But where would you choose to work?

One last example. In the age of cell phones and GPS technology, it is possible for a parent to monitor their child’s whereabouts at all times. They have cogent reasons for doing so. It slightly reduces certain kinds of risk to the teenager, and significantly reduces parental anxiety. It doesn’t scar the youngster’s psyche – after all, they were probably first placed under electronic surveillance in their crib when they were five days old! Most pertinently, it keeps them on the straight and narrow. If they go somewhere other than where they’ve said they’ll go, or if they lie afterwards about where they’ve been, they’ll be found out, and suffer the penalties – like, their cell phone plan will be downgraded from platinum to regular (assuming they have real hard-ass parents). But how many parents really think that this sort of surveillance of their teenage kids is a good idea?
The overriding issue here has nothing whatsoever to do with inculcating any sort of Kantian moral sense. The issue, rather, is whether or not employers and parents can be trusted to use surveillance and enforcement only for a mutual benefit including their employees and children. Neither employees nor children are the slaves of their employers or parents, and excessive surveillance compromises their primary benefits of autonomy and privacy.

It is not at all clear too whether strict surveillance in the workplace — despite claims to the contrary — actually improves actual productivity, which is difficult to measure directly; I know from direct experience that strict workplace surveillance is often used to reinforce status distinctions and social dominance relations between management and workers; workplaces with strict social hierarchies are not necessarily more productive than those with a more collaborative and equalitarian atmosphere.

Rather than objecting to surveillance because it fails to develop or hinders development of a Kantian moral sense, we object to surveillance in these examples because it's just bad in itself.

We can draw the larger conclusion that when strict surveillance and enforcement of some behavior appears intuitively objectionable, we have not fully understood the game in which the surveillance and enforcement is taking place.

In the case of traffic enforcement, driving safely itself has clear and unambiguous instrumental utility, and the surveillance and enforcement acts predominantly to create a mutually beneficial outcome that would be impossible or unstable without the surveillance and enforcement. The surveillance and enforcement do not act to inculcate a Kantian moral sense, they act rather to protect those who (somehow) develop a Kantian moral sense — in the sense of directly preferring a mutual benefit to exploiting others — and ensure they are not exploited or made suckers.

In the case of academic honesty, among the students there is not a Prisoner's Dilemma situation: academic honesty enforces one particular zero-sum game over another, and the larger social benefit of the "honesty" game does not (under present circumstances) outweigh the direct negative consequences for those students who lose that game. Surveillance and enforcement do not protect those who develop any sort of Kantian moral sense, since honest failures suffer negative consequences just as severe as detected cheaters.

Once we understand what social "game" is being played and how it is being played, we can construct systems of surveillance and enforcement that use immediate self-interest to select against truly undesired outcomes; where the desired outcome is of mutual benefit to all parties, a Kantian moral sense will develop automatically. Where a Kantian moral sense does not develop automatically, there is not Kantian moral sense to develop — no mutual benefit — or the game has been set up or played irrationally or for covert purposes.

Friday, April 09, 2010

The economics of dueling

The economics of dueling [pdf]:
Recent historical research indicates that ritualistic dueling had a rational basis. Basically, under certain social and economic conditions, individuals must fight in order to maintain their personal credit and social standing. We use a repeated two-player sequential game with random matching to show how the institution of dueling could have functioned as a costly but incentive-compatible means by which individuals could demonstrate their good faith dealings by defending their "honor".
Fundamentally, the authors show how a Prisoner's Dilemma-type game is transformed to a win-win (overall) game through the use of coercion.

While dueling is technically not a "state-imposed" solution, the practice requires larger institutionalized social constructions. Specifically, legal enforcement against ordinary murder must be knowingly (although implicitly) relaxed.

Also, dueling is viable (in a game-theoretic sense) only in fairly restrictive circumstances. Outside the parameters the authors describe, other solutions are more effective and less costly.

(via Bruce Schneier)

Monday, March 02, 2009

Taxation and the Prisoner's Dilemma

Taxation, where the cost of some activity is spread out proportionally instead of by specific use, is a perfect example of a Prisoner's Dilemma situation.

If I and my neighbor are subject to taxation, the "rational" solution for either of us is to have the other pay his taxes and avoid our own; we get the benefit of what the taxes pay for without personally incurring the costs. If my neighbor pays his taxes, I'm better off not paying my own; if he doesn't pay his taxes, I'm still better off not paying my own. On the other hand, we're both better off if we both pay our taxes than if neither of us do. That's a textbook example of a Prisoner's Dilemma in real life.

Hence I talk in Supply-side and demand-side communism about using the coercive power of the state to fulfill people's needs for survival: the government taxes everyone to pay for everyone's basic needs. The coercive power of the state is used not to make an individual do what is not in her best interest, but rather to counteract the Nash equilibrium and ensure for each person that his neighbor is not taking a "free ride" and acting in an exploitative manner. Without coercion to ensure fairness, everyone's "rational" decision would be to not pay taxes, to their mutual detriment.

Friday, March 28, 2008

Simplicity

In comments, Alonzo Fyfe asserts he can avoid the complications of game theory. I think he can only hand wave around them.

He charges that "PD situations are highly contrived and ignore many real-world facts that are morally relevant..."

Well, yes. The analysis of a simple game is not the analysis of a complex game. Game theory is a rich and varied field with volumes of serious academic work. As a philosopher, though, I'm entitled to look at how the essential features of some simple games illuminate our fundamental understanding of ethics.

Alonzo might as well argue against the "oversimplification" of gravitation. It is certainly the case that just m1*m2 / d2 ignores many complications in actually describing the motions of planets. But without a sound fundamental understanding of various ideal cases, we can't get very far in making sense of complex phenomena.

The specific cases Alonzo gives, "variable pay-offs, the possibility of anonymous defection, the possibility of deception, and the possibility of affecting desires," all (except perhaps the last, which I shall address in a moment) easily handled by more complicated game-theoretical analysis. But these more complicated analyses don't change anything about the fundamental way we interpret game theoretic analysis in an ethical sense.

He asks, "What happens if we raise our children so that they simply acquire a desire for cooperation or an aversion to defection?"

That seems like an overly simplistic strategy, leading to a susceptibility to exploitation. More importantly, even if children were infinitely labile (which they're not) it begs the question: why should we raise our children thus? Why is cooperation better than defection?

Should we not give our children a sound theoretical understanding of what's going on, so they can analyze and respond to complicated situations where simplistic strategies will not suffice?

To a certain extent, as Alonzo mentioned earlier, we can indeed change desires, to a certain extent. But which desires should we change? Why? How can we justify making those changes? These are all questions that game theory and meta-game theory attempt to answer in a consistent manner.

His next objection,
If we look at your original account from Wednesday's post, and raise children so they assign 2 units of value to cooperation itself, then the value of cooperation increases from 3.3 to 5.3,and exceeds the value of defection. We solve the same problem without any of the complexities of game theory.
is difficult to understand. Alonzo has to use game theory to perform this analysis and reach the conclusion that we should change the game by raising children in a particular way. He has employed game theory, not avoided it.

Real-life examples

John Morales asks for some real-life examples of game theory in ethics.

In many instances where game theory intersects real life, we just play the game according to the (local) Nash equilibrium. The phrase "All's fair in love and war" says that one is free to pursue the strategy that will bring the greatest immediate individual benefit. We construct specifically ethical systems when for one reason or another, we have to go "outside" the game to achieve what we intuitively feel is the best overall outcome.

For example, I can go into a restaurant, eat a meal, and then be presented with the bill. This is an example of a related game, the asymmetric closed bag exchange. Regardless of whether or not I'm actually served a good meal, I am always "better off" not paying (I get to eat the meal and keep my money). Paying before I eat (like at McDonalds) just changes the asymmetry; whether or not I pay, it's always "better" for the restaurant to not feed me (defect) once I've paid (cooperated).

The Pareto optimum (and usually the global maximum), though, is for the restaurant to serve me a good meal and for me to pay.

In a small community, we can play tit-for-tat. If I don't pay on Monday (he cooperates, I defect), the restaurant won't serve me again until I pay without eating (he "defects", I cooperate). However, a rational person with foresight will simply see the outcome of the repeated iterations. We call this foresight the ethical evaluation that you should pay for your meal.

In a larger community, where there are more non-communicating restaurants than I can eat meals, tit-for-tat doesn't work; I can play as many one-shot games as I like without fear of reprisal. So we make laws which follow from our idealized tit-for-tat strategy (i.e. good laws follow from good ethics).

But we can observe that the law is relatively easy to circumvent: There isn't a police officer standing at the door to every restaurant. Instead, we cultivate in ourselves ethical habits. In this case, the the thinking is one level more abstract: If too many people in general were to eat without paying, no one (myself included) could eat at restaurants, so we police ourselves.

There are other examples. I can work hard (cooperate) or slack off and just look busy (defect); my company can give me a raise next year (cooperate) or stiff me (defect). As an exercise, use game theory to relate the Communist slogan, "From each according to his ability, to each according to his need," with the cynical Soviet observation, "we pretend to work, and they pretend to pay us."

A lot of human behavior can be modeled just by reducing it to pure game theory and locally rational choice. But as the Prisoner's Dilemma shows, some situations are not so easy to reduce, even in theory. It is precisely those Prisoner's Dilemma and similar games which cause us to go outside the game and create ethics and laws.

Thursday, March 27, 2008

Ethics and game theory

Atheist ethicist Alonzo Fyfe weighs in with some objections to my earlier post on the Prisoner's Dilemma.
I am afraid that I do not find the prisoner's dilemma to make ethics interesting. In fact, I seldom find its relevance to ethics.
I spoke somewhat loosely in my earlier post. To be more precise, game theory in general is what makes ethics interesting, specifically those elements of game theory where Pareto optima and Nash Equilibria conflict or are undefined or ambiguous. The Prisoner's Dilemma is the best known of these sorts of games, and we can generalize the analysis of the Prisoner's Dilemma to related games, such as the Stag Hunt).

I'm not, of course, the only person interested in the connection between ethics and game theory. From the Wikipedia article:
While it is sometimes thought that morality must involve the constraint of self-interest, David Gauthier famously argues that co-operating in the prisoners dilemma on moral principles is consistent with self-interest and the axioms of game theory. It is most prudent to give up straightforward maximizing and instead adopt a disposition of constrained maximization, according to which one resolves to cooperate with all similarly disposed persons and defect on the rest. In other words, moral constraints are justified because they make us all better off, in terms of our preferences (whatever they may be). This form of contractarianism claims that good moral thinking is just an elevated and subtly strategic version of plain old means-end reasoning. Those that defect can be predicted because people are not completely opaque.

Douglas Hofstadter expresses a strong personal belief that the mathematical symmetry is reinforced by a moral symmetry, along the lines of the Kantian categorical imperative: defecting in the hope that the other player cooperates is morally indefensible. If players treat each other as they would treat themselves, then off-diagonal results cannot occur.
I find myself in almost complete agreement with this point of view.

Game theory takes the magic out of ethics. Instead of talking about some mysterious, mystical ethical realism, a game-theoretic ethics makes ethics about something physical — or at least no more unphysical than consciousness in general. Ethics is about the mind directly, about our subjective preferences and desires and about the complex emergent properties of the subjective preferences interacting in a society. Even better, games such as the Prisoner's Dilemma show us that a game-theoretic understanding is not an over-simplification of our ethical intuitions.

Alonzo complains that the Prisoner's Dilemma is "contrived".
It is a highly contrived situation that some skillful interrogators may put into practice to extract confessions from the accused [I'm curious if Alonzo actually read the Wikipedia article], but it does not describe a real-world situation.
But it is not so much contrived as it is stripped to its essence. In a very simple game, which can be described precisely in just a few sentences, we find profound emergent properties that force us to reconsider our notions of rationality itself. Any philosopher interested in something other than bloviation and obfuscation should, I think, admire the simplicity, clarity and depth of the Prisoner's Dilemma.

Wednesday, March 26, 2008

The Prisoner's Dilemma

The Prisoner's Dilemma is what makes ethics interesting. It's an apparent paradox. Given some game with the payoff matrix:
CooperateDefect
Cooperate3,30,5
Defect5,01,1

A rational person would prefer the Cooperate/Cooperate outcome [Pareto optimum] (and gain 3) to the Defect/Defect outcome (and gain 1). However, it is the dominant strategy to defect [Nash Equilibrium]: for either of my opponent's strategies, defection always has the higher payoff to me. If my opponent defects, then I win 1 if I defect instead of 0 if I cooperate; if my opponent cooperates then I win 5 if I defect instead of 3 if I cooperate. Of course, defection is my opponent's dominant strategy as well. So on one analysis, Cooperate/Cooperate is the preferred outcome; on another analysis, Defect/Defect is the preferred outcome.

There are two ways to resolve the Prisoner's Dilemma for the Pareto optimum. The first is to iterate the game an indefinite number of times and play "tit-for-tat". But it's not always possible to iterate a game indefinitely.

The second is to change the game by changing the payoff matrix, usually by threatening external punishment for defection. For example, if the townspeople agree to get together and beat either of us senseless if either cheats in a closed bag exchange, then we've changed the payoff for defection from 0,5 to 0,-1000, making cooperation the dominant strategy, and making one choice unambiguously rational (the Pareto optimum is also the Nash Equilibrium).

However, if you can change the game in one way, you can change it in other ways. We can just as easily change the game so that it's asymmetric, making it for instance always rational for brown-eyed people to cooperate and blue-eyed people to defect by punishing only brown-eyed people for defecting. Changing the low-level game just makes another Prisoner's Dilemma at a more abstract level: Cooperate becomes "make the game symmetric" (or make good laws/obey the law); "Defect" becomes "make the game asymmetric" (or make bad laws/disobey the law); the Nash Equilibrium is for the authority to make bad laws and the subjects to disobey them.

For this reason, purely authoritarian approaches to solving the Prisoner's Dilemma always fail. The authority will try to change the game for its exclusive benefit, sooner or later depending on how rational and intelligent the authority is; the subjects will then resist the authority. Authoritarian solutions to the Prisoner's Dilemma are dynamically unstable.

To a certain extent, religion can coerce the Cooperate/Cooperate outcome by changing the game: God will punish you for defecting and/or reward you for cooperating (and perhaps reward you more if your opponent defects). This is the sense I spoke of earlier of how religion could have an overall beneficial effect. The effect is weak; religion is a dynamically unstable authoritarian strategy.

(Pseudo-authoritarian solutions are possible, but only where you have competing authorities, who themselves play tit-for-tat. However, within-authority conflicts will always revert to the Nash Equilibrium.)

Democracy is a clever way of solving the Prisoner's Dilemma in a dynamically stable way. The people and the government play a abstract-level game of tit-for-tat — we need to make sure that only one abstract-level authority/submission game is iterated — and can thus implement any number of concrete-level Pareto optima where direct iteration is impractical. Of course, like any system in dynamic equilibrium, democracy is susceptible to sufficiently large "random" forces to push it to a state where the equilibrium cannot be maintained. If the government becomes too powerful, the people cannot "punish" the government sufficiently and the government can "defect" with impunity; likewise a too-weak government invites the people to "defect" into anarchy and chaos.