Saturday, October 25, 2008

BITH: Buying Behavior

(Carol Leone Childcare)
Behavior in the Headlines: Harvard Economics Professor Roland Fryer has an idea to boost performance in our failing schools – pay the students. A new program called Capital Gains is being piloted in the Washington DC area and it is paying students up to $1,500 for good performance in a variety of areas including testing and attendance. The thinking behind the program is that better incentives will encourage students to exhibit better behavior, leading them eventually to academic success. There are no hard data yet on the effectiveness of the approach so the program is currently being run as an experiment. A short movie on the DC pilot can be viewed here.

Fryer’s motive is laudable and his approach has merit; however, the DC experiment is not without risk. By providing financial incentives, Capital Gains is moving the expectation for good scholastic performance from the domain of social exchange to the domain of economic exchange. Such a transition may produce results in the opposite direction intended and the change caused by the program may be difficult to reverse.

Take for example Uri Gneezy and Aldo Rustichini’s study on an undesirable practice of day care center parents. In their resulting paper, “A Fine is a Price,” Gneezy and Rustichini describe the over-time hours and other difficulties for day care center staff caused by late child pick-ups. Day care center management imposed a financial penalty on tardy patents to discourage the practice; however, management was in for a surprise. Late pick-ups actually increased substantially after the fine policy was imposed. Further, when the day care centers later tried to remove the fine, the occurrence of late pick-ups remained at its new, higher level. One explanation for these results, also championed by Dan Ariely in his new book Predictably Irrational, is that parents no longer felt obligated by social contract to pick-up their children on time. The guilt of imposing a social difficulty was replaced by a specific economic value. If the fine price was lower than the value parents placed on the extra effort needed to get to the day care on time, parents simply showed up late and paid the fine. Once in this economic realm it was difficult to reverse the new framing. Dropping the fine merely gave parents a new fine “price” of zero dollars.

The study discussed was focused on a penalty verses an incentive payment so the results may not be directly applicable. However, in the case of Capital Gains, it is possible that students will not value the incentive money as much as they had previously valued the hopeful expectations of their parents or even their own sense of self respect. After students are in an economic exchange mindset they will understand the benefit of good behavior in explicit financial terms. If a student decides that the extra effort is not worth $1,500, she may decide to put in even less effort than she did prior to the program. If students remain in an economic exchange mindset, a later need to remove the financial incentive could leave students even less motivated than they were before the incentive system.

Though there are risks, I am happy to see programs like Capital Gains attempting to improve our nation’s educational system. The current system is failing our children, especially those from disadvantaged backgrounds. It is time to try something new. Thank you Professor Fryer.


Saturday, October 18, 2008

Competitions as Commitment Devices


Today I had the privilege of judging the first phase of MIT’s famous $100K Business Plan competition. My fellow judges and I watched approximately 30 participants give their best 60-second elevator pitch to sell their business idea. Our contestants were all part of the “development track” which consists of businesses that address global issues such as poverty or the environment. Participants covered an impressive variety of quality ideas and technologies including low cost/non-electrical lighting, unique bio-fuels, medical diagnostics that cost 10 cents and can be mailed to the lab on a post card, solar cooking, and mesh wireless networks that overcome last mile issues in rural areas.

I have a strong personal interest in developmental entrepreneurship. In my day job I was a founding member of the IBM World Development Initiative and the leader behind its successful Global ThinkPlace Challenge to brainstorm sustainable solutions to African poverty. I was also a development track $100K participant myself (although back then it was only the $50K). My “Wider Reach” team, consisting of fellow Sloan MBAs Brian Roughan, Armina Karapetyan, Kamal Quadir, and Joe Zeff along with MIT Media Lab PhD student Jose Espinosa, was the winner of the $2,000 IDEAS Award, the $1K development track, and a semi-finalist in the overall $50K competition. We designed a mobile phone accessible marketplace for Bangladesh. Kamal Quadir stuck with the plan and made it a reality. The company is now called CellBazaar and its success has been widely covered by the media including The Wall Street Journal and The Economist.

Kamal’s story illustrates the power of business plan competitions. Kamal went to MIT with the intent of landing a job in finance. Instead he is an entrepreneur helping thousand of impoverished farmers sell their crops more efficiently. How did this happen? While the organizers of business plan competitions may think they are creating entrepreneurs by providing a little financing and exposure, I believe that these competitions are actually serving as Cialdini commitment devices.

Business plan contestants, many of whom had no original intention of becoming entrepreneurs, make small but increasingly significant commitments to the competition. It is easy to put together a 60 second elevator pitch but next they are writing executive summaries and then complete business plans. At each stage contestants declare publicly both orally and in writing their intent to follow through with the business idea. Eventually, through the absolutely amazing power of cognitive dissonance, contestants feel pressure to make sense of their efforts and declarations and rationalize that they must truly want to start these businesses after all. In fact, the large prize money offered in these contests actually takes away from the cognitive dissonance effect as it provides an alternative justification to contestants. So, counter intuitively, if the $100K organizers really want to create more entrepreneurs they might consider dropping the prize money back down to the original $1K!

Monday, October 6, 2008

BITH: The Financial Crisis and Action Ambiguity

Behavior in the Headlines: The stock market is down, credit flow is paralyzed, and Americans are expressing fervent outrage at “Wall Street fat cats and greed.” Constituents are demanding that any “bailout” package include stiff punishment for the financial insiders who “got rich on the path to getting us into this mess.” In the framework of the Moral Luck/Scapegoat discussion, we have a bad outcome along with a strong associated judgment that the actions of financial insiders were unethical and a high willingness to punish. Which of the two theories, Moral Luck or Scapegoat, does a better job of explaining the current situation? Our financial crisis has a unique attribute that may provide insight into these two effects – action ambiguity. In this case at least, it seems that Scapegoat prevails.

While the market was going up (good outcome) Americans had very little interest in the activities of the masters of the universe in high finance. We are all rapidly learning more about our dire economic straights but I believe most still have very little knowledge of the specific actions undertaken by the financial insiders at which Americans are now so angered. This is a case of ethical acts in a black box. With a bad outcome people are willing to judge activity as unethical even before they understand who made what actions. Moral Luck suggests an action will look less ethical in light of a bad outcome. Here we have bad outcomes generating a desire to judge Wall Street actors as unethical before we have even identified what specific actions we are judging.

The financial crisis is a messy real world example and not truly an action black box. Obviously some people, including key thought leaders, know more about the specific questionable actions of Wall Street insiders. However, perhaps a similar black box experimental design could be constructed. Introduce a bad outcome. Next ask subjects if someone should be responsible for the outcome. Then introduce an actor who can be logically associated with the outcome. Minimize the description of the action so that is has very little detail and phrase it in a statement that control subjects would find ethically neutral in a vacuum. “The chef mixed the cake.” I predict that given the right kind of bad outcome (one without culturally predetermined judgments of blame or innocence) subjects will assume that someone must be responsible and further be willing to assign some ethical responsibility to whatever logically connectable subject actor is introduced.

Friday, October 3, 2008

The Blame Game: Desperately Seeking Scapegoat


Before moving on to other phenomena, let’s take the topic of moral luck for another spin. To begin with, please observe that there is an inherent assumption in the standard framing of the effect. The assumption is that subjects are judging the moral act itself. As demonstrated in experiments with this framing in mind, subject judges non-normatively rate an act as less moral when there is a negative outcome and more moral when there is a positive outcome -- as compared to control groups that judged the act “without an outcome.” Like an optical illusion, juxtaposing a moral act with different outcomes can make the act itself look different.

As a mental exercise, let us see if we can turn the standard framing on its head. What if the effect is manifest not from subjects judging moral acts in the light of outcomes but instead from subjects compelled to assign blame for bad outcomes? Colloquially, this concept is found in the term “scapegoat” and in the phrase “someone is going to have to take the fall.” In this alternative “outcome as driver view,” the energy/motivation to blame/punish/label amoral is generated by the bad outcome not an aversion to the revisited morality of the precursor act.

Consider bad outcomes in a vacuum. A sweet little old lady with no family or friends loses her poorly diversified retirement savings in the stock market and can no longer support herself. Or alternatively, a flood victim is left trapped on his roof for days and finally, succumbing to the elements and starvation, dies. With these outcomes, one of the very first questions we are compelled to ask ourselves is “who is to blame?” This seems a natural and productive response. We want to know how this unjust situation could possibly have been allowed to happen or even if someone purposefully caused it to happen. The reason we want to know who is to blame is so that we may be better able address a pressing need for support in the case of the old lady (who is responsible for her now?) or respond to similar situations in the future in the case of the flood. This motivation to assign blame exists even though, unlike in the moral luck experiments, there is no preceding moral antagonist identified. If we were to identify a possible antagonist (stockbroker, FEMA official) the motivation to find someone or something responsible would compel subjects to rate an available antagonist negatively to restore a sense of justice.

This scapegoat framing could explain why subjects rate the immorality of actors when there are bad outcomes as more immoral when compared to the control which has “no outcome” but, on the surface, the theory does not explain why situations with positive outcomes are rated as less immoral than the control. Since this is a mental exercise and we are questioning assumptions, let us take things a step further and challenge the idea that the control scenarios truly represents no outcome. Perhaps there is an outcome and a negative one at that – uncertainty.

Most people very much dislike uncertainty. Moral luck experimental control stimuli leave subjects with unresolved scenarios in which subjects can easily envision bad outcomes resulting. This uncertainty and threat of a bad outcome is in itself a negative outcome. An uncertainty outcome is likely less saliently negative than the certain loss of retirement funding or death from starvation in the earlier examples, however, it is still a negative outcome that may generate desire to assign blame.

Finally, if we quickly assume that positive outcomes may generate motivation to assign positive credit or at least (and perhaps more likely) they do not generate motivation to assign blame, then the scapegoat theory would indeed explain the outcomes seen in the various moral luck experiments. The certain negative outcomes scenarios would have its antagonists rated the worst, the uncertainty outcomes rated negatively and next to worse, and the certain positive outcomes would rate best either as a positive act or at least a neutral one.

For this scapegoat theory to have any value there should be additional hypothesis that could be generated which would predict results that differ from what might be predicted using the standard moral luck theory. Here are a few possible ones that pop to mind (some more merited than others):

Negative Outcomes:

* When faced with a bad outcome in the absence of a moral antagonist, subjects will be willing and able to self generate a generic antagonist and assign blame. The worse the outcome the worse will be the morality rating.

* When an antagonist is introduced, even one with weak ties of responsibility, subjects will assign near full blame to this antagonist (similar rating to the subject’s invented generic antagonist).

* Subsequently, when a more clearly responsible second antagonist is introduced in the presence of first, subjects will reassign most of the blame to the second antagonist, improving the morality ratings of the first.

* If morality is associated with an actor, each actor should generate their own rating independent of other actors. If blame is a fixed quantity based on the negativity of the outcome, introducing more antagonist actors will diffuse assigned blame across antagonists.


Positive Outcomes:

* When faced with a good outcome in the absence of a moral (pro/an)tagonist, subjects will have more difficultly self generating a moral actor and assigning credit in the form of a favorable morality rating.

* When a moral actor is introduced, one with weak ties of responsibility, subjects will assign relatively neutral to positive morality ratings for this actor (similar rating to the subjects invented actor if they were able to generate one).


I believe the desire to assign blame in the case of bad outcomes is powerful, so powerful that people will even sometimes personify the natural world to have “a someone” to blame. However, I am under no real illusions. Remember that this is merely a thought exercise and that the simplest explanation is usually the best. The moral luck framing of this phenomenon has been the stuff of philosophy for a long time and the basis for experiments by some of most admired researchers in the field. I had to go through a lot of logic gymnastics to challenge the moral luck assumptions and in the process generated many new assumptions of my own to lay out the scapegoat theory. There are possibly some big holes in the theory and the predictions are still pretty loose. Additionally, there are very likely results generated by actual moral luck experiments that the scapegoat theory does not explain as I’ve only looked at the most basic findings here. Crafting an alternative explanation is enjoyable and it may be interesting to run a few experiments to test some of the new predictions. However, I predict that we will want to stick with the findings of the papers noted in the previous posting.

Wednesday, October 1, 2008

Moral Luck

In philosophy, the term moral luck is used to describe the morality of an action judged in the light of its uncontrollable and unforeseeable consequences instead of in isolation. Such judgments are not normative. The morality of an action should not be different because of a lucky good outcome or an unfortunate bad end. Questions of moral luck are not new to philosophy but they seemed like fertile ground for experimental behavioral research. In fact I have been working on a rough experimental design to demonstrate the moral luck effect in collaboration with Columbia’s Leonard Lee.

Here is the draft set up:

--------------------------------------------------------

A doctor is visited by a patient complaining of a stomach ache and other vague symptoms. The doctor has a “gut feeling” that the patient may be suffering from Disease X. Disease X is a serious condition and, left untreated, it can reduce the expected lifespan of a sufferer by up to 5 years. The majority of medical experts estimate there is only a 1 in 10,000 chance that a randomly selected person in the population will have Disease X. None of the symptoms of which the patient is complaining are associated with Disease X and two other doctors have already examined the patient and ruled out the disease. These other two doctors believe the patient has a mild form of a flu virus that should resolve itself in a few days.

There is a test for Disease X that is 100% accurate in its diagnosis. Diagnosed early the disease can be cheaply treated with outstanding success; however, the test costs $5,000 to administer and in 2% of cases the test itself results in a serious infection, which also has negative effects on expected lifespan.

The doctor decided to run the test based on his own judgment. [GOOD OUTCOME: The lab results from the test show that the patient does have Disease X which can now be cheaply and effectively treated. The patient may or may not have an infection resulting from the test (2% chance of infection). BAD OUTCOME: The lab results from the test show that the patient does not have Disease X. The patient may or may not have an infection resulting from the test (2% chance of infection).] On a scale of 1 to 5, how moral was the doctor’s decision to run the test?

Very Immoral (1 to 7 scale) Highly Moral


Should an experienced doctor be allowed to make such a decision even if the statistical odds are not in favor of his or her decision?

Yes / No


If you believe the patient’s family is justified in suing the doctor for medical malpractice, what is a reasonable dollar amount that the doctor’s insurance should be expected to pay in compensation? The average malpractice payment at the doctor’s hospital is $50,000.

$__________________


--------------------------------------------------------

There are a number of improvements that should be made to this set up before running it with real subjects but that may not be necessary. In researching the project I ran across two new papers on the subject that already provide quite solid evidence of a moral luck like effect.

Francesca Gino, Don A. Moore, and Max H. Bazerman, “No harm, no foul: The outcome bias in ethical judgments,” HBS Working Paper Number: 08-080, February 2008

Gino, Francesca, Lisa Lixin Shu, and Max H. Bazerman. "Nameless + Harmless = Blameless: When Seemingly Irrelevant Factors Influence Judgment of (Un)ethical Behavior." Harvard Business School Working Paper, No. 09-020, August 2008.

So it looks like we do not get to be the experimental moral luck vanguard. On the plus side I was at least lucky enough to have a wonderful coffee conversation with one of the authors yesterday, Lisa Shu. I look forward to reading more of her work.