Benoit Mandelbrot and finance

Mathematician Benoit Mandelbrot died earlier this week (the news just came out today). I got to know him while editing a piece that he and Nassim Nicholas Taleb wrote for Fortune in 2005, then interviewed him a couple times for Myth of the Rational Market. For a while after that we kept in touch—I remember getting an out-of-the-blue call from him once while riding a crosstown bus through Central Park—but I hadn’t spoken to him in a couple of years. To commemorate his passing, here’s an excerpt from the book dealing with his complicated (and, in light of the recent financial crisis, somewhat tragic) relationship with academic finance.

Mandelbrot was a Polish Jew who had emigrated to France in 1936, spent what would have been his high school years hiding from the Nazis, and then got a doctorate in mathematics at the Sorbonne. It was a 1949 book by Harvard linguist George Zipf that first piqued his interest in strange statistical distributions. Pick a text and rank the words in it by how often each appears, then graph the result, as Zipf did, and you get a fascinating pattern. “The curve does not fall smoothly from most common to least common word,” Mandelbrot observed. “It plunges vertiginously at first, then declines more slowly—like the profile of a ski jumper leaping into space, to land and coast down the gentler slope below.”

Such statistical distributions have become known as “power laws,” because one variable is exponentially related to the other. These patterns, which allow far more room for outliers than the standard bell curve, had first been observed around the turn of the nineteenth century in the distribution of wealth, and it was the statistics of wealth and income that Mandelbrot studied. Then he visited Hendrik Houthakker’s Harvard classroom and saw that cotton futures prices fell into the same pattern as incomes and words. It wasn’t just the ski jump line; the data was also “self-similar”—that is, charts of small snippets looked just like those of large swaths. Mandelbrot was later to find similar patterns in historical climate data along the Nile, the coast of Britain, and the ins and outs of tree bark. After he dubbed them “fractals” in 1982, he was hailed as a visionary, one of the progenitors of the new science of chaos and complexity that was transforming physics and other fields. By then, though, Mandelbrot had long abandoned finance. At the beginning he had been warmly welcomed into the small but growing fellowship of random walkers. Gene Fama became his informal student. Harvard invited him to spend the 1964–65 academic year as a visiting professor of economics. He authored a paper that appeared not long after Samuelson’s in 1965 showing mathematically that a random market would be a rational one.  “The first period was very nice,” Mandelbrot recalled. “They were receptive, but with an ominous cloud.”

The “cloud” was the frustration that developed among economists as they discovered how hard it was to work with Mandelbrot’s power laws. In his depiction of security price movements, variance—the measure of how widely scattered the different data points are—was infinite. For scholars who were just getting acquainted with Markowitz’s depiction of portfolio selection as a tradeoff between mean and variance, infinity was not helpful.

“Mandelbrot, like Prime Minister Churchill before him, promises us not utopia but blood, sweat, toil and tears,” wrote random walk ringleader Paul Cootner in 1964. “If he is right, almost all of our statistical tools are obsolete . . . Surely, before consigning centuries of work to the ash pile, we should like to have some assurance that all our work is truly useless.” Such assurances were not forthcoming, and before long, finance scholars had ceased paying attention to Mandelbrot at all. “The reason people didn’t latch on to that stuff is it’s not that tractable,” said Eugene Fama, who went from Mandelbrot disciple to Mandelbrot ignorer in a few short years in the 1960s. “It’s not that easy to deal with those predictions in a systematic way.”

Physicist M. F. M. Osborne, who visited UC–Berkeley’s Business School in 1972 to teach two finance courses, told his students that Mandelbrot’s ideas about infinite variance were “a stew of red herring and baloney.” Sure, there were jumps and dips in stock prices that couldn’t be shoehorned into a normal distribution, Osborne acknowledged. But for most purposes, it was OK to ignore them. The important thing was to figure out what you were measuring probability for:

You ask what is probable and what is improbable, but definitely not impossible. For rainfall you take 99% of the occasions (days) when you average less than two inches of rain . . . That kind of information is significant for grazing or agriculture, for what kind of vegetation is likely to grow. The improbable situation, which may give much more than 1% of the total rain which may fall, is really concerned with a different caliber of problems. Are the roads going to be washed away, is it safe to build a house in certain locations if you want to live there for twenty or thirty years?

The improbable-but-not-impossible was not something that bell curve statistics could address. But Osborne didn’t see any point in reinventing statistics to handle it. When it came to rare events, he argued, one had to look outside the statistics of randomness and identify actual causes for the anomalies. This required judgment and experience, two areas in which finance scholars possessed no comparative advantage. They focused instead on the probable.

A review of Myth of the Rational Market in The Hindu (and other matters)

The Indian edition of The Myth of the Rational Market is now out (it's the UK edition, printed on different paper), and last week it was reviewed in The Hindu, one of the country's big English-language newspapers. The review, by D. Murali, is mostly just a summary of the book, but the writer does conclude that it is a "Recommended addition to the professional investors’ shelf."

In other news, Bloomberg's James Pressley included Myth in his list of the top 50 business books published since Jan. 1, 2009, and the included it on its roundup of "the best books on the financial crisis and its aftermath."

Also, P.J. Anders Linder of Stockholm's Svenska Dagbladet, whom I remember taking to dinner almost 20 years ago at a sidewalk table at O.T.'s in the lovely (albeit unlaked) Lakeview neighborhood in Birmingham, said something or other in Swedish about the book in his "blogg," and somebody named Elliot wrote a very kind and thoughtful review in his blogg. Or maybe it's just a blog.

Oh, and The New Haven Register covered a speech I gave in New Haven back in April.

Also, the U.S. paperback edition will finally be coming out toward the end of the year. But don't tell anybody. We're trying to keep those hardcover sales going for a while.

A Chinese edition (complex characters) is out!


The first foreign-language edition of The Myth of the Rational Market is in print. From Wealth Press in Taipei. I like the sleeve with all the big headlines (review blurbs and Notable Book citations, I imagine). Other foreign-language editions currently in the works: Japanese, simplified-character (=mainland) Chinese, Korean, French and (Brazilian) Portuguese. Still no Spanish or German or (wat jammer!) Dutch, though.

13 hours, 38 minutes of Myth of the Rational Market fun

The Myth of the Rational Market is now out as an audiobook! I just bought a copy. It's still downloading (58 minutes remaining) as I write this. I can't imagine I'll ever listen to the whole thing, but I am looking forward to sampling narrator Alan Sklar's rendition. He and I did a lot of talking on the phone over the holidays, as he checked the pronunciations of characters' names with me. The man has a fine voice.

I knew most of pronunciations, but there were a couple that I had never heard said aloud—and discovered, after some asking around, that I had been mispronouncing in my head. Turns out the late University of Chicago economist Melvin Reder's last name is pronounced "Reader" (thanks to Edward Lazear for setting me straight), and rational expectations pioneer John Muth's is pronounced "Myouth" (Bob Lucas came through on that one).

In other news, there are new book-related interviews up at the website of Chai University (a new online MBA provider) and at the Motley Fool's UK site. Plus, I did a commentary for public radio's Marketplace that was informed by my book research.

The UK edition is out!

The official publication date was Monday, but as it was out of stock at
for the first couple days of the week, it seemed pointless to post
about it. Right now it says there are only four copies left in
stock, so it may be pointless again soon enough. This is not because the book's a big best-seller (it's currently at 8,865 in the ranking).

But I am not going to whine about it. After having lost my first UK publisher because I took so long to finish, I am thrilled that the nice people at Harriman House have seen fit to print the thing. And eventually I'm sure anybody who wants a copy will get one.


Update: Harriman House is not even remotely to blame for the stocking problems. just runs an insanely lean operation. As best I can tell, they don't like to go into double digits. Right now (Feb. 5) they are again trumpeting that there's "only 1 left in stock." Seriously,, I think I can guarantee sales at least in the dozens. Just order a few more!

From ‘yawn-inducing’ to one of the year’s best

Back when USA Today ran a review of Myth of the Rational Market last summer, it was "yawn-inducing." Now, though, the paper's Money Bookshelf editor, Gary Rawlins (not the author of the original review), has listed it as one of the "Year's best business books to make sense of financial crisis." Not sure if that's the same as calling it one of the year's best business books, but I'll take it.

Meanwhile, at Bloomberg, James Pressley puts Myth on his list of ten Top Crisis Books. And Washington Examiner books editor Marcela Valdes put it at No. 2 on her list of the year's 10 best books. Let me just state here that there is no way Myth was the really one of the two best books published in the United States last year (I'm also pretty sure there's no way that Frank Bruni's Born Round, Valdes's first choice, was the best). But again, I'll take it.

Oh, and one other thing: I've got this new job.

Update: Made some more best-of lists. New York Times columnist Floyd Norris included Myth in his list of "six books I recommend with enthusiasm." In the East Hampton Star, Kurt Wenzel called it one of the top 10 books of the year. Bookseller 800ceoread put it on its extended list of the best business books of the year. And finally, Time put Myth on its list of the five best business books of the year, which seems kind of suspect. I didn't know about it beforehand, if that's any consolation. I guess it was a going-away present.

Update 2: Also on the Library Journal list of the best business books of 2009 and The Epicurean Dealmaker's list of books he's planning to read one of these days.