Archive for ‘chaos theory’

Efficient Market Theory’s Demise: Where do we go from here?

By , 25 July, 2009, No Comment

Mendelbrot had the problem pegged long ago, chaos and randomness…there has been no real explanations because a degree of randomness exists in the market and it is difficult to account for irrational behavior, or market noise.

Emini Trading: Do you have style?

By , 22 July, 2009, 1 Comment

I think before anyone embarks upon serious study of trading, then trying to make a living at trading, he/she ought consider the style of trading that best fits their personality.  Unfortunately, the term “trader” means a lot of things and encompasses a wide range of trading styles and methodologies.   My personal style of trading reflects my personality, I like immediate gratification and results, so I am a scalper.

So what is a scalper?

Most scalpers, especially the scalpers who trade the eminis, seek to exploit the natural rhythm of the market and carve out small gains on each trade.  My goal is often 12 ticks, though that can change depending upon the mood of the market and an indicator I used (and have written a post about) called the Average True Range.  My trades seldom last more than 10 or 15 minutes and I exit.  I never carry positions overnight.  My account is trade free at the end of the trading session, or at least, the period of time I am trading.

I scalp because it suits my personality.  I like the fast paced action and the lack of dependence on intermediate term prognostications on the direction of the market.  Some scalpers, seek to exploit the big/ask disparities in the market, though that is never my goal.  Scalpers need to implement strict money management guidelines in their trading, and never risk more than 5% of their capital on a given trade.  There are a host of traits scalpers use, and those traits even vary from scalp trader to scalp trader.  The important thing to remember in scalping is that I am looking for very short term moves in the market to exploit, and I do not attempt to predict any overall direction of the market as a whole.  I am interested in certain moves in very specific contracts.  The market as a whole does not interest me and, generally speaking, I don’t pay much attention to overall market conditions.  I trade the chart I am looking at, not the news, not the economy, just the chart before me.

Swing traders are a different matter, though.

Swing traders are really fundamental traders who hold their positions longer than a single day. Most fundamentalists are actually swing traders since changes in corporate fundamentals generally require several days or even weeks to produce a price movement sufficient enough for the trader to claim a reasonable profit.  The important difference between a swing trader and a scalper are basic: A swing trader has a notion or idea which way the market is going to move, or which way an individual stock is going to move, and invests based upon his belief.  Swing traders usually identify a specific characteristic or event in the market and trade based upon this theory.   I should point out that though many swing traders are interested in market and stock fundamentals, there is also a field of swing trading that invest based solely on technical trading.  Oscillators, Gann lines, Dow theory….there are scads of theories that swing trader may implement to ascertain the timing and direction of the trades they choose to execute.

Technical Traders, Fundamental Traders and Efficient Market Traders.

There is scant space in this post to cover the myriad of styles these three titles cover.  I should also point out that there is often very little agreement upon methodology by the three trading camps.  Each lays claim to correctness, though I incorporate parts of all three trading styles into my personal trading style.  I will devote some posts in the future to contrasting the mindset of each of these trading theories.

The point here is a basic one, a trader ought to decide who and what he is and what style he will implement in his trading activities.  This decision is usually gained through extensive reading and trading experience.  There are some great books written on each of these trading styles, and all traders out to consider spending some time reading about the great theorists of trading and the style and rationale they employed to reach the conclusions they write about.

Some suggested reading would include:

Dr. Burton Malkiel, “A Random Walk Down Wall Street”  (efficient market theory)

Benjamin Graham and David Dodd, “Security Analysis”  (value investing, fundamental investing)

Benjamin Graham, “The Intelligent Investor”  (value investing, fundamental investing)

John Murphy, “Technical Analysis of Financial Markets” (technical trading)

J. Welles Wilder, “New Strategies in Technical Analysis” (technical trading)

Martin Pring, “Introduction to Technical Analysis” (technical trading)

Dr. Bill Williams, “Trading Chaos” (chaos and fractal theory)

Benoit Mendalbrot “The Misbehavior of Markets”

All of these fine books will provide you with a great theoretical background to begin your journey as a trader.  I have dog eared copies of each of the books, and often refer back to them to refresh my own knowledge base.

So read, trade, experiment…then find the style of trading with which you can succeed.  As always, best of luck trading.

Chaos Theory and Fractals

By , 5 September, 2008, No Comment

It is fitting that chaos theory got its start in the humble but frustrating field of meteorology. Why does it seem impossible for all our hot-shot meteorologists, armed as they are with ever more efficient computers and ever greater masses of data, to predict the weather?

Two decades ago, Edward Lorenz, a meteorologist at MIT stumbled onto chaos theory by making the discovery that ever so tiny changes in climate could bring about enormous and volatile changes in weather. Calling it the Butterfly Effect, he pointed out that if a butterfly flapped its wings in Brazil, it could well produce a tornado in Texas.

Since then, the discovery that small, unpredictable causes could have dramatic and turbulent effects has been expanded into other, seemingly unconnected, realms of science.

The conclusion, for the weather and for many other aspects of the world, is that the weather, in principle, cannot be predicted successfully, no matter how much data is accumulated for our computers. This is not really “chaos” since the Butterfly Effect does have its own causal patterns, albeit very complex. (Many of these causal patterns follow what is known as “Feigenbaum’s Number.”)

But even if these patterns become known, who in the world can predict the arrival of a flapping butterfly?

The stock markets are said to be nonlinear, dynamic systems. Chaos theory is the mathematics of studying such nonlinear, dynamic systems. Does this mean that chaoticians can predict when stocks will rise and fall? Not quite; however, chaoticians have determined that the market prices are highly random, but with a trend. The stock market is accepted as a self-similar system in the sense that the individual parts are related to the whole. Another self-similar system in the area of mathematics are fractals. Could the stock market be associated with a fractal? Why not? In the market price action, if one looks at the market monthly, weekly, daily, and intra day bar charts, the structure has a similar appearance. However, just like a fractal, the stock market has sensitive dependence on initial conditions. This factor is what makes dynamic market systems so difficult to predict. Because we cannot accurately describe the current situation with the detail necessary, we cannot accurately predict the state of the system at a future time. Stock market success can be predicted by chaoticians.

Manus J. Donahue III
An Introduction to Chaos Theory and Fractal Geometry

The upshot of chaos theory is not that the real world is chaotic or in principle unpredictable or undetermined, but that in practice much of it is unpredictable. And in particular that mathematical tools such as the calculus, which assumes smooth surfaces and infinitesimally small steps, is deeply flawed in dealing with much of the real world. (Thus, Benoit Mandelbroit’s “fractals” indicate that smooth curves are inappropriate and misleading for modeling coastlines or geographic surfaces.)

Chaos theory is even more challenging when applied to human events such as the workings of the stock market. Here the chaos theorists have directly challenged orthodox neoclassical theory of the stock market, which assumes that the expectations of the market are “rational,” that is, are omniscient about the future. If all stock or commodity market prices perfectly discount and incorporate perfect knowledge of the future, then the patterns of stock market prices must be purely accidental, meaningless, and random (“random walk”), since all the underlying basic knowledge is already known and incorporated into the price.

The absurdity of believing that the market is omniscient about the future, or that it has perfect knowledge of all “probability distributions” of the future, is matched by the equal folly of assuming that all happenings on the real stock market are “random,” that is, that no one stock price is related to any other price, past or future. And yet a crucial fact of human history is that all historical events are interconnected, that cause and effect patterns permeate human events, that very little is homogeneous, and that nothing is random.

With their enormous prestige, the chaos theorists have done important work in denouncing these assumptions, and in rebuking any attempt to abstract statistically from the actual concrete events of the real world. Thus, the chaos theorists are opposed to the common statistical technique of “smoothing out” the data by taking twelve-month moving averages of monthly data-whether of prices, production, or employment. In attempting to eliminate jagged “random elements” and separate them out from alleged underlying patterns, orthodox statisticians have been unwittingly getting rid of the very real-world data that need to be examined.

Benoit Mandelbrot’s Pioneering Fractal and Chaos theory

By , 8 August, 2008, No Comment

Source: ScientificAmerican Feb. 1999

I relialize some of the information is a bit esotericc in this article…..but it is an excellent intoduction ton Fractals and Chaos Theory as it relate to investing



A Multifractal Walk Down Wall Street

“The geometry that describes the shape of coastlines and the patterns of galaxies also elucidates how stock prices soar and plummet.”

by Benoit B. Mandelbrot

Individual investors and professional stock and currency traders know better than ever that prices quoted in any financial market often change with heart-stopping swiftness. Fortunes are made and lost in sudden bursts of activity when the market seems to speed up and the volatility soars. Last September, for instance, the stock for Alcatel, A French telecommunications equipment manufacturer, dropped about 40 percent one day and fell another 6 percent over the next few days. In a reversal, the stock shot up 10 percent on the fourth day.

The classical financial models used for most of this century predict that such precipitous events should never happen. A cornerstone of finance is modern portfolio theory, which tries to maximize returns for a given level of risk. The mathematics underlying portfolio theory handles extreme situations with benign neglect: it regards large market shifts as too unlikely to matter or as impossible to take into account. It is true that portfolio theory may account for what occurs 95 percent of the time in the market. But the picture it presents does not reflect reality, if one agrees that major events are part of the remaining 5 percent. An inescapable analogy is that of a sailor at sea. If the weather is moderate 95 percent of the time, can the mariner afford to ignore the possibility of a typhoon?

The risk-reducing formulas behind portfolio theory rely on a number of demanding and ultimately unfounded premises. First, they suggest that price changes are statistically independent of one another: for example, that today’s price has no influence on the changes between the current price and tomorrow’s. As a result, predictions of future market movements become impossible. The second presumption is that all price changes are distributed in a pattern that conforms to the standard bell curve. The width of the bell shape (as measured by its sigma, or standard deviation) depicts how far price changes diverge from the mean; events at the extremes are considered extremely rare. Typhoons are, in effect, defined out of existence.

Do financial data neatly conform to such assumptions? Of course, they never do. Charts of stock or currency changes over time do reveal a constant background of small up and down price movements – but not as uniform as one would expect if price changes fit the bell curve. These patterns, however, constitute only one aspect of the graph. A substantial number of sudden large changes – spikes on the chart that shoot up and down as with the Alcatel stock – stand out from the background of more moderate perturbations. Moreover, the magnitude of price movements (both large and small) may remain roughly constant for a year, and then suddenly the variability may increase for an extended period. Big price jumps become more common as the turbulence of the market grows – clusters of them appear on the chart.

According to portfolio theory, the probability of these large fluctuations would be a few millionths of a millionth of a millionth of a millionth. (The fluctuations are greater than 10 standard deviations.) But in fact, one observes spikes on a regular basis – as often as every month – and their probability amounts to a few hundredths. Granted, the bell curve is often described as normal – or, more precisely, as the normal distribution. But should financial markets then be described as abnormal? Of course not – they are what they are, and it is portfolio theory that is flawed.

Modern portfolio theory poses a danger to those who believe in it too strongly and is a powerful challenge for the theoretician. Though sometimes acknowledging faults in the present body of thinking, its adherents suggest that no other premises can be handled through mathematical modeling. This contention leads to the question of whether a rigorous quantitative description of at least some features of major financial upheavals can be developed. The bearish answer is that large market swings are anomalies, individual “acts of God” that present no conceivable regularity. Revisionists correct the questionable premises of modern portfolio theory through small fixes that lack any guiding principle and do not improve matters sufficiently. My own work – carried out over many years – takes a very different and decidedly bullish position.

I claim that variations in financial prices can be accounted for by a model derived from my work in fractal geometry. Fractals – or their later elaboration, call multifractals – do not purport to predict the future with certainty. But they do create a more realistic picture of market risks. Given the recent troubles confronting the large investment pools call hedge funds, it would be foolhardy not to investigate models providing more accurate estimates of risk.

Multifractals and the Market

An extensive mathematical basis already exists for fractals and multifractals. Fractal patterns appear not just in the price changes of securities but in the distribution of galaxies throughout the cosmos, in the shape of coastlines and in the decorative designs generated by innumerable computer programs.

A fractal is a geometric shape that can be separated into parts, each of which is a reduced-scale version of the whole. In finance, this concept is not a rootless abstraction but a theoretical reformulation of a down-to-earth bit of market folklore – namely, that movements of a stock or currency all look alike when a market chart is enlarged or reduced so that is fits the same time and price scale. An observer then cannot tell which of the data concern prices that change from week to week, day to day or hour to hour. This quality defines the charts as fractal curves and makes available many powerful tools of mathematical and computer analysis.

A more specific technical term for the resemblance between the parts and the whole is self-affinity. This property is related to the better-known concept of fractals called self-similarity, in which every feature of a picture is reduced or blown up by the same ratio – a process familiar to anyone who has ever ordered a photographic enlargement. Financial market charts, however, are far from being self-similar.

Illustration 1 – THREE-PIECE-FRACTAL GENERATOR (top) can be interpolated repeatedly into each piece of subsequent charts (bottom three diagrams). The pattern that emerges icreasingly resembles market price oscillations. (The interpolated generator is inverted for each descending piece.)

ManArticleCharts.gif (26642 bytes)


In a detail of a graphic in which the features are higher than they are wide – as are the individual up-and-down price ticks of a stock – the transformation from the whole to a part must reduce the horizontal axis more than the vertical one. For a price chart, this transformation must shrink the time-scale (the horizontal axis) more than the price scale (the vertical axis). The geometric relation of the whole to its parts is said to be one of self-affinity.

The existence of unchanging properties is not given much weight by most statisticians. But they are beloved of physicists and mathematicians like myself, who call them invariances and are happiest with models that present an attractive invariance property. A good idea of what I mean is provided by drawing a simple chart that inserts price changes from time 0 to a later time 1 in successive steps. The intervals themselves are chosen arbitrarily; they may represent a second, an hour, a day or a year.

The process begins with a price, represented by a straight trend line (illustration 1). Next, a broken line called a generator is used to create the pattern that corresponds to the up-and-down oscillations of a price quoted in financial markets. The generator consists of three pieces that are inserted (interpolated) along the straight trend line. (A generator with fewer than three pieces would not simulate a price that can move up and down.) After delineating the initial generator, its three pieces are interpolated by three shorter ones. Repeating these steps reproduces the shape of the generator, or price curve, but at compressed scales. Both the horizontal axis (timescale) and the vertical axis (price scale) are squeezed to fit the horizontal and vertical boundaries of each piece of the generator.

Interpolations Forever

Only the first stages are shown in the illustration, although the same process continues. In theory, it has no end, but in practice, it makes no sense to interpolate down to time intervals shorter than those between trading transactions, which may occur in less than a minute. Clearly, each piece ends up with a shape roughly like the whole. That is, scale invariance is present simply because it was built in. The novelty (and surprise) is that these self-affine fractal curves exhibit a wealth of structure — a foundation of both fractal geometry and the theory of chaos.

7Fig4a.gif (8151 bytes)

A few selected generators yield so-called unifractal curves that exhibit the relatively tranquil picture of the market encompassed by modern portfolio theory. But tranquillity prevails only under extraordinarily special conditions that are satisfied only by these special generators. The assumptions behind this oversimplified model are one of the central mistakes of modern portfolio theory. It is much like a theory of sea waves that forbids their swells to exceed six feet.

The beauty of fractal geometry is that it makes possible a model general enough to reproduce the patterns that characterize portfolio theory’s placid markets as well as the tumultuous trading conditions of recent months. The just described method of creating a fractal price model can be altered to show how the activity of markets speeds up and slows down — the essence of volatility. This variability is the reason that the prefix “multi-” was added to the word “fractal.”

To create a multifractal from a unifractal, the key step is to lengthen or shorten the horizontal time axis so that the pieces of

ManArticleCharts2.gif (39090 bytes)

the generator are either stretched or squeezed. At the same time, the vertical price axis may remain untouched. In illustration 2, the first piece of the unifractal generator is progressively shortened, which also provides room to lengthen the second piece. After making these adjustments, the generators become multifractal (M1 to M4). Market activity speeds up in the interval of time represented by the first piece of the generator and slows in the interval that corresponds to the second piece (illustration 3).

Such an alteration to the generator can produce a full simulation of price fluctuations over a given period, using the process of interpolation described earlier. Each time the first piece of the generator is further shortened — and the process of successive interpolation is undertaken — it produces a chart that increasingly resembles the characteristics of volatile markets (illustration 4).

The unifractal (U) chart shown here (before any shortening) corresponds to the becalmed markets postulated in the portfolio theorists’ model. Proceeding down the stack (M1 to M4), each chart diverges further from that model, exhibiting the sharp, spiky price jumps and the persistently large movements that resemble recent trading. To make these models of volatile markets achieve the necessary realism, the three pieces of each generator were scrambled — a process not shown in the illustrations. It works as follows: imagine a die on which each side bears the image of one of the six permutations of the pieces of the generator. Before each interpolation, the die is thrown, and then the permutation that comes up is selected.

What should a corporate treasurer, currency trader or other market strategist conclude from all this? The discrepancies between the pictures painted by modern portfolio theory and the actual movement of prices are obvious. Prices do not vary continuously, and they oscillate wildly at all timescales. Volatility — far from a static entity to be ignored or easily compensated for — is at the very heart of what goes on in financial markets. In the past, money managers embraced the continuity and constrained price movements of modern portfolio theory because of the absence of strong alternatives. But a money manager need no longer accept the current financial models at face value.

Instead multifractals can be put to work to “stress-test” a portfolio. In this technique the rules underlying multifractals attempt to create the same patterns of variability as do the unknown rules that govern actual markets. Multifractals describe accurately the relation between the shape of the generator and the patterns of up-and-down swings of prices to be found on charts of real market data.

On a practical level, this finding suggests that a fractal generator can be developed based on historical market data. The actual model used does not simply inspect what the market did yesterday or last week. It is in fact a more realistic depiction of market fluctuations, called fractional Brownian motion in multifractal trading time. The charts created from the generators produced by this model can simulate alternative scenarios based on previous market activity.

These techniques do not come closer to forecasting a price drop or rise on a specific day on the basis of past records. But they provide estimates of the probability of what the market might do and allow one to prepare for inevitable sea changes. The new modeling techniques are designed to cast a light of order into the seemingly impenetrable thicket of the financial markets. They also recognize the mariner’s warning that, as recent events demonstrate, deserves to be heeded: On even the calmest sea, a gale may be just over the horizon.



Pick the FakePickFake.gif (17656 bytes)

How do multifractals stand up against actual records of changes in financial prices? To assess their performance, let us compare several historical series of price changes with a few artificial models. The goal of modeling the patterns of real markets is certainly not fulfilled by the first chart, which is extremely monotonous and reduces to a static background of small price changes, analogous to the static noise from a radio. Volatility stays uniform with no sudden jumps. In a historical record of this kind, daily chapters would vary from one another, but all the monthly chapters would read very much alike. The rather simple second chart is less unrealistic, because is shows many spikes; however, these are isolated against an unchanging background in which the overall variability of prices remains constant. The third chart has interchanged strengths and failings, because it lacks any precipitous jumps.

The eye tells us that these three diagrams are unrealistically simple. Let us now reveal the sources. Chart 1 illustrates price fluctuations in a model introduced in 1900 by French mathematician Louis Bachelier. The changes in prices follow a “random walk” that conforms to the bell curve and illustrates the model that underlies modern portfolio theory. Charts 2 and 3 are partial improvements on Bachelier’s work: a model I proposed in 1963 (based on Levy stable random processes) and one I published in 1965 (based on fractional Brownian motion). These revisions, however, are inadequate, except under certain special market conditions.

In the more important five lower diagrams of the graph, at least one is a real record and at least another is a computer-generated sample of my latest multifractal model. The reader is free to sort those five lines into the appropriate categories. I hope the forgeries will be perceived as surprisingly effective. In fact, only two are real graphs of market activity. Chart 5 refers to the changes in price of IBM stock, and chart 6 shows price fluctuations for the dollar-deutsche mark, exchange rate. The remaining charts (4, 7 and 8) bear a strong resemblance to their two real-world predecessors. But they are completely artificial, having been generated through a more refined form of my multifractal m

Just Chaos

By , 5 August, 2008, No Comment

Fundamental traders have no extra time for the technical traders, and technical traders battle with the Efficient Market rabble, who constitute the vast majority of market theoreticians, for coherent interpretation of the unruly and unpredictable beast we refer to as “the market”. Of course, reams of academically-sound market studies proclaim the inherent correctness of the Efficient Market Theory. Why…no less than the eminent Dr. Burton Malkiel trumpets the sheer futility in considering anything short of Efficient Market Theory. No, one cannot argue with facts laid bare in slick PowerPoint presentations with glossy charts and multi-colored tables, that’s for sure, and yet there is something missing, something so essentially important that no theorist dare utter the words...equity market theory seldom translates into profitable trading.

And that’s a real problem for me. If a market theory is irrefutably true on paper it ought to have some phenomenal performance in practice. Of course, this is seldom the case.

For those who might have missed it, we’ve put a team of astronauts on the moon. We have unravelled the the vagaries of the quantum mechanics with startling accuracy, and teased the destructive power of atomic structure to produce enough nuclear weapons to obliterate ourselves tenfold. Why, we have even sequenced the double helix structure of of our own DNA
molecule. We are talking about the very building block upon which life is based, a structure so complex that literally billions, not millions, but billions of gene strands comprise it’s makeup.

But we have failed miserably at predicting where the market is going to move at a given point in time.

Yet we argue on as to who is right and who is wrong. It seems to me that I learned in my college Argumentation class that something true at face value, and provide proofs to that end, before you can argue your point. So it would seem a bit imprudent to argue about which theory holds true when we have proven to ourselves, over and over, that no theory has predicted, with any accuracy, where the market is going to be at a given point in time.

My one-watt brain cell demands that a FACT has to hold up time after time to be true. One cannot argue the untrue into truth. For example, these are facts:

  • 1+1=2 (unless you’ve digested Liebnitz’s arguments)
  • The moon revolves around the earth in a given arc and is not made out of cheese.
  • George Bush is the President of the United States.
  • We will all die

I think you get my point here. It is impossible to argue untruth into truth through a sheer volume of words. So I’ve managed in 21 years of trading at the institutional and retail level to establish only one irrefutable FACT

  • We have an incomplete knowledge base about the market and there is not a method to predict, with 100% accuracy, what the market is going to be valued at a given point in time.

Which leaves me out there with the lunatic fringe scratching my head in bewilderment. Yet I am a consistently profitable trader. I live in the very uncertain world of fractals, strange attractors and chaos theory. Yes, you heard me say it….CHAOS THEORY

The real problem with all market theories, in my opinion. is that they are linear in nature. Of course, even a cursory observation of any equity chart exposes the distinct non-linear pattern typical of the equity markets. It is not possible to predict even from bar to bar where he market is headed. No, a binary outcome is after each bar is the best you can hope for. That is to say there is a probability from bar to bar whether the market will go up or down or stay the same. And when trading, probabilities are the best we can hope for…and careful observation of market fractal mini-structures can be teased from the charts. Which is not to say that fractal structures are the Holy Grail in trading, but they are reliable predictors in non-dynamic markets….that is, markets unaffected by catastrophic or peculiar outside occurrences.

Of course, this type of thinking turns the world inside out….after all, we linear thinkers and are programmed to see patterns in the world and formulate patterns based upon observation. I am 5’7″ and weight 210 pounds and have gray hair. My boss is also 5’7″ and weighs 210 pounds, and yes…he has gray hair. So it stands to reason that 5’7″ and 210 pound men must all have gray hair. Of course, that is a simplistic view of our linear thinking process, but it serves it’s purpose well enough…and that is correlating variables of an infinite set is, at best, a dicey endeavor.

No, I’ve learned that the secret to the market lies in thinking in a non-linear fashion, and blocking out what seem to be obvious correlations. There are no obvious correlations in a non linear world….only fractals. Are you with me?

Easy AdSense by Unreal