Chaos Theory


Contents

Non-linear Equations
Bifurcation
Fractal

Non-linear Equations

Chaos At the end of the 19th century, the French mathematician Henri Poincare tried to solve the differential equations for the three body problem. It was noticed that the orbit is not periodical anymore (in contrary to the case with just two body), actually the motion appears to be random. Then it was found that the solution is "exquisite sensitivity to initial conditions". The object would follow a very different path at the slightest change of initial condition. Figure 01 is an animation showing two paths of a third body under the gravitational influence of two massive objects. The paths start at the same position but the velocities differ by 1%. Initially the paths are very close, the difference becomes apparent after a while. Sixty years later, this kind of divergent behavior was re-visited by a meteorologist, named Edward Lorenz, with a set of 12 equations used to model the weather. He found the system evolves differently by just a very

Figure 01 Chaos
[view large image]

slight variation of the initial condition. This divergent behavior is now known as the butterfly effect - the slightest disturbance of the air by a butterfly would cause a global weather change a year later. Eventually, Lorenz simplified the number of equations to three, and the system still
Lorenz System Lorenz Equations exhibits the same kind of divergent behavior. The simplified system simulates the dynamical behavior of convection rolls in fluid layers that are heated from below (see Figure 02). This is a crude approximation of the air circulation at different latitude of the Earth (see Figure 09-10) It is also applicable to a leaky waterwheel. A waterwheel built from cups with equal sized holes in the bottom of each cup is allowed to turn freely under the force of a steady stream of water poured into the top cup. Figure 03 shows the Lorenz equations,

Figure 02 Lorenz System
[view large image]

Figure 03 Lorenz Eqs.

where t denotes time - the running variable, x, y, z are the dependent variables, and sigma, r, b are the parameters;
          x: rotational speed of the convectional rolls (and the waterwheel),
          y: temperature difference between p and q,
          z: deviation of temperature from the mean,
          sigma: Prandtl number = (fluid viscosity/thermal conductivity),
          r ~ Rayleigh number (used in heat transfer and free convection calculations),
          b ~ width/height.

For sigma = 10, r = 28, and b = 8/3, the system shows chaotic behavior. The variation of x, y, and z with time is displayed in Figure 04, which shows oscillations between some limits - it is similar to white noise. The behavior is easier to visualize if the
Time Series Phase Space development of the system is plotted in the phase space, where the values of x, y, z define each point in the graph. It is then clear that the system is confined to a certain region, namely the two shells (see Figure 05). However, the time progression of the points is not obvious. It either relies on color codes (for example, blue for earlier and red for later moment) or animation (which shows the points spreading from a small initial region) to display the evolution of the

Figure 04 Time Series [view large image]

Figure 05 Phase Space [view large image]

system. The region occupied by the system in the phase state, namely the butterfly or the shells, is known as Lorenz attractor, to which the dynamical motion will always converge no matter how far off initially.
Lorenz Eqs., r = 10 Lorenz Eqs., r = 21 Lorenz Eqs., r = 400 The solutions of the Lorenz equations also depend on the parameters. When r is small, e.g., r = 10 all solutions tend to a fixed point. This is not chaos (see Figure 06). Starting from r ~ 14 the fixed points lose their stability. For r = 21, the system begins to exhibit transient chaos. This means that although it begins as a chaotic process, its long-

Figure 06 r = 10
[view large image]

Figure 07 r = 21
[view large image]

Figure 08 r = 400 [view large image]

term behavior becomes periodic (see Figure 07). The critical value for r that is required to produce chaos is r > 24. However, for very large value of r such as r = 400, all solutions become periodical again (see Figure 08).
In recent years scientists have come to recognize more and more systems that must be understood holistically or not at all. These systems are described mathematically by equations known as "nonlinear". Non-linearity is a mathematical way of saying that the different dynamical degrees of freedom (the dependent variables or functions) "act on" each other and on themselves so that a given degree of freedom evolves not in a fixed environment but in an environment that itself changes with time. For example, the xz and xy terms in the Lorenz equations can be interpreted as x being "acted on" by z and y respectively. While the function X(n+1) in the logistic equation below receives a negative feedback (in the form of (1 - X(n))), which impedes further increase (a positive feedback loop can run out of control, and can result in the collapse of the system).

[Top]


Bifurcation

Another system with sensitive dependence on initial conditions is the logistic equation:

X(n+1) = R X(n) (1 - X(n))

where R is a parameter, and X is the variable at the nth iteration with value between 1 and 0, and n can be considered as the running variable.

It is a recursive equation, which generates a new value from the previous value. It can be used as a simple model for species population with no predators, but limited food supply. In this case, the population is a number between 0 and 1, where 1 represents the maximum possible population and 0 represents extinction. R is the growth rate, and n becomes the time in unit of 1 year for example.

There is a website, which shows the logistic solution by specifying the value of R, the initial population, and the number of iterations. Figure 09 is a sample obtained from there with R = 4, initial population = 0.5, and running for 100 generations.

Maximum Growth Rate Bifurcation Figure 10 is the graphic representation of the solutions. The lower diagrams are the time series for different value of R. The steady state reaches a stable value at Xm. The "period two" diagram shows two stationary points a and b, which are the maximum and minimum of the oscillation respectively. The "period four" diagram shows four stationary points c, d, e, and f. It looks like white

Figure 09 Logistic Eq. [view large image]

Figure 10 Bifurcation
[view large image]

noise in the "chaos" diagram. Actually, there are so many stationary points, it is very difficult to follow the details. The upper diagram in Figure 10 plots the stable or stationary point Xm as a
function of R. The separation to 2, 4, 8, ... branches are called bifurcation. Looking closer at the chaotic region reveals the same kind of bifurcation getting finer at successive level. This self-similarity, the fact that the graph has an exact copy of itself hidden deep inside, came to be known as "scale invariance". It was discovered that the bifurcations come at a constant rate of 4.669 - the exact scale at which it was self-similar. If the diagram is made 4.669 times smaller or larger, it will look the same as the next region of bifurcations. The scaling factor of 4.669 is the same for other nonlinear equations exhibiting bifurcation, i.e., it is universal.

[Top]


Fractal

Koch The Koch curve has been constructed according to the idea of self-similarity. It starts from a straight line. Then add an equilateral triangle to the middle third of each side. A Kock curve is obtained by repeating the procedure on each successive (and shorter) straight line (see Figure 10). It is noticed the area enclosed within does not increase with the length of the lines as prescribed by the Euclidian geometry. To get around this difficulty, mathematicians invented fractal (fractional) dimensions. The fractal dimension of the Kock curve is somewhere around 1.26. Now fractal has come to mean any image that displays the attribute of self-similarity.

Figure 10 Koch Curve
[view large image]

The general formula to compute the fractal dimension is:

D = log(N)/log(1/r)

where r = scaling down ratio, and N = number of replacement parts.

For the Koch curve, the number of new units is 4, and the scaling down factor is 1/3. Thus

D = log(4)/log(1/3) = 1.261859

Fractal structures have been noticed in many real-world areas - blood vessels branching out further and further, the branches of a tree, the internal structure of the lungs, graphs of stock market data, the rhythm of heartbeat, ... these systems all have something in common: they are all self-similar. Figure 11 below shows the similarity of the branching of blood vessels on the left, the right half shows the similarity of average pattern of heartbeat rate.
Fractal

Figure 11 Fractal in Real-World
[view large image]