Highly optimized tolerance explained

In applied mathematics, highly optimized tolerance (HOT) is a method of generating power law behavior in systems by including a global optimization principle. It was developed by Jean M. Carlson and John Doyle in the early 2000s.[1] For some systems that display a characteristic scale, a global optimization term could potentially be added that would then yield power law behavior. It has been used to generate and describe internet-like graphs, forest fire models and may also apply to biological systems.

Example

The following is taken from Sornette's book.

Consider a random variable,

X

, that takes on values

xi

with probability

pi

. Furthermore, let’s assume for another parameter

ri

xi=

-\beta
r
i
for some fixed

\beta

. We then want to minimize

L=

N-1
\sum
i=0

pixi

subject to the constraint
N-1
\sum
i=0

ri=\kappa

Using Lagrange multipliers, this gives

pi\propto

-(1+1/\beta)
x
i

giving us a power law. The global optimization of minimizing the energy along with the power law dependence between

xi

and

ri

gives us a power law distribution in probability.

See also

References

  1. Carlson. null. Doyle. null. 2000-03-13. Highly optimized tolerance: robustness and design in complex systems. Physical Review Letters. 84. 11. 2529–2532. 10.1103/PhysRevLett.84.2529. 1079-7114. 11018927. 2000PhRvL..84.2529C.