Redundancy principle (biology) explained

The redundancy principle in biology^{[1] [2] [3] [4] [5] [6] [7] [8] [9]} expresses the need of many copies of the same entity (cells, molecules, ions) to fulfill a biological function. Examples are numerous: disproportionate numbers of spermatozoa during fertilization compared to one egg, large number of neurotransmitters released during neuronal communication compared to the number of receptors, large numbers of released calcium ions during transient in cells, and many more in molecular and cellular transduction or gene activation and cell signaling. This redundancy is particularly relevant when the sites of activation are physically separated from the initial position of the molecular messengers. The redundancy is often generated for the purpose of resolving the time constraint of fast-activating pathways. It can be expressed in terms of the theory of extreme statistics to determine its laws and quantify how the shortest paths are selected. The main goal is to estimate these large numbers from physical principles and mathematical derivations.

When a large distance separates the source and the target (a small activation site), the redundancy principle explains that this geometrical gap can be compensated by large number. Had nature used less copies than normal, activation would have taken a much longer time, as finding a small target by chance is a rare event and falls into narrow escape problems.^[10]

Molecular rate

The time for the fastest particles to reach a target in the context of redundancy depends on the numbers and the local geometry of the target. In most of the time, it is the rate of activation. This rate should be used instead of the classical Smoluchowski's rate describing the mean arrival time, but not the fastest. The statistics of the minimal time to activation set kinetic laws in biology, which can be quite different from the ones associated to average times.

Physical models

Stochastic process

The motion of a particle located at position

X _{t} can be described by the Smoluchowski's limit of the Langevin equation:^{[11] [12]} dX _{t=\sqrt{2D}} dB _{t + (1)/(\gamma)} F(x)dt,

where

D is the diffusion coefficient of the particle, \gamma is the friction coefficient per unit of mass, F(x) the force per unit of mass, and B _{t} is a Brownian motion. This model is classically used in molecular dynamics simulations.

Jump processes

\begin{align} x _{n+1} = \begin{cases} x _{n-a,} & withprobability l(x _{n)} \ x _{n+b,} & withprobability r(x _{n)} \end{cases} \end{align} , which is for example a model of telomere length dynamics. Here r(x) = (1)/(1+ \beta x) , , with r(x) + l(x) =1 .^[13]

Directed motion process

• X = v _{0} \bf u, where \bf u is a unit vector chosen from a uniform distribution. Upon hitting an obstacle at a boundary point X _{0} \in \partial \Omega , the velocity changes to • X = v _{0} \bf v, where \bf v is chosen on the unit sphere in the supporting half space at X _{0} from a uniform distribution, independently of \bf u . This rectilinear with constant velocity is a simplified model of spermatozoon motion in a bounded domain \Omega . Other models can be diffusion on graph, active graph motion.^[14]

Mathematical formulation: Computing the rate of arrival time for the fastest

The mathematical analysis of large numbers of molecules, which are obviously redundant in the traditional activation theory, is used to compute the in vivo time scale of stochastic chemical reactions. The computation relies on asymptotics or probabilistic approaches to estimate the mean time of the fastest to reach a small target in various geometries.^{[15] [16] [17]}

With N non-interacting i.i.d. Brownian trajectories (ions) in a bounded domain Ω that bind at a site, the shortest arrival time is by definition

\tau ^{1} =min (t _{1,\ldots,t} _{N),} where t _{i} are the independent arrival times of the N ions in the medium. The survival distribution of arrival time of the fastest Pr(\tau ^{1} >t) is expressed in terms of a single particle, Pr(\tau ^{1} >t) = Pr ^{N(t} _{1 >t)} . Here Pr\{t _{1} >t \} is the survival probability of a single particle prior to binding at the target.This probability is computed from the solution of the diffusion equation in a domain \Omega :(\partial p(x,t))/(\partial t) = D \Delta p(x,t) \hbox { for } x \in \Omega, t> 0 \begin{align} p(x, 0 ) = &p _{0(x)} \hbox{ for } x \in \Omega \\ (\partial p)/(\partial n) (x,t) & =0 \hbox{ for } x \in \partial \Omega _{r\\ p(x,t)&=0} \hbox{ for } x \in \partial \Omega _{a, \end{align}}

where the boundary

\partial \Omega contains NR binding sites \partial \Omega _{i\subset\partial} \Omega (\partial \Omega _{a=cup\limits} ^{N _{R}} ^{i =1} \partial\Omega _{i, \partial\Omega} _{r=\partial\Omega-\partial\Omega} _{a} ). The single particle survival probability is\Pr\{t _{1} >t \} = \int\limits _{\Omega} p(x,t)dx, so that \Pr\{\tau ^{1} = t \} = (d)/(dt) \Pr\{\tau ^{1} <t \} = N(\Pr\{t _{1} >t \}) ^{N-1} \Pr\limits\{t _{1} = t \}, where\Pr\{t _{1} = t \} = {\oint _{\partial \Omega _{a}} } \frac\, dS_and \Pr\{t _{1} = t \} = N _{R} {\oint _{\partial \Omega _{1}} } \frac\,dS_ .

The probability density function (pdf) of the arrival time is

\Pr\{\tau ^{1} = t \} = N N _{R} \left[\int\limits _{\Omega} p(x,t)dx \right] ^{N-1} \oint\limits _{\partial \Omega _{1}} (\partial p(x,t))/(\partial n) dS _{x} , which gives the MFPT\bar{\tau} ^{1} = \int\limits\limits ^{inf ty} _{0} \Pr\{\tau ^{1} >t\} dt = \int\limits ^{inf ty} _{0} \left[ \Pr\{t _{1} >t\} \right] ^{N} dt. The probability \Pr\{t _{1} >t \} can be computed using short-time asymptotics of the diffusion equation as shown in the next sections.

Explicit computation in dimension 1

The short-time asymptotic of the diffusion equation is based on the ray method approximation. For an semi-interval

[ 0 , inf ty[ , the survival pdf is solution of\begin{align} (\partial (x,t))/(\partial t) & = D (\partial ^{2} p(x,t))/(\partial x ^{2}) for x> 0 , t> 0 \\ p(x, 0 )& = \delta(x - a) for x> 0 , p( 0 ,t) =0 for t> 0 , \end{align}

that is

p(x,t) = (1)/(\sqrt{ 4 D \pi t) }\left[\exp\left\{ - \frac{(x-a)^2}{4Dt}\right\}- \exp\left\{ - \frac{(x+a)^2}{4Dt}\right\}\right].

The survival probability with D=1 is

\Pr\{t _{1} >t \} = \int\limits\limits ^{inf ty} _{0} p(x,t)dx =1- (2)/(\sqrt{\pi) } \int\limits\limits_^e^\,du . To compute the MFPT, we expand the complementary error function(2)/(\sqrt{\pi) } \int\limits\limits_^e^\,du =\frac\left(1-\frac+O(x^)\right)\quad\mbox\ x\gg1, which gives\bar{\tau} ^{1} = \int\limits\limits ^{inf ty} _{0} \left[ \Pr\{t _{1} >t\} \right] ^{N} dt ≈ \int\limits\limits ^{inf ty} _{0} \exp\left\{ N ln \left( 1- (e ^{-(a/\sqrt{4t} ) ^{2})/() }\right)\right\}\, dt \approx \frac\int\limits\limits_0^ \exp \left\du ,

leading (the main contribution of the integral is near 0) to

\bar{\tau} ^{1} ≈ (a ^{2})/(4 D ln (N)/(\sqrt{\pi)) }\quad\mbox\ N\gg1.

This result is reminiscent of using the Gumbel's law. Similarly, escape from the interval [0,a] is computed from the infinite sum

p(x,t|y) = (1)/(\sqrt{ 4 D \pi t) }\sum\limits_^ \left[\exp \left\{ -\frac{(x-y+2na)^2}{4t} \right\} -\exp \left\{ -\frac{(x+y+2na)^2}{4t} \right\} \right] .The conditional survival probability is approximated by^[1] \Pr\{t _{1} >t|y \} = \int\limits\limits ^{a} _{0} p(x,t|y)dx ds\sim 1-max (2 \sqrt{t)/() }\left[\frac{e^{-y^2/4t}}{y},\frac{e^{-(a-y)^2/4t}}{a-y}\right] \quad\mbox\ t\to0 , where the maximum occurs at \delta = min[y,a-y] for 0<y<a (the shortest ray from y to the boundary). All other integrals can be computed explicitly, leading to\bar{\tau} ^{1} = \int\limits\limits ^{inf ty} _{0} \left[ \Pr\{t _{1} >t\} \right] ^{N} dt ≈ \int\limits\limits ^{inf ty} _{0} \exp\left\{ N ln \left( 1- (8 \sqrt{t)/() }e^\right) \right\}dt \approx \frac\quad\mbox\ N\gg1.

Arrival times of the fastest in higher dimensions

The arrival times of the fastest among many Brownian motions are expressed in terms of the shortest distance from the source S to the absorbing window A, measured by the distance

\delta _{min} = d(S,A), where d is the associated Euclidean distance. Interestingly, trajectories followed by the fastest are as close as possible from the optimal trajectories. In technical language, the associated trajectories of the fastest among N, concentrate near the optimal trajectory (shortest path) when the number N of particles increases. For a diffusion coefficient D and a window of size a, the expected first arrival times of N identically independent distributed Brownian particles initially positioned at the source S are expressed in the following asymptotic formulas :\bar\tau ^{d1} ≈ (\delta ^{2} _{min})/(4 D ln \left( (N)/(\sqrt{\pi)) \right)}, \hbox{in dim 1 , valid for} N \gg 1 ,

$\backslash bar\; \backslash tau^\; \backslash approx\; \backslash frac,\; \backslash hbox\; \backslash frac\backslash gg1,$

\bar\tau ^{d3} ≈ (\delta ^{2} _{min})/(4 D{ log \left(N (4 a ^{2})/(\right) \pi ^{1 / 2} \delta ^{2} _{min})) }, \hbox 3, \hbox \frac\gg1.

These formulas show that the expected arrival time of the fastest particle is in dimension 1 and 2, O(1/\log(N)). They should be used instead of the classical forward rate in models of activation in biochemical reactions. The method to derive formulas is based on short-time asymptotic and the Green's function representation of the Helmholtz equation. Note that other distributions could lead to other decays with respect N.

Optimal Paths

Minimizing The optimal path in large N

The optimal paths for the fastest can be found using the Wencell-Freidlin functional in the Large-deviation theory. These paths correspond to the short-time asymptotics of the diffusion equation from a source to a target. In general, the exact solution is hard to find, especially for a space containing various distribution of obstacles.

The Wiener integral representation of the pdf for a pure Brownian motion is obtained for a zero drift and diffusion tensor

\sigma = D constant, so that it is given by the probability of a sampled path until it exits at the small window \partial\Omega _{a} at the random time TPr\{ x _{N(t} _{1,M} )\in\Omega,{x} _{N(t} _{2,M} )\in\Omega, ... , x _{M(t)=x,} t\leq T\leq t + \Delta t |x( 0 ) = y\} = [\int\limits _{\Omega} … \int\limits\limits _{\Omega} \prod ^{M} _{j =1} (d{y)/(_{j}{\sqrt{(2\pi}) \Delta t) ^{n\det} {\sigma}(x)(t _{j-1,M} ))}} \exp \{ - (1)/(2 \Delta t) \left[{y} _{j-x(t} _{j-1,N} ) - {a}({x}(t _{j-1,N} ))\Delta t \right] ^{T{\sigma}} ^{-1} (x(t _{j-1,N} ))\left[{y} _{j-x(t} _{j-1,N} ) - {a}(x(t _{j-1,N} ))\Delta t \right]\}

where

\Delta t = t/M, t _{j,N} = j\Delta t, x(t _{0,N} ) = y \hbox{ and } {y} _{j=x(t} _{j,N} ) in the product and T is the exit time in the narrow absorbing window \partial\Omega _{a.} Finally,\langle\tau ^{(n)} \rangle = \int\limits\limits ^{inf ty} _{0} \exp \left\{ n log \int\limits _{\Omega} p(x,t|y)dx\right\} dt = \int ^{inf ty} _{0} \tau _{\sigma} Pr\{ \hbox{ Path }\sigma \in S _{n} (y), \tau _{\sigma} = t \} dt,

where

S _{n(y)} is the ensemble of shortest paths selected among n Brownian trajectories, starting at point y and exiting between time t and t+dt from the domain \Omega . The probabilityPr\{ \hbox{ Path }\sigma \in S _{n} \} is used to show that the empirical stochastic trajectories of S _{n} concentrate near the shortest paths starting from y and ending at the small absorbing window \partial \Omega _{a} , under the condition that \epsilon = (|\partial \Omega _{a|})/(|\partial\Omega|) \ll 1 .  The paths of S _{n(y)} can be approximated using discrete broken lines among a finite number of points and we denote the associated ensemble by \tilde S _{n(y)} .  Bayes' rule leads toPr\{ \hbox{ Path }\sigma \in \tilde S _{n(y)|} t<\tau _{\sigma} <t + dt \} = \sum ^{inf ty} _{m =0} Pr\{ \hbox{ Path }\sigma \in \tilde S _{n(y)|m,} t<\tau _{\sigma} <t + dt \}Pr\{ m steps \} where Pr\{ m steps \} = Pr\{ thepathsof \tilde S _{n(y)} exitinmsteps \} is the probability that a path of \tilde S _{n(y)}   exits in m-discrete time steps. A path made of broken lines (random walk with a time step\Delta t ) can be expressed using Wiener path-integral.  The probability of a Brownian path x(s) can be expressed in the limit of a path-integral with the functional:Pr\{ x(s)| s\in[ 0 ,t] \} ≈ \exp \left( - \int ^{t} _{0} | • x| ^{2ds} \right).

The Survival probability conditioned on starting at y is given by the Wiener representation:

S(t|x _{0)=} \int _{x\in} dx \int ^{x(t) = x} _{x( 0 )} { l D} (x)\exp \left( - \int ^{t} _{0} | • x| ^{2ds} \right),

where

{ l D} (x) is the limit Wiener measure: the exterior integral is taken over all end points x and the path integral is over all paths starting from x(0). When we consider n-independent paths (\sigma _{1,..\sigma} _{n)} (made of points with a time step \Delta t that exit in m-steps, the probability of such an event isPr \{ \sigma _{1,..\sigma} _{n} \in S _{n(y)|m,} \tau _{\sigma} = m \Delta t \} = \left(\int\limits _{y _{0=y}} … \int\limits _{{y} _{j} \in\Omega} \int\limits _{{y} _{n\in} \partial \Omega _{a}} (1)/(( 4 D\Delta t) ^{dm/2}) \prod ^{m} _{j =1} \exp \{ - (1)/(4 D\Delta t) \left[|{y} _{j-{y}} _{j-1} )| ^{2} \right] \} \right) ^{n} ≈ \left( (1)/(( 4 D\Delta t) ^{dm/2}) \right) ^{n\int} _{x} { l D} (x)\exp \{ - n\int\limits ^{m \Delta t} _{0} • x ^{2ds} \} .Indeed, when there are n paths of m steps, and the fastest one escapes in m-steps, they should all exit in m steps. Using the limit of path integral, we get heuristically the representationPr \{ \hbox{ Path }\sigma \in \tilde S _{n(y)|m,} \tau _{\sigma} = m \Delta t \} = \left(\int\limits _{{y} _{0=y}} … \int\limits _{{y} _{j} \in\Omega}\int\limits _{{y} _{n\in\partial\Omega} _{a}} (1)/(( 4 D\Delta t) ^{dm/2}) \prod ^{m} _{j =1} \exp ( - (1)/(4 D\Delta t) \left[|{y} _{j-{y}} _{j-1} )| ^{2} \right])\right) ^{n} ≈ \int dx \int ^{x(t) = x} _{x( 0 ) = y} {D} (x)\exp ( - n \int\limits ^{m \Delta t} _{0} • x ^{2ds} ) ,

where the integral is taken over all paths starting at y(0) and exiting at time

m\Delta t . This formula suggests that when n is large, only the paths that minimize the integrant will contribute. For large n, this formula suggests that paths that will contribute the most are the ones that will minimize the exponent, which allows selecting the paths for which the energy functional is minimal, that isE =min _{X\in l P _{t}} \int\limits ^{T} _{0} • x ^{2ds,}

where the integration is taken over the ensemble of regular paths

l P _{t} inside \Omega starting at y and exiting in \partial \Omega _{a} , defined asl P _{T=\{} P( 0 ) = y, P(T)\in \partial \Omega _{a} \hbox{ and } P(s) \in \Omega \hbox{ and } 0 \leq s\leq T\}.

This formal argument shows that the random paths associated to the fastest exit time are concentrated near the shortest paths. Indeed, the Euler-Lagrange equations for the extremal problem are the classical geodesics between y and a point in the narrow window

\partial \Omega _{a} .

Fastest escape from a cusp in two dimensions

The formula for the fastest escape can generalize to the case where the absorbing window is located in funnel cusp and the initial particles are distributed outside the cusp. The cusp has a size

\epsilon in the opening and a curvature R. The diffusion coefficient is D. The shortest arrival time, valid for large n is given by \tau ^{(n)} ≈ (\pi ^{2} R ^{3})/(4 \epsilon D ( (1- \cos(c\sqrt{\tilde \epsilon)/())) {\tilde\epsilon }) ^{2} log ( (2 n)/(\sqrt{\pi) })}. Here\tilde \epsilon = (\epsilon)/(R) and c is a constant that depends on the diameter of the domain. The time taken by the first arrivers is proportional to the reciprocal of the size of the narrow target \epsilon . This formula is derived for fixed geometry and large n and not in the opposite limit of large n and small epsilon.^[18]

Concluding remarks

How nature sets the disproportionate numbers of particles remain unclear, but can be found using the theory of diffusion. One example is the number of neurotransmitters around 2000 to 3000 released during synaptic transmission, that are set to compensate the low copy number of receptors, so the probability of activation is restored to one.^{[19] [20]}

In natural processes these large numbers should not be considered wasteful, but are necessary for generating the fastest possible response and make possible rare events that otherwise would never happen. This property is universal, ranging from the molecular scale to the population level.^[21]

Nature's strategy for optimizing the response time is not necessarily defined by the physics of the motion of an individual particle, but rather by the extreme statistics, that select the shortest paths. In addition, the search for a small activation site selects the particle to arrive first: although these trajectories are rare, they are the ones that set the time scale. We may need to reconsider our estimation toward numbers when punctioning nature in agreement with the redundant principle that quantifies the request to achieve the biological function.^[21]

References

1. Schuss . Z. . Basnayake . K. . Holcman . D. . Redundancy principle and the role of extreme statistics in molecular and cellular biology . Physics of Life Reviews . 1 March 2019 . 28 . 52–79 . 30691960 . 10.1016/j.plrev.2019.01.001 . 2019PhLRv..28...52S . free .
2. Basnayake . Kanishka . Holcman . David . Fastest among equals: a novel paradigm in biology . Physics of Life Reviews . March 2019 . 28 . 96–99 . 10.1016/j.plrev.2019.03.017 . 31151792 . free .
3. Sokolov . Igor M. . Extreme fluctuation dominance in biology: On the usefulness of wastefulness . Physics of Life Reviews . March 2019 . 28 . 88–91 . 10.1016/j.plrev.2019.03.003 . 30904271 . 85496733 .
4. Redner . S. . Meerson . B. . Redundancy, extreme statistics and geometrical optics of Brownian motion . Physics of Life Reviews . March 2019 . 28 . 80–82 . 10.1016/j.plrev.2019.01.020 . 30718199 . free .
5. Rusakov . Dmitri A. . Savtchenko . Leonid P. . Extreme statistics may govern avalanche-type biological reactions . Physics of Life Reviews . March 2019 . 28 . 85–87 . 10.1016/j.plrev.2019.02.001 . 30819590 . 73468286 .
6. Martyushev . Leonid M. . Minimal time, Weibull distribution and maximum entropy production principle . Physics of Life Reviews . March 2019 . 28 . 83–84 . 10.1016/j.plrev.2019.02.002 . 30824391 . 73471445 .
7. Coombs . Daniel . First among equals . Physics of Life Reviews . March 2019 . 28 . 92–93 . 10.1016/j.plrev.2019.03.002 . 30905554 . 85497459 .
8. Tamm . M.V. . Importance of extreme value statistics in biophysical contexts . Physics of Life Reviews . March 2019 . 28 . 94–95 . 10.1016/j.plrev.2019.03.001 . 30905557 . 85497848 .
9. Basnayake . Kanishka . Mazaud . David . Bemelmans . Alexis . Rouach . Nathalie . Korkotian . Eduard . Holcman . David . Polleux . Franck . Fast calcium transients in dendritic spines driven by extreme statistics . PLOS Biology . 4 June 2019 . 17 . 6 . e2006202 . 10.1371/journal.pbio.2006202 . 31163024 . 6548358 . free .
10. Book: Holcman, David, author.. Asymptotics of elliptic and parabolic PDEs : and their applications in statistical physics, computational neuroscience, and biophysics. 6 June 2018. Springer . 978-3-319-76894-6. 1022084107.
11. Book: Schuss . Zeev . Theory and Applications of Stochastic Differential Equations . 1980 . Wiley . 978-0-471-04394-2 .
12. Book: Schuss . Zeev . Theory and Applications of Stochastic Processes: An Analytical Approach . 2009 . Springer Science & Business Media . 978-1-4419-1605-1 .
13. Dao Duc . K. . Holcman . D. . Computing the Length of the Shortest Telomere in the Nucleus . Physical Review Letters . 27 November 2013 . 111 . 22 . 228104 . 10.1103/PhysRevLett.111.228104 . 24329474 . 2013PhRvL.111v8104D . 20471595 . https://web.archive.org/web/20200626015149/http://pdfs.semanticscholar.org/efc2/4d8ca1834184d68fac39c46c91a1fa2f0429.pdf . dead . 26 June 2020 .
14. Dora . Matteo . Holcman . David . Active unidirectional network flow generates a packet molecular transport in cells . October 2018 . 1810.07272 . 2018arXiv181007272D .
15. Yang . J. . Kupka . I. . Schuss . Z. . Holcman . D. . Search for a small egg by spermatozoa in restricted geometries . Journal of Mathematical Biology . 26 December 2015 . 73 . 2 . 423–446 . 10.1007/s00285-015-0955-3 . 26707857 . 4940446 . free .
16. Weiss . George H. . Shuler . Kurt E. . Lindenberg . Katja . Katja Lindenberg . Order statistics for first passage times in diffusion processes . Journal of Statistical Physics . May 1983 . 31 . 2 . 255–278 . 10.1007/BF01011582 . 1983JSP....31..255W . 121208316 .
17. Basnayake . K. . Hubl . A. . Schuss . Z. . Holcman . D. . Extreme Narrow Escape: Shortest paths for the first particles among n to reach a target window . Physics Letters A . December 2018 . 382 . 48 . 3449–3454 . 10.1016/j.physleta.2018.09.040 . 2018PhLA..382.3449B . 125796251 .
18. Basnayake . K. . Holcman . D. . Extreme escape from a cusp: When does geometry matter for the fastest Brownian particles moving in crowded cellular environments? . The Journal of Chemical Physics . 7 April 2020 . 152 . 13 . 134104 . 10.1063/5.0002030 . 32268749 . 1912.10142 . 209444822 .
19. Reingruber . Jürgen . Holcman . David . The Narrow Escape Problem in a Flat Cylindrical Microdomain with Application to Diffusion in the Synaptic Cleft . Multiscale Modeling & Simulation . April 2011 . 9 . 2 . 793–816 . 10.1137/100807612 . 1104.1090 . 10.1.1.703.3467 . 15907625 .
20. Book: Holcman . David . Schuss . Zeev . Stochastic Narrow Escape in Molecular and Cellular Biology: Analysis and Applications . 2015 . Springer . 978-1-4939-3103-3 .
21. Schuss. Z.. Basnayake. K.. Holcman. D.. March 2019. Redundancy principle and the role of extreme statistics in molecular and cellular biology. Physics of Life Reviews. 28. 52–79. 10.1016/j.plrev.2019.01.001. 30691960. 2019PhLRv..28...52S. 59341971 . 1571-0645.