Barabási–Albert model explained

The Barabási–Albert (BA) model is an algorithm for generating random scale-free networks using a preferential attachment mechanism. Several natural and human-made systems, including the Internet, the World Wide Web, citation networks, and some social networks are thought to be approximately scale-free and certainly contain few nodes (called hubs) with unusually high degree as compared to the other nodes of the network. The BA model tries to explain the existence of such nodes in real networks. The algorithm is named for its inventors Albert-László Barabási and Réka Albert.

Concepts

Many observed networks (at least approximately) fall into the class of scale-free networks, meaning that they have power-law (or scale-free) degree distributions, while random graph models such as the Erdős–Rényi (ER) model and the Watts–Strogatz (WS) model do not exhibit power laws. The Barabási–Albert model is one of several proposed models that generate scale-free networks. It incorporates two important general concepts: growth and preferential attachment. Both growth and preferential attachment exist widely in real networks.

Growth means that the number of nodes in the network increases over time.

Preferential attachment means that the more connected a node is, the more likely it is to receive new links. Nodes with a higher degree have a stronger ability to grab links added to the network. Intuitively, the preferential attachment can be understood if we think in terms of social networks connecting people. Here a link from A to B means that person A "knows" or "is acquainted with" person B. Heavily linked nodes represent well-known people with lots of relations. When a newcomer enters the community, they are more likely to become acquainted with one of those more visible people rather than with a relative unknown. The BA model was proposed by assuming that in the World Wide Web, new pages link preferentially to hubs, i.e. very well known sites such as Google, rather than to pages that hardly anyone knows. If someone selects a new page to link to by randomly choosing an existing link, the probability of selecting a particular page would be proportional to its degree. The BA model claims that this explains the preferential attachment probability rule.

Later, the Bianconi–Barabási model works to address this issue by introducing a "fitness" parameter. Preferential attachment is an example of a positive feedback cycle where initially random variations (one node initially having more links or having started accumulating links earlier than another) are automatically reinforced, thus greatly magnifying differences. This is also sometimes called the Matthew effect, "the rich get richer". See also autocatalysis.

Algorithm

The only parameter in the BA model is

m

, a positive integer. The network initializes with a network of

m0\geqm

nodes.

At each step, add one new node, then sample

m

existing vertices from the network, with a probability that is proportional to the number of links that the existing nodes already have (The original papers did not specify how to handle cases where the same existing node is chosen multiple times.). Formally, the probability

pi

that the new node is connected to node

i

is[1]

pi=

ki
\sumjkj

,

where

ki

is the degree of node

i

and the sum is made over all pre-existing nodes

j

(i.e. the denominator results in twice the current number of edges in the network). This step can be performed by first uniformly sampling one edge, then sampling one of the two vertices on the edge.

Heavily linked nodes ("hubs") tend to quickly accumulate even more links, while nodes with only a few links are unlikely to be chosen as the destination for a new link. The new nodes have a "preference" to attach themselves to the already heavily linked nodes.

Properties

Degree distribution

The degree distribution resulting from the BA model is scale free, in particular, it is a power law of the form

P(k)\simk-3

Hirsch index distribution

The h-index or Hirsch index distribution was shown to also be scale free and was proposed as the lobby index, to be used as a centrality measure[2]

H(k)\simk-6

Furthermore, an analytic result for the density of nodes with h-index 1 can be obtained in the case where

m0=1

H(1)|
m0=1

=4-\pi

Node degree correlations

Correlations between the degrees of connected nodes develop spontaneously in the BA model because of the way the network evolves. The probability,

nk\ell

, of finding a link that connects a node of degree

k

to an ancestor node of degree

\ell

in the BA model for the special case of

m=1

(BA tree) is given by

nk\ell=

4\left(\ell-1\right)+
k\left(k+1\right)\left(k+\ell\right)\left(k+\ell+1\right)\left(k+\ell+2\right)
12\left(\ell-1\right)
k\left(k+\ell-1\right)\left(k+\ell\right)\left(k+\ell+1\right)\left(k+\ell+2\right)

.

This confirms the existence of degree correlations, because if the distributions were uncorrelated, we would get

nk\ell=k-3\ell-3

.[1]

For general

m

, the fraction of links who connect a node of degree

k

to a node of degree

\ell

is[3]

p(k,\ell)=

2m(m+1)
k(k+1)\ell(\ell+1)

\left[1-

\binom{2m+2
m+1

\binom{k+\ell-2m}{\ell-m}}{\binom{k+\ell+2}{\ell+1}}\right].

Also, the nearest-neighbor degree distribution

p(\ell\midk)

, that is, the degree distribution of the neighbors of a node with degree

k

, is given by[3]

p(\ell\midk)=

m(k+2)
k\ell(\ell+1)

\left[1-

\binom{2m+2
m+1

\binom{k+\ell-2m}{\ell-m}}{\binom{k+\ell+2}{\ell+1}}\right].

In other words, if we select a node with degree

k

, and then select one of its neighbors randomly, the probability that this randomly selected neighbor will have degree

\ell

is given by the expression

p(\ell|k)

above.

Clustering coefficient

An analytical result for the clustering coefficient of the BA model was obtained by Klemm and Eguíluz[4] and proven by Bollobás.[5] A mean-field approach to study the clustering coefficient was applied by Fronczak, Fronczak and Holyst.[6]

This behavior is still distinct from the behavior of small-world networks where clustering is independent of system size.In the case of hierarchical networks, clustering as a function of node degree also follows a power-law,

C(k)=k-1.

This result was obtained analytically by Dorogovtsev, Goltsev and Mendes.[7]

Spectral properties

The spectral density of BA model has a different shape from the semicircular spectral density of random graph. It has a triangle-like shape with the top lying well above the semicircle and edges decaying as a power law.[8] In [9] (Section 5.1), it was proved that the shape of this spectral density is not an exact triangular function by analyzing the moments of the spectral density as a function of the power-law exponent.

By definition, the BA model describes a time developing phenomenon and hence, besides its scale-free property, one could also look for its dynamic scaling property.In the BA network nodes can also be characterized by generalized degree

q

, the productof the square root of the birth time of each node and their corresponding degree

k

, insteadof the degree

k

alone since the time of birth matters in the BA network. We find that thegeneralized degree distribution

F(q,t)

has some non-trivial features and exhibits dynamic scaling

F(q,t)\simt-1/2\phi(q/t1/2).

It implies that the distinct plots of

F(q,t)

vs

q

would collapse into a universal curve if we plot

F(q,t)t1/2

vs

q/t1/2

.[10]

Limiting cases

Model A

Model A retains growth but does not include preferential attachment. The probability of a new node connecting to any pre-existing node is equal. The resulting degree distribution in this limit is geometric,[11] indicating that growth alone is not sufficient to produce a scale-free structure.

Model B

Model B retains preferential attachment but eliminates growth. The model begins with a fixed number of disconnected nodes and adds links, preferentially choosing high degree nodes as link destinations. Though the degree distribution early in the simulation looks scale-free, the distribution is not stable, and it eventually becomes nearly Gaussian as the network nears saturation. So preferential attachment alone is not sufficient to produce a scale-free structure.

The failure of models A and B to lead to a scale-free distribution indicates that growth and preferential attachment are needed simultaneously to reproduce the stationary power-law distribution observed in real networks.[1]

Non-linear preferential attachment

The BA model can be thought of as a specific case of the more general non-linear preferential attachment (NLPA) model.[12] The NLPA algorithm is identical to the BA model with the attachment probability replaced by the more general form

pi=

\alpha
k
i
\sum
\alpha
k
j
j

,

where

\alpha

is a constant positive exponent. If

\alpha=1

, NLPA reduces to the BA model and is referred to as "linear". If

0<\alpha<1

, NLPA is referred to as "sub-linear" and the degree distribution of the network tends to a stretched exponential distribution. If

\alpha>1

, NLPA is referred to as "super-linear" and a small number of nodes connect to almost all other nodes in the network. For both

\alpha<1

and

\alpha>1

, the scale-free property of the network is broken in the limit of infinite system size. However, if

\alpha

is only slightly larger than

1

, NLPA may result in degree distributions which appear to be transiently scale free.[13]

History

Preferential attachment made its first appearance in 1923 in the celebrated urn model of the Hungarian mathematician György Pólya in 1923.[14] The master equation method, which yields a more transparent derivation, was applied to the problem by Herbert A. Simon in 1955[15] in the course of studies of the sizes of cities and other phenomena. It was first applied to explain citation frequencies by Derek de Solla Price in 1976.[16] Price was interested in the accumulation of citations of scientific papers and the Price model used "cumulative advantage" (his name for preferential attachment) to generate a fat tailed distribution. In the language of modern citations network, Price's model produces a directed network, i.e. the version of the Barabási-Albert model. The name "preferential attachment" and the present popularity of scale-free network models is due to the work of Albert-László Barabási and Réka Albert, who discovered that a similar process is present in real networks, and applied in 1999 preferential attachment to explain the numerically observed degree distributions on the web.[17]

See also

External links

Notes and References

  1. Statistical mechanics of complex networks . Réka Albert . Réka . Albert . Albert-László Barabási . Albert-László . Barabási . . 74 . 47 . 47–97 . 2002 . 10.1103/RevModPhys.74.47 . 2002RvMP...74...47A . cond-mat/0106096 . dead . https://web.archive.org/web/20150824235818/http://www3.nd.edu/~networks/Publication%20Categories/03%20Journal%20Articles/Physics/StatisticalMechanics_Rev%20of%20Modern%20Physics%2074,%2047%20(2002).pdf . 2015-08-24. 10.1.1.242.4753 . 60545 .
  2. A. Korn . A. . Korn . A. Schubert . A. . Schubert . A. Telcs . A. . Telcs . Lobby index in networks . Physica A . 388 . 11 . 2221–2226 . 2009 . 10.1016/j.physa.2009.02.013 . 0809.0514 . 2009PhyA..388.2221K . 1119190 .
  3. Fotouhi. Babak. Rabbat. Michael. Degree correlation in scale-free graphs. The European Physical Journal B. 2013. 86. 12. 510. 10.1140/epjb/e2013-40920-6. 2013EPJB...86..510F. 1308.5169 . 7520124 .
  4. 10.1103/PhysRevE.65.057102. 12059755. Growing scale-free networks with small-world behavior. Physical Review E. 65. 5. 057102. 2002. Klemm . K. . Eguíluz . V. C. . cond-mat/0107607 . 2002PhRvE..65e7102K . 10261/15314. 12945422.
  5. Book: Bollobás . B. . Mathematical results on scale-free random graphs . Handbook of Graphs and Networks . 2003 . 1–37 . 10.1.1.176.6988.
  6. cond-mat/0306255. Fronczak. Agata. Mean-field theory for clustering coefficients in Barabasi-Albert networks. Phys. Rev. E . 68 . 4 . 046126. Fronczak. Piotr. Hołyst. Janusz A. 2003. 10.1103/PhysRevE.68.046126. 14683021. 2003PhRvE..68d6126F . 2372695 .
  7. S.N. . Dorogovtsev . A.V. . Goltsev . J.F.F. . Mendes . Pseudofractal scale-free web . . 65 . 6 . 066122 . 25 June 2002 . 10.1103/PhysRevE.65.066122 . 12188798 . cond-mat/0112143 . 2002PhRvE..65f6122D . 13996254 .
  8. I.J. . Farkas . I. . Derényi . A.-L. . Barabási . T. . Vicsek . Spectra of "real-world" graphs: Beyond the semicircle law . . 64 . 2 . 026704 . 20 July 2001 . 19 February 2001 . 10.1103/PhysRevE.64.026704 . 11497741 . cond-mat/0102335 . 2001PhRvE..64b6704F . 2047/d20000692 . 1434432 .
  9. V.M. . Preciado . A. . Rahimian . Moment-Based Spectral Analysis of Random Graphs with a Given Expected Degree Sequence . . 4 . 4 . 215–228 . December 2017 . 10.1109/TNSE.2017.2712064 . 12187100 . free . 1512.03489 .
  10. M. K. Hassan, M. Z. Hassan and N. I. Pavel, “Dynamic scaling, data-collapseand Self-similarity in Barabasi-Albert networks” J. Phys. A: Math. Theor. 44 175101 (2011) https://dx.doi.org/10.1088/1751-8113/44/17/175101
  11. Pekoz . Erol . A. . Rollin . N. . Ross . Total variation and local limit error bounds for geometric approximation . Bernoulli . 2012 . 2012-10-25 . 2015-09-23 . https://web.archive.org/web/20150923221310/http://www.e-publications.org/ims/submission/index.php/BEJ/user/submissionFile/10315?confirm=c40442a0 . live .
  12. Krapivsky . P. L. . Redner . S. . Leyvraz . F. . Connectivity of Growing Random Networks . Physical Review Letters . 20 November 2000 . 85 . 21 . 4629–4632 . 10.1103/PhysRevLett.85.4629. 11082613 . cond-mat/0005139 . 2000PhRvL..85.4629K . 16251662 .
  13. Krapivsky . Paul . Krioukov . Dmitri . Scale-free networks as preasymptotic regimes of superlinear preferential attachment . Physical Review E . 21 August 2008 . 78 . 2 . 026114 . 10.1103/PhysRevE.78.026114. 18850904 . 0804.1366 . 2008PhRvE..78b6114K . 14292535 .
  14. Albert-László Barabási . Albert-László . Barabási . Luck or reason . Nature . 489 . 7417 . 507–508 . 2012 . 10.1038/nature11486 . 22972190 . 205230706 .
  15. Herbert A. Simon . Herbert A. . Simon . On a Class of Skew Distribution Functions . . 42 . 3–4 . 425 - 440 . December 1955 . 10.1093/biomet/42.3-4.425.
  16. Derek J. de Solla Price . D.J. de Solla . Price. A general theory of bibliometric and other cumulative advantage processes . 10.1002/asi.4630270505 . . 27 . 5 . 292–306 . September 1976 . 10.1.1.161.114 . 8536863 .
  17. Emergence of scaling in random networks . Albert-László Barabási . Albert-László . Barabási . Réka Albert . Réka . Albert . . 286 . 509 - 512 . October 1999 . 10.1126/science.286.5439.509 . 5439 . 10521342 . cond-mat/9910332 . 1999Sci...286..509B . 524106 . dead . https://web.archive.org/web/20120417112354/http://www.nd.edu/~networks/Publication%20Categories/03%20Journal%20Articles/Physics/EmergenceRandom_Science%20286,%20509-512%20(1999).pdf . 2012-04-17.