Google matrix explained
A Google matrix is a particular stochastic matrix that is used by Google's PageRank algorithm. The matrix represents a graph with edges representing links between pages. The PageRank of each page can then be generated iteratively from the Google matrix using the power method. However, in order for the power method to converge, the matrix must be stochastic, irreducible and aperiodic.
Adjacency matrix A and Markov matrix S
In order to generate the Google matrix G, we must first generate an adjacency matrix A which represents the relations between pages or nodes.
Assuming there are N pages, we can fill out A by doing the following:
- A matrix element
is filled with 1 if node
has a link to node
, and 0 otherwise; this is the adjacency matrix of links.
- A related matrix S corresponding to the transitions in a Markov chain of given network is constructed from A by dividing the elements of column "j" by a number of
where
is the total number of outgoing links from node
j to all other nodes. The columns having zero matrix elements, corresponding to dangling nodes, are replaced by a constant value
1/N. Such a procedure adds a link from every sink, dangling state
to every other node.
- Now by the construction the sum of all elements in any column of matrix S is equal to unity. In this way the matrix S is mathematically well defined and it belongs to the class of Markov chains and the class of Perron-Frobenius operators. That makes S suitable for the PageRank algorithm.
Construction of Google matrix G
Then the final Google matrix G can be expressed via S as:
Gij=\alphaSij+(1-\alpha)
(1)
By the construction the sum of all non-negative elements inside each matrix column is equal to unity. The numerical coefficient
is known as a damping factor.
Usually S is a sparse matrix and for modern directed networks it has only about ten nonzero elements in a line or column, thus only about 10N multiplications are needed to multiply a vector by matrix G.[1] [2]
Examples of Google matrix
An example of the matrix
construction via Eq.(1) within a simple network is given in the article
CheiRank.
For the actual matrix, Google uses a damping factor
around 0.85.
[1] [2] [3] The term
gives a surfer probability to jump randomly on any page. The matrix
belongs to the class of
Perron-Frobenius operators of
Markov chains.
[1] The examples of Google matrix structure are shown in Fig.1 for Wikipedia articles hyperlink network in 2009 at small scale and in Fig.2 for University of Cambridge network in 2006 at large scale.
Spectrum and eigenstates of G matrix
For
there is only one maximal eigenvalue
with the corresponding right eigenvector which has non-negative elements
which can be viewed as stationary probability distribution.
[1] These probabilities ordered by their decreasing values give the PageRank vector
with the PageRank
used by Google search to rank webpages. Usually one has for the World Wide Web that
with
. The number of nodes with a given PageRank value scales as
with the exponent
.
[4] [5] The left eigenvector at
has constant matrix elements. With
all eigenvalues move as
except the maximal eigenvalue
, which remains unchanged.
[1] The PageRank vector varies with
but other eigenvectors with
remain unchanged due to their orthogonality to the constant left vector at
. The gap between
and other eigenvalue being
gives a rapid convergence of a random initial vector to the PageRank approximately after 50 multiplications on
matrix.
At
the matrix
has generally many degenerate eigenvalues
(see e.g. [6]). Examples of the eigenvalue spectrum of the Google matrix of various directed networks is shown in Fig.3 from and Fig.4 from.
The Google matrix can be also constructed for the Ulam networks generated by the Ulam method [8] for dynamical maps. The spectral properties of such matrices are discussed in [9,10,11,12,13,15]. In a number of cases the spectrum is described by the fractal Weyl law [10,12].
The Google matrix can be constructed also for other directed networks, e.g. for the procedure call network of the Linux Kernel software introduced in [15]. In this case the spectrum of
is described by the fractal Weyl law with the fractal dimension
(see Fig.5 from). Numerical analysis shows that the eigenstates of matrix
are localized (see Fig.6 from).
Arnoldi iteration method allows to compute many eigenvalues and eigenvectors for matrices of rather large size [13].
Other examples of
matrix include the Google matrix of brain [17]and business process management [18], see also. Applications of Google matrix analysis toDNA sequences is described in [20]. Such a Google matrix approach allows also to analyze entanglement of cultures via ranking of multilingual Wikipedia articles abouts persons [21]
Historical notes
The Google matrix with damping factor was described by Sergey Brin and Larry Page in 1998 [22], see also articles on PageRank history [23],[24].
See also
References
- Serra-Capizzano. Stefano. SIAM J. Matrix Anal. Appl.. 27 . 305. Jordan Canonical Form of the Google Matrix: a Potential Contribution to the PageRank Computation. 2005 . 2. 10.1137/s0895479804441407. 11383/1494937. free.
- Book: Ulam
, Stanislaw
. Interscience . New York . 73. A Collection of Mathematical Problems. Interscience Tracts in Pure and Applied Mathematics. 1960.
- Froyland G.. Padberg K.. Physica D. 238 . 1507. Almost-invariant sets and invariant manifolds—Connecting probabilistic and geometric descriptions of coherent structures in flows. 2009 . 16. 10.1016/j.physd.2009.03.002. 2009PhyD..238.1507F.
- Shepelyansky D.L.. Zhirov O.V.. Phys. Rev. E. 81 . 036213. Google matrix, dynamical attractors and Ulam networks. 2010 . 3. 10.1103/physreve.81.036213. 20365838. 0905.4162. 2010PhRvE..81c6213S. 15874766.
- Ermann L.. Shepelyansky D.L.. Phys. Rev. E . 81 . 036221. Google matrix and Ulam networks of intermittency maps. 2010 . 3. 10.1103/physreve.81.036221. 20365846. 0911.3823. 2010PhRvE..81c6221E. 388806.
- Ermann L.. Shepelyansky D.L.. Eur. Phys. J. B. 75 . Ulam method and fractal Weyl law for Perron-Frobenius operators. 2010 . 3. 299–304. 10.1140/epjb/e2010-00144-0. 0912.5083. 2010EPJB...75..299E. 54899977.
- Frahm K.M.. Shepelyansky D.L.. Eur. Phys. J. B. 76 . Ulam method for the Chirikov standard map. 2010 . 1. 57–68. 10.1140/epjb/e2010-00190-6. 1004.1349. 2010EPJB...76...57F. 55539783.
- Chepelianskii. Alexei D.. 1003.5455. Towards physical laws for software architecture. 2010. cs.SE.
- Shepelyansky D.L.. Zhirov O.V.. Phys. Lett. A. 374 . 3206. Towards Google matrix of brain. 2010 . 31–32. 10.1016/j.physleta.2010.06.007. 1002.4583. 2010PhLA..374.3206S.
- Abel M.. Shepelyansky D.L.. Eur. Phys. J. B. 84 . 4. 493. 1009.2631. Google matrix of business process management. 2011. 2011EPJB...84..493A. 10.1140/epjb/e2010-10710-y. 15510734.
- 10.1371/journal.pone.0061519. 23671568. 3650020. Google Matrix Analysis of DNA Sequences. PLOS ONE. 8. 5. e61519. 2013. Kandiah. Vivek. Shepelyansky. Dima L.. 1301.1626. 2013PLoSO...861519K. free.
- 10.1371/journal.pone.0074554. 24098338. 3789750. Highlighting Entanglement of Cultures via Ranking of Multilingual Wikipedia Articles. PLOS ONE. 8. 10. e74554. 2013. Eom. Young-Ho. Shepelyansky. Dima L.. 1306.6259. 2013PLoSO...874554E. free.
- Brin S.. Page L.. Computer Networks and ISDN Systems. 30 . 107. The anatomy of a large-scale hypertextual Web search engine. 1998 . 1–7. 10.1016/s0169-7552(98)00110-x. 7587743.
- 1002.2858. Massimo. Franceschet. PageRank: Standing on the shoulders of giants. cs.IR. 2010.
- Web site: Vigna . Sebastiano . Spectral Ranking . 2010.
External links
Notes and References
- Book: Langville . Amy N. . Amy Langville . Meyer . Carl . Google's PageRank and Beyond . . 2006 . 978-0-691-12202-1.
- Web site: Austin . David . AMS Feature Columns . How Google Finds Your Needle in the Web's Haystack . 2008.
- Web site: PageRank Lecture 12 . 2008-10-09 . Law . Edith .
- Donato . Debora . Laura . Luigi . Leonardi . Stefano . Millozzi . Stefano . European Physical Journal B . 38 . 2 . 239–243 . Large scale properties of the Webgraph . 2004-03-30 . 10.1140/epjb/e2004-00056-6 . 10.1.1.104.2136 . 2004EPJB...38..239D. 10640375 .
- Pandurangan . Gopal . Ranghavan . Prabhakar . Upfal . Eli . Internet Mathematics . 3 . 1 . 1–20 . Using PageRank to Characterize Web Structure . 2005 . 10.1080/15427951.2006.10129114. 101281 . free .