Google matrix

Fig.1. Google matrix of Wikipedia articles network, written in the bases of PageRank index; fragment of top 200 X 200 matrix elements is shown, total size N=3282257 (from ^[1])

A Google matrix is a particular stochastic matrix that is used by Google's PageRank algorithm. The matrix represents a graph with edges representing links between pages. The rank of each page can be generated iteratively from the Google matrix using the power method. However, in order for the power method to converge, the matrix must be stochastic, irreducible and aperiodic.

Adjacency matrix A and Markov matrix S

In order to generate the Google matrix G, we must first generate an adjacency matrix A which represents the relations between pages or nodes.

Assuming there are N pages, we can fill out A by doing the following:

1. A matrix element $A_{{i,j}}$ is filled with 1 if node $j$ has a link to node $i$, and 0 otherwise; this is the adjacency matrix of links.
2. A related matrix S corresponding to the transitions in a Markov chain of given network is constructed from A by dividing the elements of column "j" by a number of $k_j$ where $k_j$ is the total number of outgoing links from node j to all other nodes. The columns having zero matrix elements, corresponding to dangling nodes, are replaced by a constant value 1/N. Such a procedure adds a link from every sink, dangling state $a$ to every other node.
3. Now by the construction the sum of all elements in any column of matrix S is equal to unity. In this way the matrix S is mathematically well defined and it belongs to the class of Markov chains and the class of Perron-Frobenius operators. That makes S suitable for the PageRank algorithm.

Construction of Google matrix G

Fig.2. Google matrix of Cambridge University network (2006), coarse-grained matrix elements are written in the bases of PageRank index, total size N=212710 is shown (from ^[1])

Then the final Google matrix G can be expressed via S as:

$G_{{ij}}=\alpha S_{{ij}}+(1-\alpha ){\frac {1}{N}}\;\;\;\;\;\;\;\;\;\;\;(1)$

By the construction the sum of all non-negative elements inside each matrix column is equal to unity. The numerical coefficient $\alpha$ is known as a damping factor.

Usually S is a sparse matrix and for modern directed networks it has only about ten nonzero elements in a line or column, thus only about 10N multiplications are needed to multiply a vector by matrix G.^[2][3]

Examples of Google matrix

An example of the matrix $S$ construction via Eq.(1) within a simple network is given in the article CheiRank.

For the actual matrix, Google uses a damping factor $\alpha$ around 0.85.^[2][3][4] The term $(1-\alpha)$ gives a surfer probability to jump randomly on any page. The matrix $G$ belongs to the class of Perron-Frobenius operators of Markov chains.^[2] The examples of Google matrix structure are shown in Fig.1 for Wikipedia articles hyperlink network in 2009 at small scale and in Fig.2 for University of Cambridge network in 2006 at large scale.

Spectrum and eigenstates of G matrix

Fig3. The spectrum of eigenvalues of the Google matrix of University of Cambridge from Fig.2 at $\alpha =1$, blue points show eigenvalues of isolated subspaces, red points show eigenvalues of core component (from ^[5])

For $0<\alpha <1$ there is only one maximal eigenvalue $\lambda =1$ with the corresponding right eigenvector which has non-negative elements $P_{i}$ which can be viewed as stationary probability distribution.^[2] These probabilities ordered by their decreasing values give the PageRank vector $P_{i}$ with the PageRank $K_{i}$ used by Google search to rank webpages. Usually one has for the World Wide Web that $P\propto 1/K^{{\beta }}$ with $\beta \approx 0.9$. The number of nodes with a given PageRank value scales as $N_{P}\propto 1/P^{\nu }$ with the exponent $\nu =1+1/\beta \approx 2.1$.^[6][7] The left eigenvector at $\lambda =1$ has constant matrix elements. With $0<\alpha$ all eigenvalues move as $\lambda _{i}\rightarrow \alpha \lambda _{i}$ except the maximal eigenvalue $\lambda =1$, which remains unchanged.^[2] The PageRank vector varies with $\alpha$ but other eigenvectors with $\lambda _{i}<1$ remain unchanged due to their orthogonality to the constant left vector at $\lambda =1$. The gap between $\lambda =1$ and other eigenvalue is $1-\alpha \approx 0.15$ gives a rapid convergence of a random initial vector to the PageRank approximately after 50 multiplications on $G$ matrix.

Fig4. Distribution of eigenvalues $\lambda _{i}$ of Google matrices in the complex plane at $\alpha =1$ for dictionary networks: Roget (A, N=1022), ODLIS (B, N=2909) and FOLDOC (C, N=13356); UK university WWW networks: University of Wales (Cardiff) (D, N=2778), Birmingham City University (E, N=10631), Keele University (Staffordshire) (F, N=11437), Nottingham Trent University (G, N=12660), Liverpool John Moores University (H, N=13578)(data for universities are for 2002) (from ^[8])

At $\alpha =1$ the matrix $G$ has generally many degenerate eigenvalues $\lambda =1$ (see e.g. [6]^[8]). Examples of the eigenvalue spectrum of the Google matrix of various directed networks is shown in Fig.3 from ^[5] and Fig.4 from.^[8]

The Google matrix can be also constructed for the Ulam networks generated by the Ulam method [8] for dynamical maps. The spectral properties of such matrices are discussed in [9,10,11,12,13,15].^[5][9] In a number of cases the spectrum is described by the fractal Weyl law [10,12].

Fig5. Distribution of eigenvalues $\lambda$ in the complex plane for the Google matrix $G$ of the Linux Kernel version 2.6.32 with matrix size $N=285509$ at $\alpha =0.85$, unit circle is shown by solid curve (from ^[9])

Fig.6 Coarse-grained probability distribution for the eigenstates of the Google matrix for Linux Kernel version 2.6.32. The horizontal lines show the first 64 eigenvectors ordered vertically by $|\lambda _{i}|$ (from ^[9])

The Google matrix can be constructed also for other directed networks, e.g. for the procedure call network of the Linux Kernel software introduced in [15]. In this case the spectrum of $\lambda$ is described by the fractal Weyl law with the fractal dimension $d\approx 1.3$ (see Fig.5 from ^[9]). Numerical analysis shows that the eigenstates of matrix $G$ are localized (see Fig.6 from ^[9]). Arnoldi iteration method allows to compute many eigenvalues and eigenvectors for matrices of rather large size [13].^[5][9]

Other examples of $G$ matrix include the Google matrix of brain [17] and business process management [18], see also.^[1] Applications of Google matrix analysis to DNA sequences is described in [20]. Such a Google matrix approach allows also to analyze entanglement of cultures via ranking of multilingual Wikipedia articles abouts persons [21]

Historical notes

The Google matrix with damping factor was described by Sergey Brin and Larry Page in 1998 [22], see also articles PageRank and [23],[24].

See also

• PageRank, CheiRank
• Arnoldi iteration
• Markov chain, Transfer operator, Perron–Frobenius theorem
• Web search engines

External links

• Google matrix at Scholarpedia

References

1. Ermann L.; Chepelianskii A.D; Shepelyansky D.L. (2011). "Towards two-dimensional search engines". arXiv:1106.6215.
2. Langville, Amity N; Meyer, Carl (2006). Google's PageRank and Beyond. Princeton University Press. ISBN 0-691-12202-4.
3. Austin, David (2008). "How Google Finds Your Needle in the Web's Haystack". AMS Feature Columns.
4. Law, Edith (2008-10-09). "PageRank Lecture 12" (PDF).
5. Frahm K.M.; Georgeot B.; Shepelyansky D.L. (2011-11-01). "Universal emergence of PageRank". Journal of Physics A: Mathematical and Theoretical. IOP Publishing Ltd. 44 (46): 465101. arXiv:1105.1062. doi:10.1088/1751-8113/44/46/465101.
6. Donato, Debora; Laura, Luigi; Leonardi, Stefano; Millozzi, Stefano (2004-03-30). "Large scale properties of the Webgraph" (PDF). The European Physical Journal B. Springer-Verlag. 38: 239–243. CiteSeerX 10.1.1.104.2136. doi:10.1140/epjb/e2004-00056-6.
7. Pandurangan, Gopal; Ranghavan, Prabhakar; Upfal, Eli (2005). "Using PageRank to Characterize Web Structure" (PDF). Internet Mathematics. pp. 1–20.
8. Georgeot Bertrand; Giraud Olivier; Shepelyansky Dima L. (2010-05-25). "Spectral properties of the Google matrix of the World Wide Web and other directed networks". Physical Review E. Statistical, nonlinear, and soft matter physics. p. 056109. doi:10.1103/PhysRevE.81.056109.
9. Ermann L.; Chepelianskii A.D.; Shepelyansky D.L. (2010-12-21). "Fractal Weyl law for Linux Kernel Architecture". The European Physical Journal B. Springer-Verlag. pp. 115–120. arXiv:1005.1395. doi:10.1140/epjb/e2010-10774-7.

• [6] Serra-Capizzano, Stefano (2005). "Jordan Canonical Form of the Google Matrix: a Potential Contribution to the PageRank Computation". SIAM J. Matrix. Anal. Appl. v.27, p.305.
• [8] Ulam, Stanislaw (1960). "A Collection of mathematical problems, Interscience tracs in pure and applied mathematics". Interscience, New York p.73.
• [9] Froyland G.; Padberg K. (2009). "Almost-invariant sets and invariant manifolds — Connecting probabilistic and geometric descriptions of coherent structures in flows". Physica D v.238, p.1507.
• [10] Shepelyansky D.L.; Zhirov O.V. (2010). "Google matrix, dynamical attractors and Ulam networks". Phys. Rev. E v.81, p.036213.
• [11] Ermann L.; Shepelyansky D.L. (2010). "Google matrix and Ulam networks of intermittency maps". Phys. Rev. E v.81, p.036221.
• [12] Ermann L.; Shepelyansky D.L. (2010). "Ulam method and fractal Weyl law for Perron-Frobenius operators". Eur. Phys. J. B v.75, p.299.
• [13] Frahm K.M.; Shepelyansky D.L. (2010). "Ulam method for the Chirikov standard map". Eur. Phys. J. B v.76, p.57.
• [15] Chepelianskii, Alexei D. (2010). "Towards physical laws for software architecture". arXiv:1003.5455.
• [17] Shepelyansky D.L.; Zhirov O.V. (2010). "Towards Google matrix of brain". Phys. Lett. A v.374, p.3206.
• [18] Abel M.; Shepelyansky D.L. (2011). "Google matrix of business process management". Eur. Phys. J. B v.84, p.493. arXiv:1009.2631.
• [20] Kandiah V.; Shepelyansky D.L. (2013). "Google matrix analysis of DNA sequences". PLOS ONE v.8(5): e61519.
• [21] Eom Y.-H.; Shepelyansky D.L. (2013). "Highlighting entanglement of cultures via ranking of multilingual Wikipedia articles". PLOS ONE v.8(10): e74554.
• [22] Brin S.; Page L. (1998). "The anatomy of a large-scale hypertextual Web search engine". Computer Networks and ISDN Systems v.30, p.107.
• [23] Franceschet, Massimo (2010). "PageRank: Standing on the shoulders of giants". arXiv:1002.2858.
• [24] Vigna, Sebastiano (2010). "Spectral Ranking" (PDF).