Direct coupling analysis explained

Direct coupling analysis or DCA is an umbrella term comprising several methods for analyzing sequence data in computational biology.^[1] The common idea of these methods is to use statistical modeling to quantify the strength of the direct relationship between two positions of a biological sequence, excluding effects from other positions. This contrasts usual measures of correlation, which can be large even if there is no direct relationship between the positions (hence the name direct coupling analysis). Such a direct relationship can for example be the evolutionary pressure for two positions to maintain mutual compatibility in the biomolecular structure of the sequence, leading to molecular coevolution between the two positions.

DCA has been used in the inference of protein residue contacts,^{[2] [3] [4] [5]} RNA structure prediction,^{[6] [7]} the inference of protein-protein interaction networks,^{[8] [9] [10] [11] [12]} the modeling of fitness landscapes,^{[13] [14] [15]} the generation of novel function proteins,^[16] and the modeling of protein evolution.^{[17] [18]}

Mathematical Model and Inference

Mathematical Model

The basis of DCA is a statistical model for the variability within a set of phylogenetically related biological sequences. When fitted to a multiple sequence alignment (MSA) of sequences of length

N , the model defines a probability for all possible sequences of the same length. This probability can be interpreted as the probability that the sequence in question belongs to the same class of sequences as the ones in the MSA, for example the class of all protein sequences belonging to a specific protein family.

We denote a sequence by

a = (a _{1,a} _{2..,a} _{N)} , with the a _{i} being categorical variables representing the monomers of the sequence (if the sequences are for example aligned amino acid sequences of proteins of a protein family, the a _{i} take as values any of the 20 standard amino acids). The probability of a sequence within a model is then defined as\begin{align} P\left(a | J,h\right) = (1)/(Z) \exp{\left(\sum\limits ^{N -1} _{i =1} \sum\limits ^{N} _{j = i +1} J _{ij} (a _{i,a} _{j)} + \sum\limits ^{N} _{i =1} h _{i(a} _{i)\right)}, \end{align}}

where

J,h are sets of real numbers representing the parameters of the model (more below)Z is a normalization constant (a real number) to ensure \sum\limits _{a} P(a | J,h) = 1

The parameters

h _{i(a} _{i)} depend on one position i and the symbol a _{i} at this position. They are usually called fields and represent the propensity of symbol to be found at a certain position. The parameters J _{ij} (a _{i,a} _{j)} depend on pairs of positions i,j and the symbols a _{i,a} _{j,} at these positions. They are usually called couplings and represent an interaction, i.e. a term quantifying how compatible the symbols at both positions are with each other. The model is fully connected, so there are interactions between all pairs of positions. The model can be seen as a generalization of the Ising model, with spins not only taking two values, but any value from a given finite alphabet. In fact, when the size of the alphabet is 2, the model reduces to the Ising model. Since it is also reminiscent of the model of the same name, it is often called Potts model.^[19]

Even knowing the probabilities of all sequences does not determine the parameters

J,h uniquely. For example, a simple transformation of the parametersJ _{ij} (a,b) → J _{ij} (a,b) + R _{ij}

for any set of real numbers

R _{ij} leaves the probabilities the same. The likelihood function is invariant under such transformations as well, so the data cannot be used to fix these degrees of freedom (although a prior on the parameters might do so^[3]).

A convention often found in literature^{[3] [20]} is to fix these degrees of freedom such that the Frobenius norm of the coupling matrix

F _{ij} = \sqrt{\sum\limits _{a,b} J _{ij} (a,b) ^{2},}

is minimized (independently for every pair of positions

i and j ).

Maximum Entropy Derivation

To justify the Potts model, it is often noted that it can be derived following a maximum entropy principle:^[21] For a given set of sample covariances and frequencies, the Potts model represents the distribution with the maximal Shannon entropy of all distributions reproducing those covariances and frequencies. For a multiple sequence alignment, the sample covariances are defined as

C _{ij} (a,b) = f _{ij} (a,b) - f _{i(a)f} _{j(b)} ,

where

f _{ij} (a,b) is the frequency of finding symbols a and b at positions i and j in the same sequence in the MSA, and f _{i(a)} the frequency of finding symbol a at position i . The Potts model is then the unique distribution P that maximizes the functional\begin{align} F[P] = & - \sum\limits _{a} P(a) log P(a) \\ & + \sum\limits _{i<j} \sum\limits _{x,y} λ _{ij} (x,y) ( P _{ij} (x,y) - f _{ij} (x,y) ) \\ & + \sum\limits _{i} \sum\limits _{x} λ _{i} (x) ( P _{i(x)} - f _{i(x)} ) \\ & + \Omega \left( 1 - \sum\limits _{a} P(a)\right). \end{align}

The first term in the functional is the Shannon entropy of the distribution. The

λ are Lagrange multipliers to ensure P _{ij} (x,y) = f _{ij} (x,y) , with P _{ij} (x,y) being the marginal probability to find symbols x,y at positions i,j . The Lagrange multiplier \Omega ensures normalization. Maximizing this functional and identifying\begin{align} & λ _{ij} (x,y) = J _{ij} (x,y) \\ & λ _{i} (x) = h _{i(x)} \\ &\Omega = Z \\ \end{align}

leads to the Potts model above. This procedure only gives the functional form of the Potts model, while the numerical values of the Lagrange multipliers (identified with the parameters) still have to be determined by fitting the model to the data.

Direct Couplings and Indirect Correlation

The central point of DCA is to interpret the

J _{ij} (which can be represented as a q x q matrix if there are q possible symbols) as direct couplings. If two positions are under joint evolutionary pressure (for example to maintain a structural bond), one might expect these couplings to be large because only sequences with fitting pairs of symbols should have a significant probability. On the other hand, a large correlation between two positions does not necessarily mean that the couplings are large, since large couplings between e.g. positions i,j and j,k might lead to large correlations between positions i and k , mediated by position j . In fact, such indirect correlations have been implicated in the high false positive rate when inferring protein residue contacts using correlation measures like mutual information.^[22]

Inference

The inference of the Potts model on a multiple sequence alignment (MSA) using maximum likelihood estimation is usually computationally intractable, because one needs to calculate the normalization constant

Z , which is for sequence length N and q possible symbols a sum of q ^{N} terms (which means for example for a small protein domain family with 30 positions 20 ^{30} terms). Therefore, numerous approximations and alternatives have been developed:

• mpDCA^[23] (inference based on message passing/belief propagation)
• mfDCA^[1] (inference based on a mean-field approximation)
• gaussDCA^[20] (inference based on a Gaussian approximation)
• plmDCA^[3] (inference based on pseudo-likelihoods)
• Adaptive Cluster Expansion^[24]

All of these methods lead to some form of estimate for the set of parameters

J,{h} maximizing the likelihood of the MSA. Many of them include regularization or prior terms to ensure a well-posed problem or promote a sparse solution.

Applications

Protein Residue Contact Prediction

A possible interpretation of large values of couplings in a model fitted to a MSA of a protein family is the existence of conserved contacts between positions (residues) in the family. Such a contact can lead to molecular coevolution, since a mutation in one of the two residues, without a compensating mutation in the other residue, is likely to disrupt protein structure and negatively affect the fitness of the protein. Residue pairs for which there is a strong selective pressure to maintain mutual compatibility are therefore expected to mutate together or not at all. This idea (which was known in literature long before the conception of DCA^[25]) has been used to predict protein contact maps, for example analyzing the mutual information between protein residues.

Within the framework of DCA, a score for the strength of the direct interaction between a pair of residues

i,j is often defined^{[3] [20]} using the Frobenius norm F _{ij} of the corresponding coupling matrix J _{ij} and applying an average product correction (APC):F ^{APC} _{ij} = F _{ij} - (F _{i} F _{j})/(F) ,

where

F _{ij} has been defined above and\begin{align} &F _{i} = (1)/(N) \sum\limits ^{N} _{j ≠ i} F _{ij} \\ &F = (1)/(N ^{2-N}) \sum\limits ^{N} _{i,j, i ≠ j} F _{ij} \end{align} . This correction term was first introduced for mutual information^[26] and is used to remove biases of specific positions to produce large F _{ij} . Scores that are invariant under parameter transformations that do not affect the probabilities have also been used.^[1] Sorting all residue pairs by this score results in a list in which the top of the list is strongly enriched in residue contacts when compared to the protein contact map of a homologous protein.^[4] High-quality predictions of residue contacts are valuable as prior information in protein structure prediction.^[4]

Inference of protein-protein interaction

DCA can be used for detecting conserved interaction between protein families and for predicting which residue pairs form contacts in a protein complex. Such predictions can be used when generating structural models for these complexes,^[27] or when inferring protein-protein interaction networks made from more than two proteins.

Modeling of fitness landscapes

DCA can be used to model fitness landscapes and to predict the effect of a mutation in the amino acid sequence of a protein on its fitness.^[14]

External links

Online services:

• EVcouplings
• Gremlin
• DCA Webservice
• AmoAi
• ELIHKSIR

Source code:

• gplmDCA
• GaussDCA
• plmDCA

Useful applications:

• DCA-MOL: a PyMOL plugin to analyze DCA results on a structure^[28]

Notes and References

1. Morcos. F.. Pagnani. A.. Lunt. B.. Bertolino. A.. Marks. D. S.. Sander. C.. Zecchina. R.. Onuchic. J. N.. Hwa. T.. Weigt. M.. Direct-coupling analysis of residue coevolution captures native contacts across many protein families. Proceedings of the National Academy of Sciences. 21 November 2011. 108. 49. E1293–E1301. 10.1073/pnas.1111471108. 22106262. 3241805. 1110.5223. 2011PNAS..108E1293M. free.
2. Kamisetty. H.. Ovchinnikov. S.. Baker. D.. Assessing the utility of coevolution-based residue-residue contact predictions in a sequence- and structure-rich era. Proceedings of the National Academy of Sciences. 5 September 2013. 110. 39. 15674–15679. 10.1073/pnas.1314045110. 24009338. 3785744. 2013PNAS..11015674K. free.
3. Ekeberg. Magnus. Lövkvist. Cecilia. Lan. Yueheng. Weigt. Martin. Aurell. Erik. Improved contact prediction in proteins: Using pseudolikelihoods to infer Potts models. Physical Review E. 11 January 2013. 87. 1. 012707. 10.1103/PhysRevE.87.012707. 23410359. 1211.1281. 2013PhRvE..87a2707E. 27772365.
4. Marks. Debora S.. Colwell. Lucy J.. Sheridan. Robert. Hopf. Thomas A.. Pagnani. Andrea. Zecchina. Riccardo. Sander. Chris. Sali. Andrej. Protein 3D Structure Computed from Evolutionary Sequence Variation. PLOS ONE. 7 December 2011. 6. 12. e28766. 10.1371/journal.pone.0028766. 22163331. 3233603. 2011PLoSO...628766M. free.
5. Ekeberg . Magnus . Hartonen . Tuomo . Aurell . Erik . 2014-11-01 . Fast pseudolikelihood maximization for direct-coupling analysis of protein structure from many homologous amino-acid sequences . Journal of Computational Physics . en . 276 . 341–356 . 10.1016/j.jcp.2014.07.024 . 1401.4832 . 2014JCoPh.276..341E . 15635703 . 0021-9991.
6. De Leonardis. Eleonora. Lutz. Benjamin. Ratz. Sebastian. Cocco. Simona. Monasson. Rémi. Schug. Alexander. Weigt. Martin. Direct-Coupling Analysis of nucleotide coevolution facilitates RNA secondary and tertiary structure prediction. Nucleic Acids Research. 29 September 2015. 10444–55. 10.1093/nar/gkv932. 26420827. 4666395. 43. 21. 1510.03351.
7. Weinreb. Caleb. Riesselman. Adam J.. Ingraham. John B.. Gross. Torsten. Sander. Chris. Marks. Debora S.. 3D RNA and Functional Interactions from Evolutionary Couplings. Cell. May 2016. 165. 4. 963–975. 10.1016/j.cell.2016.03.030. 27087444. 5024353.
8. Ovchinnikov. Sergey. Kamisetty. Hetunandan. Baker. David. Robust and accurate prediction of residue–residue interactions across protein interfaces using evolutionary information. eLife. 1 May 2014. 3. e02030. 10.7554/eLife.02030. 24842992. 4034769 . free .
9. Feinauer. Christoph. Szurmant. Hendrik. Weigt. Martin. Pagnani. Andrea. Keskin. Ozlem. Inter-Protein Sequence Co-Evolution Predicts Known Physical Interactions in Bacterial Ribosomes and the Trp Operon. PLOS ONE. 16 February 2016. 11. 2. e0149166. 10.1371/journal.pone.0149166. 26882169. 4755613. 1512.05420. 2016PLoSO..1149166F. free.
10. dos Santos. R.N.. Morcos. F.. Jana. B.. Andricopulo. A.D.. Onuchic. J.N.. Dimeric interactions and complex formation using direct coevolutionary couplings.. Scientific Reports. 4 September 2015. 5. 13652. 10.1038/srep13652. 26338201. 4559900. 2015NatSR...513652D.
11. Uguzzoni . Guido . John Lovis . Shalini . Oteri . Francesco . Schug . Alexander . Szurmant . Hendrik . Weigt . Martin . 2017-03-28 . Large-scale identification of coevolution signals across homo-oligomeric protein interfaces by direct coupling analysis . Proceedings of the National Academy of Sciences . en . 114 . 13 . E2662–E2671 . 10.1073/pnas.1615068114 . 0027-8424 . 5380090 . 28289198. 1703.01246 . 2017PNAS..114E2662U . free .
12. Croce . Giancarlo . Gueudré . Thomas . Cuevas . Maria Virginia Ruiz . Keidel . Victoria . Figliuzzi . Matteo . Szurmant . Hendrik . Weigt . Martin . 2019-10-21 . A multi-scale coevolutionary approach to predict interactions between protein domains . PLOS Computational Biology . en . 15 . 10 . e1006891 . 10.1371/journal.pcbi.1006891 . 1553-7358 . 6822775 . 31634362 . 2019PLSCB..15E6891C . free .
13. Ferguson. Andrew L.. Mann. Jaclyn K.. Omarjee. Saleha. Ndung'u. Thumbi. Walker. Bruce D.. Chakraborty. Arup K.. Translating HIV Sequences into Quantitative Fitness Landscapes Predicts Viral Vulnerabilities for Rational Immunogen Design. Immunity. 38. 3. 606–617. 10.1016/j.immuni.2012.11.022. 3728823. 23521886. March 2013.
14. Figliuzzi. Matteo. Jacquier. Hervé. Schug. Alexander. Tenaillon. Oliver. Weigt. Martin. Coevolutionary Landscape Inference and the Context-Dependence of Mutations in Beta-Lactamase TEM-1. Molecular Biology and Evolution. January 2016. 33. 1. 268–280. 10.1093/molbev/msv211. 26446903. 4693977.
15. Asti. Lorenzo. Uguzzoni. Guido. Marcatili. Paolo. Pagnani. Andrea. Ofran. Yanay. Maximum-Entropy Models of Sequenced Immune Repertoires Predict Antigen-Antibody Affinity. PLOS Computational Biology. 13 April 2016. 12. 4. e1004870. 10.1371/journal.pcbi.1004870. 27074145. 4830580. 2016PLSCB..12E4870A . free .
16. Russ . William P. . Figliuzzi . Matteo . Stocker . Christian . Barrat-Charlaix . Pierre . Socolich . Michael . Kast . Peter . Hilvert . Donald . Monasson . Remi . Cocco . Simona . Weigt . Martin . Ranganathan . Rama . 2020-07-24 . An evolution-based model for designing chorismate mutase enzymes . Science . en . 369 . 6502 . 440–445 . 10.1126/science.aba3304 . 32703877 . 2020Sci...369..440R . 220714458 . 0036-8075.
17. Rodriguez-Rivas . Juan . Croce . Giancarlo . Muscat . Maureen . Weigt . Martin . 2022-01-25 . Epistatic models predict mutable sites in SARS-CoV-2 proteins and epitopes . Proceedings of the National Academy of Sciences . en . 119 . 4 . 10.1073/pnas.2113118119 . 0027-8424 . 8795541 . 35022216. 2112.10093 . 2022PNAS..11913118R .
18. Vigué . Lucile . Croce . Giancarlo . Petitjean . Marie . Ruppé . Etienne . Tenaillon . Olivier . Weigt . Martin . 2022-07-12 . Deciphering polymorphism in 61,157 Escherichia coli genomes via epistatic sequence landscapes . Nature Communications . en . 13 . 1 . 4030 . 10.1038/s41467-022-31643-3 . 35821377 . 9276797 . 2022NatCo..13.4030V . 2041-1723.
19. Feinauer. Christoph. Skwark. Marcin J.. Pagnani. Andrea. Aurell. Erik. Improving Contact Prediction along Three Dimensions. PLOS Computational Biology. 9 October 2014. 10. 10. e1003847. 10.1371/journal.pcbi.1003847. 25299132. 4191875. 1403.0379. 2014PLSCB..10E3847F . free .
20. Baldassi. Carlo. Zamparo. Marco. Feinauer. Christoph. Procaccini. Andrea. Zecchina. Riccardo. Weigt. Martin. Pagnani. Andrea. Fast and Accurate Multivariate Gaussian Modeling of Protein Families: Predicting Residue Contacts and Protein-Interaction Partners. PLOS ONE. 24 March 2014. 9. 3. e92721. 10.1371/journal.pone.0092721. 24663061. 3963956. 1404.1240. 2014PLoSO...992721B. free.
21. Stein. Richard R.. Marks. Debora S.. Sander. Chris. Chen. Shi-Jie. Inferring Pairwise Interactions from Biological Data Using Maximum-Entropy Probability Models. PLOS Computational Biology. 30 July 2015. 11. 7. e1004182. 10.1371/journal.pcbi.1004182. 26225866. 4520494. 2015PLSCB..11E4182S . free .
22. Burger. Lukas. van Nimwegen. Erik. Bourne. Philip E.. Disentangling Direct from Indirect Co-Evolution of Residues in Protein Alignments. PLOS Computational Biology. 1 January 2010. 6. 1. e1000633. 10.1371/journal.pcbi.1000633. 20052271. 2793430. 2010PLSCB...6E0633B . free .
23. Weigt. M.. White. R. A.. Szurmant. H.. Hoch. J. A.. Hwa. T.. Identification of direct residue contacts in protein-protein interaction by message passing. Proceedings of the National Academy of Sciences. 30 December 2008. 106. 1. 67–72. 10.1073/pnas.0805923106. 19116270. 2629192. 0901.1248. 2009PNAS..106...67W. free.
24. Barton. J. P.. De Leonardis. E.. Coucke. A.. Cocco. S.. ACE: adaptive cluster expansion for maximum entropy graphical model inference. Bioinformatics. 21 June 2016. 3089–3097. 10.1093/bioinformatics/btw328. 32. 20. 27329863. free.
25. Göbel. Ulrike. Sander. Chris. Schneider. Reinhard. Valencia. Alfonso. Correlated mutations and residue contacts in proteins. Proteins: Structure, Function, and Genetics. April 1994. 18. 4. 309–317. 10.1002/prot.340180402. 8208723. 14978727.
26. Dunn. S.D.. Wahl. L.M.. Gloor. G.B.. Mutual information without the influence of phylogeny or entropy dramatically improves residue contact prediction. Bioinformatics. 5 December 2007. 24. 3. 333–340. 10.1093/bioinformatics/btm604. 18057019. free.
27. Schug. A.. Weigt. M.. Onuchic. J. N.. Hwa. T.. Szurmant. H.. High-resolution protein complexes from integrating genomic information with molecular simulation. Proceedings of the National Academy of Sciences. 17 December 2009. 106. 52. 22124–22129. 10.1073/pnas.0912100106. 20018738. 2799721. 2009PNAS..10622124S. free.
28. Jarmolinska. Aleksandra I.. Zhou. Qin. Sulkowska. Joanna I.. Morcos. Faruck. DCA-MOL: A PyMOL Plugin To Analyze Direct Evolutionary Couplings. Journal of Chemical Information and Modeling. 11 January 2019. 59. 2. 625–629. 10.1021/acs.jcim.8b00690. 30632747. 58634008 .