Book chapter · 2022
Statistical Relational Learning for Genomics Applications: A State-of-the-Art Review
In Handbook of Machine Learning Applications for Genomics, Studies in Big Data, pp. 31–42, Springer Nature Singapore Pte Ltd. · Published
Summary
Biba and Vajjhala (2022) reviewed the literature on statistical relational learning (SRL) for genomics, where data are relational, noisy and incomplete, covering probabilistic graphical models, SRL approaches including probabilistic relational models, relational dependency networks and relational Markov networks, and their genomics applications, with 66 references. They present SRL as suited to genomics tasks from sequence annotation to genome-wide association studies (GWAS), and identify the computational complexity of inference, followed by graph size, as probably the main limitation shared by most SRL methods.
Practical implication. Statistical relational learning methods will be essential, the authors argue, to automatically annotate sequences and handle large genomic data sets.
- The Problem
- Genomics data are relational, noisy and incomplete, violating the independence assumptions of most machine learning methods.
- The Methodology
- State-of-the-art literature review (66 references) of probabilistic graphical models and statistical relational learning approaches — probabilistic relational models, relational dependency networks, relational Markov networks — and their genomics applications.
- The Core Finding
- The review shows that statistical relational learning — probabilistic relational models, relational dependency networks and relational Markov networks — suits genomics tasks from sequence annotation to GWAS, and identifies the computational complexity of inference, followed by graph size, as the main limitation shared by most methods.
- The Citation
- Biba, M., & Vajjhala, N. R. (2022). Statistical Relational Learning for Genomics Applications: A State-of-the-Art Review. In S. S. Roy & Y.-H. Taguchi (Eds.), Handbook of Machine Learning Applications for Genomics (pp. 31–42). Springer Nature Singapore Pte Ltd. https://doi.org/10.1007/978-981-16-9158-4_3
The summary, key findings, methods, implications and relevance notes on this page are this website’s own description of the chapter, written from the published abstract and text. The official abstract and citation details are given further down.
Key findings
- Finding 1. The chapter explains that statistical relational learning (SRL) combines statistical and probabilistic modeling with structured, relational data representations, making it suited to genomics data that violates the i.i.d. assumption of most machine learning methods.
- Finding 2. The review classifies SRL models into three categories — relational graphical models, latent class models and tensor factorization models — and describes approaches including probabilistic relational models, stochastic logic programs, Bayesian logic programs, relational dependency networks, relational Markov networks and Markov logic networks.
- Finding 3. Probabilistic relational models extend Bayesian networks to relational domains, remove the i.i.d. assumption and have been successfully evaluated on genomic data, according to the review.
- Finding 4. Relational dependency networks can exploit autocorrelation (for example, in the functions of co-located proteins in a cell) and give easy-to-interpret models, while relational Markov networks can represent arbitrary autocorrelation but are impractical because of inefficient parameter estimation.
- Finding 5. The review identifies computational complexity of inference as probably the most significant limitation shared by most SRL methods, followed by graph size proportional to the number of attributes and objects, which limits scalability on realistic genomic datasets.
- Finding 6. Genomics applications of SRL surveyed include annotating genomic sequence elements, modeling missing gene expression microarray values, using inductive logic programming to identify drought-resistant genes in plants, identifying plant disease resistance genes, genome-wide association studies and mining electronic health records for drug discovery.
- Finding 7. The chapter notes that genomics is expected to generate the largest amounts of data by 2025 and that Europe's Million Genomes project, launched in 2018, will create large genomic data sets for which SRL methods will be important.
Source: Biba & Vajjhala (2022), In Handbook of Machine Learning Applications for Genomics, Studies in Big Data, pp. 31–42, Springer Nature Singapore Pte Ltd. DOI: 10.1007/978-981-16-9158-4_3
The chapter in detail
What question does this chapter answer?
What statistical relational learning (SRL) models exist, and how can they be applied to the relational, noisy and incomplete data found in genomics?
What did the chapter find, in detail?
The chapter reviews the background of SRL (probabilistic graphical models, Bayesian networks, Markov networks) and the main SRL approaches — probabilistic relational models, relational dependency networks and relational Markov networks — and surveys their genomics applications such as annotating genomic sequence elements, handling missing microarray values, identifying drought- and disease-resistance genes in plants, GWAS and mining electronic health records. It identifies the computational complexity of inference, followed by graph size, as the most significant limitations shared by most SRL methods.
Why does it matter?
Genomic data is being generated faster than existing methods can analyze it, and annotating all sequences manually is unfeasible and costly, so the authors argue SRL methods will be essential to automatically annotate sequences and handle large genomic data sets. They expect demand for machine learning methods that can adapt to these big data sets to increase over the next decade.
Methods and data
| Research question | What is the state of the art in statistical relational learning for genomics? |
|---|---|
| Design | State-of-the-art literature review (book chapter) |
| Data | Published literature on probabilistic graphical models, SRL approaches and genomics applications (66 references) |
| Methods | Narrative review of background models, SRL approaches, and SRL problems and applications in genomics |
| Main result | SRL suits non-i.i.d. relational genomic data, but inference complexity and graph size limit scalability |
| Implication | SRL methods will be essential for handling and annotating large genomic data sets |
| Citation | Biba & Vajjhala (2022) · DOI 10.1007/978-981-16-9158-4_3 |
Definitions and key terms
- Statistical relational learning (SRL)
- An area of machine learning that combines statistical and probabilistic modeling with languages supporting structured data representations, learning from relational data where observations may be missing, partially observed and noisy. — as used in Biba & Vajjhala (2022)
- Bayesian network
- A directed probabilistic graphical model representing the joint probability distribution over a set of random variables as the product of each variable's probability given its parents. — as used in Biba & Vajjhala (2022)
- Independent and identically distributed (i.i.d.)
- A property of random variables that share the same probability distribution and are mutually independent — an assumption most relational data, including genomic data, violates. — as used in Biba & Vajjhala (2022)
Abstract
This paper aims to review the state-of-the-art statistical relational learning models (SRL) in genomics. SRL deals with machine learning and data mining in relational domains where observations may be missing, partially observed, and noisy. This chapter introduces a background overview of various models, including probabilistic graphical models, Bayesian networks, dependency networks, Markov networks, first-order logic, and probabilistic inductive logic programming. This chapter also discusses the various statistical relational learning approaches, including probabilistic relational models, stochastic logic programs, Bayesian logic programs, relational dependency networks, relational Markov networks, and Markov logic networks. Finally, the last part of the paper focuses on the practical application of statistical relational learning techniques in genomics. The chapter concludes with a discussion on the limitations of current methods.
Abstract as published in Handbook of Machine Learning Applications for Genomics.
Keywords: Genomic; Artificial intelligence; Machine learning; Probabilistic; Bayesian; Markov; Dependency; Genetics; Bioinformatics
Practical implications
- Statistical relational learning (SRL) methods will be essential for automatic sequence annotation, the authors argue, because annotating all sequences manually is unfeasible and costly.
- For most statistical relational learning methods, computational complexity of inference and graph size proportional to the number of attributes and objects limit scalability on realistic genomic datasets, according to the review.
- The review notes that relational dependency networks give easy-to-interpret models, while relational Markov networks can represent arbitrary autocorrelation but are impractical because of inefficient parameter estimation.
- Probabilistic relational models extend Bayesian networks to relational domains, remove the i.i.d. assumption and have been successfully evaluated on genomic data, according to the review.
Drawn from Biba & Vajjhala (2022), In Handbook of Machine Learning Applications for Genomics, Studies in Big Data, pp. 31–42, Springer Nature Singapore Pte Ltd.
When this research may be relevant
This chapter may be relevant to literature on statistical relational learning, probabilistic graphical models for non-i.i.d. biological data, machine learning in genomics and genome-wide association studies, and the scalability limits of relational inference on large graphs.
Research topics addressed: statistical relational learning; genomics; bioinformatics; machine learning; probabilistic graphical models; Bayesian networks; Markov networks; probabilistic relational models; relational dependency networks; relational Markov networks; Markov logic networks; non-i.i.d. data; genome-wide association studies; big data
How to cite
- APA 7
- Biba, M., & Vajjhala, N. R. (2022). Statistical Relational Learning for Genomics Applications: A State-of-the-Art Review. In S. S. Roy & Y.-H. Taguchi (Eds.), Handbook of Machine Learning Applications for Genomics (pp. 31–42). Springer Nature Singapore Pte Ltd. https://doi.org/10.1007/978-981-16-9158-4_3
- MLA 9
- Biba, Marenglen, and Narasimha Rao Vajjhala. “Statistical Relational Learning for Genomics Applications: A State-of-the-Art Review.” Handbook of Machine Learning Applications for Genomics, edited by S. S. Roy and Y.-H. Taguchi, Springer Nature Singapore Pte Ltd, 2022, pp. 31–42. https://doi.org/10.1007/978-981-16-9158-4_3.
- IEEE
- M. Biba and N. R. Vajjhala, “Statistical Relational Learning for Genomics Applications: A State-of-the-Art Review,” in Handbook of Machine Learning Applications for Genomics, S. S. Roy and Y.-H. Taguchi, Eds. Springer Nature Singapore Pte Ltd, 2022, pp. 31–42, doi: 10.1007/978-981-16-9158-4_3.
BibTeX
@incollection{biba2022statistical,
title = {Statistical Relational Learning for Genomics Applications: A State-of-the-Art Review},
author = {Biba, Marenglen and Vajjhala, Narasimha Rao},
booktitle = {Handbook of Machine Learning Applications for Genomics},
series = {Studies in Big Data},
editor = {Roy, S. S. and Taguchi, Y.-H.},
pages = {31--42},
year = {2022},
publisher = {Springer Nature Singapore Pte Ltd.},
doi = {10.1007/978-981-16-9158-4_3},
url = {https://doi.org/10.1007/978-981-16-9158-4_3}
}RIS
TY - CHAP TI - Statistical Relational Learning for Genomics Applications: A State-of-the-Art Review AU - Biba, Marenglen AU - Vajjhala, Narasimha Rao ED - Roy, S. S. ED - Taguchi, Y.-H. T2 - Handbook of Machine Learning Applications for Genomics T3 - Studies in Big Data PY - 2022 DA - 2022/06/24 VL - 103 SP - 31 EP - 42 PB - Springer Nature Singapore Pte Ltd. DO - 10.1007/978-981-16-9158-4_3 UR - https://www.narasimharao.net/research/statistical-relational-learning-genomics-review/ LA - en ER -
Links and files
- DOI: https://doi.org/10.1007/978-981-16-9158-4_3
- This page as text: https://www.narasimharao.net/research/statistical-relational-learning-genomics-review/paper.md
- Permanent address of this page: https://www.narasimharao.net/research/statistical-relational-learning-genomics-review/
Related research
Related publications
A comparison of 11 bit-parallel algorithms shows that bit-parallelism is versatile for biological sequence analysis but is limited mainly by the requirement that pattern length not exceed the computer word length.
The authors developed a bit-parallel structural matching (s-matching) algorithm that extends Shift-Or with encoding techniques for s-strings, solving exact s-matching on RNA secondary structure with assumed average-time optimality.
The chapter identifies seven technologies as imperative for digital business, explains each one’s applications, benefits and challenges, and shows how their interplay affects business strategy, operations and innovation.
Across 439 successful US government IT projects with 1,230 features, linear regression outperformed random forest and SVM in predicting project manager commitment tenure.
Supervised machine learning on 439 successful US government IT projects showed linear regression best predicted project manager commitment tenure (r² = 0.238), with line of business, experience, network collaboration tools and cross-industry team membership as the strongest features — supporting an association between higher commitment and project success.