{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T23:02:49Z","timestamp":1780614169033,"version":"3.54.1"},"reference-count":38,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T00:00:00Z","timestamp":1780617600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Genet."],"abstract":"<jats:sec>\n                    <jats:title>Objectives<\/jats:title>\n                    <jats:p>Inferring gene regulatory networks (GRNs) from expression profiles is essential for identifying critical genes within complex disease pathways. However, current machine learning-based GRN inference methods face two challenges. Unsupervised methods struggle to achieve satisfactory accuracy in inference, while supervised methods are limited by the scarcity of high-quality interaction labels. Further, existing models demonstrate significant shortcomings when it comes to transferring reasoning to other GRN task subtypes. These issues affect GRN inference and hinder the ability to discover new regulatory patterns.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Findings<\/jats:title>\n                    <jats:p>To address these challenges, we have developed SIGMA: a transformer-based framework that uses self-supervised learning to pretrain the encoder on expression profiles. This alleviates the need for high-quality labels. During pretraining, it converts gene expression pairs into non-overlapping patches, and randomly masks some of these patches. This forces the encoder to extract correlation representations from the unmasked patches without label guidance, enabling the decoder to reconstruct the masked patches while preserving their similarity. Experiments have demonstrated that the pretrained encoder can accurately infer GRNs and be used to infer other subtypes, thereby reducing reliance on labels. Benchmark tests on human and mouse datasets have shown that SIGMA outperforms state-of-the-art methods. When applied to breast cancer datasets, SIGMA produced predictions that were consistent with established networks and identified candidate interactions that were not present in the gold-standard networks. Further investigation and experimental validation of these relationships is warranted.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fgene.2026.1825728","type":"journal-article","created":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T22:10:24Z","timestamp":1780611024000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["SIGMA: self-supervised inference of gene networks via masked auto-encoding"],"prefix":"10.3389","volume":"17","author":[{"given":"Qian","family":"Wang","sequence":"first","affiliation":[{"name":"School of Medicine, Guangxi University","place":["Nanning, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ziyi","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Pulmonary and Critical Care Medicine, The First Affiliated Hospital of Guangxi Medical University","place":["Nanning, Guangxi, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nan-Qing","family":"Liao","sequence":"additional","affiliation":[{"name":"Department of Plastic Surgery and Burns, Affiliated Hospital of Zunyi Medical University","place":["Zunyi, China"]},{"name":"College of Life Science and Technology, Guangxi University","place":["Nanning, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shibin","family":"Yang","sequence":"additional","affiliation":[{"name":"Department of Gastrointestinal Surgery, The First Affiliated Hospital, Sun Yat-sen University","place":["Guangzhou, China"]},{"name":"Department of General Surgery, Guangxi Hospital Division of the First Affiliated Hospital of Sun Yat-sen University","place":["Nanning, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zehua","family":"He","sequence":"additional","affiliation":[{"name":"College of Life Science and Technology, Guangxi University","place":["Nanning, China"]},{"name":"Department of General Surgery, Guangxi Hospital Division of the First Affiliated Hospital of Sun Yat-sen University","place":["Nanning, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,6,5]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"1083","DOI":"10.1038\/nmeth.4463","article-title":"Scenic: single-cell regulatory network inference and clustering","volume":"14","author":"Aibar","year":"2017","journal-title":"Nat. Methods"},{"key":"B2","doi-asserted-by":"publisher","first-page":"1650","DOI":"10.1093\/bioinformatics\/btn250","article-title":"Ontologizer 2.0\u2014a multifunctional tool for go term enrichment analysis and data exploration","volume":"24","author":"Bauer","year":"2008","journal-title":"Bioinformatics"},{"key":"B3","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1007\/978-1-4939-8882-2_12","article-title":"Unsupervised grn ensemble","volume":"1883","author":"Bellot","year":"2019","journal-title":"Gene Regul. Netw. Methods Protoc."},{"key":"B4","first-page":"35","article-title":"Hydra attention: efficient attention with many heads","volume-title":"European conference on computer vision","author":"Bolya","year":"2022"},{"key":"B5","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1016\/j.cels.2017.08.014","article-title":"Gene regulatory network inference from single-cell data using multivariate information measures","volume":"5","author":"Chan","year":"2017","journal-title":"Cell Systems"},{"key":"B6","first-page":"15750","article-title":"Exploring simple siamese representation learning","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"Chen","year":"2021"},{"key":"B7","first-page":"9640","article-title":"An empirical study of training self-supervised vision transformers","volume-title":"Proceedings of the IEEE\/CVF international conference on computer vision","author":"Chen","year":"2021"},{"key":"B8","doi-asserted-by":"crossref","first-page":"498","DOI":"10.1145\/3773966.3778007","article-title":"Timemae: Self-supervised representations of time series with decoupled masked autoencoders","author":"Cheng","year":"2026","journal-title":"Proceedings of the Nineteenth ACM International Conference on Web Search and Data Mining"},{"key":"B9","doi-asserted-by":"crossref","first-page":"1724","DOI":"10.3115\/v1\/D14-1179","article-title":"Learning phrase representations using RNN encoder-decoder for statistical machine translation","author":"Cho","year":"2014","journal-title":"Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP)"},{"key":"B10","doi-asserted-by":"publisher","first-page":"D794","DOI":"10.1093\/nar\/gkx1081","article-title":"The encyclopedia of DNA elements (encode): data portal update","volume":"46","author":"Davis","year":"2018","journal-title":"Nucleic Acids Research"},{"key":"B11","first-page":"4171","article-title":"Bert: pre-training of deep bidirectional transformers for language understanding","volume":"1","author":"Devlin","year":"2019","journal-title":"Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies"},{"key":"B12","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1038\/nature11247","article-title":"An integrated encyclopedia of DNA elements in the human genome","volume":"489","year":"2012","journal-title":"Nature"},{"key":"B13","doi-asserted-by":"publisher","first-page":"1363","DOI":"10.1101\/gr.240663.118","article-title":"Benchmark and integration of resources for the estimation of human transcription factor activities","volume":"29","author":"Garcia-Alonso","year":"2019","journal-title":"Genome Research"},{"key":"B14","doi-asserted-by":"publisher","first-page":"11432","DOI":"10.1038\/srep11432","article-title":"Trrust: a reference database of human transcriptional regulatory interactions","volume":"5","author":"Han","year":"2015","journal-title":"Sci. Reports"},{"key":"B15","first-page":"9729","article-title":"Momentum contrast for unsupervised visual representation learning","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"He","year":"2020"},{"key":"B16","first-page":"16000","article-title":"Masked autoencoders are scalable vision learners","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"He","year":"2022"},{"key":"B17","doi-asserted-by":"crossref","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","author":"Hochreiter","year":"1997","journal-title":"Neural Comput. MIT-Press"},{"key":"B18","doi-asserted-by":"publisher","first-page":"e12776","DOI":"10.1371\/journal.pone.0012776","article-title":"Inferring regulatory networks from expression data using tree-based methods","volume":"5","author":"Huynh-Thu","year":"2010","journal-title":"PloS One"},{"key":"B19","doi-asserted-by":"publisher","first-page":"21342","DOI":"10.1038\/s41598-024-71864-8","article-title":"Inferring gene regulatory networks with graph convolutional network based on causal feature reconstruction","volume":"14","author":"Ji","year":"2024","journal-title":"Sci. Rep."},{"key":"B20","first-page":"27","volume-title":"Nucleic Acids Res","author":"Kanehisa","year":"2000"},{"key":"B21","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1038\/s41540-023-00312-6","article-title":"Gene regulatory network reconstruction: harnessing the power of single-cell multi-omic data","volume":"9","author":"Kim","year":"2023","journal-title":"NPJ Syst. Biol. Appl."},{"key":"B22","doi-asserted-by":"crossref","first-page":"1169","DOI":"10.26599\/BDMA.2024.9020034","article-title":"Transformer-based single-cell language model: A survey","volume":"7","author":"Lan","year":"","journal-title":"Big Data Min. Anal"},{"key":"B23","first-page":"373","article-title":"Single-cell multi-omics clustering algorithm based on adaptive weighted hyper-laplacian regularization","volume-title":"International symposium on bioinformatics research and applications","author":"Lan","year":""},{"key":"B24","first-page":"2112.13492","article-title":"Vision transformer for small-size datasets","author":"Lee","year":"2021","journal-title":"arXiv Preprint"},{"key":"B25","first-page":"1255","article-title":"Noise-resilient unsupervised graph representation learning via multi-hop feature quality estimation","author":"Li","year":"2024","journal-title":"Proceedings of the 33rd ACM International Conference on Information and Knowledge Management"},{"key":"B26","doi-asserted-by":"publisher","first-page":"bav095","DOI":"10.1093\/database\/bav095","article-title":"Regnetwork: an integrated database of transcriptional and post-transcriptional regulatory networks in human and mouse","volume":"2015","author":"Liu","year":"2015","journal-title":"Database"},{"key":"B27","doi-asserted-by":"publisher","first-page":"2159","DOI":"10.1093\/bioinformatics\/bty916","article-title":"Grnboost2 and arboreto: efficient and scalable inference of gene regulatory networks","volume":"35","author":"Moerman","year":"2019","journal-title":"Bioinformatics"},{"key":"B28","doi-asserted-by":"publisher","first-page":"e46255","DOI":"10.15252\/embr.201846255","article-title":"Ch ip-atlas: a data-mining suite powered by full integration of public ch ip-seq data","volume":"19","author":"Oki","year":"2018","journal-title":"EMBO Reports"},{"key":"B29","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1038\/s41592-019-0690-6","article-title":"Benchmarking algorithms for gene regulatory network inference from single-cell transcriptomic data","volume":"17","author":"Pratapa","year":"2020","journal-title":"Nat. Methods"},{"key":"B30","doi-asserted-by":"publisher","first-page":"491","DOI":"10.1038\/s43588-021-00099-8","article-title":"Modeling gene regulatory networks using neural network architectures","volume":"1","author":"Shu","year":"2021","journal-title":"Nat. Comput. Sci."},{"key":"B31","doi-asserted-by":"publisher","first-page":"D607","DOI":"10.1093\/nar\/gky1131","article-title":"String v11: protein\u2013protein association networks with increased coverage, supporting functional discovery in genome-wide experimental datasets","volume":"47","author":"Szklarczyk","year":"2019","journal-title":"Nucleic Acids Research"},{"key":"B32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41581-024-00849-7","article-title":"Gene regulatory networks in disease and ageing","volume":"20","author":"Unger Avila","year":"2024","journal-title":"Nat. Rev. Nephrol."},{"key":"B33","first-page":"30","article-title":"Attention is all you need","author":"Vaswani","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst"},{"key":"B34","doi-asserted-by":"publisher","first-page":"bat045","DOI":"10.1093\/database\/bat045","article-title":"Escape: database for integrating high-content published data collected from human and mouse embryonic stem cells","volume":"2013","author":"Xu","year":"2013","journal-title":"Database"},{"key":"B35","doi-asserted-by":"publisher","first-page":"btad165","DOI":"10.1093\/bioinformatics\/btad165","article-title":"Stgrns: an interpretable transformer-based method for inferring gene regulatory networks from single-cell transcriptomic data","volume":"39","author":"Xu","year":"2023","journal-title":"Bioinformatics"},{"key":"B36","doi-asserted-by":"publisher","first-page":"27151","DOI":"10.1073\/pnas.1911536116","article-title":"Deep learning for inferring gene relationships from single-cell expression data","volume":"116","author":"Yuan","year":"2019","journal-title":"Proc. Natl. Acad. Sci. U. S. A."},{"key":"B37","doi-asserted-by":"publisher","first-page":"bbab009","DOI":"10.1093\/bib\/bbab009","article-title":"A comprehensive overview and critical evaluation of gene regulatory network inference technologies","volume":"22","author":"Zhao","year":"2021","journal-title":"Briefings Bioinformatics"},{"key":"B38","doi-asserted-by":"publisher","first-page":"bbab568","DOI":"10.1093\/bib\/bbab568","article-title":"A hybrid deep learning framework for gene regulatory network inference from single-cell transcriptomic data","volume":"23","author":"Zhao","year":"2022","journal-title":"Briefings Bioinformatics"}],"container-title":["Frontiers in Genetics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fgene.2026.1825728\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T22:10:29Z","timestamp":1780611029000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fgene.2026.1825728\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,5]]},"references-count":38,"alternative-id":["10.3389\/fgene.2026.1825728"],"URL":"https:\/\/doi.org\/10.3389\/fgene.2026.1825728","relation":{},"ISSN":["1664-8021"],"issn-type":[{"value":"1664-8021","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,5]]},"article-number":"1825728"}}