{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:57:03Z","timestamp":1760241423493,"version":"build-2065373602"},"reference-count":59,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2018,2,27]],"date-time":"2018-02-27T00:00:00Z","timestamp":1519689600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"King Fahd University of Petroleum and Minerals, DSR","award":["JF141010"],"award-info":[{"award-number":["JF141010"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Data or signal separation is one of the critical areas of data analysis. In this work, the problem of non-negative data separation is considered. The problem can be briefly described as follows: given     X \u2208  R  m \u00d7 N      , find     A \u2208  R  m \u00d7 n       and     S \u2208  R  +   n \u00d7 N       such that     X = A S    . Specifically, the problem with sparse locally dominant sources is addressed in this work. Although the problem is well studied in the literature, a test to validate the locally dominant assumption is not yet available. In addition to that, the typical approaches available in the literature sequentially extract the elements of the mixing matrix. In this work, a mathematical modeling-based approach is presented that can simultaneously validate the assumption, and separate the given mixture data. In addition to that, a correntropy-based measure is proposed to reduce the model size. The approach presented in this paper is suitable for big data separation. Numerical experiments are conducted to illustrate the performance and validity of the proposed approach.<\/jats:p>","DOI":"10.3390\/e20030150","type":"journal-article","created":{"date-parts":[[2018,2,27]],"date-time":"2018-02-27T14:18:08Z","timestamp":1519741088000},"page":"150","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Big Data Blind Separation"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3862-2935","authenticated-orcid":false,"given":"Mujahid","family":"Syed","sequence":"first","affiliation":[{"name":"Department of Systems Engineering, King Fahd University of Petroleum & Minerals, Dhahran 31261, Saudi Arabia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,2,27]]},"reference":[{"key":"ref_1","unstructured":"Joho, M., Mathis, H., and Lambert, R.H. (2000, January 19\u201322). Overdetermined blind source separation: Using more sensors than source signals in a noisy mixture. Proceedings of the Independent Component Analysis and Blind Signal Separation, Helsinki, Finlan."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"071632","DOI":"10.1155\/ASP\/2006\/71632","article-title":"Geometrical interpretation of the PCA subspace approach for overdetermined blind source separation","volume":"2006","author":"Winter","year":"2006","journal-title":"EURASIP J. Adv. Signal Process."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2353","DOI":"10.1016\/S0165-1684(01)00120-7","article-title":"Underdetermined blind source separation using sparse representations","volume":"81","author":"Bofill","year":"2001","journal-title":"Signal Process."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"3102","DOI":"10.1109\/TNNLS.2016.2610960","article-title":"Underdetermined blind source separation using sparse coding","volume":"28","author":"Zhen","year":"2017","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_5","unstructured":"Herault, J., Jutten, C., and Ans, B. (1985). Detection de Grandeurs Primitives dans un Message Composite par une Architecture de Calcul Neuromimetique en Apprentissage Non Supervise. 1985\u2014GRETSI\u2014Actes de Colloques, Groupe d\u2019Etudes du Traitement du Signal et des Images."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"386","DOI":"10.1016\/j.cor.2012.12.002","article-title":"A hierarchical approach for sparse source blind signal separation problem","volume":"41","author":"Syed","year":"2012","journal-title":"Comput. Oper. Res."},{"key":"ref_7","unstructured":"Hyv\u00e4rinen, A., Karhunen, J., and Oja, E. (2004). Independent Component Analysis, John Wiley & Sons."},{"key":"ref_8","unstructured":"Amari, S.I., Cichocki, A., and Yang, H.H. (December, January 27). A new learning algorithm for blind signal separation. Proceedings of the 8th International Conference on Neural Information Processing Systems, Denver, CO, USA."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1016\/0165-1684(94)90029-9","article-title":"Independent component analysis, a new concept?","volume":"36","author":"Comon","year":"1994","journal-title":"Signal Process."},{"key":"ref_10","unstructured":"Hyv\u00e4rinen, A. (1998, January 1\u20136). New approximations of differential entropy for independent component analysis and projection pursuit. Proceedings of the 1997 Conference on Advances in Neural Information Processing Systems, Denver, CO, USA."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1129","DOI":"10.1162\/neco.1995.7.6.1129","article-title":"An information-maximization approach to blind separation and blind deconvolution","volume":"7","author":"Bell","year":"1995","journal-title":"Neural Comput."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"715","DOI":"10.1109\/JBHI.2016.2532354","article-title":"Driver fatigue classification with independent component by entropy rate bound minimization analysis in an EEG-based system","volume":"21","author":"Chai","year":"2017","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1689","DOI":"10.1109\/JBHI.2014.2340397","article-title":"Dependence independence measure for posterior and anterior EMG sensors used in simple and complex finger flexion movements: Evaluation using SDICA","volume":"19","author":"Naik","year":"2015","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"837","DOI":"10.1109\/TNSRE.2015.2478138","article-title":"Transradial amputee gesture classification using an optimal number of sEMG sensors: An approach using ICA clustering","volume":"24","author":"Naik","year":"2016","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"288","DOI":"10.1016\/j.brainres.2016.12.017","article-title":"Increase of posterior connectivity in aging within the Ventral Attention Network: A functional connectivity analysis using independent component analysis","volume":"1657","author":"Deslauriers","year":"2017","journal-title":"Brain Res."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"O\u2019Muircheartaigh, J., and Jbabdi, S. (2017). Concurrent white matter bundles and grey matter networks using independent component analysis. NeuroImage.","DOI":"10.1016\/j.neuroimage.2017.05.012"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1364","DOI":"10.1002\/aur.1787","article-title":"Latent constructs underlying sensory subtypes in children with autism: A preliminary study","volume":"10","author":"Hand","year":"2017","journal-title":"Autism Res."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"704","DOI":"10.1016\/j.energy.2017.03.129","article-title":"AGC performance enrichment of multi-source hydrothermal gas power systems using new optimized FOFPID controller and redox flow batteries","volume":"127","author":"Arya","year":"2017","journal-title":"Energy"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Al-Ali, A.K.H., Senadji, B., and Naik, G.R. (2017, January 12\u201314). Enhanced forensic speaker verification using multi-run ICA in the presence of environmental noise and reverberation conditions. Proceedings of the 2017 IEEE International Conference on Signal and Image Processing Applications (ICSIPA), Kuching, Malaysia.","DOI":"10.1109\/ICSIPA.2017.8120601"},{"key":"ref_20","unstructured":"Comon, P., and Jutten, C. (2010). Handbook of Blind Source Separation: Independent Component Analysis and Applications, Academic Press."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1109\/TGRS.2004.839806","article-title":"Does independent component analysis play a role in unmixing hyperspectral data?","volume":"43","author":"Nascimento","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1007\/s10559-015-9701-5","article-title":"Robust Physiological Mappings: From Non-Invasive to Invasive","volume":"1","author":"Syed","year":"2015","journal-title":"Cybern. Syst. Anal."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Georgiev, P., Theis, F., Cichocki, A., and Bakardjian, H. (2007). Sparse component analysis: A new tool for data mining. Data Mining Biomedicine, Springer.","DOI":"10.1007\/978-0-387-69319-4_6"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1711","DOI":"10.1016\/j.sigpro.2005.03.006","article-title":"Blind source separation of positive and partially correlated data","volume":"85","author":"Naanaa","year":"2005","journal-title":"Signal Process."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"5120","DOI":"10.1109\/TSP.2008.928937","article-title":"A convex analysis framework for blind separation of non-negative sources","volume":"56","author":"Chan","year":"2008","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"4418","DOI":"10.1109\/TSP.2009.2025802","article-title":"A convex analysis-based minimum-volume enclosing simplex algorithm for hyperspectral unmixing","volume":"57","author":"Chan","year":"2009","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_27","unstructured":"Syed, M.N., Georgiev, P.G., and Pardalos, P.M. (2015). Blind Signal Separation Methods in Computational Neuroscience. Modern Electroencephalographic Assessment Techniques: Theory and Applications, Humana Press."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1109\/MSP.2013.2279731","article-title":"A signal processing perspective on hyperspectral unmixing: Insights from remote sensing","volume":"31","author":"Ma","year":"2014","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1109\/JSTARS.2012.2194696","article-title":"Hyperspectral unmixing overview: Geometrical, statistical, and sparse regression-based approaches","volume":"5","author":"Plaza","year":"2012","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1007\/s11760-014-0696-6","article-title":"A geometric blind source separation method based on facet component analysis","volume":"10","author":"Yin","year":"2016","journal-title":"Signal Image Video Process."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1946","DOI":"10.1109\/TSP.2015.2508778","article-title":"A Fast Hyperplane-Based Minimum-Volume Enclosing Simplex Algorithm for Blind Hyperspectral Unmixing","volume":"64","author":"Lin","year":"2016","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"6431","DOI":"10.1109\/TGRS.2017.2728104","article-title":"Robust Minimum Volume Simplex Analysis for Hyperspectral Unmixing","volume":"55","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1016\/j.sigpro.2016.07.016","article-title":"Extreme direction analysis for blind separation of nonnegative signals","volume":"130","author":"Naanaa","year":"2017","journal-title":"Signal Process."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1838","DOI":"10.1016\/j.sigpro.2011.02.007","article-title":"Postprocessing and sparse blind source separation of positive and partially overlapped data","volume":"91","author":"Sun","year":"2011","journal-title":"Signal Process."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1016\/j.laa.2005.06.035","article-title":"On the uniqueness of overcomplete dictionaries, and a practical way to retrieve them","volume":"416","author":"Aharon","year":"2006","journal-title":"Linear Algebra Appl."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Georgiev, P., Theis, F., and Ralescu, A. (2007). Identifiability conditions and subspace clustering in sparse BSS. Independent Component Analysis and Signal Separation, Springer.","DOI":"10.1007\/978-3-540-74494-8_45"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"3890","DOI":"10.1109\/TIP.2016.2579259","article-title":"Blind hyperspectral unmixing using an Extended Linear Mixing Model to address spectral variability","volume":"25","author":"Drumetz","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/j.jsv.2015.10.028","article-title":"Underdetermined blind modal identification of structures by earthquake and ambient vibration measurements via sparse component analysis","volume":"366","author":"Amini","year":"2016","journal-title":"J. Sound Vib."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"3523","DOI":"10.1109\/TIT.2010.2048466","article-title":"Dictionary Identification\u2014Sparse Matrix-Factorization via l1-Minimization","volume":"56","author":"Gribonval","year":"2010","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1162\/089976603762552951","article-title":"Dictionary learning algorithms for sparse representation","volume":"15","author":"Murray","year":"2003","journal-title":"Neural Comput."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Nascimento, J.M., and Bioucas-Dias, J.M. (2007, January 18\u201320). Blind hyperspectral unmixing. Proceedings of the SPIE Conference on Image and Signal Processing for Remote Sensing XIII, Florence, Italy.","DOI":"10.1117\/12.738158"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1109\/MSP.2013.2296099","article-title":"Source separation in chemical analysis: Recent achievements and perspectives","volume":"31","author":"Duarte","year":"2014","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"886","DOI":"10.1137\/110827223","article-title":"Nonnegative Sparse Blind Source Separation for NMR Spectroscopy by Data Clustering, Model Reduction, and \u21131 Minimization","volume":"5","author":"Sun","year":"2012","journal-title":"SIAM J. Imag. Sci."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Winter, M.E. (1999, January 19\u201321). N-FINDR: An algorithm for fast autonomous spectral end-member determination in hyperspectral data. Proceedings of the Imaging Spectrometry V, Denver, CO, USA.","DOI":"10.1117\/12.366289"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"898","DOI":"10.1109\/TGRS.2005.844293","article-title":"Vertex component analysis: A fast algorithm to unmix hyperspectral data","volume":"43","author":"Nascimento","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"2187","DOI":"10.1109\/TSP.2006.872524","article-title":"Generalized correlation function: Definition, properties, and application to blind equalization","volume":"54","author":"Santamaria","year":"2006","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"5286","DOI":"10.1109\/TSP.2007.896065","article-title":"Correntropy: Properties and applications in non-Gaussian signal processing","volume":"55","author":"Liu","year":"2007","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Singh, A., and Principe, J.C. (2009, January 14\u201319). Using correntropy as a cost function in linear adaptive filters. Proceedings of the 2009 International Joint Conference on Neural Networks, Atlanta, GA, USA.","DOI":"10.1109\/IJCNN.2009.5178823"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Zhao, S., Chen, B., and Principe, J.C. (August, January 31). Kernel adaptive filtering with maximum correntropy criterion. Proceedings of the 2011 International Joint Conference on Neural Networks, San Jose, CA, USA.","DOI":"10.1109\/IJCNN.2011.6033473"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"880","DOI":"10.1109\/LSP.2014.2319308","article-title":"Steady-state mean-square error analysis for adaptive filtering under the maximum correntropy criterion","volume":"21","author":"Chen","year":"2014","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"3376","DOI":"10.1109\/TSP.2016.2539127","article-title":"Generalized correntropy for robust adaptive filtering","volume":"64","author":"Chen","year":"2016","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.automatica.2016.10.004","article-title":"Maximum correntropy Kalman filter","volume":"76","author":"Chen","year":"2017","journal-title":"Automatica"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"823","DOI":"10.1007\/s11590-013-0626-5","article-title":"On the optimization properties of the correntropic loss function in data analysis","volume":"8","author":"Syed","year":"2014","journal-title":"Optim. Lett."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Kuhn, H.W. (2010). The hungarian metRhod for the assignment problem. 50 Years of Integer Programming 1958\u20132008, Springer.","DOI":"10.1007\/978-3-540-68279-0_2"},{"key":"ref_55","unstructured":"Cplex, I. (2011). User-Manual CPLEX, IBM Software Group."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Li, J., and Bioucas-Dias, J.M. (2008, January 7\u201311). Minimum volume simplex analysis: A fast algorithm to unmix hyperspectral data. Proceedings of the 2008 IEEE International Geoscience and Remote Sensing Symposium, Boston, MA, USA.","DOI":"10.1109\/IGARSS.2008.4779330"},{"key":"ref_57","unstructured":"Terlaky, T. (2013). Interior Point Methods of Mathematical Programming, Springer Science & Business Media."},{"key":"ref_58","unstructured":"Dantzig, G.B., and Thapa, M.N. (2006). Linear Programming 2: Theory and Extensions, Springer Science & Business Media."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1007\/BF01586000","article-title":"Presolving in linear programming","volume":"71","author":"Andersen","year":"1995","journal-title":"Math. Program."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/20\/3\/150\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T14:56:36Z","timestamp":1760194596000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/20\/3\/150"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,2,27]]},"references-count":59,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2018,3]]}},"alternative-id":["e20030150"],"URL":"https:\/\/doi.org\/10.3390\/e20030150","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2018,2,27]]}}}