{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:45:12Z","timestamp":1760237112962,"version":"build-2065373602"},"reference-count":60,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2020,3,3]],"date-time":"2020-03-03T00:00:00Z","timestamp":1583193600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Despite the rapidly growing computing power of computers, it is often insufficient to perform mass calculations in a short time, for example, simulation of systems for various sets of parameters, the searching of huge state spaces, optimization using ant or genetic algorithms, machine learning, etc. One can solve the problem of a lack of computing power through workload management systems used in local networks in order to use the free computing power of servers and workstations. This article proposes raising such a system to a higher level of abstraction: The use in the .NET environment of a new Shapp library that allows remote task execution using fork-like operations from Portable Operating System Interface for UNIX (POSIX) systems. The library distributes the task code, sending static data on which task force is working, and individualizing tasks. In addition, a convenient way of communicating distributed tasks running hierarchically in the Shapp library was proposed to better manage the execution of these tasks. Many different task group architectures are possible; we focus on tree-like calculations that are suitable for many problems where the range of possible parallelism increases as the calculations progress.<\/jats:p>","DOI":"10.3390\/info11030143","type":"journal-article","created":{"date-parts":[[2020,3,3]],"date-time":"2020-03-03T13:06:23Z","timestamp":1583240783000},"page":"143","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Tree-Like Distributed Computation Environment with Shapp Library"],"prefix":"10.3390","volume":"11","author":[{"given":"Tomasz","family":"Ga\u0142ecki","sequence":"first","affiliation":[{"name":"Institute of Computer Science, Warsaw University of Technology, 00-665 Warsaw, Poland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7532-362X","authenticated-orcid":false,"given":"Wiktor Bohdan","family":"Daszczuk","sequence":"additional","affiliation":[{"name":"Institute of Computer Science, Warsaw University of Technology, 00-665 Warsaw, Poland"}]}],"member":"1968","published-online":{"date-parts":[[2020,3,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Liu, H., Wang, K., Luo, J., Chen, Z., Yang, B., and He, R. (2016, January 30). Accelerating Large-scale Reservoir Simulations Using Supercomputers. Proceedings of the 78th EAGE Conference and Exhibition, Vienna, Austria.","DOI":"10.3997\/2214-4609.201600782"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"608","DOI":"10.1002\/atr.1365","article-title":"Distributed algorithm for empty vehicles management in personal rapid transit (PRT) network","volume":"50","author":"Daszczuk","year":"2016","journal-title":"J. Adv. Transp."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Francesca, G., Santone, A., Vaglini, G., and Villani, M.L. (2011, January 18\u201322). Ant Colony Optimization for Deadlock Detection in Concurrent Systems. Proceedings of the IEEE 35th Annual Computer Software and Applications Conference, Munich, Germany.","DOI":"10.1109\/COMPSAC.2011.22"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Daszczuk, W.B. (2020, March 02). 2-Vagabonds: Non-Exhaustive Verification Algorithm. Available online: https:\/\/www.springer.com\/gp\/book\/9783030128340.","DOI":"10.1007\/978-3-030-12835-7_11"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Baumann, A., Appavoo, J., Krieger, O., and Roscoe, T. (2020, March 02). A Fork() in the Road. Available online: https:\/\/www.microsoft.com\/en-us\/research\/uploads\/prod\/2019\/04\/fork-hotos19.pdf.","DOI":"10.1145\/3317550.3321435"},{"key":"ref_6","unstructured":"(2020, March 02). HTCondor Main Page. Available online: https:\/\/research.cs.wisc.edu\/htcondor\/."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"082014","DOI":"10.1088\/1742-6596\/898\/8\/082014","article-title":"Mixing HTC and HPC Workloads with HTCondor and Slurm","volume":"898","author":"Hollowell","year":"2017","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"08004","DOI":"10.1051\/epjconf\/201921408004","article-title":"A Feasibility Study on workload integration between HT-Condor and Slurm Clusters","volume":"214","author":"Du","year":"2019","journal-title":"EPJ Web Conf."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"062014","DOI":"10.1088\/1742-6596\/664\/6\/062014","article-title":"How much higher can HTCondor fly?","volume":"664","author":"Fajardo","year":"2015","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Erickson, R.A., Fienen, M.N., McCalla, S.G., Weiser, E.L., Bower, M.L., Knudson, J.M., and Thain, G. (2018). Wrangling distributed computing for high-throughput environmental science: An introduction to HTCondor. PLoS Comput. Biol., 14.","DOI":"10.1371\/journal.pcbi.1006468"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"03008","DOI":"10.1051\/epjconf\/201921403008","article-title":"Limits of the HTCondor Transfer System","volume":"214","author":"Fajardo","year":"2019","journal-title":"EPJ Web Conf."},{"key":"ref_12","unstructured":"Radek, S. (2019). Shapp: Workload Management System for Massive Distributed Calculations. Software Engineering Methods in Intelligent Algorithms, Springer."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"062044","DOI":"10.1088\/1742-6596\/119\/6\/062044","article-title":"glideinWMS\u2014A generic pilot-based workload management system","volume":"119","author":"Sfiligoi","year":"2008","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"e2248","DOI":"10.7717\/peerj.2248","article-title":"A simple grid implementation with Berkeley Open Infrastructure for Network Computing using BLAST as a model","volume":"4","author":"Pinthong","year":"2016","journal-title":"PeerJ"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"03011","DOI":"10.1051\/epjconf\/201921403011","article-title":"Advances in ATLAS@Home towards a major ATLAS computing resource","volume":"214","author":"Cameron","year":"2019","journal-title":"EPJ Web Conf."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.ascom.2015.09.004","article-title":"Asteroids@home\u2014A BOINC distributed computing project for asteroid shape reconstruction","volume":"13","year":"2015","journal-title":"Astron. Comput."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Patoli, M.Z., Gkion, M., Al-Barakati, A., Zhang, W., Newbury, P., and White, M. (2009, January 15\u201318). An open source grid based render farm for blender 3d. Proceedings of the IEEE\/PES Power Systems Conference and Exposition, Seattle, MA, USA.","DOI":"10.1109\/PSCE.2009.4839978"},{"key":"ref_18","first-page":"17","article-title":"Volunteer computing in a scalable lightweight web-based environment","volume":"24","author":"Chorazyk","year":"2017","journal-title":"Comput. Assist. Methods Eng. Sci."},{"key":"ref_19","unstructured":"Domenico, T., Ramin, Y., and Wolfgang, Z. (2008). A Practical Approach for a Workflow Management System. Grid Middleware and Services: Challenges and Solutions, Springer."},{"key":"ref_20","unstructured":"Anderson, D.P. (2004, January 8). BOINC: A System for Public-Resource Computing and Storage. Proceedings of the Fifth IEEE\/ACM International Workshop on Grid Computing, Pittsburgh, PA, USA."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"887","DOI":"10.1007\/s10586-018-2879-3","article-title":"Cost-efficient parallel processing of irregularly structured problems in cloud computing environments","volume":"22","author":"Haussmann","year":"2019","journal-title":"Clust. Comput."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Kosar, T. (2012). Towards data intensive many-task computing. Data Intensive Distributed Computing: Challenges and Solutions for Large-Scale Information Management, IGI Global.","DOI":"10.4018\/978-1-61520-971-2"},{"key":"ref_23","unstructured":"Pool, M. (2020, March 02). Distcc, a Fast Free Distributed Compiler. Available online: https:\/\/distcc.github.io\/."},{"key":"ref_24","unstructured":"Zhang, W. (2020, March 02). Linux Virtual Server for Scalable Network Services. Available online: http:\/\/www.linuxvirtualserver.org\/ols\/lvs.pdf."},{"key":"ref_25","first-page":"1","article-title":"A Proposal for A High Availability Architecture for VoIP Telephone Systems based on Open Source Software","volume":"9","author":"Martin","year":"2018","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Han, M., Yao, D.G., and Yu, X.L. (2019, January 24\u201325). A Solution for Instant Response of Cloud Platform Based on Nginx + Keepalived. Proceedings of the International Conference on Computer Science, Communications and Multimedia Engineering, Beijing, China.","DOI":"10.12783\/dtcse\/cscme2019\/32516"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10723-016-9381-z","article-title":"Redundant eucalyptus private clouds: Availability modeling and sensitivity analysis","volume":"15","author":"Matos","year":"2017","journal-title":"J. Grid Comput."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1245","DOI":"10.1631\/FITEE.1800501","article-title":"The rise of high-throughput computing","volume":"19","author":"Sun","year":"2018","journal-title":"Front. Inf. Technol. Electron. Eng."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Assiroj, P., Hananto, A.L., Fauzi, A., and Hendric Spits Warnars, H.L. (2018, January 7\u20138). High Performance Computing (HPC) Implementation: A Survey. Proceedings of the Indonesian Association for Pattern Recognition International Conference (INAPR), Tangerang, Indonesia.","DOI":"10.1109\/INAPR.2018.8627040"},{"key":"ref_30","first-page":"32","article-title":"Many-task computing on many-core architectures","volume":"17","author":"Nookala","year":"2016","journal-title":"Scalable Comput. Pract. Exp."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41524-019-0200-5","article-title":"Transparent conducting materials discovery using high-throughput computing","volume":"5","author":"Brunin","year":"2019","journal-title":"NPJ Comput. Mater."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1427","DOI":"10.1109\/TSG.2016.2646640","article-title":"High Throughput Computing for Massive Scenario Analysis and Optimization to Minimize Cascading Blackout Risk","volume":"8","author":"Anderson","year":"2017","journal-title":"IEEE Trans. Smart Grid"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1146\/annurev-nucl-102010-130059","article-title":"Computing for the Large Hadron Collider","volume":"61","author":"Bird","year":"2011","journal-title":"Annu. Rev. Nucl. Part. Sci."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1410","DOI":"10.1016\/j.joule.2018.05.009","article-title":"Accelerating Materials Development via Automation, Machine Learning, and High-Performance Computing","volume":"2","author":"Hippalgaonkar","year":"2018","journal-title":"Joule"},{"key":"ref_35","unstructured":"Daszczuk, W.B. (2017). Discrete Event Simulation of Personal Rapid Transit (PRT) Systems. arXiv."},{"key":"ref_36","unstructured":"Weitzel, D. (2020, March 02). Enabling Microsoft OneDrive Integration with HTCondor. Available online: https:\/\/arxiv.org\/pdf\/1907.03688.pdf."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"092021","DOI":"10.1088\/1742-6596\/898\/9\/092021","article-title":"Interfacing HTCondor-CE with OpenStack","volume":"898","author":"Bockelman","year":"2017","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Maciulaitis, R., Brener, P., Hampton, S., Hildreth, M., Hurtado Anampa, K.P., Johnson, I., Kankel, C., Okraska, J., Rodriguez Rodriguez, D., and Simko, T. (2020, March 02). Support for HTCondor high-Throughput Computing Workflows in the REANA Reusable Analysis Platform. Available online: https:\/\/cds.cern.ch\/record\/2696223\/files\/CERN-IT-2019-004.pdf.","DOI":"10.1109\/eScience.2019.00091"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1088\/1742-6596\/898\/5\/052021","article-title":"On-demand provisioning of HEP compute resources on cloud sites and shared HPC centers","volume":"898","author":"Erli","year":"2017","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_40","first-page":"47","article-title":"Qualities of Grid Computing that can last for Ages","volume":"12","author":"Asagba","year":"2007","journal-title":"J. Appl. Sci. Environ. Manag."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1007\/s10723-009-9143-2","article-title":"A Grid-enabled CPU Scavenging Architecture and a Case Study of its Use in the Greek School Network","volume":"8","author":"Georgatos","year":"2010","journal-title":"J. Grid Comput."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"855","DOI":"10.1007\/s11219-017-9385-3","article-title":"A systematic survey on automated concurrency bug detection, exposing, avoidance, and fixing techniques","volume":"26","author":"Fu","year":"2018","journal-title":"Softw. Qual. J."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Lima, B., and Faria, J.P. (2016, January 6\u20139). Towards the Online Testing of Distributed and Heterogeneous Systems with Extended Petri Nets. Proceedings of the 10th International Conference on the Quality of Information and Communications Technology (QUATIC), Lisbon, Portugal.","DOI":"10.1109\/QUATIC.2016.057"},{"key":"ref_44","unstructured":"Hoare, C.A.R. (1985). Communicating Sequential Processes, Prentice-Hall, Inc."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1177\/0037549715571623","article-title":"Transforming classic Discrete Event System Specification models to Specification and Description Language","volume":"91","year":"2015","journal-title":"Simulation"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Daszczuk, W.B. (2020, March 02). Integrated Model of Distributed Systems. Available online: https:\/\/www.springer.com\/gp\/book\/9783030128340.","DOI":"10.1007\/978-3-030-12835-7"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1007\/s10009-018-0488-3","article-title":"Towards formal methods diversity in railways: An experience report with seven frameworks","volume":"20","author":"Mazzanti","year":"2018","journal-title":"Int. J. Softw. Tools Technol. Transf."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"642","DOI":"10.1007\/s11704-016-6192-0","article-title":"The role of model checking in software engineering","volume":"12","author":"Karna","year":"2018","journal-title":"Front. Comput. Sci."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/j.asoc.2014.06.055","article-title":"A heuristic solution for model checking graph transformation systems","volume":"24","author":"Yousefian","year":"2014","journal-title":"Appl. Soft Comput."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1016\/j.jss.2017.05.128","article-title":"Deadlock detection in complex software systems specified through graph transformation using Bayesian optimization algorithm","volume":"131","author":"Pira","year":"2017","journal-title":"J. Syst. Softw."},{"key":"ref_51","unstructured":"HTCondor User\u2019s Manual (2020, March 02). Managing a Job. Available online: https:\/\/htcondor.readthedocs.io\/en\/stable\/users-manual\/managing-a-job.html."},{"key":"ref_52","unstructured":"Stevens, W.R., and Rago, S.A. (2020, March 02). Advanced Programming in the UNIX Environment. Available online: http:\/\/ptgmedia.pearsoncmg.com\/images\/9780321637734\/samplepages\/0321637739.pdf."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"M\u00fcller, J., Lorenz, M., Geller, F., Zeier, A., and Plattner, H. (2010, January 29\u201331). Assessment of communication protocols in the EPC Network\u2014Replacing textual SOAP and XML with binary google protocol buffers encoding. Proceedings of the IEEE 17Th International Conference on Industrial Engineering and Engineering Management, Xiamen, China.","DOI":"10.1109\/ICIEEM.2010.5646586"},{"key":"ref_54","unstructured":"Eaddy, M. (2020, March 02). C# versus Java. Available online: http:\/\/www1.cs.columbia.edu\/~eaddy\/publications\/csharpvsjava-eaddy-ddj-feb01.pdf."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1145\/944579.944589","article-title":"Object Serialization Analysis and Comparison in Java and .NET","volume":"38","author":"Hericko","year":"2003","journal-title":"SIGPLAN Not."},{"key":"ref_56","unstructured":"Cui, Y. (2020, March 02). Performance Test\u2014BinaryFormatter vs Protobuf-Net. Available online: https:\/\/theburningmonk.com\/2011\/08\/performance-test-binaryformatter-vs-protobuf-net\/."},{"key":"ref_57","unstructured":"Feldmeier, D.C. (2020, March 02). A Survey of High Performance Protocol Implementation Techniques. Available online: https:\/\/link.springer.com\/chapter\/10.1007\/978-1-4615-3194-4_2."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Lutton, E., Legrand, P., Parrend, P., Monmarch\u00e9, N., and Schoenauer, M. (2017). H-ACO: A Heterogeneous Ant Colony Optimization Approach with Application to the Travelling Salesman Problem. Artificial Evolution, Springer International Publishing.","DOI":"10.1007\/978-3-319-78133-4"},{"key":"ref_59","unstructured":"(2020, March 02). Mono-Project Main Webpage. Available online: https:\/\/www.mono-project.com\/."},{"key":"ref_60","unstructured":"(2020, March 02). Shapp Library Repository. Available online: https:\/\/github.com\/saleph\/shapp."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/11\/3\/143\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:03:49Z","timestamp":1760173429000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/11\/3\/143"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,3]]},"references-count":60,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2020,3]]}},"alternative-id":["info11030143"],"URL":"https:\/\/doi.org\/10.3390\/info11030143","relation":{},"ISSN":["2078-2489"],"issn-type":[{"type":"electronic","value":"2078-2489"}],"subject":[],"published":{"date-parts":[[2020,3,3]]}}}