{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T00:53:47Z","timestamp":1760230427005,"version":"build-2065373602"},"reference-count":28,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2022,7,21]],"date-time":"2022-07-21T00:00:00Z","timestamp":1658361600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Agency for Defense Development (ADD)","award":["UD200042ED"],"award-info":[{"award-number":["UD200042ED"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this paper, we present a design method for a wideband non-uniformly spaced linear array (NUSLA), with both symmetric and asymmetric geometries, using the modified reinforcement learning algorithm (MORELA). We designed a cost function that provided freedom to the beam pattern by setting limits only on the beam width (BW) and side-lobe level (SLL) in order to satisfy the desired BW and SLL in the wide band. We added the scan angle condition to the cost function to design the scanned beam pattern, as the ability to scan a beam in the desired direction is important in various applications. In order to prevent possible pointing angle errors for asymmetric NUSLA, we employed a penalty function to ensure the peak at the desired direction. Modified reinforcement learning algorithm (MORELA), which is a reinforcement learning-based algorithm used to determine a global optimum of the cost function, is applied to optimize the spacing and weights of the NUSLA by minimizing the proposed cost function. The performance of the proposed scheme was verified by comparing it with that of existing heuristic optimization algorithms via computer simulations.<\/jats:p>","DOI":"10.3390\/s22145456","type":"journal-article","created":{"date-parts":[[2022,7,21]],"date-time":"2022-07-21T22:38:50Z","timestamp":1658443130000},"page":"5456","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Design Method for a Wideband Non-Uniformly Spaced Linear Array Using the Modified Reinforcement Learning Algorithm"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1889-4412","authenticated-orcid":false,"given":"Seyoung","family":"Kang","sequence":"first","affiliation":[{"name":"Department of Computer Science and Engineering, Korea University, Seoul 02841, Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8714-2404","authenticated-orcid":false,"given":"Seonkyo","family":"Kim","sequence":"additional","affiliation":[{"name":"Agency for Defense Development, Daejeon 34186, Korea"}]},{"given":"Cheolsun","family":"Park","sequence":"additional","affiliation":[{"name":"Agency for Defense Development, Daejeon 34186, Korea"}]},{"given":"Wonzoo","family":"Chung","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence, Korea University, Seoul 02841, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,21]]},"reference":[{"key":"ref_1","unstructured":"Volakis, J.L. (2007). Antenna Engineering Handbook, McGraw-Hill Education."},{"key":"ref_2","unstructured":"Stutzman, W.L., and Thiele, G.A. (2012). Antenna Theory and Design, John Wiley & Sons."},{"key":"ref_3","unstructured":"Balanis, C. (2015). A Antenna Theory: Analysis and Design, John Wiley & Sons."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Benesty, J., Cohen, I., and Chen, J. (2017). Fundamentals of Signal Enhancement and Array Signal Processing, John Wiley & Sons.","DOI":"10.1002\/9781119293132"},{"key":"ref_5","unstructured":"Ridwan, M., Abdo, M., and Jorswieck, E. (2011, January 13\u201316). Design of Non-Uniform Antenna Arrays Using Genetic Algorithm. Proceedings of the 13th International Conference on Advanced Communication Technology (ICACT2011), Seoul, Korea."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"169","DOI":"10.2528\/PIERB11053108","article-title":"Fire Fly and Artificial Bees Colony Algorithm for Synthesis of Scanned and Broadside Linear Array Antenna","volume":"32","author":"Basu","year":"2011","journal-title":"Prog. Electromagn. Res. B"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1017\/S175907871300086X","article-title":"Optimized Hyper Beamforming of Receiving Linear Antenna Arrays Using Firefly Algorithm","volume":"6","author":"Ram","year":"2014","journal-title":"Int. J. Microw. Wirel. Technol."},{"key":"ref_8","unstructured":"Bai, H. (2014). Design of Non-Uniform Linear Array via Linear Programming and Particle Swarm Optimization and Studies on Phased Array Calibration. [Masters Thesis, University of Massachusetts Amherst]."},{"key":"ref_9","first-page":"19","article-title":"Optimization of SLL of Linear Array Antennas using Enhanced Firefly Algorithm","volume":"10","author":"Sri","year":"2020","journal-title":"Int. J. Eng. Res. Appl."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Li, S., Yang, X., Ning, L., Long, T., and Sarkar, T.K. (2017, January 8\u201312). Broadband Constant Beamwidth Beamforming for Suppressing Mainlobe and Sidelobe Interferences. Proceedings of the 2017 IEEE Radar Conference (RadarConf), Seattle, WA, USA.","DOI":"10.1109\/RADAR.2017.7944358"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"145","DOI":"10.2528\/PIERL19072303","article-title":"Practical Beamforming Technologies for Wideband Digital Array Radar","volume":"86","author":"Liu","year":"2019","journal-title":"Prog. Electromagn. Res. Lett."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"366","DOI":"10.1109\/LAWP.2021.3131806","article-title":"A Broadband Wide-Angle Scanning Linear Array Antenna with Suppressed Mutual Coupling for 5G Sub-6G Applications","volume":"21","author":"Feng","year":"2022","journal-title":"IEEE Antennas Wirel. Propag. Lett."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2580","DOI":"10.1109\/TAP.2010.2050428","article-title":"Optimal Wideband Beamforming for Uniform Linear Arrays Based on Frequency-Domain MISO System Identification","volume":"58","author":"Wang","year":"2010","journal-title":"IEEE Trans. Antennas Propag."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhang, W., and Su, T. (2016). Reference Beam Pattern Design for Frequency Invariant Beamforming Based on Fast Fourier Transform. Sensors, 16.","DOI":"10.3390\/s16101554"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Long, T., Cohen, I., Berdugo, B., Yang, Y., and Chen, J. (2019). Window-Based Constant Beamwidth Beamformer. Sensors, 19.","DOI":"10.3390\/s19092091"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Xu, L., Li, R., Chen, X., Wei, F., and Shi, X. (2021). Wideband Frequency Invariant Array Synthesis Based on Matrix Singular Value Decomposition. Electronics, 10.","DOI":"10.3390\/electronics10162039"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1109\/78.482017","article-title":"Synthesis of Unequally Spaced Arrays by Simulated Annealing","volume":"44","author":"Murino","year":"1996","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Gangwar, V.S., Singh, A.K., and Singh, S.P. (2015, January 10\u201312). Side Lobe Level Suppression in Randomly Spaced Linear Array Using Genetic Algorithm. Proceedings of the 2015 IEEE MTT-S International Microwave and RF Conference (IMaRC), India, Hyderabad.","DOI":"10.1109\/IMaRC.2015.7411425"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"256759","DOI":"10.1155\/2012\/256759","article-title":"Nonuniformly Spaced Linear Antenna Array Design Using Firefly Algorithm","volume":"2012","author":"Zaman","year":"2012","journal-title":"Int. J. Microw. Sci. Technol."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Miranda, A.V., Ashwin, P., Sharan, P., Gangwar, V.S., Singh, A.K., and Singh, S.P. (2017, January 11\u201313). An Efficient Synthesis of Unequally Spaced Antenna Array with Electronic Scan Capability Utilizing Particle Swarm Optimization. Proceedings of the 2017 IEEE MTT-S International Microwave and RF Conference (IMaRC), India, Ahmedabad.","DOI":"10.1109\/IMaRC.2017.8611005"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"690","DOI":"10.1080\/09205071.2020.1855259","article-title":"Optimum design of both linear and planar sparse arrays with sidelobe level reduction using salp swarm algorithm","volume":"35","author":"Luo","year":"2021","journal-title":"J. Electromagn. Waves Appl."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1614","DOI":"10.1109\/TAP.2015.2394497","article-title":"Synthesis of Nonuniformly Spaced Linear Arrays With Frequency-Invariant Patterns by the Generalized Matrix Pencil Methods","volume":"63","author":"Liu","year":"2015","journal-title":"IEEE Trans. Antennas Propag."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1871","DOI":"10.1049\/iet-map.2018.0148","article-title":"Efficient Unitary Matrix Pencil Method for Synthesising Wideband Frequency Patterns of Sparse Linear Arrays","volume":"12","author":"Gu","year":"2018","journal-title":"IET Microwaves Antennas Propag."},{"key":"ref_24","first-page":"23","article-title":"Null-Steering Beamformer Using Bat Algorithm","volume":"33","author":"Giang","year":"2018","journal-title":"Appl. Comput. Electromagn. Soc. J."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.dsp.2020.102780","article-title":"Comparison of Nature-Inspired Techniques in Design Optimization of Non-Uniformly Spaced Arrays in The Presence of Mutual Coupling","volume":"105","author":"BouDaher","year":"2020","journal-title":"Digit. Signal Process."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1017\/S1759078721000295","article-title":"Chebyshev-Based Array for Beam Steering and Null Positioning Using Modified Ant Lion Optimization","volume":"14","author":"Pradhan","year":"2022","journal-title":"Int. J. Microw. Wirel. Technol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"602","DOI":"10.1590\/2179-10742017v16i3790","article-title":"Quantum Particle Swarm Optimization for Synthesis of Non-Uniformly Spaced Linear Arrays with Broadband Frequency Invariant Pattern","volume":"16","author":"Patidar","year":"2017","journal-title":"J. Microwaves Optoelectron. Electromagn. Appl."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"65","DOI":"10.4236\/ojop.2017.62006","article-title":"A Novel Approach Based on Reinforcement Learning for Finding Global Optimum","volume":"6","author":"Ozan","year":"2017","journal-title":"Open J. Optim."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/14\/5456\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:55:41Z","timestamp":1760140541000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/14\/5456"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,21]]},"references-count":28,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["s22145456"],"URL":"https:\/\/doi.org\/10.3390\/s22145456","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,7,21]]}}}