{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T00:16:10Z","timestamp":1775175370262,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":33,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,11,29]],"date-time":"2022-11-29T00:00:00Z","timestamp":1669680000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"German Federal Ministry for Economic Affiars and Climate Action","award":["KIZAM"],"award-info":[{"award-number":["KIZAM"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,11,29]]},"DOI":"10.1145\/3567512.3567534","type":"proceedings-article","created":{"date-parts":[[2022,12,1]],"date-time":"2022-12-01T21:22:55Z","timestamp":1669929775000},"page":"260-265","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Neural Language Models and Few Shot Learning for Systematic Requirements Processing in MDSE"],"prefix":"10.1145","author":[{"given":"Vincent","family":"Bertram","sequence":"first","affiliation":[{"name":"RWTH Aachen University, Germany"}]},{"given":"Miriam","family":"Bo\u00df","sequence":"additional","affiliation":[{"name":"RWTH Aachen University, Germany"}]},{"given":"Evgeny","family":"Kusmenko","sequence":"additional","affiliation":[{"name":"RWTH Aachen University, Germany"}]},{"given":"Imke Helene","family":"Nachmann","sequence":"additional","affiliation":[{"name":"RWTH Aachen University, Germany"}]},{"given":"Bernhard","family":"Rumpe","sequence":"additional","affiliation":[{"name":"RWTH Aachen University, Germany"}]},{"given":"Danilo","family":"Trotta","sequence":"additional","affiliation":[{"name":"RWTH Aachen University, Germany"}]},{"given":"Louis","family":"Wachtmeister","sequence":"additional","affiliation":[{"name":"RWTH Aachen University, Germany"}]}],"member":"320","published-online":{"date-parts":[[2022,12]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Letsholo","author":"Alhoshan Waad","year":"2022","unstructured":"Waad Alhoshan , Liping Zhao , Alessio Ferrari , and Keletso J . Letsholo . 2022 . A Zero-Shot Learning Approach to Classifying Requirements : A Preliminary Study. In Requirements Engineering: Foundation for Software Quality, Vincenzo Gervasi and Andreas Vogelsang (Eds.). Springer International Publishing , Cham. 52\u201359. isbn:978-3-030-98464-9 Waad Alhoshan, Liping Zhao, Alessio Ferrari, and Keletso J. Letsholo. 2022. A Zero-Shot Learning Approach to Classifying Requirements: A Preliminary Study. In Requirements Engineering: Foundation for Software Quality, Vincenzo Gervasi and Andreas Vogelsang (Eds.). Springer International Publishing, Cham. 52\u201359. isbn:978-3-030-98464-9"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3486609.3487199"},{"key":"e_1_3_2_1_3_1","volume-title":"Interoperable Toolchain for Requirements-Driven Model-Based Development. In 9th European Congress Embedded Real Time Software and Systems ERTS \u20192018","author":"Becker Jan Steffen","year":"2018","unstructured":"Jan Steffen Becker , Vincent Bertram , Tom Bienm\u00fcller , Udo Brockmeyer , Heiko D\u00f6rr , Thomas Peikenkamp , and Tino Teige . 2018 . Interoperable Toolchain for Requirements-Driven Model-Based Development. In 9th European Congress Embedded Real Time Software and Systems ERTS \u20192018 . Jan Steffen Becker, Vincent Bertram, Tom Bienm\u00fcller, Udo Brockmeyer, Heiko D\u00f6rr, Thomas Peikenkamp, and Tino Teige. 2018. Interoperable Toolchain for Requirements-Driven Model-Based Development. In 9th European Congress Embedded Real Time Software and Systems ERTS \u20192018."},{"key":"e_1_3_2_1_4_1","volume-title":"Bernhard Rumpe, Danilo Trotta, and Louis Wachtmeister.","author":"Bertram Vincent","year":"2022","unstructured":"Vincent Bertram , Miriam Bo\u00df , Evgeny Kusmenko , Imke Helene Nachmann , Bernhard Rumpe, Danilo Trotta, and Louis Wachtmeister. 2022 . Technical Report on Neural Language Models and Few-Shot Learning for Systematic Requirements Processing in MDSE. https:\/\/doi.org\/10.48550\/ARXIV.2211.09084 10.48550\/ARXIV.2211.09084 Vincent Bertram, Miriam Bo\u00df, Evgeny Kusmenko, Imke Helene Nachmann, Bernhard Rumpe, Danilo Trotta, and Louis Wachtmeister. 2022. Technical Report on Neural Language Models and Few-Shot Learning for Systematic Requirements Processing in MDSE. https:\/\/doi.org\/10.48550\/ARXIV.2211.09084"},{"key":"e_1_3_2_1_5_1","volume-title":"Bernhard Rumpe, and Michael von Wenckstern.","author":"Bertram Vincent","year":"2017","unstructured":"Vincent Bertram , Shahar Maoz , Jan Oliver Ringert , Bernhard Rumpe, and Michael von Wenckstern. 2017 . Component and Connector Views in Practice : An Experience Report. In MODELS\u2019 17. Vincent Bertram, Shahar Maoz, Jan Oliver Ringert, Bernhard Rumpe, and Michael von Wenckstern. 2017. Component and Connector Views in Practice: An Experience Report. In MODELS\u201917."},{"key":"e_1_3_2_1_6_1","unstructured":"Tom B Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry and Amanda Askell. 2020. Language models are few-shot learners. arXiv preprint arXiv:2005.14165. Tom B Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry and Amanda Askell. 2020. Language models are few-shot learners. arXiv preprint arXiv:2005.14165."},{"key":"e_1_3_2_1_7_1","volume-title":"Grand Challenges in Model-Driven Engineering: An Analysis of the State of Research. Software and Systems Modeling, 19, 1","author":"Buchhiarone Antonio","year":"2020","unstructured":"Antonio Buchhiarone , Jordi Cabot , Richard F. Paige , and Alfonso Pierantonio . 2020. Grand Challenges in Model-Driven Engineering: An Analysis of the State of Research. Software and Systems Modeling, 19, 1 ( 2020 ). Antonio Buchhiarone, Jordi Cabot, Richard F. Paige, and Alfonso Pierantonio. 2020. Grand Challenges in Model-Driven Engineering: An Analysis of the State of Research. Software and Systems Modeling, 19, 1 (2020)."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.268542"},{"key":"e_1_3_2_1_9_1","volume-title":"Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805.","author":"Devlin Jacob","year":"2018","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2018 . Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.5381\/jot.2021.20.2.a7"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1002\/spe.2650"},{"key":"e_1_3_2_1_12_1","volume-title":"Modellierung","author":"Drave Imke","year":"2020","unstructured":"Imke Drave , Timo Henrich , Katrin H\u00f6lldobler , Oliver Kautz , Judith Michael , and Bernhard Rumpe . 2020. Modellierung , Verifikation und Synthese von validen Planungszust\u00e4nden f\u00fcr Fernsehausstrahlungen . In Modellierung 2020 . Imke Drave, Timo Henrich, Katrin H\u00f6lldobler, Oliver Kautz, Judith Michael, and Bernhard Rumpe. 2020. Modellierung, Verifikation und Synthese von validen Planungszust\u00e4nden f\u00fcr Fernsehausstrahlungen. In Modellierung 2020."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"crossref","unstructured":"Imke Drave Oliver Kautz Judith Michael and Bernhard Rumpe. 2019. Semantic Evolution Analysis of Feature Models. In SPLC\u201919. ACM 245\u2013255. Imke Drave Oliver Kautz Judith Michael and Bernhard Rumpe. 2019. Semantic Evolution Analysis of Feature Models. In SPLC\u201919. ACM 245\u2013255.","DOI":"10.1145\/3336294.3336300"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"crossref","unstructured":"Robert France and Bernhard Rumpe. 2007. Model-driven Development of Complex Software: A Research Roadmap. Future of Software Engineering (FOSE \u201907) May 37\u201354. Robert France and Bernhard Rumpe. 2007. Model-driven Development of Complex Software: A Research Roadmap. Future of Software Engineering (FOSE \u201907) May 37\u201354.","DOI":"10.1109\/FOSE.2007.14"},{"key":"e_1_3_2_1_15_1","volume-title":"Meaningful Modeling: What\u2019s the Semantics of \u201dSemantics\u201d? IEEE Computer, 37, 10","author":"Harel David","year":"2004","unstructured":"David Harel and Bernhard Rumpe . 2004 . Meaningful Modeling: What\u2019s the Semantics of \u201dSemantics\u201d? IEEE Computer, 37, 10 (2004). David Harel and Bernhard Rumpe. 2004. Meaningful Modeling: What\u2019s the Semantics of \u201dSemantics\u201d? IEEE Computer, 37, 10 (2004)."},{"key":"e_1_3_2_1_16_1","volume-title":"2020 IEEE 28th International Requirements Engineering Conference (RE). 169\u2013179","author":"Hey Tobias","unstructured":"Tobias Hey , Jan Keim , Anne Koziolek , and Walter F. Tichy . 2020. NoRBERT: Transfer learning for requirements classification . In 2020 IEEE 28th International Requirements Engineering Conference (RE). 169\u2013179 . Tobias Hey, Jan Keim, Anne Koziolek, and Walter F. Tichy. 2020. NoRBERT: Transfer learning for requirements classification. In 2020 IEEE 28th International Requirements Engineering Conference (RE). 169\u2013179."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.5381\/jot.2021.20.3.a5"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.5381\/jot.2019.18.2.a2"},{"key":"e_1_3_2_1_19_1","volume-title":"Combined Proceedings of the Workshops at Software Engineering 2020. 2581, CEUR Workshop Proceedings.","author":"Kausch Hendrik","year":"2020","unstructured":"Hendrik Kausch , Mathias Pfeiffer , Deni Raco , and Bernhard Rumpe . 2020 . An Approach for Logic-based Knowledge Representation and Automated Reasoning over Underspecification and Refinement in Safety-Critical Cyber-Physical Systems . In Combined Proceedings of the Workshops at Software Engineering 2020. 2581, CEUR Workshop Proceedings. Hendrik Kausch, Mathias Pfeiffer, Deni Raco, and Bernhard Rumpe. 2020. An Approach for Logic-based Knowledge Representation and Automated Reasoning over Underspecification and Refinement in Safety-Critical Cyber-Physical Systems. In Combined Proceedings of the Workshops at Software Engineering 2020. 2581, CEUR Workshop Proceedings."},{"key":"e_1_3_2_1_20_1","volume-title":"Modeling and Training of Neural Processing Systems. In Conference on Model Driven Engineering Languages and Systems (MODELS\u201919)","author":"Kusmenko Evgeny","year":"2019","unstructured":"Evgeny Kusmenko , Sebastian Nickels , Svetlana Pavlitskaya , Bernhard Rumpe , and Thomas Timmermanns . 2019 . Modeling and Training of Neural Processing Systems. In Conference on Model Driven Engineering Languages and Systems (MODELS\u201919) . IEEE, 283\u2013293. Evgeny Kusmenko, Sebastian Nickels, Svetlana Pavlitskaya, Bernhard Rumpe, and Thomas Timmermanns. 2019. Modeling and Training of Neural Processing Systems. In Conference on Model Driven Engineering Languages and Systems (MODELS\u201919). IEEE, 283\u2013293."},{"key":"e_1_3_2_1_21_1","volume-title":"Software Engineering Intelligence Workshop (SEI\u201919)","author":"Kusmenko Evgeny","year":"2019","unstructured":"Evgeny Kusmenko , Svetlana Pavlitskaya , Bernhard Rumpe , and Sebastian St\u00fcber . 2019 . On the Engineering of AI-Powered Systems. In ASE\u201919 . Software Engineering Intelligence Workshop (SEI\u201919) , Lisa O\u2019Conner (Ed.). IEEE, 126\u2013133. Evgeny Kusmenko, Svetlana Pavlitskaya, Bernhard Rumpe, and Sebastian St\u00fcber. 2019. On the Engineering of AI-Powered Systems. In ASE\u201919. Software Engineering Intelligence Workshop (SEI\u201919), Lisa O\u2019Conner (Ed.). IEEE, 126\u2013133."},{"key":"e_1_3_2_1_22_1","volume-title":"ECMFA\u201917 (LNCS 10376)","author":"Kusmenko Evgeny","unstructured":"Evgeny Kusmenko , Alexander Roth , Bernhard Rumpe , and Michael von Wenckstern . 2017. Modeling Architectures of Cyber-Physical Systems . In ECMFA\u201917 (LNCS 10376) . Springer , 34\u201350. Evgeny Kusmenko, Alexander Roth, Bernhard Rumpe, and Michael von Wenckstern. 2017. Modeling Architectures of Cyber-Physical Systems. In ECMFA\u201917 (LNCS 10376). Springer, 34\u201350."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"crossref","unstructured":"Grischa Liebel Matthias Tichy and Eric Knauss. 2019. Use potential and showstoppers of models in automotive requirements engineering. Grischa Liebel Matthias Tichy and Eric Knauss. 2019. Use potential and showstoppers of models in automotive requirements engineering.","DOI":"10.1007\/s10270-018-0683-4"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"crossref","unstructured":"Grzegorz Loniewski Emilio Insfran and Silvia Abrah\u00e3o. 2010. A Systematic Review of the Use of Requirements Engineering Techniques in Model-Driven Development. In Model Driven Engineering Languages and Systems. MODELS\u20192010. Grzegorz Loniewski Emilio Insfran and Silvia Abrah\u00e3o. 2010. A Systematic Review of the Use of Requirements Engineering Techniques in Model-Driven Development. In Model Driven Engineering Languages and Systems. MODELS\u20192010.","DOI":"10.1007\/978-3-642-16129-2_16"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.21428\/594757db.9e433d7c"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2012.52"},{"key":"e_1_3_2_1_27_1","unstructured":"Klaus Pohl and Chris Rupp. 2021. Basiswissen requirements engineering: Aus-und Weiterbildung nach IREB-Standard zum certified professional for requirements engineering foundation level. Klaus Pohl and Chris Rupp. 2021. Basiswissen requirements engineering: Aus-und Weiterbildung nach IREB-Standard zum certified professional for requirements engineering foundation level."},{"key":"e_1_3_2_1_28_1","unstructured":"Alec Radford Karthik Narasimhan Tim Salimans and Ilya Sutskever. 2018. Improving language understanding by generative pre-training. Alec Radford Karthik Narasimhan Tim Salimans and Ilya Sutskever. 2018. Improving language understanding by generative pre-training."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380356"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"crossref","unstructured":"Amit Kumar Tyagi and N. Sreenath. 2021. Cyber Physical Systems: Analyses challenges and possible solutions. Internet of Things and Cyber-Physical Systems 1 (2021). Amit Kumar Tyagi and N. Sreenath. 2021. Cyber Physical Systems: Analyses challenges and possible solutions. Internet of Things and Cyber-Physical Systems 1 (2021).","DOI":"10.1016\/j.iotcps.2021.07.001"},{"key":"e_1_3_2_1_31_1","volume-title":"\u0141 ukasz Kaiser, and Illia Polosukhin","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan N Gomez , \u0141 ukasz Kaiser, and Illia Polosukhin . 2017 . Attention is all you need. In Advances in neural information processing systems. 5998\u20136008. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, \u0141 ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems. 5998\u20136008."},{"key":"e_1_3_2_1_32_1","unstructured":"Ben Wang. 2021. Mesh-Transformer-JAX: Model-Parallel Implementation of Transformer Language Model with JAX. https:\/\/github.com\/kingoflolz\/mesh-transformer-jax Ben Wang. 2021. Mesh-Transformer-JAX: Model-Parallel Implementation of Transformer Language Model with JAX. https:\/\/github.com\/kingoflolz\/mesh-transformer-jax"},{"key":"e_1_3_2_1_33_1","unstructured":"Ben Wang and Aran Komatsuzaki. 2021. GPT-J-6B: A 6 Billion Parameter Autoregressive Language Model. https:\/\/github.com\/kingoflolz\/mesh-transformer-jax Ben Wang and Aran Komatsuzaki. 2021. GPT-J-6B: A 6 Billion Parameter Autoregressive Language Model. https:\/\/github.com\/kingoflolz\/mesh-transformer-jax"}],"event":{"name":"SLE '22: 15th ACM SIGPLAN International Conference on Software Language Engineering","location":"Auckland New Zealand","acronym":"SLE '22","sponsor":["SIGPLAN ACM Special Interest Group on Programming Languages"]},"container-title":["Proceedings of the 15th ACM SIGPLAN International Conference on Software Language Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3567512.3567534","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3567512.3567534","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T22:43:47Z","timestamp":1750286627000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3567512.3567534"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,29]]},"references-count":33,"alternative-id":["10.1145\/3567512.3567534","10.1145\/3567512"],"URL":"https:\/\/doi.org\/10.1145\/3567512.3567534","relation":{},"subject":[],"published":{"date-parts":[[2022,11,29]]},"assertion":[{"value":"2022-12-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}