{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,17]],"date-time":"2026-11-17T12:17:11Z","timestamp":1794917831473,"version":"4.9.1"},"publisher-location":"California","reference-count":0,"publisher":"International Joint Conferences on Artificial Intelligence Organization","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,9]]},"abstract":"<jats:p>Transformer models are rapidly becoming a cornerstone of modern Internet of Things (IoT) applications, yet their computational and memory demands far exceed the capabilities of a single typical ultra-low-power IoT device. We present CATS, a framework for distributed transformer inference on ultra-low-power wireless devices, enabling multiple devices to collaboratively execute models far larger than what a single device can sustain. At its core, CATS is a communication-aware distributed transformer inference scheme co-designed across transformer partitioning, wireless communication and training. It employs SomeGather, a new pruned communication primitive that selectively broadcasts activation columns to reduce communication bandwidth and RAM usage without sacrificing model accuracy. Building on SomeGather, we design a partitioning method that exploits this primitive for efficient model parallelism. To cope with unreliable wireless communication, CATS employs message-dropout during training, which mimics packet losses and yields models that are robust to message loss during inference. In real-world experiments, we show that CATS brings distributed transformer inference to ultra-low-power wireless devices for the first time, with deployments on up to 16 devices that collaboratively execute transformer models up to 14 times larger than what a single device can run.<\/jats:p>","DOI":"10.24963\/ijcai.2026\/14","type":"proceedings-article","created":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T22:01:13Z","timestamp":1789596073000},"page":"118-126","source":"Crossref","is-referenced-by-count":0,"title":["Going Beyond the Edge: Distributed Inference of Transformer Models on Ultra-Low-Power Wireless Devices"],"prefix":"10.24963","author":[{"given":"Alexander","family":"Gr\u00e4fe","sequence":"first","affiliation":[{"name":"RWTH Aachen University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ding","family":"Huo","sequence":"additional","affiliation":[{"name":"Technical University of Darmstadt"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vincent","family":"de Bakker","sequence":"additional","affiliation":[{"name":"RWTH Aachen University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Johannes","family":"Berger","sequence":"additional","affiliation":[{"name":"RWTH Aachen University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marco","family":"Zimmerling","sequence":"additional","affiliation":[{"name":"Technical University of Darmstadt"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sebastian","family":"Trimpe","sequence":"additional","affiliation":[{"name":"RWTH Aachen University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"10584","event":{"name":"Thirty-Fifth International Joint Conference on Artificial Intelligence {IJCAI-26}","theme":"Artificial Intelligence","location":"Bremen, Germany","acronym":"IJCAI-2026","number":"35","sponsor":["International Joint Conferences on Artificial Intelligence Organization (IJCAI)"],"start":{"date-parts":[[2026,8,15]]},"end":{"date-parts":[[2026,8,21]]}},"container-title":["Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence"],"original-title":[],"deposited":{"date-parts":[[2026,11,17]],"date-time":"2026-11-17T11:27:12Z","timestamp":1794914832000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ijcai.org\/proceedings\/2026\/14"}},"subtitle":[],"proceedings-subject":"Artificial Intelligence Research Articles","short-title":[],"issued":{"date-parts":[[2026,9]]},"references-count":0,"URL":"https:\/\/doi.org\/10.24963\/ijcai.2026\/14","relation":{},"subject":[],"published":{"date-parts":[[2026,9]]}}}