{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,9,30]],"date-time":"2023-09-30T15:43:10Z","timestamp":1696088590517},"reference-count":0,"publisher":"IOS Press","isbn-type":[{"value":"9781643684369","type":"print"},{"value":"9781643684376","type":"electronic"}],"license":[{"start":{"date-parts":[[2023,9,28]],"date-time":"2023-09-28T00:00:00Z","timestamp":1695859200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,9,28]]},"abstract":"<jats:p>The performance of Graph Neural Networks (GNNs) deteriorates as the depth of the network increases. That performance drop is mainly attributed to oversmoothing, which leads to similar node representations through repeated graph convolutions. We show that in deep GNNs the activation function plays a crucial role in oversmoothing. We explain theoretically why this is the case and propose a simple modification to the slope of ReLU to reduce oversmoothing. The proposed approach enables deep networks without the need to change the network architecture or to add residual connections. We verify the theoretical results experimentally and further show that deep networks, which do not suffer from oversmoothing, are beneficial in the presence of the \u201ccold start\u201d problem, i.e. when there is no feature information about unlabeled nodes.<\/jats:p>","DOI":"10.3233\/faia230400","type":"book-chapter","created":{"date-parts":[[2023,9,29]],"date-time":"2023-09-29T09:11:38Z","timestamp":1695978698000},"source":"Crossref","is-referenced-by-count":0,"title":["Reducing Oversmoothing in Graph Neural Networks by Changing the Activation Function"],"prefix":"10.3233","author":[{"given":"Dimitrios","family":"Kelesis","sequence":"first","affiliation":[{"name":"School of Electrical Engineering and Computer Science, National Technical University of Athens, Greece"},{"name":"National Center for Scientific Research \u201cDemokritos\u201d, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dimitrios","family":"Vogiatzis","sequence":"additional","affiliation":[{"name":"National Center for Scientific Research \u201cDemokritos\u201d, Greece"},{"name":"American College of Greece, Deree"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Georgios","family":"Katsimpras","sequence":"additional","affiliation":[{"name":"National Center for Scientific Research \u201cDemokritos\u201d, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dimitris","family":"Fotakis","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering and Computer Science, National Technical University of Athens, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Georgios","family":"Paliouras","sequence":"additional","affiliation":[{"name":"National Center for Scientific Research \u201cDemokritos\u201d, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"7437","container-title":["Frontiers in Artificial Intelligence and Applications","ECAI 2023"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/FAIA230400","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,29]],"date-time":"2023-09-29T09:11:39Z","timestamp":1695978699000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/FAIA230400"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,28]]},"ISBN":["9781643684369","9781643684376"],"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/faia230400","relation":{},"ISSN":["0922-6389","1879-8314"],"issn-type":[{"value":"0922-6389","type":"print"},{"value":"1879-8314","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,28]]}}}