{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T03:25:30Z","timestamp":1783740330217,"version":"3.55.0"},"reference-count":44,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2017,7,11]],"date-time":"2017-07-11T00:00:00Z","timestamp":1499731200000},"content-version":"vor","delay-in-days":365,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-1514268"],"award-info":[{"award-number":["IIS-1514268"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2016,7,11]]},"abstract":"<jats:p>\n                    We learn a probabilistic model connecting human poses and arrangements of object geometry from real-world observations of interactions collected with commodity RGB-D sensors. This model is encoded as a set\n                    <jats:italic toggle=\"yes\">of prototypical interaction graphs<\/jats:italic>\n                    (PiGraphs), a human-centric representation capturing physical contact and visual attention linkages between 3D geometry and human body parts. We use this encoding of the joint probability distribution over pose and geometry during everyday interactions to generate\n                    <jats:italic toggle=\"yes\">interaction snapshots<\/jats:italic>\n                    , which are static depictions of human poses and relevant objects during human-object interactions. We demonstrate that our model enables a novel human-centric understanding of 3D content and allows for jointly generating 3D scenes and interaction poses given terse high-level specifications, natural language, or reconstructed real-world scene constraints.\n                  <\/jats:p>","DOI":"10.1145\/2897824.2925867","type":"journal-article","created":{"date-parts":[[2016,7,11]],"date-time":"2016-07-11T12:04:33Z","timestamp":1468238673000},"page":"1-12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":118,"title":["PiGraphs"],"prefix":"10.1145","volume":"35","author":[{"given":"Manolis","family":"Savva","sequence":"first","affiliation":[{"name":"Stanford University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Angel X.","family":"Chang","sequence":"additional","affiliation":[{"name":"Stanford University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pat","family":"Hanrahan","sequence":"additional","affiliation":[{"name":"Stanford University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew","family":"Fisher","sequence":"additional","affiliation":[{"name":"Stanford University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthias","family":"Nie\u00dfner","sequence":"additional","affiliation":[{"name":"Stanford University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2016,7,11]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366175"},{"key":"e_1_2_2_2_1","doi-asserted-by":"crossref","unstructured":"Bohg J. Morales A. Asfour T. and Kragic D. 2013. Data-driven grasp synthesis---a survey.","DOI":"10.1109\/TRO.2013.2289018"},{"key":"e_1_2_2_3_1","doi-asserted-by":"crossref","unstructured":"Chang A. X. Savva M. and Manning C. D. 2014. Learning spatial knowledge for text to 3D scene generation. In Empirical Methods in Natural Language Processing (EMNLP).","DOI":"10.3115\/v1\/D14-1217"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383316"},{"key":"e_1_2_2_5_1","unstructured":"De la Torre F. Hodgins J. Montano J. Valcarcel S. and Macey J. 2009. Guide to the Carnegie Mellon university multimodal activity (CMU-MMAC) database. Robotics Institute Carnegie Mellon University."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","unstructured":"Delaitre V. Fouhey D. F. Laptev I. Sivic J. Gupta A. and Efros A. A. 2012. Scene semantics from long-term observation of people. In ECCV. 10.1007\/978-3-642-33783-3_21","DOI":"10.1007\/978-3-642-33783-3_21"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","unstructured":"Felzenszwalb P. F. and Huttenlocher D. P. 2004. Efficient graph-based image segmentation. IJCV. 10.1023\/B:VISI.0000022288.19776.77","DOI":"10.1023\/B:VISI.0000022288.19776.77"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","unstructured":"Fisher M. Ritchie D. Savva M. Funkhouser T. and Hanrahan P. 2012. Example-based synthesis of 3D object arrangements. In ACM TOG. 10.1145\/2366145.2366154","DOI":"10.1145\/2366145.2366154"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818057"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","unstructured":"Fouhey D. F. Delaitre V. Gupta A. Efros A. A. Laptev I. and Sivic J. 2012. People watching: Human actions as a cue for single view geometry. In ECCV. 10.1007\/978-3-642-33715-4_53","DOI":"10.1007\/978-3-642-33715-4_53"},{"key":"e_1_2_2_11_1","unstructured":"Gibson J. 1977. The concept of affordances. Perceiving acting and knowing."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","unstructured":"Grabner H. Gall J. and Van Gool L. 2011. What makes a chair a chair? In CVPR. 10.1109\/CVPR.2011.5995327","DOI":"10.1109\/CVPR.2011.5995327"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015755"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","unstructured":"Guo S. Southern R. Chang J. Greer D. and Zhang J. J. 2014. Adaptive motion synthesis for virtual characters: a survey. The Visual Computer 1--16. 10.1007\/s00371-014-0943-4","DOI":"10.1007\/s00371-014-0943-4"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","unstructured":"Gupta A. Satkin S. Efros A. A. and Hebert M. 2011. From 3D scene geometry to human workspace. In CVPR. 10.1109\/CVPR.2011.5995448","DOI":"10.1109\/CVPR.2011.5995448"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766914"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12694"},{"key":"e_1_2_2_18_1","doi-asserted-by":"crossref","unstructured":"Jiang Y. and Saxena A. 2013. Infinite latent conditional random fields for modeling environments through humans. In RSS.","DOI":"10.15607\/RSS.2013.IX.034"},{"key":"e_1_2_2_19_1","unstructured":"Jiang Y. Lim M. and Saxena A. 2012. Learning object arrangements in 3D scenes using human context. arXiv preprint arXiv:1206.6462."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","unstructured":"Jiang Y. Koppula H. and Saxena A. 2013. Hallucinated humans as the hidden context for labeling 3D scenes. In CVPR. 10.1109\/CVPR.2013.385","DOI":"10.1109\/CVPR.2013.385"},{"key":"e_1_2_2_21_1","doi-asserted-by":"crossref","unstructured":"Kallmann M. and Thalmann D. 1999. Modeling objects for interaction tasks. Springer.","DOI":"10.1007\/978-3-7091-6375-7_6"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185551"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12468"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","unstructured":"Kim V. G. Chaudhuri S. Guibas L. and Funkhouser T. 2014. Shape2Pose: Human-centric shape analysis. ACM TOG. 10.1145\/2601097.2601117","DOI":"10.1145\/2601097.2601117"},{"key":"e_1_2_2_25_1","doi-asserted-by":"crossref","unstructured":"Koppula H. S. and Saxena A. 2013. Anticipating human activities using object affordances for reactive robotic response. RSS.","DOI":"10.15607\/RSS.2013.IX.006"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","unstructured":"Koppula H. Gupta R. and Saxena A. 2013. Learning human activities and object affordances from RGB-D videos. IJRR. 10.1177\/0278364913478446","DOI":"10.1177\/0278364913478446"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141972"},{"key":"e_1_2_2_28_1","volume-title":"The Stanford CoreNLP natural language processing toolkit","author":"Manning C. D.","unstructured":"Manning, C. D., Surdeanu, M., Bauer, J., Finkel, J., Bethard, S. J., and McClosky, D. 2014. The Stanford CoreNLP natural language processing toolkit. In Association for Computational Linguistics (ACL): System Demonstrations."},{"key":"e_1_2_2_29_1","unstructured":"Mardia K. V. and Jupp P. E. 2009. Directional statistics vol. 494. John Wiley & Sons."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366172"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","unstructured":"Niessner M. Zollh\u00f6fer M. Izadi S. and Stamminger M. 2013. Real-time 3D reconstruction at scale using voxel hashing. ACM TOG. 10.1145\/2508363.2508374","DOI":"10.1145\/2508363.2508374"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV.2013.6474999"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","unstructured":"Savva M. Chang A. X. Hanrahan P. Fisher M. and Niessner M. 2014. SceneGrok: Inferring action maps in 3D environments. ACM TOG. 10.1145\/2661229.2661230","DOI":"10.1145\/2661229.2661230"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-25090-3_9"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","unstructured":"Shotton J. Sharp T. Kipman A. Fitzgibbon A. Finocchio M. Blake A. Cook M. and Moore R. 2013. Real-time human pose recognition in parts from single depth images. CACM. 10.1145\/2398356.2398381","DOI":"10.1145\/2398356.2398381"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00180-011-0232-x"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","unstructured":"Stark M. Lies P. Zillich M. Wyatt J. and Schiele B. 2008. Functional object class detection based on learned affordance cues. In Computer Vision Systems.","DOI":"10.5555\/1788524.1788572"},{"key":"e_1_2_2_38_1","volume-title":"Computer Vision Workshops (ICCV Workshops), 2009 IEEE 12th International Conference on, IEEE, 1089--1096","author":"Tenorth M.","unstructured":"Tenorth, M., Bandouch, J., and Beetz, M. 2009. The TUM kitchen data set of everyday manipulation activities for motion tracking and action recognition. In Computer Vision Workshops (ICCV Workshops), 2009 IEEE 12th International Conference on, IEEE, 1089--1096."},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.406"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.389"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","unstructured":"Xu K. Ma R. Zhang H. Zhu C. Shamir A. Cohen-Or D. and Huang H. 2014. Organizing heterogeneous scene collection through contextual focal points. ACM TOG. 10.1145\/2601097.2601109","DOI":"10.1145\/2601097.2601109"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964981"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766908"},{"key":"e_1_2_2_44_1","volume-title":"-C","author":"Zheng B.","year":"2014","unstructured":"Zheng, B., Zhao, Y., Yu, J. C., Ikeuchi, K., and Zhu, S.-C. 2014. Detecting potential falling objects by inferring human action and natural disturbance. In ICRA."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2897824.2925867","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2897824.2925867","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2897824.2925867","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,18]],"date-time":"2025-11-18T09:28:05Z","timestamp":1763458085000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2897824.2925867"}},"subtitle":["learning interaction snapshots from observations"],"short-title":[],"issued":{"date-parts":[[2016,7,11]]},"references-count":44,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2016,7,11]]}},"alternative-id":["10.1145\/2897824.2925867"],"URL":"https:\/\/doi.org\/10.1145\/2897824.2925867","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,7,11]]},"assertion":[{"value":"2016-07-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}