{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T15:48:25Z","timestamp":1781884105788,"version":"3.54.5"},"reference-count":35,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2022,9,8]],"date-time":"2022-09-08T00:00:00Z","timestamp":1662595200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Toyota Research Institute (TRI)"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>We present the MiniCity, a multi-vehicle evaluation platform for testing perception hardware and software for autonomous vehicles. The MiniCity is a 1\/10th scale city consisting of realistic urban scenery, intersections, and multiple fully autonomous 1\/10th scale vehicles with state-of-the-art sensors and algorithms. The MiniCity is used to evaluate and test perception algorithms both upstream and downstream in the autonomy stack, in urban driving scenarios such as occluded intersections and avoiding multiple vehicles. We demonstrate the MiniCity\u2019s ability to evaluate different sensor and algorithm configurations for perception tasks such as object detection and localization. For both tasks, the MiniCity platform is used to evaluate the task itself (accuracy in estimating obstacle pose and ego pose in the map) as well as the downstream performance in collision avoidance and lane following, respectively.<\/jats:p>","DOI":"10.3390\/s22186793","type":"journal-article","created":{"date-parts":[[2022,9,8]],"date-time":"2022-09-08T07:05:56Z","timestamp":1662620756000},"page":"6793","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Evaluating Autonomous Urban Perception and Planning in a 1\/10th Scale MiniCity"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5534-7939","authenticated-orcid":false,"given":"Noam","family":"Buckman","sequence":"first","affiliation":[{"name":"Computer Science & Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA 02139, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7249-3244","authenticated-orcid":false,"given":"Alex","family":"Hansen","sequence":"additional","affiliation":[{"name":"Computer Science & Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA 02139, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2225-7275","authenticated-orcid":false,"given":"Sertac","family":"Karaman","sequence":"additional","affiliation":[{"name":"Laboratory for Information & Decision Systems, Massachusetts Institute of Technology, Cambridge, MA 02139, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5473-3566","authenticated-orcid":false,"given":"Daniela","family":"Rus","sequence":"additional","affiliation":[{"name":"Computer Science & Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA 02139, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,9,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Huang, X., Rosman, G., Jasour, A., McGill, S.G., Leonard, J.J., and Williams, B.C. (2021). TIP: Task-Informed Motion Prediction for Intelligent Vehicles. arXiv.","DOI":"10.1109\/IROS47612.2022.9982100"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Buhler, A., Gaidon, A., Cramariuc, A., Ambrus, R., Rosman, G., and Burgard, W. (2020\u201324, January 24). Driving Through Ghosts: Behavioral Cloning with False Positives. Proceedings of the 2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA.","DOI":"10.1109\/IROS45743.2020.9340639"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Geiger, A., Lenz, P., and Urtasun, R. (2012, January 16\u201321). Are we ready for autonomous driving? The KITTI vision benchmark suite. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6248074"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Caesar, H., Bankiti, V., Lang, A.H., Vora, S., Liong, V.E., Xu, Q., Krishnan, A., Pan, Y., Baldan, G., and Beijbom, O. (2020, January 13\u201319). nuScenes: A multimodal dataset for autonomous driving. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01164"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Chang, M.F., Lambert, J., Sangkloy, P., Singh, J., Bak, S., Hartnett, A., Wang, D., Carr, P., Lucey, S., and Ramanan, D. (2019, January 15\u201320). Argoverse: 3D tracking and forecasting with rich maps. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00895"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Sun, P., Kretzschmar, H., Dotiwalla, X., Chouard, A., Patnaik, V., Tsui, P., Guo, J., Zhou, Y., Chai, Y., and Caine, B. (2020, January 13\u201319). Scalability in perception for autonomous driving: Waymo open dataset. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00252"},{"key":"ref_7","unstructured":"Geyer, J., Kassahun, Y., Mahmudi, M., Ricou, X., Durgesh, R., Chung, A.S., Hauswald, L., Pham, V.H., M\u00fchlegg, M., and Dorn, S. (2020). A2D2: Audi Autonomous Driving Dataset. arXiv."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2702","DOI":"10.1109\/TPAMI.2019.2926463","article-title":"The ApolloScape Open Dataset for Autonomous Driving and Its Application","volume":"42","author":"Huang","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"621","DOI":"10.1007\/978-3-319-67361-5_40","article-title":"AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles","volume":"5","author":"Shah","year":"2018","journal-title":"Springer Proc. Adv. Robot."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"902","DOI":"10.1007\/s11263-018-1073-7","article-title":"Sim4CV: A Photo-Realistic Simulator for Computer Vision Applications","volume":"126","author":"Casser","year":"2018","journal-title":"Int. J. Comput. Vis."},{"key":"ref_11","first-page":"1","article-title":"CARLA: An Open Urban Driving Simulator","volume":"78","author":"Dosovitskiy","year":"2017","journal-title":"Conf. Robot. Learn."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1143","DOI":"10.1109\/LRA.2020.2966414","article-title":"Learning Robust Control Policies for End-to-End Autonomous Driving From Data-Driven Simulation","volume":"5","author":"Amini","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_13","first-page":"77","article-title":"F1TENTH: An Open-source Evaluation Environment for Continuous Control and Reinforcement Learning","volume":"123","author":"Zheng","year":"2020","journal-title":"Proc. Mach. Learn. Res."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Balaji, B., Mallya, S., Genc, S., Gupta, S., Dirac, L., Khare, V., Roy, G., Sun, T., Tao, Y., and Townsend, B. (August, January 31). DeepRacer: Autonomous Racing Platform for Experimentation with Sim2Real Reinforcement Learning. Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France.","DOI":"10.1109\/ICRA40945.2020.9197465"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/MCS.2018.2876958","article-title":"AutoRally: An Open Platform for Aggressive Autonomous Driving","volume":"39","author":"Goldfain","year":"2019","journal-title":"IEEE Control Syst."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Paull, L., Tani, J., Ahn, H., Alonso-Mora, J., Carlone, L., Cap, M., Chen, Y.F., Choi, C., Dusek, J., and Fang, Y. (June, January 29). Duckietown: An open, inexpensive and flexible platform for autonomy education and research. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.","DOI":"10.1109\/ICRA.2017.7989179"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Karaman, S., Anders, A., Boulet, M., Connor, J., Gregson, K., Guerra, W., Guldner, O., Mohamoud, M., Plancher, B., and Shin, R. (2017, January 11). Project-based, collaborative, algorithmic robotics for high school students: Programming self-driving race cars at MIT. Proceedings of the 2017 IEEE Integrated STEM Education Conference (ISEC), Princeton, NJ, USA.","DOI":"10.1109\/ISECon.2017.7910242"},{"key":"ref_18","unstructured":"Buckman, N., Hansen, A., Karaman, S., and Rus, D. (2022, January 23\u201327). Sharing Intersection Control with Human Drivers in a 1\/10th Miniature City. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) Workshop on \u2018Shared Autonomy in Physical Human-Robot Interaction: Adaptability and Trust\u2019, Philadelphia, PA, USA."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Buckman, N., Pierson, A., Schwarting, W., Karaman, S., and Rus, D. (2019, January 3\u20138). Sharing is Caring: Socially-Compliant Autonomous Intersection Negotiation. Proceedings of the 2019 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China.","DOI":"10.1109\/IROS40897.2019.8967997"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Gog, I., Kalra, S., Schafhalter, P., Wright, M.A., Gonzalez, J.E., and Stoica, I. (June, January 30). Pylot: A Modular Platform for Exploring Latency-Accuracy Tradeoffs in Autonomous Vehicles. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi\u2019an, China.","DOI":"10.1109\/ICRA48506.2021.9561747"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Lopez, P.A., Behrisch, M., Bieker-Walz, L., Erdmann, J., Flotterod, Y.P., Hilbrich, R., Lucken, L., Rummel, J., Wagner, P., and Wiebner, E. (2018, January 4\u20137). Microscopic Traffic Simulation using SUMO. Proceedings of the 2018 21st International Conference on Intelligent Transportation Systems (ITSC), Maui, HI, USA.","DOI":"10.1109\/ITSC.2018.8569938"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Amini, A., Wang, T.H., Gilitschenski, I., Schwarting, W., Liu, Z., Han, S., Karaman, S., and Rus, D. (2022, January 23\u201327). VISTA 2.0: An Open, Data-driven Simulator for Multimodal Sensing and Policy Learning for Autonomous Vehicles. Proceedings of the 2022 International Conference on Robotics and Automation (ICRA), Philadelphia, PA, USA.","DOI":"10.1109\/ICRA46639.2022.9812276"},{"key":"ref_23","first-page":"1","article-title":"Mcity Grand Opening","volume":"46","author":"Briefs","year":"2015","journal-title":"Res. Rev."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Funke, J., Theodosis, P., Hindiyeh, R., Stanek, G., Kritatakirana, K., Gerdes, C., Langer, D., Hernandez, M., M\u00fcller-Bessler, B., and Huhnke, B. (2012, January 3\u20137). Up to the limits: Autonomous Audi TTS. Proceedings of the 2012 IEEE Intelligent Vehicles Symposium, Madrid, Spain.","DOI":"10.1109\/IVS.2012.6232212"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Naser, F., Dorhout, D., Proulx, S., Pendleton, S.D., Andersen, H., Schwarting, W., Paull, L., Alonso-Mora, J., Ang, M.H., and Karaman, S. (2017, January 11\u201314). A parallel autonomy research platform. Proceedings of the 2017 IEEE Intelligent Vehicles Symposium (IV), Los Angeles, CA, USA.","DOI":"10.1109\/IVS.2017.7995835"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Burnett, K., Schimpe, A., Samavi, S., Gridseth, M., Liu, C.W., Li, Q., Kroeze, Z., and Schoellig, A.P. (2019, January 20\u201324). Building a winning self-driving car in six months. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8794029"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Williams, G., Goldfain, B., Drews, P., Rehg, J.M., and Theodorou, E.A. (2018, January 21\u201325). Best Response Model Predictive Control for Agile Interactions between Autonomous Ground Vehicles. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia.","DOI":"10.1109\/ICRA.2018.8462831"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Pan, Y., Cheng, C.A., Saigol, K., Lee, K., Yan, X., Theodorou, E.A., and Boots, B. (2018, January 26\u201330). Agile Autonomous Driving using End-to-End Deep Imitation Learning. Proceedings of the Robotics: Science and Systems, Pittsburgh, PA, USA.","DOI":"10.15607\/RSS.2018.XIV.056"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Poggenhans, F., Pauls, J.H., Janosovits, J., Orf, S., Naumann, M., Kuhnt, F., and Mayr, M. (2018, January 4\u20137). Lanelet2: A high-definition map framework for the future of automated driving. Proceedings of the 2018 21st International Conference on Intelligent Transportation Systems (ITSC), Maui, HI, USA.","DOI":"10.1109\/ITSC.2018.8569929"},{"key":"ref_30","unstructured":"Coulter, R.C. (1992). Implementation of the Pure Pursuit Path Tracking Algorithm, Carnegie Mellon University. Technical Report."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Li, P., Chen, X., and Shen, S. (2019, January 15\u201320). Stereo R-CNN based 3D object detection for autonomous driving. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00783"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Yang, B., Luo, W., and Urtasun, R. (2018, January 18\u201323). PIXOR: Real-time 3D Object Detection from Point Clouds. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00798"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1007\/978-3-319-08338-4_25","article-title":"A generalized extended Kalman filter implementation for the robot operating system","volume":"302","author":"Moore","year":"2016","journal-title":"Adv. Intell. Syst. Comput."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/s10851-009-0161-2","article-title":"Metrics for 3D rotations: Comparison and analysis","volume":"35","author":"Huynh","year":"2009","journal-title":"J. Math. Imaging Vis."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1109\/TMECH.2008.915820","article-title":"Development of a scaled vehicle with longitudinal dynamics of an HMMWV for an ITS testbed","volume":"13","author":"Verma","year":"2008","journal-title":"IEEE\/ASME Trans. Mechatron."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/18\/6793\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:27:18Z","timestamp":1760142438000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/18\/6793"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,8]]},"references-count":35,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["s22186793"],"URL":"https:\/\/doi.org\/10.3390\/s22186793","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,8]]}}}