{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,4]],"date-time":"2025-05-04T14:42:02Z","timestamp":1746369722561,"version":"3.28.2"},"reference-count":58,"publisher":"Association for Computing Machinery (ACM)","issue":"11","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2024,7]]},"abstract":"<jats:p>In this paper, we propose nsDB, a novel neuro-symbolic database system that integrates neural and symbolic system architectures natively to address the weaknesses of each, providing a strong database capable of data managing, model learning, and complex analytical query processing over multi-modal data. We employ a real-world NBA data analytical query as an example to illustrate the functionality of each component in nsDB and highlight the research challenges to build it. We then present the key design principles and our preliminary attempts to address them.<\/jats:p><jats:p>In a nutshell, we envision that the next generation database system nsDB integrates the complex neural system with the simple symbolic system. Undoubtedly, nsDB will serve as a bridge between databases with AI models, which abstracts away the AI complexities but allows end users to enjoy the strong capabilities of them. We are in the early stages of the journey to build nsDB, there are many opening challenges, e.g., in-database model training, multi-objective query optimization, and database agent development. We hope the researchers from different communities (e.g., system, architecture, database, artificial intelligence) could tackle them together.<\/jats:p>","DOI":"10.14778\/3681954.3682000","type":"journal-article","created":{"date-parts":[[2024,8,30]],"date-time":"2024-08-30T16:23:36Z","timestamp":1725035016000},"page":"3283-3289","update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["nsDB: Architecting the Next Generation Database by Integrating Neural and Symbolic Systems"],"prefix":"10.14778","volume":"17","author":[{"given":"Ye","family":"Yuan","sequence":"first","affiliation":[{"name":"Beijing Institute of Technology, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bo","family":"Tang","sequence":"additional","affiliation":[{"name":"Southern Univ. of Sci. and Tech., Shenzhen, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tianfei","family":"Zhou","sequence":"additional","affiliation":[{"name":"Beijing Institute of Technology, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhiwei","family":"Zhang","sequence":"additional","affiliation":[{"name":"Beijing Institute of Technology, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianbin","family":"Qin","sequence":"additional","affiliation":[{"name":"Shenzhen University, Shenzhen, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,8,30]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"2024. 2023 NBA All-Star Game Promo. https:\/\/www.nba.com\/watch\/video\/2023-nba-all-star-game-promo."},{"key":"e_1_2_1_2_1","unstructured":"2024. AI Functions on Databricks. https:\/\/docs.databricks.com\/en\/large-language-models\/ai-functions.html."},{"key":"e_1_2_1_3_1","unstructured":"2024. Amazon Redshift ML. https:\/\/aws.amazon.com\/blogs\/aws\/amazon-redshift-ml-is-now-generally-available-use-sql-to-create-machine-learning-models-and-make-predictions-from-your-data\/."},{"key":"e_1_2_1_4_1","unstructured":"2024. Amazon SageMaker. https:\/\/aws.amazon.com\/sagemaker\/."},{"key":"e_1_2_1_5_1","unstructured":"2024. Apache Flink. https:\/\/flink.apache.org\/."},{"key":"e_1_2_1_6_1","unstructured":"2024. Apache Hive. https:\/\/hive.apache.org\/."},{"key":"e_1_2_1_7_1","unstructured":"2024. Apache Spark. https:\/\/spark.apache.org\/."},{"key":"e_1_2_1_8_1","unstructured":"2024. Boost Fiber. https:\/\/www.boost.org\/doc\/libs\/1_83_0\/libs\/fiber\/doc\/html\/fiber\/overview.html."},{"key":"e_1_2_1_9_1","unstructured":"2024. DAPHNE: Integrated Data Analysis Pipelines for Large-Scale Data Management HPC and Machine Learning. https:\/\/daphne-eu.github.io\/."},{"key":"e_1_2_1_10_1","unstructured":"2024. EvaDB: Database system for AI-powered apps. https:\/\/github.com\/georgia-tech-db\/evadb."},{"key":"e_1_2_1_11_1","unstructured":"2024. Introduction to AI and ML in BigQuery. https:\/\/cloud.google.com\/bigquery\/docs\/bqml-introduction."},{"key":"e_1_2_1_12_1","unstructured":"2024. Large Language Models for sentiment analysis with Amazon Red-shift ML. https:\/\/aws.amazon.com\/blogs\/big-data\/large-language-models-for-sentiment-analysis-with-amazon-redshift-ml-preview\/."},{"key":"e_1_2_1_13_1","unstructured":"2024. libco. https:\/\/github.com\/Tencent\/libco."},{"key":"e_1_2_1_14_1","unstructured":"2024. ModelDB: An open-source system for Machine Learning model versioning metadata and experiment management. https:\/\/github.com\/VertaAI\/modeldb."},{"key":"e_1_2_1_15_1","unstructured":"2024. MySQL. https:\/\/www.mysql.com\/."},{"key":"e_1_2_1_16_1","unstructured":"2024. PostgresML. https:\/\/postgresml.org\/."},{"key":"e_1_2_1_17_1","unstructured":"2024. PostgreSQL. https:\/\/www.postgresql.org\/."},{"key":"e_1_2_1_18_1","unstructured":"2024. SQL-only LLM for text generation using Vertex AI model in Big-Query. https:\/\/cloud.google.com\/blog\/products\/ai-machine-learning\/llm-with-vertex-ai-only-using-sql-queries-in-bigquery."},{"key":"e_1_2_1_19_1","unstructured":"2024. Symbolic System. https:\/\/en.wikipedia.org\/wiki\/Computer_algebra."},{"key":"e_1_2_1_20_1","doi-asserted-by":"crossref","unstructured":"Arvind Arasu Christopher R\u00e9 and Dan Suciu. 2009. Large-scale deduplication with constraints using dedupalog. In ICDE. 952--963.","DOI":"10.1109\/ICDE.2009.43"},{"key":"e_1_2_1_21_1","doi-asserted-by":"crossref","unstructured":"Marcelo Arenas Leopoldo Bertossi and Jan Chomicki. 1999. Consistent query answers in inconsistent databases. In PODS. 68--79.","DOI":"10.1145\/303976.303983"},{"key":"e_1_2_1_22_1","volume-title":"Rock: Cleaning Data by Embedding ML in Logic Rules. In SIGMOD.","author":"Bao Xianchun","year":"2024","unstructured":"Xianchun Bao, Zian Bao, Binbin Bie, Qingsong Duan, Wenfei Fan, Hui Lei, Daji Li, Wei Lin, Peng Liu, Zhicong Lv, Mingliang Ouyang, Shuai Tang, Yaoshu Wang, Qiyuan Wei, Min Xie, Jing Zhang, Xin Zhang, Runxiao Zhao, and Shuping Zhou. 2024. Rock: Cleaning Data by Embedding ML in Logic Rules. In SIGMOD."},{"key":"e_1_2_1_23_1","doi-asserted-by":"crossref","unstructured":"Nils Boeschen and Carsten Binnig. 2022. GaccO-A GPU-accelerated OLTP DBMS. In SIGMOD. 1003--1016.","DOI":"10.1145\/3514221.3517876"},{"key":"e_1_2_1_24_1","volume-title":"Symphony: Towards natural language query answering over multi-modal data lakes. In CIDR. 8--151.","author":"Chen Zui","year":"2023","unstructured":"Zui Chen, Zihui Gu, Lei Cao, Ju Fan, Sam Madden, and Nan Tang. 2023. Symphony: Towards natural language query answering over multi-modal data lakes. In CIDR. 8--151."},{"key":"e_1_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Dawei Cheng Sheng Xiang Chencheng Shang Yiyi Zhang Fangzhou Yang and Liqing Zhang. 2020. Spatio-temporal attention-based neural network for credit card fraud detection. In AAAI. 362--369.","DOI":"10.1609\/aaai.v34i01.5371"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.14778\/3625054.3625056"},{"key":"e_1_2_1_27_1","unstructured":"Periklis Chrysogelos Panagiotis Sioulas and Anastasia Ailamaki. 2019. Hardware-conscious query processing in gpu-accelerated analytical engines. In CIDR."},{"key":"e_1_2_1_28_1","doi-asserted-by":"crossref","unstructured":"Francesco Del Buono Matteo Paganelli Paolo Sottovia Matteo Interlandi and Francesco Guerra. 2021. Transforming ML predictive pipelines into SQL with MASQ. In SIGMOD. 2696--2700.","DOI":"10.1145\/3448016.3452771"},{"key":"e_1_2_1_29_1","volume-title":"Arcface: Additive angular margin loss for deep face recognition. In CVPR. 4690--4699.","author":"Deng Jiankang","year":"2019","unstructured":"Jiankang Deng, Jia Guo, Niannan Xue, and Stefanos Zafeiriou. 2019. Arcface: Additive angular margin loss for deep face recognition. In CVPR. 4690--4699."},{"key":"e_1_2_1_30_1","unstructured":"Wenfei Fan Ping Lu Kehan Pan Ruochun Jin and Wenyuan Yu. 2024. Linking entities across relations and graphs. In TODS. 634--647."},{"key":"e_1_2_1_31_1","doi-asserted-by":"crossref","unstructured":"Christoph Feichtenhofer Haoqi Fan Jitendra Malik and Kaiming He. 2019. Slow-fast networks for video recognition. In ICCV. 6202--6211.","DOI":"10.1109\/ICCV.2019.00630"},{"key":"e_1_2_1_32_1","doi-asserted-by":"crossref","unstructured":"Vijay Gadepally Peinan Chen Jennie Duggan Aaron Elmore Brandon Haynes Jeremy Kepner Samuel Madden Tim Mattson and Michael Stonebraker. 2016. The BigDAWG polystore system and architecture. In HPEC. 1--6.","DOI":"10.1109\/HPEC.2016.7761636"},{"key":"e_1_2_1_33_1","volume-title":"Jes\u00fas Camacho-Rodr\u00edguez, and Matteo Interlandi.","author":"Gandhi Apurva","year":"2023","unstructured":"Apurva Gandhi, Yuki Asada, Victor Fu, Advitya Gemawat, Lihao Zhang, Rathijit Sen, Carlo Curino, Jes\u00fas Camacho-Rodr\u00edguez, and Matteo Interlandi. 2023. The tensor data platform: Towards an ai-centric database system. CIDR."},{"key":"e_1_2_1_34_1","unstructured":"Geoffrey Hinton Oriol Vinyals and Jeff Dean. 2015. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3422648.3422659"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.14778\/3551793.3551801"},{"key":"e_1_2_1_37_1","unstructured":"Md Kamruzzaman Sarker Lu Zhou Aaron Eberhart and Pascal Hitzler. 2021. Neuro-Symbolic Artificial Intelligence: Current Trends. arXiv e-prints arXiv-2105."},{"key":"e_1_2_1_38_1","volume-title":"VIVA: An End-to-End System for Interactive Video Analytics. In CIDR.","author":"Kang Daniel","year":"2022","unstructured":"Daniel Kang, Francisco Romero, Peter D Bailis, Christos Kozyrakis, and Matei Zaharia. 2022. VIVA: An End-to-End System for Interactive Video Analytics. In CIDR."},{"key":"e_1_2_1_39_1","unstructured":"Konstantinos Karanasos Matteo Interlandi Doris Xin Fotis Psallidas Rathijit Sen Kwanghyun Park Ivan Popivanov Supun Nakandal Subru Krishnan Markus Weimer et al. 2020. Extending Relational Query Processing with ML Inference. CIDR."},{"key":"e_1_2_1_40_1","volume-title":"Tao: Improving Resource Utilization while Guaranteeing SLO in Multi-tenant Relational Database-as-a-Service. In SIGMOD.","author":"Liu Haotian","year":"2025","unstructured":"Haotian Liu, Runzhong Li, Ziyang Zhang, and Bo Tang. 2025. Tao: Improving Resource Utilization while Guaranteeing SLO in Multi-tenant Relational Database-as-a-Service. In SIGMOD."},{"key":"e_1_2_1_41_1","volume-title":"Huan Li, Mingji Han, Qian Li, and Zhenghai Luo.","author":"Liu Haotian","year":"2022","unstructured":"Haotian Liu, Bo Tang, Jiashu Zhang, Yangshen Deng, Xiao Yan, Xinying Zheng, Qiaomu Shen, Dan Zeng, Zunyao Mao, Chaozu Zhang, Zhengxin You, Zhihao Wang, Runzhe Jiang, Fang Wang, Yiu Man Lung, Huan Li, Mingji Han, Qian Li, and Zhenghai Luo. 2022. GHive: accelerating analytical query processing in apache hive via CPU-GPU heterogeneous computing. In SoCC. 158--172."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3277006.3277013"},{"key":"e_1_2_1_43_1","unstructured":"Amir Netz Surajit Chaudhuri Jeff Bernhardt and Usama Fayyad. 2000. Integration of data mining and relational databases. In VLDB. 285--296."},{"key":"e_1_2_1_44_1","volume-title":"Yuncheng Wu, Xiaokui Xiao, Naili Xing, Cong Yue, Lingze Zeng, Meihui Zhang, et al.","author":"Ooi Beng Chin","year":"2024","unstructured":"Beng Chin Ooi, Shaofeng Cai, Gang Chen, Kian Lee Tan, Yuncheng Wu, Xiaokui Xiao, Naili Xing, Cong Yue, Lingze Zeng, Meihui Zhang, et al. 2024. NeurDB: An AI-powered Autonomous Data System. arXiv preprint arXiv:2405.03924 (2024)."},{"key":"e_1_2_1_45_1","doi-asserted-by":"crossref","unstructured":"Kwanghyun Park Karla Saur Dalitso Banda Rathijit Sen Matteo Interlandi and Konstantinos Karanasos. 2022. End-to-end optimization of machine learning prediction queries. In SIGMOD. 587--601.","DOI":"10.1145\/3514221.3526141"},{"key":"e_1_2_1_46_1","first-page":"1405","article-title":"CGgraph: An Ultrafast Graph Processing System on Modern Commodity CPU-GPU Co-processor","volume":"17","author":"Pengjie Cui","year":"2024","unstructured":"Cui Pengjie, Liu Haotian, Tang Bo, and Yuan Ye. 2024. CGgraph: An Ultrafast Graph Processing System on Modern Commodity CPU-GPU Co-processor. PVLDB 17, 6 (2024), 1405--1417.","journal-title":"PVLDB"},{"key":"e_1_2_1_47_1","volume-title":"Arachne: Core-Aware thread management. In OSDI. 145--160.","author":"Qin Henry","year":"2018","unstructured":"Henry Qin, Qian Li, Jacqueline Speiser, Peter Kraft, and John Ousterhout. 2018. Arachne: Core-Aware thread management. In OSDI. 145--160."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.14778\/3137628.3137631"},{"key":"e_1_2_1_49_1","volume-title":"Facenet: A unified embedding for face recognition and clustering. In CVPR. 815--823.","author":"Schroff Florian","year":"2015","unstructured":"Florian Schroff, Dmitry Kalenichenko, and James Philbin. 2015. Facenet: A unified embedding for face recognition and clustering. In CVPR. 815--823."},{"key":"e_1_2_1_50_1","volume-title":"QEVIS: Multi-grained Visualization of Distributed Query Execution. TVCG, 153--163.","author":"Shen Qiaomu","year":"2024","unstructured":"Qiaomu Shen, Zhengxin You, Xiao Yan, Chaozu Zhang, Ke Xu, Dan Zeng, Jianbin Qin, and Bo Tang. 2024. QEVIS: Multi-grained Visualization of Distributed Query Execution. TVCG, 153--163."},{"key":"e_1_2_1_51_1","doi-asserted-by":"crossref","unstructured":"Du Tran Lubomir Bourdev Rob Fergus Lorenzo Torresani and Manohar Paluri. 2015. Learning spatiotemporal features with 3d convolutional networks. In ICCV. 4489--4497.","DOI":"10.1109\/ICCV.2015.510"},{"key":"e_1_2_1_52_1","unstructured":"Matthew A Turk and Alex P Pentland. 1991. Face recognition using eigenfaces. In CVPR. 586--587."},{"key":"e_1_2_1_53_1","first-page":"1","article-title":"Speeding Up End-to-end Query Execution via Learning-based Progressive Cardinality Estimation","volume":"1","author":"Wang Fang","year":"2023","unstructured":"Fang Wang, Xiao Yan, Man Lung Yiu, Shuai LI, Zunyao Mao, and Bo Tang. 2023. Speeding Up End-to-end Query Execution via Learning-based Progressive Cardinality Estimation. SIGMOD 1, 1 (2023), 1--25.","journal-title":"SIGMOD"},{"key":"e_1_2_1_54_1","doi-asserted-by":"crossref","unstructured":"Limin Wang Bingkun Huang Zhiyu Zhao Zhan Tong Yinan He Yi Wang Yali Wang and Yu Qiao. 2023. Videomae v2: Scaling video masked autoencoders with dual masking. In CVPR. 14549--14560.","DOI":"10.1109\/CVPR52729.2023.01398"},{"key":"e_1_2_1_55_1","volume-title":"Tensor relational algebra for distributed machine learning system design. PVLDB 14, 8","author":"Yuan Binhang","year":"2021","unstructured":"Binhang Yuan, Dimitrije Jankov, Jia Zou, Yuxin Tang, Daniel Bourgeois, and Chris Jermaine. 2021. Tensor relational algebra for distributed machine learning system design. PVLDB 14, 8 (2021)."},{"key":"e_1_2_1_56_1","first-page":"671","article-title":"TVM: A Tile-based Video Management Framework","volume":"17","author":"Zhong Tianxiong","year":"2024","unstructured":"Tianxiong Zhong, Zhiwei Zhang, Guo Lu, Ye Yuan, Yu-Ping Wang, and Guoren Wang. 2024. TVM: A Tile-based Video Management Framework. PVLDB 17, 4, 671--684.","journal-title":"PVLDB"},{"key":"e_1_2_1_57_1","unstructured":"Lixi Zhou Qi Lin Kanchan Chowdhury Saif Masood Alexandrem Eichenberger Hong Min Alexander Sim Jie Wang Yida Wang Kesheng Wu Binhang Yuan and jia Zou. 2024. Serving Deep Learning Models from Relational Databases. In EDBT. 717--724."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11432-023-3823-6"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3681954.3682000","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,27]],"date-time":"2024-11-27T15:17:50Z","timestamp":1732720670000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3681954.3682000"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7]]},"references-count":58,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2024,7]]}},"alternative-id":["10.14778\/3681954.3682000"],"URL":"https:\/\/doi.org\/10.14778\/3681954.3682000","relation":{},"ISSN":["2150-8097"],"issn-type":[{"type":"print","value":"2150-8097"}],"subject":[],"published":{"date-parts":[[2024,7]]},"assertion":[{"value":"2024-08-30","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}