{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:54:13Z","timestamp":1750308853525,"version":"3.41.0"},"reference-count":11,"publisher":"Cambridge University Press (CUP)","issue":"S325","license":[{"start":{"date-parts":[[2017,5,30]],"date-time":"2017-05-30T00:00:00Z","timestamp":1496102400000},"content-version":"unspecified","delay-in-days":241,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. IAU"],"published-print":{"date-parts":[[2016,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>With new catalogues arriving such as the<jats:italic>Gaia<\/jats:italic>DR1, containing more than a billion objects, new methods of handling and visualizing these data volumes are needed. We show that by calculating statistics on a regular (N-dimensional) grid, visualizations of a billion objects can be done within a second on a modern desktop computer. This is achieved using memory mapping of hdf5 files together with a simple binning algorithm, which are part of a<jats:monospace>Python<\/jats:monospace>library called<jats:monospace>vaex<\/jats:monospace>. This enables efficient exploration or large datasets interactively, making science exploration of large catalogues feasible.<jats:monospace>Vaex<\/jats:monospace>is a<jats:monospace>Python<\/jats:monospace>library and an application, which allows for interactive exploration and visualization. The motivation for developing<jats:monospace>vaex<\/jats:monospace>is the catalogue of the<jats:italic>Gaia<\/jats:italic>satellite, however,<jats:monospace>vaex<\/jats:monospace>can also be used on SPH or N-body simulations, any other (future) catalogues such as SDSS, Pan-STARRS, LSST, etc. or other tabular data. The homepage for<jats:monospace>vaex<\/jats:monospace>is<jats:uri xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:type=\"simple\" xlink:href=\"http:\/\/vaex.astro.rug.nl\">http:\/\/vaex.astro.rug.nl<\/jats:uri>.<\/jats:p>","DOI":"10.1017\/s1743921316012795","type":"journal-article","created":{"date-parts":[[2017,5,30]],"date-time":"2017-05-30T11:04:51Z","timestamp":1496142291000},"page":"299-304","source":"Crossref","is-referenced-by-count":3,"title":["Interactive (statistical) visualisation and exploration of a billion objects with vaex"],"prefix":"10.1017","volume":"12","author":[{"given":"M. A.","family":"Breddels","sequence":"first","affiliation":[]}],"member":"56","published-online":{"date-parts":[[2017,5,30]]},"reference":[{"key":"S1743921316012795_ref009","unstructured":"Perryman M. A. C. , Hassan H. , Batut T. , et al., eds. 1989, The Hipparcos mission. Pre-launch status. Volume I: The Hipparcos satellite., Vol. 1"},{"key":"S1743921316012795_ref008","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2007.53"},{"key":"S1743921316012795_ref007","unstructured":"Lindegren L. , Lammers U. , Bastian U. , et al. 2016, ArXiv e-prints, arXiv:1609.04303"},{"key":"S1743921316012795_ref005","unstructured":"Ivezic Z. , Tyson J. A. , Abel B. , et al. 2008, ArXiv e-prints, arXiv:0805.2366"},{"key":"S1743921316012795_ref006","doi-asserted-by":"crossref","unstructured":"Kaiser N. , Burgett W. , Chambers K. , et al. 2010, in Proc. SPIE, Vol. 7733, Ground-based and Airborne Telescopes III, 77330E","DOI":"10.1117\/12.859188"},{"key":"S1743921316012795_ref002","unstructured":"Gaia Collaboration, et al. 2016, ArXiv e-prints, arXiv:1609.04153"},{"key":"S1743921316012795_ref003","doi-asserted-by":"publisher","DOI":"10.1046\/j.1365-8711.2000.03895.x"},{"key":"S1743921316012795_ref010","unstructured":"Taylor M. B. 2005, in Astronomical Society of the Pacific Conference Series, Vol. 347, Astronomical Data Analysis Software and Systems XIV, ed. P. Shopbell , M. Britton , & R. Ebert , 29"},{"key":"S1743921316012795_ref001","unstructured":"Gaia Collaboration, Brown A. G. A. , Vallenari A. , et al. 2016, ArXiv e-prints, arXiv:1609.04172"},{"key":"S1743921316012795_ref011","unstructured":"van Leeuwen F. , Evans D. W. , De Angeli F. , et al. 2016, A&A special Gaia volume"},{"key":"S1743921316012795_ref004","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2007.55"}],"container-title":["Proceedings of the International Astronomical Union"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S1743921316012795","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T21:13:51Z","timestamp":1750281231000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S1743921316012795\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,10]]},"references-count":11,"journal-issue":{"issue":"S325","published-print":{"date-parts":[[2016,10]]}},"alternative-id":["S1743921316012795"],"URL":"https:\/\/doi.org\/10.1017\/s1743921316012795","relation":{},"ISSN":["1743-9213","1743-9221"],"issn-type":[{"type":"print","value":"1743-9213"},{"type":"electronic","value":"1743-9221"}],"subject":[],"published":{"date-parts":[[2016,10]]}}}