{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,21]],"date-time":"2025-11-21T18:22:00Z","timestamp":1763749320421,"version":"3.37.3"},"reference-count":56,"publisher":"Springer Science and Business Media LLC","license":[{"start":{"date-parts":[[2024,8,1]],"date-time":"2024-08-01T00:00:00Z","timestamp":1722470400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,8,1]],"date-time":"2024-08-01T00:00:00Z","timestamp":1722470400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001872","name":"CDTI","doi-asserted-by":"crossref","award":["SNEO-20222386"],"award-info":[{"award-number":["SNEO-20222386"]}],"id":[{"id":"10.13039\/501100001872","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100004233","name":"Universitat Polit\u00e8cnica de Val\u00e8ncia","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004233","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Neural Comput &amp; Applic"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Automatic transcription of large series of historical handwritten documents generally aims at allowing to search for textual information in these documents. However, automatic transcripts often lack the level of accuracy needed for reliable text indexing and search purposes. Probabilistic Indexing (PrIx) offers a unique alternative to raw transcripts. Since it needs training data to achieve good search performance, PrIx-based crowdsourcing techniques are introduced in this paper to gather the required data. In the proposed approach, PrIx confidence measures are used to drive a correction process in which users can amend errors and possibly add missing text. In a further step, corrected data are used to retrain the PrIx models. Results on five large series are reported which show consistent improvements after retraining. However, it can be argued whether the overall costs of the crowdsourcing operation pay off for the improvements, or perhaps it would have been more cost-effective to just start with a larger and cleaner amount of professionally produced training transcripts.<\/jats:p>","DOI":"10.1007\/s00521-024-10188-0","type":"journal-article","created":{"date-parts":[[2024,8,1]],"date-time":"2024-08-01T19:02:34Z","timestamp":1722538954000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Ground-truth generation through crowdsourcing with probabilistic indexes"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0423-2020","authenticated-orcid":false,"given":"Joan Andreu","family":"S\u00e1nchez","sequence":"first","affiliation":[]},{"given":"Enrique","family":"Vidal","sequence":"additional","affiliation":[]},{"given":"Vicente","family":"Bosch","sequence":"additional","affiliation":[]},{"given":"Lorenzo","family":"Quir\u00f3s","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,8,1]]},"reference":[{"key":"10188_CR1","doi-asserted-by":"publisher","DOI":"10.46298\/jdmdh.5759","author":"S Blickhan","year":"2019","unstructured":"Blickhan S, Krawczyk C, Hanson D, Boyer A, Simenstad A, van Hyning V (2019) Individual vs collaborative methods of crowdsourced transcription. J Data Mining Digit Hum. https:\/\/doi.org\/10.46298\/jdmdh.5759","journal-title":"J Data Mining Digit Hum"},{"key":"10188_CR2","unstructured":"Bluche T (2015) Deep neural networks for large vocabulary handwritten text recognition. PhD thesis, Ecole Doctorale Informatique de Paris-Sud - Laboratoire d\u2019Informatique pour la M\u00e9canique et les Sciences de l\u2019Ing\u00e9nieur"},{"key":"10188_CR3","doi-asserted-by":"crossref","unstructured":"Bluche T, Hamel S, Kermorvant C, et\u00a0al (2017) Preparatory KWS experiments for large-scale indexing of a vast medieval manuscript collection in the HIMANIS project. In: International conference on document analysis and recognition (ICDAR), pp 311\u2013316","DOI":"10.1109\/ICDAR.2017.59"},{"issue":"2","key":"10188_CR4","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1093\/llc\/fqs004","volume":"27","author":"T Causer","year":"2012","unstructured":"Causer T, Tonra J, Wallace V (2012) Transcription maximized; expense minimized? Crowdsourcing and editing the collected works of Jeremy Bentham. Lit Linguist Comput 27(2):119\u2013137","journal-title":"Lit Linguist Comput"},{"issue":"3","key":"10188_CR5","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1093\/llc\/fqx064","volume":"33","author":"T Causer","year":"2018","unstructured":"Causer T, Grint K, Sichani AM et al (2018) \u2018making such bargain\u2019: transcribe Bentham and the quality and cost-effectiveness of crowdsourced transcription. Digit Scholar Hum 33(3):467\u2013487","journal-title":"Digit Scholar Hum"},{"key":"10188_CR6","doi-asserted-by":"crossref","unstructured":"Chang JC, Amershi S, Kamar E (2017) Revolt: Collaborative crowdsourcing for labeling machine learning datasets. In: Proceedings of the 2017 CHI conference on human factors in computing systems, CHI \u201917, pp 2334\u20132346","DOI":"10.1145\/3025453.3026044"},{"key":"10188_CR7","unstructured":"Dahl CM, Johansen TS, S\u00f8rensen EN, et\u00a0al (2021) Applications of machine learning in document digitisation. arXiv preprint arXiv:2102.03239"},{"key":"10188_CR8","doi-asserted-by":"crossref","unstructured":"Gatos B, Louloudis G, Causer T, et\u00a0al (2014) Ground-truth production in the transcriptorium project. In: 2014 11th IAPR International workshop on document analysis systems, pp 237\u2013241","DOI":"10.1109\/DAS.2014.23"},{"issue":"2","key":"10188_CR9","doi-asserted-by":"publisher","first-page":"409","DOI":"10.1109\/TASLP.2016.2634123","volume":"25","author":"E Granell","year":"2016","unstructured":"Granell E, Martinez-Hinarejos CD (2016) Multimodal crowdsourcing for transcribing handwritten documents. IEEE\/ACM Trans Audio, Speech Lang Process 25(2):409\u2013419","journal-title":"IEEE\/ACM Trans Audio, Speech Lang Process"},{"issue":"2","key":"10188_CR10","doi-asserted-by":"publisher","first-page":"398","DOI":"10.1111\/coin.12169","volume":"34","author":"E Granell","year":"2018","unstructured":"Granell E, Romero V, Mart\u00ednez-Hinarejos CD (2018) Multimodality, interactivity, and crowdsourcing for document transcription. Comput Intell 34(2):398\u2013419","journal-title":"Comput Intell"},{"key":"10188_CR11","unstructured":"Granet A, Hervy B, Jimenez GR, et\u00a0al (2018) Crowdsourcing-based annotation of the accounting registers of the Italian comedy. In: 11th International conference on language resources and evaluation (LREC)"},{"issue":"5","key":"10188_CR12","doi-asserted-by":"publisher","first-page":"855","DOI":"10.1109\/TPAMI.2008.137","volume":"31","author":"A Graves","year":"2009","unstructured":"Graves A, Liwicki M, Fern\u00e1ndez S et al (2009) A novel connectionist system for unconstrained handwriting recognition. IEEE Trans Pattern Anal Mach Intell 31(5):855\u2013868","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"10188_CR13","doi-asserted-by":"crossref","unstructured":"Hast A, Cullhed P, Vats E (2017) Text-text extractor tool for handwritten document transcription and annotation. In: Italian research conference on digital libraries, Springer, pp 81\u201392","DOI":"10.1007\/978-3-319-73165-0_8"},{"key":"10188_CR14","doi-asserted-by":"crossref","unstructured":"Kahle P, Colutto S, Hackl G, et\u00a0al (2017) Transkribus\u2014a service platform for transcription, recognition and retrieval of historical documents. In: 2017 14th IAPR International conference on document analysis and recognition (ICDAR), pp 19\u201324","DOI":"10.1109\/ICDAR.2017.307"},{"issue":"02","key":"10188_CR15","doi-asserted-by":"publisher","first-page":"64","DOI":"10.3390\/info12020064","volume":"12","author":"E Kaldeli","year":"2021","unstructured":"Kaldeli E, Menis-Mastromichalakis O, Bekiaris S et al (2021) Crowdheritage: crowdsourcing for improving the quality of cultural heritage metadata. Information 12(02):64","journal-title":"Information"},{"key":"10188_CR16","doi-asserted-by":"crossref","unstructured":"Kiessling B, Tissot R, Stokes P, et\u00a0al (2019) escriptorium: an open source platform for historical document analysis. In: 2019 International conference on document analysis and recognition workshops (ICDARW), pp 19\u201319","DOI":"10.1109\/ICDARW.2019.10032"},{"key":"10188_CR17","unstructured":"Lang ASID, Rio-Ross J (2011) Using amazon mechanical Turk to transcribe historical handwritten documents. Code4Lib J 15. https:\/\/journal.code4lib.org\/articles\/6004"},{"key":"10188_CR18","unstructured":"Leon SM (2016) Build, analyse and generalise: Community transcription of the papers of the war department and the development of Scripto. In: Crowdsourcing our cultural heritage. pp 89\u2013112"},{"issue":"2","key":"10188_CR19","doi-asserted-by":"publisher","first-page":"262","DOI":"10.1108\/AJIM-09-2019-0245","volume":"72","author":"J Liang","year":"2020","unstructured":"Liang J, Wang H, Li X (2020) Task design and assignment of full-text generation on mass Chinese historical archives in digital humanities: a crowdsourcing approach. Aslib J Inf Manag 72(2):262\u2013286","journal-title":"Aslib J Inf Manag"},{"issue":"05","key":"10188_CR20","doi-asserted-by":"publisher","first-page":"1263,003","DOI":"10.1142\/S0218001412630037","volume":"26","author":"D Martin-Albo","year":"2012","unstructured":"Martin-Albo D, Romero V, Toselli AH et al (2012) Multimodal computer-assisted transcription of text images at character-level interaction. Int J Pattern Recognit Artif Intell 26(05):1263,003","journal-title":"Int J Pattern Recognit Artif Intell"},{"issue":"3\u20134","key":"10188_CR21","doi-asserted-by":"publisher","first-page":"347","DOI":"10.18352\/lq.7999","volume":"20","author":"M Moyle","year":"2011","unstructured":"Moyle M, Tonra J, Wallace V (2011) Manuscript transcription by crowdsourcing: transcribe Bentham. LIBER Q J Assoc Eur Res Librari 20(3\u20134):347\u2013356","journal-title":"LIBER Q J Assoc Eur Res Librari"},{"issue":"5","key":"10188_CR22","doi-asserted-by":"publisher","first-page":"102,606","DOI":"10.1016\/j.ipm.2021.102606","volume":"58","author":"E Nieddu","year":"2021","unstructured":"Nieddu E, Firmani D, Merialdo P et al (2021) In codice ratio: a crowd-enabled solution for low resource machine transcription of the Vatican registers. Inform Process Manag 58(5):102,606","journal-title":"Inform Process Manag"},{"key":"10188_CR23","doi-asserted-by":"crossref","unstructured":"Pratikakis I, Zagoris K, Gatos B, et\u00a0al (2014) ICFHR 2014 competition on handwritten keyword spotting (H-KWS 2014). In: 2014 14th International conference on frontiers in handwriting recognition, pp 814\u2013819","DOI":"10.1109\/ICFHR.2014.142"},{"key":"10188_CR24","unstructured":"Puigcerver J (2018) A probabilistic formulation of keyword spotting. PhD thesis, Universitat Polit\u00e8cnica de Val\u00e8ncia"},{"key":"10188_CR25","doi-asserted-by":"crossref","unstructured":"Puigcerver J, Toselli AH, Vidal E (2015) ICDAR2015 competition on keyword spotting for handwritten documents. In: 2015 13th International conference on document analysis and recognition (ICDAR), pp 1176\u20131180","DOI":"10.1109\/ICDAR.2015.7333946"},{"key":"10188_CR26","unstructured":"Quir\u00f3s L (2018) Multi-task handwritten document layout analysis. CoRR arXiv:1806.08852"},{"key":"10188_CR27","unstructured":"Quir\u00f3s L, Vidal E (2021) Evaluation of a region proposal architecture for multi-task document layout analysis. CoRR arXiv:2106.11797"},{"key":"10188_CR28","unstructured":"Raghallaigh B\u00d3, Palandri A, Mac\u00a0C\u00e1rthaigh C (2022) Handwritten text recognition (HTR) for Irish-language folklore. In: Proceedings of the 4th Celtic language technology workshop within LREC2022, pp 121\u2013126"},{"key":"10188_CR29","unstructured":"Ridge M, Blickhan S, Ferriter M, et\u00a0al (2021) 10. working with crowdsourced data. The collective wisdom handbook: perspectives on crowdsourcing in cultural heritage-community review version"},{"key":"10188_CR30","series-title":"Series in machine perception and artificial intelligence (MPAI)","doi-asserted-by":"publisher","DOI":"10.1142\/8394","volume-title":"Multimodal interactive handwritten text transcription","author":"V Romero","year":"2012","unstructured":"Romero V, Toselli AH, Vidal E (2012) Multimodal interactive handwritten text transcription. Series in machine perception and artificial intelligence (MPAI), vol 80. World Scientific Publishing. https:\/\/doi.org\/10.1142\/8394"},{"key":"10188_CR31","unstructured":"S\u00e1nchez JA, Vidal E (2021) Handwritten text recognition for the EDT project. Part I: model training and automatic transcription. In: Bermejo MA et al. (ed) Proc of the EDT Alicante workshop. To appear"},{"key":"10188_CR32","doi-asserted-by":"crossref","unstructured":"S\u00e1nchez JA, Toselli AH, Romero V, et\u00a0al (2015) ICDAR 2015 competition HTRtS: handwritten text recognition on the tranScriptorium dataset. In: 13th International conference on document analysis and recognition (ICDAR), pp 1166\u20131170","DOI":"10.1109\/ICDAR.2015.7333944"},{"key":"10188_CR33","doi-asserted-by":"crossref","unstructured":"S\u00e1nchez JA, Romero V, Toselli AH, et\u00a0al (2016) ICFHR2016 competition on handwritten text recognition on the READ dataset. In: Proceedings of 15th ICFHR, pp 630\u2013635","DOI":"10.1109\/ICFHR.2016.0120"},{"key":"10188_CR34","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1016\/j.patcog.2019.05.025","volume":"94","author":"JA S\u00e1nchez","year":"2019","unstructured":"S\u00e1nchez JA, Romero V, Toselli AH et al (2019) A set of benchmarks for handwritten text recognition on historical documents. Pattern Recogn 94:122\u2013134","journal-title":"Pattern Recogn"},{"key":"10188_CR35","doi-asserted-by":"crossref","unstructured":"S\u00e1nchez JA, Vidal E, Bosch V (2022) Effective crowdsourcing in the EDT project with probabilistic indexes. In: International workshop on document analysis systems, Springer, pp 291\u2013305","DOI":"10.1007\/978-3-031-06555-2_20"},{"key":"10188_CR36","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1016\/j.patrec.2020.01.007","volume":"131","author":"A Santoro","year":"2020","unstructured":"Santoro A, Marcelli A (2020) Using keyword spotting systems as tools for the transcription of historical handwritten documents: models and procedures for performance evaluation. Pattern Recogn Lett 131:329\u2013335","journal-title":"Pattern Recogn Lett"},{"key":"10188_CR37","doi-asserted-by":"crossref","unstructured":"Schomaker L (2020) Handwritten historical document analysis, recognition and retrieval-state of the art and future trends, World Scientific, London, chap Lifelong learning for text retrieval and recognition in historical handwritten document collections, pp 221\u2013248","DOI":"10.1142\/9789811203244_0012"},{"issue":"1","key":"10188_CR38","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1007\/s10032-013-0204-5","volume":"17","author":"N Serrano","year":"2014","unstructured":"Serrano N, Gim\u00e9nez A, Civera J et al (2014) Interactive handwriting recognition with limited user effort. Int J Doc Anal Recogn 17(1):47\u201359","journal-title":"Int J Doc Anal Recogn"},{"key":"10188_CR39","unstructured":"Sicilia M (2020) Remembrance in the citizen humanities: co-producing memories and historical knowledge. Dissertation. Umea Universitet. https:\/\/www.diva-portal.org\/smash\/\/record.jsf%3Fpid=diva2%3A1532401&dswid=3370"},{"issue":"3","key":"10188_CR40","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1080\/01615440.2018.1558138","volume":"52","author":"R Sieber","year":"2019","unstructured":"Sieber R, Slonosky V (2019) Developing a flexible platform for crowdsourcing historical weather records. Hist Methods J Quantit Interdiscipl History 52(3):164\u2013177","journal-title":"Hist Methods J Quantit Interdiscipl History"},{"key":"10188_CR41","doi-asserted-by":"crossref","unstructured":"S\u00e1nchez JA, Romero V, Toselli AH, et\u00a0al (2014) ICFHR2014 competition on handwritten text recognition on transcriptorium datasets (HTRtS). In: 2014 14th International conference on frontiers in handwriting recognition, pp 785\u2013790","DOI":"10.1109\/ICFHR.2014.137"},{"key":"10188_CR42","first-page":"1","volume":"23","author":"S Tarride","year":"2023","unstructured":"Tarride S, Faine T, Boillet M et al (2023) Handwritten text recognition from crowdsourced annotations. HIP 23:1\u20136","journal-title":"HIP"},{"key":"10188_CR43","doi-asserted-by":"publisher","unstructured":"Terras M (2015) Crowdsourcing in the digital humanities. In: Schreibman S, Siemens R, Unsworth J (eds) A new companion to digital humanities, pp 420\u2013438. https:\/\/doi.org\/10.1002\/9781118680605.ch29","DOI":"10.1002\/9781118680605.ch29"},{"key":"10188_CR44","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-55389-9","volume-title":"Probabilistic indexing for information search and retrieval in large collections of handwritten text images","author":"A Toselli","year":"2024","unstructured":"Toselli A, Puigcerver J, Vidal E (2024) Probabilistic indexing for information search and retrieval in large collections of handwritten text images. Springer, Cham"},{"key":"10188_CR45","doi-asserted-by":"publisher","first-page":"497","DOI":"10.1016\/j.ins.2016.07.063","volume":"370","author":"AH Toselli","year":"2016","unstructured":"Toselli AH, Vidal E, Romero V et al (2016) HMM word graph based keyword spotting in handwritten document images. Inform Sci 370:497\u2013518","journal-title":"Inform Sci"},{"key":"10188_CR46","doi-asserted-by":"crossref","unstructured":"Toselli AH, Romero V, Vidal E, et\u00a0al (2019) Making two vast historical manuscript collections searchable and extracting meaningful textual features through large-scale probabilistic indexing. In: 15th International conference on document analysis and recognition (ICDAR)","DOI":"10.1109\/ICDAR.2019.00026"},{"issue":"1","key":"10188_CR47","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1007\/s10044-018-0742-z","volume":"22","author":"AH Toselli","year":"2019","unstructured":"Toselli AH, Vidal E, Puigcerver J, Noya-Garc\u00eda E (2019) Probabilistic multi-word spotting in handwritten text images. Pattern Anal Appl 22(1):23\u201332","journal-title":"Pattern Anal Appl"},{"issue":"3\u20134","key":"10188_CR48","doi-asserted-by":"publisher","first-page":"e12,507","DOI":"10.1111\/lic3.12507","volume":"16","author":"V Van Hyning","year":"2019","unstructured":"Van Hyning V (2019) Harnessing crowdsourcing for scholarly and glam purposes. Lit Compass 16(3\u20134):e12,507","journal-title":"Lit Compass"},{"key":"10188_CR49","unstructured":"Vidal E, S\u00e1nchez JA (2021) Handwritten text recognition for the EDT project. Part II: textual information search in untranscribed manuscripts. In: Bermejo MA et al. (ed) Proceeding of the EDT Alicante workshop. To appear"},{"key":"10188_CR50","doi-asserted-by":"crossref","unstructured":"Vidal E, Toselli AH (2021) Probabilistic indexing and search for hyphenated words. In: International conference on document analysis and recognition, Springer, pp 426\u2013442","DOI":"10.1007\/978-3-030-86331-9_28"},{"key":"10188_CR51","doi-asserted-by":"crossref","unstructured":"Vidal E, Rodr\u00edguez L, Casacuberta F, et\u00a0al (2008) Interactive pattern recognition. In: Machine learning for multimodal interaction: 4th international workshop, MLMI 2007, Brno, Czech Republic, June 28-30, 2007, Revised Selected Papers 4, pp 60\u201371","DOI":"10.1007\/978-3-540-78155-4_6"},{"key":"10188_CR52","doi-asserted-by":"crossref","unstructured":"Vidal E, Romero V, Toselli AH, et\u00a0al (2020) The Carabela project and manuscript collection: large-scale probabilistic indexing and content-based classification. In: 17th International conference on frontiers in handwriting recognition (ICFHR), pp 85\u201390","DOI":"10.1109\/ICFHR2020.2020.00026"},{"key":"10188_CR53","doi-asserted-by":"publisher","first-page":"17501","DOI":"10.1007\/s00521-023-08620-y","volume":"35","author":"E Vidal","year":"2023","unstructured":"Vidal E, Toselli AH, Puigcerver J (2023) Lexicon-based probabilistic indexing of handwritten text images. Neural Comput Appl 35:17501\u201317520","journal-title":"Neural Comput Appl"},{"issue":"6","key":"10188_CR54","doi-asserted-by":"publisher","first-page":"709","DOI":"10.1109\/TPAMI.2004.14","volume":"26","author":"A Vinciarelli","year":"2004","unstructured":"Vinciarelli A, Bengio S, Bunke H (2004) Off-line recognition of unconstrained handwritten texts using HMMs and statistical language models. IEEE Trans Pattern Anal Mach Intell 26(6):709\u2013720","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"10188_CR55","doi-asserted-by":"crossref","unstructured":"Zagoris K, Pratikakis I, Gatos B (2015) A framework for efficient transcription of historical documents using keyword spotting. In: Proceedings of the 3rd international workshop on historical document imaging and processing, pp 9\u201314","DOI":"10.1145\/2809544.2809557"},{"key":"10188_CR56","doi-asserted-by":"crossref","unstructured":"Zarndt F (2012) Putting the world\u2019s cultural heritage online with crowdsourcing. In: IFLA Pre-conference, Finlandia","DOI":"10.25281\/0869-608X-2013-0-1-76-84"}],"container-title":["Neural Computing and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-024-10188-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00521-024-10188-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-024-10188-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,1]],"date-time":"2024-08-01T19:05:48Z","timestamp":1722539148000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00521-024-10188-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,1]]},"references-count":56,"alternative-id":["10188"],"URL":"https:\/\/doi.org\/10.1007\/s00521-024-10188-0","relation":{},"ISSN":["0941-0643","1433-3058"],"issn-type":[{"type":"print","value":"0941-0643"},{"type":"electronic","value":"1433-3058"}],"subject":[],"published":{"date-parts":[[2024,8,1]]},"assertion":[{"value":"22 June 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 July 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 August 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"First two authors own stock in tranSkriptorium. Two last authors own stock in tranSkriptorium and are employees of tranSkriptorium.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}