{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:25:54Z","timestamp":1760235954523,"version":"build-2065373602"},"reference-count":43,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2021,10,11]],"date-time":"2021-10-11T00:00:00Z","timestamp":1633910400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Polish Myeloma Consortium","award":["Educational grant"],"award-info":[{"award-number":["Educational grant"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>Minimal residual disease (MRD) status is now considered as one of the most relevant prognostic factors in multiple myeloma (MM) while MRD negativity became an important endpoint in clinical trials. Here, we report the results of the first study evaluating the reproducibility of high-sensitivity flow cytometry MM MRD assessment in four laboratories in Poland. EuroFlow protocols for instrument setting standardization and sample preparation in MM MRD assessment were implemented in each laboratory. In the inter-laboratory reproducibility study, 12 bone marrow samples from MM patients were distributed and processed in participant laboratories. In the inter-operator concordance study, 13 raw data files from MM MRD measurements were analyzed by five independent operators. The inter-laboratory study showed high 95% overall concordance of results among laboratories. In the inter-operator study, 89% of MRD results reported were concordant, and the highest immunophenotype interpretation differences with regard to expression of CD27, CD45, CD81 were noticed. We confirmed the applicability and feasibility of the EuroFlow protocol as a highly sensitive method of MRD evaluation in MM. Results of our inter-center comparison study demonstrate that the standardization of MM MRD assessment protocols is highly desirable to improve quality and comparability of results within and between different clinical trials.<\/jats:p>","DOI":"10.3390\/diagnostics11101872","type":"journal-article","created":{"date-parts":[[2021,10,11]],"date-time":"2021-10-11T21:45:32Z","timestamp":1633988732000},"page":"1872","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Harmonization of Flow Cytometric Minimal Residual Disease Assessment in Multiple Myeloma in Centers of Polish Myeloma Consortium"],"prefix":"10.3390","volume":"11","author":[{"given":"Agnieszka","family":"Krzywdzi\u0144ska","sequence":"first","affiliation":[{"name":"Laboratory of Immunophenotyping, Institute of Hematology and Transfusion Medicine, 02-776 Warsaw, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bartosz","family":"Pu\u0142a","sequence":"additional","affiliation":[{"name":"Department of Hematology, Institute of Hematology and Transfusion Medicine, 02-776 Warsaw, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6641-0182","authenticated-orcid":false,"given":"Anna","family":"Czy\u017c","sequence":"additional","affiliation":[{"name":"Department of Hematology and Bone Marrow Transplantation, Wroclaw Medical University, 50-367 Wroclaw, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Beata","family":"Krzymieniewska","sequence":"additional","affiliation":[{"name":"Laboratory of Immunophenotyping, Institute of Hematology and Transfusion Medicine, 02-776 Warsaw, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jolanta","family":"Kiernicka-Parulska","sequence":"additional","affiliation":[{"name":"Flow Cytometry Laboratory, Haematology Clinical Laboratory, Department of Haematology and Bone Marrow Transplantation, University Hospital of Lord\u2019s Transfiguration, 60-101 Poznan, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anna","family":"Mierzwa","sequence":"additional","affiliation":[{"name":"Flow Cytometry Laboratory, Haematology Clinical Laboratory, Department of Haematology and Bone Marrow Transplantation, University Hospital of Lord\u2019s Transfiguration, 60-101 Poznan, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Donata","family":"Szymczak","sequence":"additional","affiliation":[{"name":"Flow Cytometry and Cytomorphology Laboratory, Department and Clinic of Haematology, Blood Neoplasms and Bone Marrow Transplantation, University Hospital in Wroclaw, 50-367 Wroclaw, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aneta","family":"Milanowska","sequence":"additional","affiliation":[{"name":"Flow Cytometry and Cytomorphology Laboratory, Department and Clinic of Haematology, Blood Neoplasms and Bone Marrow Transplantation, University Hospital in Wroclaw, 50-367 Wroclaw, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aleksandra","family":"Kiraga","sequence":"additional","affiliation":[{"name":"Flow Cytometry and Cytomorphology Laboratory, Department and Clinic of Haematology, Blood Neoplasms and Bone Marrow Transplantation, University Hospital in Wroclaw, 50-367 Wroclaw, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2266-971X","authenticated-orcid":false,"given":"Iwona","family":"Kwiecie\u0144","sequence":"additional","affiliation":[{"name":"Laboratory of Hematology and Flow Cytometry, Department of Internal Medicine and Hematology, Military Institute of Medicine, 04-141 Warsaw, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4417-7831","authenticated-orcid":false,"given":"Joanna","family":"Zaleska","sequence":"additional","affiliation":[{"name":"Department of Experimental Hematooncology, Medical University of Lublin, 20-059 Lublin, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Krzysztof","family":"Jamroziak","sequence":"additional","affiliation":[{"name":"Department of Hematology, Transplantation and Internal Medicine, Medical University of Warsaw, 02-097 Warsaw, Poland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,10,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1111\/joim.12590","article-title":"Modern multiple myeloma therapy: Deep, sustained treatment response and good clinical outcomes","volume":"281","author":"Landgren","year":"2017","journal-title":"J. Intern. Med."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2516","DOI":"10.1182\/blood-2007-10-116129","article-title":"Improved survival in multiple myeloma and the impact of novel therapies","volume":"111","author":"Kumar","year":"2008","journal-title":"Blood"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1016\/S0140-6736(16)31594-X","article-title":"Bortezomib with lenalidomide and dexamethasone versus lenalidomide and dexamethasone alone in patients with newly diagnosed myeloma without intent for immediate autologous stem-cell transplant (SWOG S0777): A randomised, open-label, phase 3 trial","volume":"389","author":"Durie","year":"2017","journal-title":"Lancet"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1207","DOI":"10.1056\/NEJMoa1506348","article-title":"Targeting CD38 with Daratumumab monotherapy in Multiple Myeloma","volume":"373","author":"Lokhorst","year":"2015","journal-title":"N. Engl. J. Med."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"621","DOI":"10.1056\/NEJMoa1505654","article-title":"Elotuzumab therapy for relapsed or refractory Multiple Myeloma","volume":"373","author":"Lonial","year":"2015","journal-title":"N. Engl. J. Med."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1038\/s41408-021-00469-5","article-title":"CAR T-cell therapy in multiple myeloma: More room for improvement","volume":"11","author":"Teoh","year":"2021","journal-title":"Blood Cancer J."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1007\/978-3-319-40320-5_7","article-title":"Multiple myeloma minimal residual disease","volume":"169","author":"Paiva","year":"2016","journal-title":"Cancer Treat. Res."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fonc.2020.00001","article-title":"Clinical applications and future directions of minimal residual disease testing in multiple myeloma","volume":"10","author":"Oliva","year":"2020","journal-title":"Front. Oncol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2456","DOI":"10.1182\/blood-2018-06-858613","article-title":"Minimal residual disease negativity using deep sequencing is a major prognostic factor in multiple myeloma","volume":"132","author":"Perrot","year":"2018","journal-title":"Blood"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"784","DOI":"10.1200\/JCO.19.01231","article-title":"Measurable residual disease by next-generation flow cytometry in multiple myeloma","volume":"38","author":"Paiva","year":"2020","journal-title":"J. Clin. Oncol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1001\/jamaoncol.2016.3160","article-title":"Association of minimal residual disease with superior survival outcomes in patients with multiple myeloma: A meta-analysis","volume":"3","author":"Munshi","year":"2017","journal-title":"JAMA Oncol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1565","DOI":"10.1038\/bmt.2016.222","article-title":"Role of MRD status in relation to clinical outcomes in newly diagnosed multiple myeloma patients: A meta-analysis","volume":"51","author":"Landgren","year":"2016","journal-title":"Bone Marrow Transplant."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"5988","DOI":"10.1182\/bloodadvances.2020002827","article-title":"Large meta-analysis establishes the role of MRD negativity in long-term survival outcomes in multiple myeloma patients","volume":"4","author":"Munshi","year":"2020","journal-title":"Blood Adv."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"860","DOI":"10.3389\/fonc.2020.00860","article-title":"Minimal residual disease in multiple myeloma: Current landscape and future applications with immunotherapeutic approaches","volume":"10","author":"Kostopoulos","year":"2020","journal-title":"Front. Oncol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"e30","DOI":"10.1016\/j.clml.2019.09.622","article-title":"Minimal residual disease status as a surrogate endpoint for progression-free survival in newly diagnosed multiple myeloma studies: A meta-analysis","volume":"20","author":"Ludwig","year":"2020","journal-title":"Clin. Lymphoma Myeloma Leuk."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1038\/s41375-020-01012-4","article-title":"International harmonization in performing and reporting minimal residual disease assessment in multiple myeloma trials","volume":"35","author":"Costa","year":"2021","journal-title":"Leukemia"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1002\/cyto.b.21272","article-title":"Assessment of minimal residual disease in myeloma and the need for a consensus approach","volume":"90","author":"Rawstron","year":"2016","journal-title":"Cytom. B Clin. Cytom."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"e328","DOI":"10.1016\/S1470-2045(16)30206-6","article-title":"International Myeloma Working Group consensus criteria for response and minimal residual disease assessment in multiple myeloma","volume":"17","author":"Kumar","year":"2016","journal-title":"Lancet Oncol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1002\/cyto.b.21265","article-title":"Immunophenotype of normal vs. myeloma plasma cells: Toward antibody panel specifications for MRD detection in multiple myeloma","volume":"90","author":"Paiva","year":"2016","journal-title":"Cytom. B Clin. Cytom."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1002\/cyto.b.21249","article-title":"Consensus guidelines for myeloma minimal residual disease sample staining and data acquisition","volume":"90","author":"Paiva","year":"2016","journal-title":"Cytom. B Clin. Cytom."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1002\/cyto.b.21228","article-title":"Consensus guidelines on plasma cell myeloma minimal residual disease analysis and reporting","volume":"90","author":"Arroz","year":"2016","journal-title":"Cytom. B Clin. Cytom."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2094","DOI":"10.1038\/leu.2017.29","article-title":"Next generation flow for highly sensitive and standardized detection of minimal residual disease in multiple myeloma","volume":"31","author":"Paiva","year":"2017","journal-title":"Leukemia"},{"key":"ref_23","first-page":"239","article-title":"Praktyka kliniczna oceny minimalnej choroby resztkowej u chorych na szpiczaka plazmocytowego w Polsce: Badanie ankietowe Polskiego Konsorcjum Szpiczakowego","volume":"8","author":"Solarska","year":"2017","journal-title":"Hematologia"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"246","DOI":"10.5603\/Hem.2017.0036","article-title":"Znaczenie minimalnej choroby resztkowej w szpiczaku plazmocytowym\u2014Stanowisko Polskiego Konsorcjum Szpiczakowego","volume":"8","author":"Jamroziak","year":"2017","journal-title":"Hematologia"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1986","DOI":"10.1038\/leu.2012.122","article-title":"EuroFlow standardization of flow cytometer instrument settings and immunophenotyping protocols","volume":"26","author":"Kalina","year":"2012","journal-title":"Leukemia"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Gozzetti, A., Raspadori, D., Bacchiarri, F., Sicuranza, A., Pacelli, P., Ferrigno, I., Tocci, D., and Bocchia, M. (2020). Minimal residual disease in multiple myeloma: State of the art and applications in clinical practice. J. Pers. Med., 10.","DOI":"10.3390\/jpm10030120"},{"key":"ref_27","first-page":"5404","article-title":"Preemptive Daratumumab Therapy for Minimal Residual Disease Reappearance or Biochemical Relapse in Multiple Myeloma: Rationale and Design of the Polish Myeloma Consortium Predator Study","volume":"130","author":"Jamroziak","year":"2017","journal-title":"Blood"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1088","DOI":"10.1182\/blood-2013-05-506170","article-title":"Minimal residual disease testing in multiple myeloma by flow cytometry: Major heterogeneity","volume":"122","author":"Flanders","year":"2013","journal-title":"Blood"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1276","DOI":"10.5858\/arpa.2014-0543-CP","article-title":"Marked variability in reported minimal residual disease lower level of detection of 4 Hematolymphoid neoplasms: A survey of participants in the College of American Pathologists Flow Cytometry Proficiency Testing Program","volume":"139","author":"Keeney","year":"2015","journal-title":"Arch. Pathol. Lab. Med."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1038\/s41408-020-00377-0","article-title":"Comparison of next-generation sequencing (NGS) and next-generation flow (NGF) for minimal residual disease (MRD) assessment in multiple myeloma","volume":"10","author":"Medina","year":"2020","journal-title":"Blood Cancer J."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"e523","DOI":"10.3324\/haematol.2019.238394","article-title":"Validated single-tube multiparameter flow cytometry approach for the assessment of minimal residual disease in multiple myeloma","volume":"105","author":"Dold","year":"2020","journal-title":"Haematologica"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"728","DOI":"10.1182\/bloodadvances.2016003715","article-title":"MRD detection in multiple myeloma: Comparison between MSKCC 10-color single-tube and EuroFlow 8-color 2-tube methods","volume":"1","author":"Roshal","year":"2017","journal-title":"Blood Adv."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2218","DOI":"10.1182\/blood.2019002610","article-title":"Blood monitoring of circulating tumor plasma cells by next generation flow in multiple myeloma after therapy","volume":"134","author":"Puig","year":"2019","journal-title":"Blood"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"112680","DOI":"10.1016\/j.jim.2019.112680","article-title":"Comments on EuroFlow standard operating procedures for instrument setup and compensation for BD FACS Canto II, Navios and BD FACS Lyric instruments","volume":"475","author":"Glier","year":"2019","journal-title":"J. Immunol. Methods"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"112348","DOI":"10.1016\/j.jim.2017.07.013","article-title":"Standardization of 8-color flow cytometry across different flow cytometer instruments: A feasibility study in clinical laboratories in Switzerland","volume":"475","author":"Glier","year":"2019","journal-title":"J. Immunol. Methods"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1002\/cytob.21200","article-title":"Comparison of cross-platform flow cytometry minimal residual disease evaluation in multiple myeloma using a common antibody combination and analysis strategy","volume":"88","author":"Mathis","year":"2015","journal-title":"Cytom. B Clin. Cytom."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1002\/cyto.b.21862","article-title":"Methodological considerations for the high sensitivity detection of multiple myeloma measurable residual disease","volume":"98","author":"Soh","year":"2020","journal-title":"Cytom. B Clin. Cytom."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1779","DOI":"10.1016\/j.humpath.2007.04.010","article-title":"Assessment of bone marrow plasma cell infiltrates in multiple myeloma: The added value of CD138 immunohistochemistry","volume":"38","author":"Yang","year":"2007","journal-title":"Hum. Pathol."},{"key":"ref_39","first-page":"221","article-title":"VS38 Identifies myeloma cells with dim CD38 expression and plasma cells following daratumumab therapy, which interferes with CD38 Detection for 4 to 6 Months","volume":"153","author":"Courville","year":"2020","journal-title":"Am. J. Clin. Pathol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1186","DOI":"10.1038\/leu.2014.321","article-title":"Phenotypic identification of subclones in multiple myeloma with different chemoresistant, cytogenetic and clonogenic potential","volume":"29","author":"Paiva","year":"2015","journal-title":"Leukemia"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1496","DOI":"10.3324\/haematol.2020.267831","article-title":"Standardization of flow cytometric minimal residual disease assessment in international clinical trials\u2014A feasibility study from the European Myeloma Network","volume":"106","author":"Oliva","year":"2020","journal-title":"Haematologica"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"e63","DOI":"10.1002\/cpcy.63","article-title":"Monitoring of measurable residual disease in multiple myeloma by multiparametric flow cytometry","volume":"90","author":"Soh","year":"2019","journal-title":"Curr. Protoc. Cytom."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1002\/cyto.b.21528","article-title":"A QA program for MRD testing demonstrates that systematic education can reduce discordance among experienced interpreters","volume":"94","author":"Keeney","year":"2018","journal-title":"Cytom. B Clin. Cytom."}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/11\/10\/1872\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:11:48Z","timestamp":1760166708000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/11\/10\/1872"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,11]]},"references-count":43,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2021,10]]}},"alternative-id":["diagnostics11101872"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics11101872","relation":{},"ISSN":["2075-4418"],"issn-type":[{"type":"electronic","value":"2075-4418"}],"subject":[],"published":{"date-parts":[[2021,10,11]]}}}