{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,28]],"date-time":"2026-03-28T12:10:33Z","timestamp":1774699833029,"version":"3.50.1"},"reference-count":57,"publisher":"Oxford University Press (OUP)","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2007,5,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Kell, L. T., Mosqueira, I., Grosjean, P., Fromentin, J-M., Garcia, D., Hillary, R., Jardim, E., Mardle, S., Pastoors, M. A., Poos, J. J., Scott, F., and Scott, R. D. 2007. FLR: an open-source framework for the evaluation and development of management strategies. \u2013 ICES Journal of Marine Science, 64: 640\u2013646. The FLR framework (Fisheries Library for R) is a development effort directed towards the evaluation of fisheries management strategies. The overall goal is to develop a common framework to facilitate collaboration within and across disciplines (e.g. biological, ecological, statistical, mathematical, economic, and social) and, in particular, to ensure that new modelling methods and software are more easily validated and evaluated, as well as becoming widely available once developed. Specifically, the framework details how to implement and link a variety of fishery, biological, and economic software packages so that alternative management strategies and procedures can be evaluated for their robustness to uncertainty before implementation. The design of the framework, including the adoption of object-orientated programming, its feasibility to be extended to new processes, and its application to new management approaches (e.g. ecosystem affects of fishing), is discussed. The importance of open source for promoting transparency and allowing technology transfer between disciplines and researchers is stressed.<\/jats:p>","DOI":"10.1093\/icesjms\/fsm012","type":"journal-article","created":{"date-parts":[[2007,7,6]],"date-time":"2007-07-06T18:12:39Z","timestamp":1183745559000},"page":"640-646","source":"Crossref","is-referenced-by-count":193,"title":["FLR: an open-source framework for the evaluation and development of management strategies"],"prefix":"10.1093","volume":"64","author":[{"given":"L. T.","family":"Kell","sequence":"first","affiliation":[{"name":"Cefas, Lowestoft Laboratory, Pakefield Road, Lowestoft, Suffolk NR33 0HT, UK"}]},{"given":"I.","family":"Mosqueira","sequence":"additional","affiliation":[{"name":"AZTI Tecnalia, Marine Research Division, Txatxarramendi ugartea z\/g, 48395 Sukarrieta, Bizkaia, Spain"}]},{"given":"P.","family":"Grosjean","sequence":"additional","affiliation":[{"name":"Ecologie Num\u00e9rique des Milieux Aquatiques, Mons-Hainaut University8, av du Champ de Mars, 7000 Mons, Belgium"}]},{"given":"J-M.","family":"Fromentin","sequence":"additional","affiliation":[{"name":"IFREMER, Centre de Recherche Halieutique M\u00e9diterran\u00e9en et Tropical, BP 171, 34203 S\u00e8te Cedex, France"}]},{"given":"D.","family":"Garcia","sequence":"additional","affiliation":[{"name":"AZTI Tecnalia, Marine Research Division, Txatxarramendi ugartea z\/g, 48395 Sukarrieta, Bizkaia, Spain"}]},{"given":"R.","family":"Hillary","sequence":"additional","affiliation":[{"name":"Department of Biology, Imperial College, London SW7 2BP, UK"}]},{"given":"E.","family":"Jardim","sequence":"additional","affiliation":[{"name":"IPIMAR, Av. De Brasilla, 1449-006 Lisboa, Portugal"}]},{"given":"S.","family":"Mardle","sequence":"additional","affiliation":[{"name":"Centre for the Economics and Management of Aquatic Resources (CEMARE), University of Portsmouth, Boathouse 6, College Road, HM Naval Base, Portsmouth, Hants PO1 3LJ, UK"}]},{"given":"M. A.","family":"Pastoors","sequence":"additional","affiliation":[{"name":"Wageningen IMARES, PO Box 68, 1970 AB IJmuiden, The Netherlands"}]},{"given":"J. J.","family":"Poos","sequence":"additional","affiliation":[{"name":"Wageningen IMARES, PO Box 68, 1970 AB IJmuiden, The Netherlands"}]},{"given":"F.","family":"Scott","sequence":"additional","affiliation":[{"name":"Cefas, Lowestoft Laboratory, Pakefield Road, Lowestoft, Suffolk NR33 0HT, UK"}]},{"given":"R. D.","family":"Scott","sequence":"additional","affiliation":[{"name":"Cefas, Lowestoft Laboratory, Pakefield Road, Lowestoft, Suffolk NR33 0HT, UK"}]}],"member":"286","published-online":{"date-parts":[[2007,3,29]]},"reference":[{"key":"2019081300173926500_FSM012C1","unstructured":"Aydin K. Y. Gaichas S. K. In defence of complexity: towards a representation of uncertainty in multispecies models International Whaling Commission 2006 Scientific Committee Paper, SC\/58\/E48"},{"key":"2019081300173926500_FSM012C2","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1126\/science.277.5325.509","article-title":"The management of fisheries and marine ecosystems","volume":"277","author":"Botsford","year":"1997","journal-title":"Science"},{"key":"2019081300173926500_FSM012C3","first-page":"83","article-title":"The development of a management procedure for the South African anchovy resource","volume-title":"Risk Evaluation and Biological Reference Points for Fisheries Management","author":"Butterworth","year":"1993"},{"key":"2019081300173926500_FSM012C4","first-page":"83","article-title":"Management procedures: a better way to manage fisheries? The South African experience","volume-title":"Global Trends: Fisheries Management","author":"Butterworth","year":"1997"},{"key":"2019081300173926500_FSM012C5","doi-asserted-by":"crossref","first-page":"985","DOI":"10.1006\/jmsc.1999.0532","article-title":"Experiences in the evaluation and interpretation of management procedures","volume":"56","author":"Butterworth","year":"1999","journal-title":"ICES Journal of Marine Science"},{"key":"2019081300173926500_FSM012C6","doi-asserted-by":"crossref","first-page":"509","DOI":"10.4027\/famdis.2005.28","article-title":"Evaluating harvest strategies for a rapidly expanding fishery: the Australian broadbill swordfish fishery","volume-title":"Fisheries Assessment and Management in Data-Limited Situations","author":"Campbell","year":"2005"},{"key":"2019081300173926500_FSM012C7","article-title":"Programming with Data","author":"Chambers","year":"2000"},{"key":"2019081300173926500_FSM012C8","first-page":"154","article-title":"Ecopath with Ecosim: a User's Guide","author":"Christensen","year":"2005","edition":"2005 edn"},{"key":"2019081300173926500_FSM012C9","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1023\/A:1008894011847","article-title":"Management procedures in a fishery based on highly variable stocks and with conflicting objectives: experiences in the South African pelagic fishery","volume":"8","author":"Cochrane","year":"1998","journal-title":"Reviews in Fish Biology and Fisheries"},{"key":"2019081300173926500_FSM012C10","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1111\/j.1467-2679.2004.00157.x","article-title":"Are stock assessment methods too complicated?","volume":"5","author":"Cotter","year":"2004","journal-title":"Fish and Fisheries"},{"key":"2019081300173926500_FSM012C11","doi-asserted-by":"crossref","first-page":"1432","DOI":"10.1016\/j.icesjms.2004.09.001","article-title":"Developing and refining a joint management procedure for the multispecies South African pelagic fishery","volume":"61","author":"De Oliveira","year":"2004","journal-title":"ICES Journal of Marine Science"},{"key":"2019081300173926500_FSM012C12","first-page":"165","article-title":"A new approach to assessment in the NPF: spatial models in a management strategy environment that includes uncertainty","author":"Dichmont","year":"2005"},{"key":"2019081300173926500_FSM012C13","unstructured":"FAO Precautionary approach to capture fisheries and species introductions. FAO Technical Guidelines for Responsible Fisheries, 2 1996 8 December 2006 Rome FAO http:\/\/www.fao.org\/DOCREP\/003\/W3592E\/W3592E00.HTM"},{"key":"2019081300173926500_FSM012C14","doi-asserted-by":"crossref","first-page":"2105","DOI":"10.1139\/f98-100","article-title":"MULTIFAN-CL: a length-based, age-structured model for fisheries stock assessment, with application to south Pacific albacore, Thunnus alalunga","volume":"55","author":"Fournier","year":"1998","journal-title":"Canadian Journal of Fisheries and Aquatic Sciences"},{"key":"2019081300173926500_FSM012C15","first-page":"1699","article-title":"\u201cRisk\u201d in fisheries management: a review","volume":"54","author":"Francis","year":"1997","journal-title":"Canadian Journal of Fisheries and Aquatic Sciences"},{"key":"2019081300173926500_FSM012C16","unstructured":"Fulton E. A. Fuller M. Smith A. D. M. Punt A. Ecological indicators of the ecosystem effects of fishing: final report 2004 239 Australian Fisheries Management Authority Final Research ReportR99\/1546"},{"key":"2019081300173926500_FSM012C17","doi-asserted-by":"crossref","first-page":"540","DOI":"10.1016\/j.icesjms.2004.12.012","article-title":"Which ecological indicators can robustly detect effects of fishing?","volume":"62","author":"Fulton","year":"2005","journal-title":"ICES Journal of Marine Science"},{"key":"2019081300173926500_FSM012C18","unstructured":"Fulton E. A. Smith A. D. M. Webb H. Slater J. Ecological indicators for the impacts of fishing on non-target species, communities and ecosystems: review of potential indicators 2004 116 Australian Fisheries Management Authority Final Research Report, R99\/1546"},{"key":"2019081300173926500_FSM012C19","first-page":"1","article-title":"Global overview of marine fisheries","volume-title":"Responsible Fisheries in the Marine Ecosystem","author":"Garcia","year":"2003"},{"key":"2019081300173926500_FSM012C20","doi-asserted-by":"crossref","first-page":"952","DOI":"10.1006\/jmsc.1999.0536","article-title":"Development and application of management procedures for fisheries in Southern Africa","volume":"56","author":"Geromont","year":"1999","journal-title":"ICES Journal of Marine Science"},{"key":"2019081300173926500_FSM012C21","doi-asserted-by":"crossref","first-page":"468","DOI":"10.1006\/jmsc.2000.0741","article-title":"Symposium overview: incorporating ecosystem objectives within fisheries management","volume":"57","author":"Gislason","year":"2000","journal-title":"ICES Journal of Marine Science"},{"key":"2019081300173926500_FSM012C22","doi-asserted-by":"crossref","first-page":"699","DOI":"10.1139\/f05-247","article-title":"Incentive-based approaches to sustainable fisheries","volume":"63","author":"Grafton","year":"2006","journal-title":"Canadian Journal of Fisheries and Aquatic Sciences"},{"key":"2019081300173926500_FSM012C23","article-title":"Development of the IWC Revised Management Procedure","author":"Hammond","journal-title":"Journal of Cetacean Research and Management"},{"key":"2019081300173926500_FSM012C24","doi-asserted-by":"crossref","first-page":"15","DOI":"10.3989\/scimar.2003.67s115","article-title":"The state of the art in stock assessment: where we are and where we are going","volume":"67","author":"Hilborn","year":"2003","journal-title":"Scientia Marina"},{"key":"2019081300173926500_FSM012C25","first-page":"493","article-title":"Beyond band-aids in fisheries management: fixing world fisheries","volume":"74","author":"Hilborn","year":"2004","journal-title":"Bulletin of Marine Science"},{"key":"2019081300173926500_FSM012C26","article-title":"Working Group on the Assessment of Demersal Stocks in the North Sea and Skagerrak (WGNSSK)","author":"ICES","year":"2006"},{"key":"2019081300173926500_FSM012C27","unstructured":"ICES Report of the Working Group on the Assessment of Southern Shelf Stocks of Hake, Monk and Megrim (WGHMM) 2006 29 ICES Document CM 2006\/ACFM"},{"key":"2019081300173926500_FSM012C28","unstructured":"ICES Report of the Working Group on the Assessment of Northern Shelf Demersal Stocks (WGNSDS) 2006 30 ICES Document CM 2006\/ACFM"},{"key":"2019081300173926500_FSM012C29","first-page":"19","article-title":"Workshop on Biological Reference Points for Northeast Arctic Haddock","author":"ICES","year":"2006"},{"key":"2019081300173926500_FSM012C30","first-page":"279","article-title":"The ecosystem approach to fishery management: a significant step towards sustainable use of the marine environment?","volume":"274","author":"Jennings","year":"2004","journal-title":"Marine Ecology Progress Series"},{"key":"2019081300173926500_FSM012C31","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1080\/00288330.2005.9517345","article-title":"The evolution of operational management procedures for the South African west coast rock lobster fishery","volume":"39","author":"Johnston","year":"2005","journal-title":"New Zealand Journal of Marine and Freshwater Research"},{"key":"2019081300173926500_FSM012C32","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1016\/S0167-9309(06)80018-9","article-title":"Operational Management Procedures: an introduction to the use of evaluation frameworks","volume-title":"The Knowledge Base for Fisheries Management","author":"Kell","year":"2006"},{"key":"2019081300173926500_FSM012C33","doi-asserted-by":"crossref","first-page":"1104","DOI":"10.1016\/j.icesjms.2005.05.005","article-title":"Evaluation of multiple management objectives for Northeast Atlantic flatfish stocks: sustainability vs. stability of yield","volume":"62","author":"Kell","year":"2005","journal-title":"ICES Journal of Marine Science"},{"key":"2019081300173926500_FSM012C34","doi-asserted-by":"crossref","first-page":"750","DOI":"10.1016\/j.icesjms.2005.01.001","article-title":"An evaluation of the implicit management procedure used for some ICES roundfish stocks","volume":"62","author":"Kell","year":"2005","journal-title":"ICES Journal of Marine Science"},{"key":"2019081300173926500_FSM012C35","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1016\/j.icesjms.2005.09.003","article-title":"An evaluation of multi-annual management strategies for ICES roundfish stocks","volume":"63","author":"Kell","year":"2006","journal-title":"ICES Journal of Marine Science"},{"key":"2019081300173926500_FSM012C36","first-page":"47","article-title":"User manual for the assessment program Stock Synthesis 2: Model Version 1.19. NOAA Fisheries","author":"Methot","year":"2005"},{"key":"2019081300173926500_FSM012C37","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1139\/f05-215","article-title":"A Bayesian state-space mark-recapture model to estimate fishing mortality rates within a mixed stock fishery","volume":"63","author":"Michielsens","year":"2006","journal-title":"Canadian Journal of Fisheries and Aquatic Sciences"},{"key":"2019081300173926500_FSM012C38","unstructured":"Patterson K. R. Melvin G. D. Integrated catch at age analysis, Version 1.2 Scottish Fisheries Research Report 1996 58 60"},{"key":"2019081300173926500_FSM012C39","doi-asserted-by":"crossref","first-page":"689","DOI":"10.1038\/nature01017","article-title":"Towards sustainability in world fisheries","volume":"418","author":"Pauly","year":"2002","journal-title":"Nature"},{"key":"2019081300173926500_FSM012C40","doi-asserted-by":"crossref","first-page":"1331","DOI":"10.1016\/j.icesjms.2004.08.017","article-title":"Possible solutions to some challenges facing fisheries scientists and managers","volume":"61","author":"Peterman","year":"2004","journal-title":"ICES Journal of Marine Science"},{"key":"2019081300173926500_FSM012C41","first-page":"89","article-title":"A catch-free stock assessment model with application to goliath grouper (Epinephelus itajara) off southern Florida","author":"Porch","year":"2006"},{"key":"2019081300173926500_FSM012C42","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1111\/j.1939-7445.2006.tb00189.x","article-title":"The FAO Precautionary Approach after almost 10 years: have we progressed towards implementing simulation-tested feedback-control management systems for fisheries management?","volume":"19","author":"Punt","year":"2006","journal-title":"Natural Resource Modeling"},{"key":"2019081300173926500_FSM012C43","doi-asserted-by":"crossref","first-page":"255","DOI":"10.2989\/025776195784156494","article-title":"The effects of future consumption by the Cape fur seal on catches and catch rates of the Cape hakes. 4. Modelling the biological interaction between Cape fur seals (Arctocephalus pusillus pusillus) and Cape hakes (Merluccius capensis and M. paradoxus)","volume":"16","author":"Punt","year":"1995","journal-title":"South African Journal of Marine Science"},{"key":"2019081300173926500_FSM012C44","doi-asserted-by":"crossref","first-page":"860","DOI":"10.1006\/jmsc.1999.0538","article-title":"Harvest strategy evaluation for the eastern stock of gemfish (Rexea solandri)","volume":"56","author":"Punt","year":"1999","journal-title":"ICES Journal of Marine Science"},{"key":"2019081300173926500_FSM012C45","doi-asserted-by":"crossref","unstructured":"Punt A. E. Pribac F. Taylor B. L. Walker T. I. Harvest strategy evaluation for school and gummy shark Journal of Northwest Atlantic Fisheries Science (Online) 35, art 2005 Accessed 6 January 2006 18 22 http:\/\/journal.nafo.int\/35\/18-punt.html","DOI":"10.2960\/J.v35.m517"},{"key":"2019081300173926500_FSM012C46","unstructured":"R Development Core Team R: A Language and Environment for Statistical Computing R Foundation for Statistical Computing 2006 Vienna, Austria http:\/\/www.r-project.org\/"},{"key":"2019081300173926500_FSM012C47","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1016\/j.icesjms.2004.02.001","article-title":"Management options for the Blackwater herring, a local spring-spawning stock in the Thames Estuary","volume":"61","author":"Roel","year":"2004","journal-title":"ICES Journal of Marine Science"},{"key":"2019081300173926500_FSM012C48","doi-asserted-by":"crossref","first-page":"2715","DOI":"10.1139\/f94-271","article-title":"Uncertainty and risk evaluation in stock assessment advice for US marine fisheries","volume":"51","author":"Rosenberg","year":"1994","journal-title":"Canadian Journal of Fisheries and Aquatic Sciences"},{"key":"2019081300173926500_FSM012C49","first-page":"107","article-title":"Experimental management of an Australian multispecies fishery: examining the possibility of trawl-induced habitat modification","volume-title":"Global Trends: Fisheries Management","author":"Sainsbury","year":"1997"},{"key":"2019081300173926500_FSM012C50","doi-asserted-by":"crossref","first-page":"731","DOI":"10.1006\/jmsc.2000.0737","article-title":"Design of operational management strategies for achieving fishery ecosystem objectives","volume":"57","author":"Sainsbury","year":"2000","journal-title":"ICES Journal of Marine Science"},{"key":"2019081300173926500_FSM012C51","doi-asserted-by":"crossref","first-page":"584","DOI":"10.1006\/jmsc.1999.0498","article-title":"Extended survivors analysis: an improved method for the analysis of catch-at-age data and abundance indices","volume":"56","author":"Shepherd","year":"1999","journal-title":"ICES Journal of Marine Science"},{"key":"2019081300173926500_FSM012C52","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1016\/S0165-7836(02)00168-6","article-title":"Responsible fisheries in the marine ecosystem","volume":"58","author":"Sinclair","year":"2002","journal-title":"Fisheries Research"},{"key":"2019081300173926500_FSM012C53","first-page":"291","article-title":"Moving beyond \u201cintelligent tinkering\u201d: advancing an ecosystem approach to fisheries","volume":"274","author":"Sissenwine","year":"2004","journal-title":"Marine Ecology Progress Series"},{"key":"2019081300173926500_FSM012C54","first-page":"12","article-title":"Introduction to multispecies virtual population analysis","volume":"193","author":"Sparre","year":"1991","journal-title":"ICES Marine Science Symposia"},{"key":"2019081300173926500_FSM012C55","first-page":"16","article-title":"Abundance estimation and TAC setting for Patagonian toothfish (Dissostichus eleginoides) at Macquarie Island: a synopsis","author":"Tuck","year":"2003"},{"key":"2019081300173926500_FSM012C56","unstructured":"Wilson D. C. Hegland T. J. An Analysis of Some Institutional Aspects of Science in Support of the Common Fisheries Policy 2005 Institute for Fisheries Management, Publication, 126"},{"key":"2019081300173926500_FSM012C57","doi-asserted-by":"crossref","first-page":"169","DOI":"10.47536\/jcrm.v7i2.750","article-title":"Updated 1978\u20132001 abundance estimates and their correlations for the Bering\u2013Chukchi\u2013Beaufort Seas stock of bowhead whales","volume":"7","author":"Zeh","year":"2005","journal-title":"Journal of Cetacean Research and Management"}],"container-title":["ICES Journal of Marine Science"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/icesjms\/article-pdf\/64\/4\/640\/29127466\/fsm012.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,12]],"date-time":"2023-05-12T22:07:37Z","timestamp":1683929257000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/icesjms\/article\/64\/4\/640\/640024"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2007,3,29]]},"references-count":57,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2007,3,29]]},"published-print":{"date-parts":[[2007,5,1]]}},"URL":"https:\/\/doi.org\/10.1093\/icesjms\/fsm012","relation":{},"ISSN":["1095-9289","1054-3139"],"issn-type":[{"value":"1095-9289","type":"electronic"},{"value":"1054-3139","type":"print"}],"subject":[],"published-other":{"date-parts":[[2007,5]]},"published":{"date-parts":[[2007,3,29]]}}}