{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T13:17:45Z","timestamp":1777468665197,"version":"3.51.4"},"reference-count":60,"publisher":"Emerald","issue":"3","license":[{"start":{"date-parts":[[2019,10,11]],"date-time":"2019-10-11T00:00:00Z","timestamp":1570752000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJIS"],"published-print":{"date-parts":[[2019,10,11]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title><jats:p>This study aims to demonstrate the values and effects of innovation becomes a challenge when selecting clear and correlating measures. While there is extensive research in the area of innovation measurement, there is a lack of consistent quantifiable measures that organizations can use. The International Association of Innovation Professionals (IAOIP) has partnered with Spigit to crowdsource innovation measures via the Innovation Measurement Standard (IMS) challenge with IAOIP members and the global public to determine the various ways innovation is measured across industries.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title><jats:p>This study used a mixed-methods approach and a sequential exploratory design to analyze the data collected during the IMS challenge. In the first phase, the qualitative methodology was used to analyze innovation measures submitted during the IMS challenge and participants\u2019 interactions and comments. In the second phase, the innovation measures were analyzed quantitatively to identify the most prominent measures.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Findings<\/jats:title><jats:p>A total of 73 innovation measures were collected during the challenge. In total, 18 top measures were ranked based on the participants\u2019 votes, and the top five measures were selected as the winning measures of the challenge. These five measures included intelligent failure rate, financial results of innovation, the results brought to the company, the number of innovative ideas selected for action and innovation portfolio balancing.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title><jats:p>This study is the first to select the innovation metrics while considering their relevance to the community of innovators that included academics, CEOs, consultants, innovation managers, etc. Another original factor of this work is the crowdsourcing approach used to identify innovation measures. This approach allowed us to explore multiple perspectives on the significance of each submitted measure.<\/jats:p><\/jats:sec>","DOI":"10.1108\/ijis-04-2019-0046","type":"journal-article","created":{"date-parts":[[2019,9,23]],"date-time":"2019-09-23T10:22:22Z","timestamp":1569234142000},"page":"471-488","source":"Crossref","is-referenced-by-count":15,"title":["Measuring innovation through a crowd source initiative"],"prefix":"10.1108","volume":"11","author":[{"given":"Fernando","family":"Almeida","sequence":"first","affiliation":[]},{"given":"Andrew John","family":"Kennedy","sequence":"additional","affiliation":[]},{"given":"Brook","family":"Lin","sequence":"additional","affiliation":[]},{"given":"Irina V.","family":"Nowak","sequence":"additional","affiliation":[]}],"member":"140","reference":[{"issue":"1","key":"key2019100411024600500_ref001","first-page":"137","article-title":"Strategies to perform a mixed methods study","volume":"5","year":"2018","journal-title":"European Journal of Education Studies"},{"issue":"52","key":"key2019100411024600500_ref002","first-page":"1732","article-title":"A survey of innovation performance models and metrics","volume":"6","year":"2017","journal-title":"Journal of Applied Economic Sciences"},{"key":"key2019100411024600500_ref003","unstructured":"Almquist, E. Leiman, M. Rigby, D. and Roth, A. (2013), \u201cTaking the measure of your innovation performance\u201d, Bain and Company, available at: www.bain.com\/insights\/taking-the-measure-of-your-innovation-performance\/"},{"issue":"5","key":"key2019100411024600500_ref004","doi-asserted-by":"crossref","first-page":"1297","DOI":"10.1177\/0149206314527128","article-title":"Innovation and creativity in organizations: a state-of-the-Science review, prospective commentary, and guiding framework","volume":"40","year":"2014","journal-title":"Journal of Management"},{"issue":"4","key":"key2019100411024600500_ref005","first-page":"10","article-title":"Innovation metrics: measuring what matters","volume":"5","year":"2007","journal-title":"Strategy and Innovation"},{"key":"key2019100411024600500_ref006","doi-asserted-by":"crossref","first-page":"906","DOI":"10.1016\/j.promfg.2018.03.128","article-title":"Measuring innovation using key performance indicators","volume":"22","year":"2018","journal-title":"Procedia Manufacturing"},{"key":"key2019100411024600500_ref007","volume-title":"Integrating Analyses in Mixed Methods Research","year":"2017"},{"issue":"4","key":"key2019100411024600500_ref008","first-page":"5","article-title":"Company innovative leadership model","volume":"2","year":"2015","journal-title":"Economic Alternatives"},{"key":"key2019100411024600500_ref009","unstructured":"Burnett, M. (2011), \u201cMeasuring Innovation - Sustaining competitive advantage by turning ideas into value\u201d, BearingPoint \u2013 Management and Technology Consultants, available at: www.bearingpoint.com\/files\/Innovation_High_Res.pdf"},{"issue":"1","key":"key2019100411024600500_ref010","doi-asserted-by":"crossref","first-page":"128","DOI":"10.2307\/2393553","article-title":"Absorptive capacity: a new perspective on learning and innovation","volume":"35","year":"1990","journal-title":"Administrative Science Quarterly"},{"issue":"10","key":"key2019100411024600500_ref011","doi-asserted-by":"crossref","first-page":"6","DOI":"10.22215\/timreview\/731","article-title":"A firm-level innovation management framework and assessment tool for increasing competitiveness","volume":"3","year":"2013","journal-title":"Technology Innovation Management Review"},{"key":"key2019100411024600500_ref012","volume-title":"Metrics for Firm-Level Business Innovation in Canada","year":"2013"},{"key":"key2019100411024600500_ref013","volume-title":"Innovation Measurement Metrics and Practices: The Life Sciences and Clean Tech Sectors","year":"2015"},{"key":"key2019100411024600500_ref014","volume-title":"Innovation Measurement Metrics and PracticesThe Manufacturing Sector","year":"2015"},{"key":"key2019100411024600500_ref015","volume-title":"A Concise Introduction to Mixed Methods Research","year":"2014"},{"key":"key2019100411024600500_ref016","first-page":"315","article-title":"Mixed methods research: developments, debates, and dilemmas","volume-title":"Research in Organizations: Foundations and Methods of Inquiry","year":"2005"},{"issue":"6","key":"key2019100411024600500_ref017","doi-asserted-by":"crossref","first-page":"1154","DOI":"10.1111\/j.1467-6486.2009.00880.x","article-title":"A multi-dimensional framework for organizational innovation: a systematic review of literature","volume":"47","year":"2010","journal-title":"Journal of Management Studies"},{"key":"key2019100411024600500_ref018","volume-title":"Managing Change, Creativity and Innovation","year":"2017"},{"issue":"9","key":"key2019100411024600500_ref019","doi-asserted-by":"crossref","first-page":"536","DOI":"10.1016\/j.technovation.2014.04.002","article-title":"Towards a holistic enterprise innovation performance measurement system","volume":"34","year":"2014","journal-title":"Technovation"},{"issue":"576596","key":"key2019100411024600500_ref020","first-page":"1","article-title":"Designing and validating a model for measuring innovation capacity construct","volume":"2014","year":"2014","journal-title":"Advances in Decision Sciences"},{"key":"key2019100411024600500_ref021","article-title":"Innovation indicators throughout the innovation process: an extensive literature analysis","volume":"80\/81","year":"2018","journal-title":"Technovation"},{"key":"key2019100411024600500_ref022","volume-title":"Handbook of Innovation Policy Impact","year":"2016"},{"key":"key2019100411024600500_ref023","volume-title":"Knowledge Management in Organizations","year":"2013"},{"key":"key2019100411024600500_ref024","doi-asserted-by":"crossref","first-page":"764","DOI":"10.1016\/j.sbspro.2016.11.078","article-title":"The effect of technological innovation capabilities and absorptive capacity on firm innovativeness: a conceptual framework","volume":"235","year":"2016","journal-title":"Procedia \u2013 Social and Behavioral Sciences"},{"issue":"1","key":"key2019100411024600500_ref025","first-page":"99","article-title":"The role of innovation in creating the company\u2019s competitive advantage","volume":"4","year":"2015","journal-title":"Ecoforum"},{"issue":"1","key":"key2019100411024600500_ref026","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40552-017-0038-7","article-title":"Creativity and innovation for corporate happiness management","volume":"4","year":"2017","journal-title":"Brazilian Journal of Science and Technology"},{"key":"key2019100411024600500_ref027","volume-title":"Ten Types of Innovation: The Discipline of Building Breakthroughs","year":"2013"},{"key":"key2019100411024600500_ref028","volume-title":"Innovation and Firm Performance","year":"2003"},{"key":"key2019100411024600500_ref029","first-page":"1","article-title":"Explicit design of innovation performance metrics by using analytic hierarchy process expansion","volume":"2014","year":"2014","journal-title":"International Journal of Mathematics and Mathematical Sciences"},{"key":"key2019100411024600500_ref030","volume-title":"How Innovation Really Works: Using the Trillion-Dollar R&D Fix to Drive Growth","year":"2017"},{"key":"key2019100411024600500_ref031","volume-title":"Winning at Innovation","year":"2015"},{"issue":"4","key":"key2019100411024600500_ref032","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1108\/JBS-09-2017-0137","article-title":"Measuring radical innovation project success: typical metrics don\u2019t work","volume":"39","year":"2018","journal-title":"Journal of Business Strategy"},{"issue":"6","key":"key2019100411024600500_ref033","first-page":"122","article-title":"Investment, innovation and firm performance: empirical evidence from small manufacturing industries","volume":"3","year":"2015","journal-title":"Journal of Finance and Economics"},{"key":"key2019100411024600500_ref034","article-title":"Synergy effects of innovation on firm performance","volume":"1","year":"2017","journal-title":"Journal of Business Research"},{"issue":"3","key":"key2019100411024600500_ref035","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1108\/JSBED-02-2014-0018","article-title":"Dynamic capabilities vs. innovation capability: are they related?","volume":"21","year":"2014","journal-title":"Journal of Small Business and Enterprise Development"},{"issue":"1","key":"key2019100411024600500_ref036","first-page":"131","article-title":"Innovation performance measurement: an integrative perspective of stakeholder\u2019s view","volume":"2","year":"2013","journal-title":"Nang Yan Business Journal"},{"issue":"11\/12","key":"key2019100411024600500_ref037","first-page":"1","article-title":"Measurement of innovation in South Africa: an analysis of survey metrics and recommendations","volume":"11","year":"2015","journal-title":"South African Journal of Science"},{"key":"key2019100411024600500_ref038","volume-title":"The Innovation Master Plan: The CEO\u2019s Guide to Innovation","year":"2011"},{"key":"key2019100411024600500_ref039","volume-title":"The Agile Innovation Master Plan","year":"2017"},{"key":"key2019100411024600500_ref040","volume-title":"Innovation and Business Performance: A Literature Review","year":"1998"},{"key":"key2019100411024600500_ref041","unstructured":"OECD (2018), \u201cOslo manual 2018 \u2013 guidelines for collecting, reporting and using data on innovation\u201d, available at: www.oecd.org\/science\/oslo-manual-2018-9789264304604-en.htm"},{"key":"key2019100411024600500_ref042","volume-title":"The Value of Innovation: Knowing, Proving, and Showing the Value of Innovation and Creativity","year":"2018"},{"issue":"1","key":"key2019100411024600500_ref043","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1142\/S1363919606001375","article-title":"Development of an audit tool for product innovation compass","volume":"10","year":"2006","journal-title":"International Journal of Innovation Management"},{"key":"key2019100411024600500_ref044","doi-asserted-by":"crossref","unstructured":"Richtn\u00e9r, A. Brattstr\u00f6m, A. Frishammar, J. Bj\u00f6rk, J. and Magnusson, M. (2017), \u201cCreating better innovation measurement practices\u201d, MIT Sloan Management Review, available at: https:\/\/sloanreview.mit.edu\/article\/creating-better-innovation-measurement-practices\/","DOI":"10.7551\/mitpress\/11858.003.0017"},{"key":"key2019100411024600500_ref045","volume-title":"Innovation Governance in an Open Economy: Shaping Regional Nodes in a Globalized World","year":"2012"},{"issue":"4","key":"key2019100411024600500_ref046","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1080\/13662716.2017.1414744","article-title":"Knowledge context, learning and innovation: an integrating framework","volume":"25","year":"2018","journal-title":"Industry and Innovation"},{"key":"key2019100411024600500_ref047","volume-title":"Mapping Innovation: A Playbook for Navigating a Disruptive Age","year":"2017"},{"issue":"4","key":"key2019100411024600500_ref048","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1108\/17465261211272139","article-title":"A conceptual framework for the measurement of innovation capability and its effects","volume":"7","year":"2012","journal-title":"Baltic Journal of Management"},{"issue":"9","key":"key2019100411024600500_ref049","doi-asserted-by":"crossref","first-page":"6","DOI":"10.22215\/timreview\/722","article-title":"Strategic innovation for business performance: the art and science of transformation","volume":"3","year":"2013","journal-title":"Technology Innovation Management Review"},{"key":"key2019100411024600500_ref050","volume-title":"Essays: On Entrepreneurs, Innovations, Business Cycles and the Evolution of Capitalism","year":"2017"},{"key":"key2019100411024600500_ref051","volume-title":"Counseling Research: Quantitative, Qualitative, and Mixed Methods","year":"2016"},{"issue":"4","key":"key2019100411024600500_ref052","doi-asserted-by":"crossref","first-page":"564","DOI":"10.1108\/EJIM-11-2017-0166","article-title":"Creativity, innovation effectiveness and productive efficiency in the UK","volume":"21","year":"2018","journal-title":"European Journal of Innovation Management"},{"key":"key2019100411024600500_ref053","volume-title":"Key Concepts in Innovation","year":"2011"},{"issue":"6","key":"key2019100411024600500_ref054","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1108\/JBS-08-2015-0079","article-title":"When markets stagnate: finding new territory through reverse innovation","volume":"37","year":"2016","journal-title":"Journal of Business Strategy"},{"issue":"1","key":"key2019100411024600500_ref055","first-page":"75","article-title":"Innovation and the value of failure","volume":"3","year":"2010","journal-title":"International Journal of Management and Marketing Research"},{"key":"key2019100411024600500_ref056","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/j.sbspro.2012.04.019","article-title":"A model proposal oriented to measure technological innovation capabilities of business firms \u2013 a research on automotive industry","volume":"41","year":"2012","journal-title":"Procedia \u2013 Social and Behavioral Sciences"},{"issue":"6","key":"key2019100411024600500_ref057","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1108\/13673270910997088","article-title":"Knowledge management and organizational performance: an exploratory analysis","volume":"13","year":"2009","journal-title":"Journal of Knowledge Management"},{"issue":"25","key":"key2019100411024600500_ref058","first-page":"1","article-title":"Approaches to innovation process assessment: complex results from an exploratory investigation","volume":"7","year":"2015","journal-title":"International Journal of Engineering Business Management"},{"issue":"1","key":"key2019100411024600500_ref059","doi-asserted-by":"crossref","first-page":"816","DOI":"10.1080\/1331677X.2016.1235983","article-title":"Innovation performance measurement: research into Czech business practice","volume":"29","year":"2016","journal-title":"Economic Research-Ekonomska Istra\u017eivanja"},{"issue":"10","key":"key2019100411024600500_ref060","doi-asserted-by":"crossref","first-page":"6","DOI":"10.22215\/timreview\/731","article-title":"A firm-level innovation management framework and assessment tool for increasing competitiveness","volume":"3","year":"2013","journal-title":"Technology Innovation Management Review"}],"container-title":["International Journal of Innovation Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IJIS-04-2019-0046\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IJIS-04-2019-0046\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T22:56:23Z","timestamp":1753397783000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/ijis\/article\/11\/3\/471-488\/134614"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,11]]},"references-count":60,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2019,10,11]]}},"alternative-id":["10.1108\/IJIS-04-2019-0046"],"URL":"https:\/\/doi.org\/10.1108\/ijis-04-2019-0046","relation":{},"ISSN":["1757-2223","1757-2223"],"issn-type":[{"value":"1757-2223","type":"print"},{"value":"1757-2223","type":"print"}],"subject":[],"published":{"date-parts":[[2019,10,11]]}}}