{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,15]],"date-time":"2025-10-15T18:10:40Z","timestamp":1760551840493},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"8","license":[{"start":{"date-parts":[[2022,12,22]],"date-time":"2022-12-22T00:00:00Z","timestamp":1671667200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,12,22]],"date-time":"2022-12-22T00:00:00Z","timestamp":1671667200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Behav Res"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>When one studies fake news or false reviews, the first step to take is to find a corpus of text samples to work with. However, most deceptive corpora suffer from an intrinsic problem: there is little incentive for the providers of the deception to put their best effort, which risks lowering the quality and realism of the deception. The corpus described in this project, the Motivated Deception Corpus, aims to rectify this problem by gamifying the process of deceptive text collection. By having subjects play the game Two Truths and a Lie, and by rewarding those subjects that successfully fool their peers, we collect samples in such a way that the process itself improves the quality of the text. We have amassed a large corpus of deceptive text that is strongly incentivized to be convincing, and thus more reflective of real deceptive text. We provide results from several configurations of neural network prediction models to establish machine learning benchmarks on the data. This new corpus is demonstratively more challenging to classify with the current state of the art than previous corpora.<\/jats:p>","DOI":"10.3758\/s13428-022-02028-7","type":"journal-article","created":{"date-parts":[[2022,12,22]],"date-time":"2022-12-22T16:02:48Z","timestamp":1671724968000},"page":"4478-4488","update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Building and benchmarking the motivated deception corpus: Improving the quality of deceptive text through gaming"],"prefix":"10.3758","volume":"55","author":[{"given":"Dan","family":"Barsever","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mark","family":"Steyvers","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Emre","family":"Neftci","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,12,22]]},"reference":[{"issue":"5","key":"2028_CR1","doi-asserted-by":"publisher","first-page":"1042","DOI":"10.1109\/TIFS.2016.2639344","volume":"12","author":"M Abouelenien","year":"2016","unstructured":"Abouelenien, M., P\u00e9rez-Rosas, V., Mihalcea, R., & Burzo, M. (2016). Detecting deceptive behavior via integration of discriminative features from multiple modalities. IEEE Transactions on Information Forensics and Security, 12(5), 1042\u20131055.","journal-title":"IEEE Transactions on Information Forensics and Security"},{"key":"2028_CR2","unstructured":"Amazon, A. (2014). Amazon customer reviews dataset. https:\/\/s3.amazonaws.com\/amazon-reviews-pds\/readme.html Aphiwongsophon,S.,&Chongstitvatana,P.(2018)Detectingfakenewswithmachinelearningmethod,528\u2013531. Barsever,D.,Singh,S.,&Neftci,E.(2020)BuildingaBetterLieDetectorwithBERT:TheDifference BetweenTruthandLies,1\u20137."},{"issue":"11","key":"2028_CR3","first-page":"1377","volume":"28","author":"V Carrieri","year":"2019","unstructured":"Carrieri,V.,Madio,L.,&Principe,F.(2019).Vaccinehesitancyand(fake)news:Quasi-experimentalevidence fromItaly.Healtheconomics,28(11),1377\u20131382.","journal-title":"Healtheconomics"},{"key":"2028_CR4","first-page":"88","volume":"9","author":"DL Chen","year":"2016","unstructured":"Chen,D.L.,Schonger,M.,&Wickens,C.(2016).oTree\u2014Anopen-sourceplatformforlaboratory,online, andfieldexperiments.JournalofBehavioralandExperimentalFinance,9,88\u201397.","journal-title":"JournalofBehavioralandExperimentalFinance"},{"key":"2028_CR5","volume-title":"Thepolygraphandliedetection","author":"NR Council","year":"2003","unstructured":"Council,N.R.(2003)Thepolygraphandliedetection.Washington:NationalAcademiesPress."},{"key":"2028_CR6","unstructured":"Devlin,J.,Chang,M.-W.,Lee,K.,&Toutanova,K.(2018).Bert:Pre-trainingofdeepbidirectional transformersforlanguageunderstanding.arXiv:1810.04805."},{"key":"2028_CR7","unstructured":"Feng,S.,Banerjee,R.,&Choi,Y.(2012).Syntacticstylometryfordeceptiondetection.InProceedings ofthe50thAnnualMeetingoftheAssociationforComputationalLinguistics:ShortPapers-Volume2(pp. 171\u2013175): AssociationforComputationalLinguistics."},{"key":"2028_CR8","unstructured":"Filatova,E.(2012).Ironyandsarcasm:Corpusgenerationandanalysisusingcrowdsourcing.InLrec(pp. 392\u2013398):Citeseer."},{"issue":"3","key":"2028_CR9","first-page":"1","volume":"8","author":"E Fitzpatrick","year":"2015","unstructured":"Fitzpatrick,E.,Bachenko,J.,&Fornaciari,T.(2015).Automaticdetectionofverbaldeception. SynthesisLecturesonHumanLanguageTechnologies,8(3),1\u2013119.","journal-title":"SynthesisLecturesonHumanLanguageTechnologies"},{"issue":"4","key":"2028_CR10","first-page":"1019","volume":"54","author":"T Fornaciari","year":"2020","unstructured":"Fornaciari,T.,Cagnina,L.,Rosso,P.,&Poesio,M.(2020).Fakeopiniondetection:howsimilarare crowdsourceddatasetstorealdata?LanguageResourcesandEvaluation,54(4),1019\u20131058.","journal-title":"LanguageResourcesandEvaluation"},{"key":"2028_CR11","doi-asserted-by":"crossref","unstructured":"Fornaciari,T.,&Poesio,M.(2014).IdentifyingfakeAmazonreviewsaslearningfromcrowds.InProceedings ofthe14thConferenceoftheEuropeanChapteroftheAssociationforComputationalLinguistics(pp. 279\u2013287): AssociationforComputationalLinguistics.","DOI":"10.3115\/v1\/E14-1030"},{"issue":"2","key":"2028_CR12","doi-asserted-by":"publisher","first-page":"176","DOI":"10.3758\/BF03204306","volume":"27","author":"J Frijters","year":"1980","unstructured":"Frijters,J.,Kooistra,A.,&Vereijken,P.(1980).Tablesofd\u2019forthetriangularmethodandthe3-AFCsignal detectionprocedure.Perception&Psychophysics,27(2),176\u2013178.","journal-title":"Perception&Psychophysics"},{"key":"2028_CR13","unstructured":"Hovy,D.(2016).Theenemyinyourowncamp:Howwellcanwedetectstatistically-generatedfakereviews\u2013an adversarialstudy.InProceedingsofthe54thAnnualMeetingoftheAssociationforComputationalLinguistics(Volume 2:ShortPapers)(pp. 351\u2013356)."},{"key":"2028_CR14","unstructured":"Hu,S.(2019).Detectingconcealedinformationintextandspeech.InProceedingsofthe57thAnnualMeetingof theAssociationforComputationalLinguistics(pp. 402\u2013412)."},{"key":"2028_CR15","unstructured":"Kalsnes,B.(2018).Fakenews.InOxfordResearchEncyclopediaofCommunication."},{"key":"2028_CR16","unstructured":"Khodak,M.,Saunshi,N.,&Vodrahalli,K.(2017).Alargeself-annotatedcorpusforsarcasm. arXiv:1704.05579."},{"issue":"10","key":"2028_CR17","first-page":"1960","volume":"25","author":"TR Levine","year":"2014","unstructured":"Levine,T.R.,&Bond,C.F.(2014).Directandindirectmeasuresofliedetectiontellthesamestory:Areply totenBrinke,Stimson,andCarney(2014).PsychologicalScience,25(10),1960\u20131961.","journal-title":"PsychologicalScience"},{"key":"2028_CR18","doi-asserted-by":"crossref","unstructured":"Li,J.,Ott,M.,Cardie,C.,&Hovy,E.(2014).Towardsageneralruleforidentifyingdeceptiveopinionspam. InProceedingsofthe52ndannualmeetingoftheassociationforcomputationallinguistics(Volume1:LongPapers),(Vol. 1pp. 1566\u20131576).","DOI":"10.3115\/v1\/P14-1147"},{"issue":"1","key":"2028_CR19","first-page":"429","volume":"51","author":"EP Lloyd","year":"2019","unstructured":"Lloyd,E.P.,Deska,J.C.,Hugenberg,K.,McConnell,A.R.,Humphrey,B.T.,&Kunstman,J.W. (2019).MiamiUniversitydeceptiondetectiondatabase.BehaviorResearchMethods,51(1),429\u2013439.","journal-title":"BehaviorResearchMethods"},{"key":"2028_CR20","doi-asserted-by":"crossref","unstructured":"Loper,E.,&Bird,S.(2002).NLTK:thenaturallanguagetoolkit.arXiv:cs\/0205028.","DOI":"10.3115\/1118108.1118117"},{"issue":"5","key":"2028_CR21","first-page":"665","volume":"29","author":"ML Newman","year":"2003","unstructured":"Newman,M.L.,Pennebaker,J.W.,Berry,D.S.,&Richards,J.M.(2003).Lyingwords:Predicting deceptionfromlinguisticstyles.PersonalityandSocialPsychologyBulletin,29(5),665\u2013675.","journal-title":"PersonalityandSocialPsychologyBulletin"},{"key":"2028_CR22","unstructured":"Ott,M.,Cardie,C.,&Hancock,J.T.(2013).Negativedeceptiveopinionspam.InProceedingsofthe 2013conferenceoftheNorthAmericanChapterOfTheAssociationForComputationalLinguistics:humanlanguage technologies(pp. 497\u2013501)."},{"key":"2028_CR23","unstructured":"Ott,M.,Choi,Y.,Cardie,C.,&Hancock,J.T.(2011).Findingdeceptiveopinionspambyanystretch oftheimagination.InProceedingsofthe49thannualmeetingoftheassociationforcomputationallinguistics:Human languagetechnologies-volume1(pp. 309\u2013319):AssociationforComputationalLinguistics."},{"issue":"3","key":"2028_CR24","first-page":"184","volume":"23","author":"G Paolacci","year":"2014","unstructured":"Paolacci,G.,&Chandler,J.(2014).InsidetheTurk:UnderstandingMechanicalTurkasaparticipantpool. CurrentDirectionsinPsychologicalScience,23(3),184\u2013188.","journal-title":"CurrentDirectionsinPsychologicalScience"},{"key":"2028_CR25","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa,F.,Varoquaux,G.,Gramfort,A.,Michel,V.,Thirion,B.,Grisel,O., ..., etal.(2011).Scikit-learn:MachinelearninginPython.TheJournalofMachineLearningResearch, 12,2825\u20132830.","journal-title":"TheJournalofMachineLearningResearch"},{"key":"2028_CR26","doi-asserted-by":"crossref","unstructured":"Pennington,J.,Socher,R.,&Manning,C.(2014).Glove:Globalvectorsforwordrepresentation.InProceedings ofthe2014conferenceonempiricalmethodsinnaturallanguageprocessing(EMNLP)(pp. 1532\u20131543).","DOI":"10.3115\/v1\/D14-1162"},{"key":"2028_CR27","first-page":"213","volume":"385","author":"Y Ren","year":"2017","unstructured":"Ren,Y.,&Ji,D.(2017).Neuralnetworksfordeceptiveopinionspamdetection:Anempiricalstudy. InformationSciences,385,213\u2013224.","journal-title":"InformationSciences"},{"issue":"3","key":"2028_CR28","first-page":"257","volume":"25","author":"P Robert","year":"1976","unstructured":"Robert,P.,&Escoufier,Y.(1976).Aunifyingtoolforlinearmultivariatestatisticalmethods:theRV-coefficient. JournaloftheRoyalStatisticalSociety:SeriesC(AppliedStatistics),25(3),257\u2013265.","journal-title":"JournaloftheRoyalStatisticalSociety:SeriesC(AppliedStatistics)"},{"issue":"1","key":"2028_CR29","first-page":"22","volume":"19","author":"K Shu","year":"2017","unstructured":"Shu,K.,Sliva,A.,Wang,S.,Tang,J.,&Liu,H.(2017).Fakenewsdetectiononsocialmedia:Adata miningperspective.ACMSIGKDDExplorationsNewsletter,19(1),22\u201336.","journal-title":"ACMSIGKDDExplorationsNewsletter"},{"issue":"3","key":"2028_CR30","first-page":"171","volume":"53","author":"S Tasnim","year":"2020","unstructured":"Tasnim,S.,Hossain,M.M.,&Mazumder,H.(2020).ImpactofrumorsandmisinformationonCOVID-19 insocialmedia.JournalofPreventiveMedicineandPublicHealth,53(3),171\u2013174.","journal-title":"JournalofPreventiveMedicineandPublicHealth"},{"key":"2028_CR31","unstructured":"Vaswani,A.,Shazeer,N.,Parmar,N.,Uszkoreit,J.,Jones,L.,Gomez,A.N., ..., etal. (2017).Attentionisallyouneed.InAdvancesinneuralinformationprocessingsystems(pp. 5998\u20136008)."},{"issue":"1","key":"2028_CR32","first-page":"1","volume":"1","author":"N Vogler","year":"2019","unstructured":"Vogler,N.,&Pearl,L.(2019).Usinglinguistically-definedspecificdetailstodetectdeceptionacrossdomains. NaturalLanguageEngineering,1(1),1\u201332.","journal-title":"NaturalLanguageEngineering"},{"key":"2028_CR33","volume-title":"Detectingliesanddeceit:Pitfallsandopportunities","author":"A Vrij","year":"2008","unstructured":"Vrij,A.(2008)Detectingliesanddeceit:Pitfallsandopportunities.Hoboken:Wiley."},{"key":"2028_CR34","unstructured":"Wang,W.Y.(2017).\u201cliar,liarpantsonfire\u201d:Anewbenchmarkdatasetforfakenewsdetection.arXiv:1705.00648. Wolf,T.,Chaumond,J.,Debut,L.,Sanh,V.,Delangue,C.,Moi,A., ..., etal.(2020) Transformers:State-of-the-artnaturallanguageprocessing,38\u201345."},{"key":"2028_CR35","unstructured":"Xu,Q.,&Zhao,H.(2012).Usingdeeplinguisticfeaturesforfindingdeceptiveopinionspam.Proceedingsof COLING2012:Posters1341\u20131350."}],"container-title":["Behavior Research Methods"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.3758\/s13428-022-02028-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.3758\/s13428-022-02028-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.3758\/s13428-022-02028-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,6]],"date-time":"2023-12-06T16:06:23Z","timestamp":1701878783000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.3758\/s13428-022-02028-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,22]]},"references-count":35,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["2028"],"URL":"https:\/\/doi.org\/10.3758\/s13428-022-02028-7","relation":{},"ISSN":["1554-3528"],"issn-type":[{"value":"1554-3528","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,22]]},"assertion":[{"value":"14 November 2022","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 December 2022","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}