To help offer the best experience possible, Guilford uses cookies on its site. By browsing here, you acknowledge our terms of use. For more information, see our Cookie Policy.
You can also read Guilford's Privacy Policy.

×
Skip to main content

Everything you need with Guilford's 30-day ALL ACCESS pass, just $49.95 | Click on any article to purchase  

Search
Search
Quick Search anywhere
Advanced Search
Skip main navigation

Reflecting on 25 Years of Research Using Implicit Measures: Recommendations for Their Future Use

Published Online:December 2020https://doi.org/10.1521/soco.2020.38.supp.s223

Abstract

For more than 25 years, implicit measures have shaped research, theorizing, and intervention in psychological science. During this period, the development and deployment of implicit measures have been predicated on a number of theoretical, methodological, and applied assumptions. Yet these assumptions are frequently violated and rarely met. As a result, the merit of research using implicit measures has increasingly been cast into doubt. In this article, we argue that future implicit measures research could benefit from adherence to four guidelines based on a functional approach wherein performance on implicit measures is described and analyzed as behavior emitted under specific conditions and captured in a specific measurement context. We unpack this approach and highlight recent work illustrating both its theoretical and practical value.

REFERENCES

  • Amodio D. M., , & Devine P. G. (2006). Stereotyping and evaluation in implicit race bias: Evidence for independent constructs and unique effects on behavior. Journal of Personality and Social Psychology, 91, 652. Crossref, Google Scholar
  • Banaji M. R. (2001). Implicit attitudes can be measured. In Roediger H. L., , Nairne J. S., , Neath I., , & Surprenant A. (Eds.), The nature of remembering: Essays in honor of Robert G. Crowder (pp. 117150). Washington, DC: American Psychological Association. Google Scholar
  • Bar-Anan Y., , & Nosek B. A. (2014). A comparative investigation of seven indirect attitude measures. Behavior Research Methods, 46(3), 668688. Crossref, Google Scholar
  • Blanton H., , & Jaccard J. (2006). Arbitrary metrics in psychology. American Psychologist, 61, 2741. Crossref, Google Scholar
  • Brownstein M., , Madva A., , & Gawronski B. (2019). What do implicit measures measure? Wiley Interdisciplinary Reviews: Cognitive Science, 10(5), e1501. Crossref, Google Scholar
  • Carter E. R., , Onyeador I. N., , & Lewis N. A. (2020). Developing and delivering effective anti-bias training: Challenges & recommendations. Behavioral Science & Policy, 6, 5770. Crossref, Google Scholar
  • Cathelyn F., , Van Dessel P., , Cummins J., , & De Houwer J. (2019). Driving under the influence of alcohol. Retrieved from osf.io/b7wur Google Scholar
  • Chester D., , & Lasko E. (2019). Construct validation of experimental manipulations in social psychology: Current practices and recommendations for the future. https://doi.org/10.31234/osf.io/t7ev9 Google Scholar
  • Cone J., , Mann T. C., , & Ferguson M. J. (2017). Changing our implicit minds: How, when, and why implicit evaluations can be rapidly revised. In Advances in Experimental Social Psychology (vol. 56, pp. 131199). Waltham, MA: Academic Press. Google Scholar
  • Corneille O., , & Hütter M. (2020). Implicit? What do you mean? A comprehensive review of the delusive implicitness construct in attitude research. Personality and Social Psychology Review, 24(3), 212232. https://doi.org/10.1177/1088868320911325 Crossref, Google Scholar
  • Corneille O., , & Stahl C. (2019). Associative attitude learning: A closer look at evidence and how it relates to attitude models. Personality and Social Psychology Review, 23(2), 161189. Crossref, Google Scholar
  • Cristea I. A., , Kok R. N., , & Cuijpers P. (2015). Efficacy of cognitive bias modification interventions in anxiety and depression: Meta-analysis. British Journal of Psychiatry, 206, 716. Crossref, Google Scholar
  • Cummins J., , & De Houwer J. (2019). An inkblot for beliefs: The Truth Misattribution Procedure. PLOS ONE, 14(6), e0218661. Crossref, Google Scholar
  • Cummins J., , Hussey I., , & Hughes S. (2019). The AMPeror's new clothes: Performance on the Affect Misattribution Procedure is mainly driven by awareness of influence of the primes. https://doi.org/10.31234/osf.io/d5zn8 Google Scholar
  • Dang J., , King K. M., , & Inzlicht M. (2020). Why are self-report and behavioral measures weakly correlated? Trends in Cognitive Science, 24(4), 267269. https://doi.org/10.1016/j.tics.2020.01.007 Crossref, Google Scholar
  • De Houwer J. (2011). Why the cognitive approach in psychology would profit from a functional approach and vice versa. Perspectives on Psychological Science, 6, 202209. Crossref, Google Scholar
  • De Houwer J. (2014). A propositional model of implicit evaluation. Social and Personality Psychology Compass, 8, 342353. Crossref, Google Scholar
  • De Houwer J. (2019). Implicit bias is behavior: A functional-cognitive perspective on implicit bias. Perspectives on Psychological Science, 14, 835840. Crossref, Google Scholar
  • De Houwer J., , Gawronski B., , & Barnes-Holmes D. (2013). A functional-cognitive framework for attitude research. European Review of Social Psychology, 24(1), 252287. Crossref, Google Scholar
  • De Houwer J., , Heider N., , Spruyt A., , Roets A., , & Hughes S. (2015). The relational responding task: Toward a new implicit measure of beliefs. Frontiers in Psychology, 6, 319. Crossref, Google Scholar
  • De Houwer J., , & Moors A. (2007). How to define and examine the implicitness of implicit measures. In Wittenbrink B., & Schwarz N. (Eds.), Implicit measures of attitudes: Procedures and controversies (pp. 179194). New York: Guilford. Google Scholar
  • De Houwer J., , Van Dessel P., , & Moran T. (2020). Attitudes beyond associations: On the role of propositional representations in stimulus evaluation. Advances in Experimental Social Psychology, 61, 127183. Crossref, Google Scholar
  • De Schryver M., , Hughes S., , De Houwer J., , & Rosseel Y. (2018). On the reliability of implicit measures: Current practices and novel recommendations. https://doi.org/10.31234/osf.io/w7j86 Google Scholar
  • Dovidio J. F., , Kawakami K., , Johnson C., , Johnson B., , & Howard A. (1997). On the nature of prejudice: Automatic and controlled processes. Journal of Experimental Social Psychology, 33, 510540. Crossref, Google Scholar
  • Fazio R. H., , & Olson M.A. (2003). Implicit measures in social cognition research: Their meaning and uses. Annual Review of Psychology, 54, 297327. Crossref, Google Scholar
  • Fiedler K., , & Bluemke M. (2005). Faking the IAT: Aided and unaided response control on the implicit association tests. Basic and Applied Social Psychology, 27, 307316. Crossref, Google Scholar
  • Fiedler K., , Messner C., , & Bluemke M. (2006). Unresolved problems with the “I”, the “A”, and the “T”: A logical and psychometric critique of the Implicit Association Test (IAT). European Review of Social Psychology, 17, 74147. Crossref, Google Scholar
  • Flake J. K., , Pek J., , & Hehman E. (2017). Construct validation in social and personality research: Current practice and recommendations. Social Psychological and Personality Science, 8(4), 370378. Crossref, Google Scholar
  • Forscher P. S., , Lai C. K., , Axt J. R., , Ebersole C. R., , Herman M., , Devine P. G., , & Nosek B. A. (2019). A meta-analysis of procedures to change implicit measures. Journal of Personality and Social Psychology, 117(3), 522559. Crossref, Google Scholar
  • Friese M., , Hofmann W., , & Schmitt M. (2009). When and why do implicit measures predict behaviour? Empirical evidence for the moderating role of opportunity, motivation, and process reliance. European Review of Social Psychology, 19, 285338. Crossref, Google Scholar
  • Gawronski B. (2019). Six lessons for a cogent science of implicit bias and its criticism. Perspectives on Psychological Science, 14, 574595. Crossref, Google Scholar
  • Gawronski B., , & Bodenhausen G. V. (2006). Associative and propositional processes in evaluation: An integrative review of implicit and explicit attitude change. Psychological Bulletin, 132, 692731. Crossref, Google Scholar
  • Gawronski B., , & Brannon S. M. (2019). Attitudes and the implicit-explicit dualism. In Albarracín D., & Johnson B. T. (Eds.), The handbook of attitudes. Volume 1: Basic principles (2nd ed., pp. 158196). New York: Routledge. Google Scholar
  • Gawronski B., , & De Houwer J. (2014). Implicit measures in social and personality psychology. In Reis H. T., , & Judd C. M. (Eds.), Handbook of research methods in social and personality psychology (2nd ed., pp. 283310). New York: Cambridge University Press. Crossref, Google Scholar
  • Gawronski B., , & Hahn A. (2019). Implicit measures: Procedures, use, and interpretation. In Blanton H., , LaCroix J. M., , & Webster G. D. (Eds.), Measurement in social psychology (pp. 2955). New York: Taylor & Francis. Google Scholar
  • Greenwald A. G., , & Banaji M. R. (1995). Implicit social cognition: Attitudes, self-esteem, and stereotypes. Psychological Review, 102(1), 427. Crossref, Google Scholar
  • Greenwald A. G., , & Banaji M. R. (2017). The implicit revolution: Reconceiving the relation between conscious and unconscious. American Psychologist, 72, 861871. https://doi.org/0.1037/amp0000238 Crossref, Google Scholar
  • Greenwald A. G., , McGhee D. E., , & Schwartz J. L. K. (1998). Measuring individual differences in implicit cognition: The Implicit Association Test. Journal of Personality and Social Psychology, 74, 14641480. Crossref, Google Scholar
  • Greenwald A. G., , Nosek B. A., , & Banaji M. R. (2003). Understanding and using the Implicit Association Test: I. An improved scoring algorithm. Journal of Personality and Social Psychology, 85, 197216. Crossref, Google Scholar
  • Gregg A. P., , Seibt B., , & Banaji M. R. (2006). Easier done than undone: Asymmetry in the malleability of implicit preferences. Journal of Personality and Social Psychology, 90, 120. https://doi.org/10.1037/0022-3514.90.1.1 Crossref, Google Scholar
  • Hahn A., , & Gawronski B. (2019). Facing one's implicit biases: From awareness to acknowledgement. Journal of Personality and Social Psychology, 116, 769794. Crossref, Google Scholar
  • Heycke T., , Gehrmann S. M., , Haaf J., , & Stahl C. (2018). Of two minds or one? A registered replication of Rydell et al. (2006). Emotion and Cognition, 32, 120. Crossref, Google Scholar
  • Hughes S., , Barnes-Holmes D., , & De Houwer J. (2011). The dominance of associative theorizing in implicit attitude research: Propositional and behavioral alternatives. The Psychological Record, 61, 465498. Crossref, Google Scholar
  • Hughes S., , De Houwer J., , & Perugini M. (2016). Expanding the boundaries of evaluative learning research: How intersecting regularities shape our likes and dislikes. Journal of Experimental Psychology: General, 145(6), 731754. Crossref, Google Scholar
  • Hussey I., , & Hughes S. (2020). Hidden invalidity among 15 commonly used measures in social and personality psychology. Advances in Methods and Practices in Psychological Science, 3(2), 166184. Crossref, Google Scholar
  • Irving L. H., , & Smith C. T. (2019). Measure what you are trying to predict: Applying the correspondence principle to the Implicit Association Test. Journal of Experimental Social Psychology, 86, 103898. Crossref, Google Scholar
  • James L. (2018), The stability of implicit racial bias in police officers. Police Quarterly, 21, 3052. Crossref, Google Scholar
  • Jost J. T. (2019). The IAT is dead, long live the IAT: Context-sensitive measures of implicit attitudes are indispensable to social and political psychology. Current Directions in Psychological Science, 28, 1019. Crossref, Google Scholar
  • Kurdi B., , Seitchik A. E., , Axt J. R., , Carroll T. J., , Karapetyan A., , Kaushik N., , Tomezsko D., , Greenwald A. G., , & Banaji M. R. (2019). Relationship between the Implicit Association Test and intergroup behavior: A meta-analysis. American Psychologist, 74(5), 569586. https://doi.org/10.1037/amp0000364 Crossref, Google Scholar
  • Lai C. K., , Marini M., , Lehr S. A., , Cerruti C., , Shin J. E. L., , Joy-Gaba J. A., et al. (2014). Reducing implicit racial preferences: I. A comparative investigation of 17 interventions. Journal of Experimental Psychology: General, 143, 17651785. Crossref, Google Scholar
  • Lai C. K., , Skinner A. L., , Cooley E., , Murrar S., , Brauer M., , Devos T., et al. (2016). Reducing implicit racial preferences: II. Intervention effectiveness across time. Journal of Experimental Psychology: General, 145, 10011016. Crossref, Google Scholar
  • Larsen H., , Engels R., , Wiers R., , Granic I., , & Spijkerman R. (2012). Implicit and explicit alcohol cognitions and observed alcohol consumption: Three studies in (semi)naturalistic drinking settings. Addiction, 107(8), 14201428. Crossref, Google Scholar
  • Lindgren K. P., , Baldwin S. A., , Ramirez J. J., , Olin C. C., , Peterson K. P., , Wiers R. W., , & & Neighbors C. (2019). Self-control, implicit alcohol associations, and the (lack of) prediction of consumption in an alcohol taste test with college student heavy episodic drinkers. PLOS ONE, 14, e0209940. Crossref, Google Scholar
  • Matsuda I., , Nittono H., , & Allen J. J. B. (2012). The current and future status of the concealed information test for field use. Frontiers in Psychology, 3, 532. Crossref, Google Scholar
  • Meissner F., , Grigutsch L.A., , Koranyi N., Müller F., , & Rothermund K. (2019). Predicting behavior with implicit measures: Disillusioning findings, reasonable explanations, and sophisticated solutions. Frontiers in Psychology, 10, 2483. Crossref, Google Scholar
  • Melnikoff D. E., , & Bargh J. A. (2018). The mythical number two. Trends in Cognitive Sciences, 22, 280293 Crossref, Google Scholar
  • Mitchell G., , & Tetlock P. E. (2017). Popularity as a poor proxy for utility: The case of implicit prejudice. In Lilienfeld S., & Waldman I. (Eds.), Psychological science under scrutiny: Recent challenges and proposed solutions (pp. 164195). West Sussex, England: Wiley. Crossref, Google Scholar
  • Moors A., , & De Houwer J. (2006). Automaticity: A theoretical and conceptual analysis. Psychological Bulletin, 132(2), 297326. Crossref, Google Scholar
  • Moran T., , & Bar-Anan Y. (2020). The effect of co-occurrence and relational information on speeded evaluation. Cognition and Emotion, 34(1), 144155. Crossref, Google Scholar
  • Müller F., , & Rothermund K. (2019). The Propositional Evaluation Paradigm (PEP): Indirect assessment of personal beliefs and attitudes. Frontiers in Psychology, 10, 2385. Crossref, Google Scholar
  • Nock M. K., , Park J. M., , Finn C. T., , Deliberto T. L., , Dour H. J., , & Banaji M. R. (2010). Measuring the “suicidal mind:” Implicit cognition predicts suicidal behavior. Psychological Science, 21, 511517. Crossref, Google Scholar
  • Nosek B. A., , Greenwald A. G., , & Banaji M. R. (2005). Understanding and using the Implicit Association Test: II. Method variables and construct validity. Personality and Social Psychology Bulletin, 31, 166180. Crossref, Google Scholar
  • Nosek B. A., , Greenwald A. G., , & Banaji M. R. (2007). The Implicit Association Test at age 7: A methodological and conceptual review. In Bargh J. A. (Ed.), Automatic processes in social thinking and behavior (pp. 265292). New York: Psychology Press. Google Scholar
  • Okten I. O. (2018). Studying first impressions: What to consider? APS Observer, 31(2), 3536. Google Scholar
  • Oswald F. L., , Mitchell G., , Blanton H., , Jaccard J., , & Tetlock P. E. (2013). Predicting ethnic and racial discrimination: A meta-analysis of IAT criterion studies. Journal of Personality and Social Psychology, 105, 171192. Crossref, Google Scholar
  • Payne B. K., , Burkley M. A., , & Stokes M. B. (2008). Why do implicit and explicit attitude tests diverge? The role of structural fit. Journal of Personality and Social Psychology, 94, 1631. Crossref, Google Scholar
  • Payne B. K., , Vuletich H. A., , & Lundberg K. B. (2017). The bias of crowds: How implicit bias bridges personal and systemic prejudice. Psychological Inquiry, 28, 233248. Crossref, Google Scholar
  • Rothermund K., , & Wentura D. (2004). Underlying processes in the Implicit Association Test (IAT): Dissociating salience from associations. Journal of Experimental Psychology: General, 133, 139165. Crossref, Google Scholar
  • Rydell R., , McConnell A. R., , Strain L. M., , Claypool H. M., , & Hugenberg K. (2007). Implicit and explicit attitudes respond differently to increasing amounts of counterattitudinal information. European Journal of Social Psychology, 37, 867878. Crossref, Google Scholar
  • Sartori G., , Agosta S., , Zogmaister C., , Ferrara S. D., , & Castiello U. (2008). How to accurately detect autobiographical events. Psychological Science, 19(8), 772780. Crossref, Google Scholar
  • Schimmack U. (2019). The Implicit Association Test: A method in search of a construct. Perspectives on Psychological Science. https://doi.org/10.1177/1745691619863798 Google Scholar
  • Smith E. R., , & DeCoster J. (2000). Dual-process models in social and cognitive psychology: Conceptual integration and links to underlying memory systems. Personality and Social Psychology Review, 4, 108131. Crossref, Google Scholar
  • Spruyt A., , De Houwer J., , Tibboel H., , Verschuere B., , Crombez G., , Verbanck P., , Hanak C., , Brevers D., , & Noël X. (2013). On the predictive validity of automatically activated approach/avoidance tendencies in abstaining alcohol-dependent patients. Drug and Alcohol Dependence, 127, 8186. Crossref, Google Scholar
  • Spruyt A., , Lemaigre V., , Salhi B., , Van Gucht D., , Tibboel H., , Van Bockstaele B., , De Houwer J., , Van Meerbeeck J., , & Nackaerts K. (2015). Implicit attitudes towards smoking predict long-term relapse in abstinent smokers. Psychopharmacology, 232, 25512561. Crossref, Google Scholar
  • Stieger S., , Goritz A. S., , Hergovich A., & Voracek M. (2011). Intentional faking of the single category Implicit Association Test and the Implicit Association Test. Psychological Reports, 109, 219230 Crossref, Google Scholar
  • Tello N., , Harika-Germaneau G., , Serra W., , Jaafari N., , & Chatard A. (2020). Forecasting a fatal decision: Direct replication of the predictive validity of the Suicide-Implicit Association Test. Psychological Science, 31, 6574. Crossref, Google Scholar
  • Thush C., , Wiers R. W., , Ames S. L., , Grenard J. L., , Sussman S., , & Stacy A. W. (2007). Apples and oranges? Comparing indirect measures of alcohol-related cognition predicting alcohol use in at-risk adolescents. Psychology of Addictive Behaviors, 21(4), 587591. Crossref, Google Scholar
  • Van Dessel P., , Cone J., , Gast A., , & De Houwer J. (2020). The impact of valenced verbal information on implicit and explicit evaluation: The role of information diagnosticity, primacy, and memory cueing. Cognition & Emotion., 34, 7485. Crossref, Google Scholar
  • Van Dessel P., , Gawronski B., , & De Houwer J. (2019). Does explaining social behavior require multiple memory systems. Trends in Cognitive Sciences, 23(5), 368369. Crossref, Google Scholar
  • Van Dessel P., , Gawronski B., , Smith C. T., , & De Houwer J. (2017). Mechanisms underlying approach-avoidance instruction effects on implicit evaluation: Results of a preregistered adversarial collaboration. Journal of Experimental Social Psychology, 69, 2332. Crossref, Google Scholar
  • Van Dessel P., , Hughes S., , & De Houwer J. (2019). How do actions influence attitudes? An inferential account of the impact of action performance on stimulus evaluation. Personality and Social Psychology Review, 23, 267284. Crossref, Google Scholar
  • Verschuere B., , Ben-Shakhar G., , & Meijer E. (2011). Memory detection: Theory and application of the concealed information test. New York: Cambridge University Press. Crossref, Google Scholar
  • Wiers C. E., , Gladwin T. E., , Ludwig V. U., , Gröpper S., , Stuke H., et al. (2017). Comparing three cognitive biases for alcohol cues in alcohol dependence. Alcohol, 52, 242248. Google Scholar
Previous article
Next article