Skip to main content

A Comparison of Web- with Paper-Based Surveys of Gay and Bisexual Men Who Vacationed in a Gay Resort Community

Internet Web page survey responses were compared with those collected using traditional paper-and-pencil strategies to assess relative inclusion of a geographically dispersed population and comparativeness in responses. Three hundred and seven gay or bisexual men who had vacationed in a particular gay community completed Web-based and 244 paper-and-pencil questionnaires. Each questionnaire contained the same wording and question order. More Internet respondents than paper reported bisexual identity, nonmetropolitan residence, greater numbers of nonmain male partners for unprotected anal intercourse, and alcohol use than did paper-and-pencil respondents. Few other differences were identified. Assessing the reach of survey distribution can add to our knowledge base of surveys fielded using the Internet. Similarly, examining the potential biases in modes of administering convenience surveys can assist researchers to select the survey data collection method most appropriate to their research goals and design studies to assess the effect of the methods that are used.


  • Cook , C., Heath, F., & Thompson, R. (2000). A meta-analysis of Web- or internet-based surveys. Educational and Psychological Measures, 60, 821–836. CrossrefGoogle Scholar
  • Couper , M. (2000). Web surveys: A review of issues and approaches. Public Opinion Quarterly, 64, 464–494. Crossref MedlineGoogle Scholar
  • Couper , M., Traugott, M., & Lamias, M. (2001). Web survey design and administration. Public Opinion Quarterly, 65, 230–253. Crossref MedlineGoogle Scholar
  • Dillman, D. A. (2000). Mail and Internet surveys: The tailored design method. New York: Wiley. Google Scholar
  • Epstein , J., & Klinkenberg, W. D. (2001). From Eliza to Internet: A brief history of computerized assessment. Computers in Human Behavior, 17, 295–314. CrossrefGoogle Scholar
  • Fricker , R. D., & Schonlau, M. (2002). Advantages and disadvantages of Internet research surveys: Evidence from the literature. Field Methods, 14, 347–367. CrossrefGoogle Scholar
  • King , W. C., & Miles, E. W. (1995). A quasi-experimental assessment of the effect of computerizing noncognitive paper-and-pencil measurements: A test of measurement equivalence. Journal of Applied Psychology, 80, 643–651. CrossrefGoogle Scholar
  • Lenert , L., & Skoczen, S. (2002). The Internet as a research tool: Worth the price of admission? Annals of Behavioral Medicine, 24, 251–256. Crossref MedlineGoogle Scholar
  • Madden, M. (2003). America's online pursuits: The changing picture of who's online and what they do. Washington, DC: Pew Internet and American Life Project. Google Scholar
  • National Telecommunications and Information Administration. (2000). Falling through the net: Toward digital inclusion. Washington, DC: U.S. Department of Commerce. Google Scholar
  • Raziano , D. B., Jayadevappa, R., Valenzula, D., Weiner, M., & Lavizzo-Mourey, R. (2001). E-mail versus conventional postal mail survey of geriatric chiefs. Gerontologist, 41, 799–804. Crossref MedlineGoogle Scholar
  • Rhodes , S. D., Bowie, D. A., & Hergenrather, K. C. (2003). Collecting behavioral data using the World Wide Web: Considerations for researchers. Journal of Epidemiology and Community Health, 57, 68–73. Crossref MedlineGoogle Scholar
  • Rhodes , S. D., DiClemente, R. J., Cecil, H. Bowie, D. A., Hergenrather, K. C., & Yee, L. J. (2002). Risk among men who have sex with men in the United States: A comparison of an Internet sample and a conventional outreach sample. AIDS Education and Prevention, 14, 41–50. LinkGoogle Scholar
  • Ross , M. W., Tikkanen, R., & Mansson, S. (2000). Differences between Internet samples and conventional samples of men who have sex with men: Implications for research and HIV interventions. Social Science and Medicine, 51, 749–758. Crossref MedlineGoogle Scholar
  • Simsek , Z., & Veiga, J. F. (2001). A primer on Internet organizational surveys. Organizational Research Methods, 4, 218–235. CrossrefGoogle Scholar
  • Stanton , J. M. (1998). An Empirical assessment of data collection using the Internet. Personnel Psychology, 51, 709–725. CrossrefGoogle Scholar
  • Stanton , J. M., & Rogelberg, S. G. (2001). Using Internet/intranet web pages to collect organizational research data. Organizational Research Methods, 4, 200–217. CrossrefGoogle Scholar
  • Turner , C. F., Ku, L., Rogers, S. M., Lindberg, L. D., Pleck, J. H., & Sonerstein, F. L. (1998). Adolescent sexual behavior, drug use, and violence: Increased reporting with computer survey technology. Science, 280, 867–873. Crossref MedlineGoogle Scholar
  • Whittier , D. K., Kennedy, M., Seeley, S., St, Lawrence, J., & V. Beck. (2005). Embedding health messages into entertainment television: Impact on gay men's response to a syphilis outbreak. Journal of Health Communication. MedlineGoogle Scholar