Effects of Forced Responses and Question Display Styles on Web Survey Response Rates

Abstract

Researchers have increasingly adopted a web survey for data collection. Previous studies have examined factors leading to a web survey’s success. However, virtually no empirical work has examined the effects of the three levels of forced responses or the two styles of question items displayed on a web survey’s response rate. The current study attempted to fill this void. Using a quasi-experiment approach, we obtained 778 unique responses to six comparable web questionnaires of identical content. The analysis confirmed that (1) there were statistically significant differences across the surveys with the 100%-, 50%- and 0%-forced responses, and (2) there is not a significant difference between the response rates between surveys with scrolling and those with paging styles. In addition to extending the theoretical insight into factors contributing to a web survey’s response rate, the findings have offered recommendations to enhance the response rate in a web survey project.

Keywords: {'name': 'Forced Responses'}, {'name': 'Question Display Styles'}, {'name': 'Scrolling'}, {'name': 'Paging'}, {'name': 'Web Survey Response Rate'}

Authors & affiliations

Chatpong Tangmanee
Affiliation not supplied

Phattharaphong Niruttinanon
Affiliation not supplied

Deposited references

Supplied references, not a list of publications citing this article.

DOI: 10.2753/MTP1069-6679180306

Atinc, M. Y. (2012). Response rate and response error in marketing research. Unpublished doctoral dissertation. Louisiana Tech University.

Batagelj, Z.; Manfreda, K.L.; Vehovar, V. (2002). Design of Web Survey Questionnaires: Three Basic Experiments. Journal of computer-mediated communication.

DOI: 10.2196/jmir.9.5.e40

DOI: 10.1300/J005v29n01_04

DOI: 10.1177/1525822X08330261

DOI: 10.1177/089443930202000101

Dillman, D. A. (2007). Mail and Internet surveys: The tailored design method. Imprint New York: J. Wiley.

Elliott, M.N.; Fricker, R.D. & Schonlau, M. (2002) Conducting research survey via e-mail and the web. CA: RAND

DOI: 10.1016/j.chb.2009.10.015

DOI: 10.1093/poq/nfp031

Jackob, N. & Zerback, T. (2006). Improving quality by lowering nonresponse: A guideline for online surveys. Paper presented at the WAPOR seminar “Quality criteria in survey research VI” Cadenabbia, Italy.

DOI: 10.1093/alcalc/37.3.256

DOI: 10.1016/j.foodqual.2014.06.002

DOI: 10.1093/poq/nfu015

North, N & Park, E. (2012). Potential for a web-based tool to confirm and update health management and leadership competencies. Experiences of a pilot survey in New Zealand 2012. Asia Pacific journal of health management, 9(2), 13-20.

DOI: 10.1080/01449290010021764

DOI: 10.3758/BF03202544

DOI: 10.1093/poq/nfl028

Polonsky, M. & Vocino, A. (2010). Survey completion speed of online panelists: The role of demographics and experience. Proceeding of the 2010 Australian and New Zealand Marketing Academy Conferences, NZ; 2010.

DOI: 10.1026//1618-3169.49.4.243

DOI: 10.1002/asi.20651

Roscoe, J.T. (1975). Fundamental research statistics for the behavioral sciences. 2nd edition. New York: Holt, Rinehart and Winston.

Sedley, A. & Callegaro, M., (2012). Effects of pagination on short online surveys. Proceedings of the American association for public opinion research (AAPOR), 67th Annual Conference.

DOI: 10.1002/asi.20651

DOI: 10.2466/pms.1981.52.1.219

DOI: 10.1177/0894439309340751

Yan, T.; Conrad, F.G.; Tourangeau, R. & Couper, M.P. (2007). Should I stay or should I go? The effects of progress indicators, promised duration, and questionnaire length on completing web surveys. Proceedings of the American association for public opinion research (AAPOR), 62nd Annual Conference.

DOI: 10.2196/jmir.2322