Jelke Bethlehem

Handbook of Web Surveys


Скачать книгу

1.4 shows the implementation of an open question. Any text can be entered in the input field. A limit may be set to the length of the text. An open question is defined with type=text for the <input> tag.

image

      If an input field is preferred that allows for more lines of text to be answered, the <textarea> tag can be used for this.

image

      In the first years of the World Wide Web, use of web surveys was limited by the low penetration of the Internet. Internet penetration was higher among establishments than among households. Therefore, it is not surprising that first experiments tested the use of web business surveys. Clayton and Werking (1998) describe a pilot carried out in 1996 for Current Employment Statistics (CES) program of the U.S. Bureau of Labor Statistics. They expected the web to offer a low‐cost survey environment. Because it was a form of true online data collection, an immediate response to the answers of the respondents was possible. This could improve data quality. They also saw the great flexibility of web survey questionnaires. They could be offered in a form layout or in a question‐by‐question approach. The drawback was the limited number of respondents having access to the Internet. Only 11% of CES respondents had access to Internet and a compatible browser.

      Roos and Wings (2000) conducted a test with Internet data collection at Statistics Netherlands for the construction industry. Respondents could choose between three modes:

       Completing a form offline. The form was sent as an HTML file that was attached to an e‐mail. The form is downloaded, completed offline, and returned by e‐mail.

       Completing a form online. The Internet address of an online web form was sent by e‐mail. The form was completed online.

       Completing an e‐mail form. An e‐mail is sent containing the questionnaire in plain text. Respondents clicked the reply button, answered the questions, and sent the e‐mail back.

      A sample of 1,500 companies was invited to participate in the experiment. 188 companies were willing and able to participate. Of those, 149 could surf the Internet, and 39 only had e‐mail. Questionnaire completion times of all three modes were similar to that of a paper form. Respondents preferred the form‐based layout over the question‐by‐question layout. The conclusion of the experiment was that web surveys worked well.

      General population web surveys were rare in the first period of existence of the Internet. This was due to the low Internet penetration among households. This prevented conducting representative surveys. However, there were polls on the Internet. Recruitment of respondents was based on self‐selection and not on probability sampling. Users could even create their own polls on websites like Survey Central, Open Debate, and Internet Voice (see O'Connell, 1998).

      It seems to be typical for this type of self‐selection web surveys that they make it possible to collect data about a large number of respondents in a relatively short time. Other examples are given by Bethlehem and Stoop (2007). The survey 21minuten.nl has been conducted a number of times in the Netherlands. This survey supposed to supply answers to questions about important problems in Dutch society. Within a period of six weeks in 2006, about 170,000 people completed the online questionnaires. A similar survey was conducted in Germany. It is called Perspektive Deutschland. More than 600,000 participated in this survey in 2005/2006.

      It should be noted that these large sample sizes are no guarantee for proper statistical inference. Due to under‐coverage (not everyone has access to the Internet) and self‐selection (no proper random sampling), estimates can be biased. This bias is independent of the sample size.

      Beukenhorst and Wetzels (2009) describe a mixed‐mode experiment conducted by Statistics Netherlands. They used the Dutch Safety Monitor for this experiment. This survey asks questions about feelings of security, quality of life, and level of crime experienced. The sample for this survey was selected from the Dutch population register. All sampled persons received a letter in which they were asked to complete the survey questionnaire on the Internet. The letter also included a postcard that could be used to request a paper questionnaire. Two reminders were sent to those that did not respond by web or mail. If still no response was obtained, nonrespondents were approached by means of CATI, if a listed telephone number was available. If not, these nonrespondents were approached by CAPI.

      To be able to compare this four‐mode survey with a traditional survey, also a two‐mode survey was conducted for an independent sample. Sampled persons were approached by CATI if their telephone number was listed in the directory, and otherwise they were approached by CAPI.

      The response rate for four‐mode survey turned out to be 59.7%. The response rate for the two‐mode survey was higher. So, introducing more modes did not increase the overall response rate. However, more than half of the response (58%) in the four‐mode survey was obtained with a self‐administered mode of data collection (web or paper). Therefore, the costs of the survey were much lower. Interviewers were deployed in only 42% of the cases. For more detail, see Beukenhorst and Wetzels (2009) or Bethlehem, Cobben, and Schouten (2011).