Paper and online surveys can both collect useful data. Their response rates depend on the population, invitation, reminders, questionnaire, accessibility and setting. Neither mode guarantees a high response rate, honest answers or a representative sample.
Response rate also has a denominator. A count of returned questionnaires is not a response rate unless you know how many eligible people were invited and how eligibility was handled. Keep the same definitions when comparing collection methods.
What Published Comparisons Show
Shih and Fan’s 2008 meta-analysis compared web and mail surveys across 39 studies. Mail generally received more responses, with differences varying by population and follow-up arrangements.
Daikeler and colleagues’ 2020 meta-analysis examined 114 experimental comparisons. Web response rates were about 12 percentage points lower on average than the other modes studied. That historical average is not a forecast for a particular questionnaire or audience.
For a more specific population, Meyer and colleagues’ review of surgical surveys reported average response rates of 76% for in-person surveys, 65% for postal surveys and 46% for web surveys. Those are findings from surgical patients and healthcare professionals, rather than universal benchmarks for every industry.
Do not multiply an already calculated response rate by an email open rate. They measure different stages, and a response rate based on all eligible invitees already includes people who did not open or answer the invitation.
When Online Collection Helps
An online form can reach people remotely, avoid printing and postage, and place submitted answers directly into a dataset. Respondents may prefer it when they have convenient internet access and can complete the questionnaire privately.
Those advantages do not establish who will respond. Check device access, language, accessibility, invitation coverage and repeat submissions. A large number of responses from an open link can still be a self-selected sample.
When Paper Collection Helps
Paper can be useful in classrooms, clinics, workplaces, events and field sites where people meet in person or cannot conveniently use an online form. Postal collection can also reach people outside a digital contact list when suitable addresses are available.
Paper still needs readable instructions, accessible presentation, distribution and a return process. It does not remove literacy, language, disability, privacy or nonresponse problems. People who attend a particular venue may differ from the population you intend to describe.
Response Rate and Answer Quality Are Different
A higher response rate does not, by itself, prove that the answers are accurate or representative. Both paper and online respondents can misunderstand a question, skip an item or give a socially desirable answer.
Keep question wording and scale direction consistent when comparing modes. Consider how administration, layout and respondent selection differ. Report missing answers and relevant sample limitations rather than attributing every difference to the medium.
Combining Paper and Web
Offering both methods can make participation easier for different groups. Define who receives each invitation, decide how to handle repeated submissions and keep collection-mode information with the responses.
PaperSurvey.io supports paper and web responses for the same questionnaire. For paper recognition, create or import the questions and generate new PaperSurvey forms before collection. It does not automatically recognize completed forms printed elsewhere.
After scanning, compare recognized answers with the original images and correct errors before analysis. Include checks of automatically accepted answers, then inspect the export and response counts.
Test the Collection Plan
Run a small pilot with the audience and equipment you expect to use. Measure invitations, responses, printing, scanning and review work using consistent definitions. Choose the collection mix that fits the project, and use published studies as context rather than a promised result.