Methods to Improve the Effectiveness of Online Surveys Used to Analyze Socio-Economic Processes

About the authors:

Sergei N. Martyshenko, Cand. Sci. (Tech.), Professor, Department of Mathematics and Modeling, Vladivostok State University of Economics and Service; sergey.martishenko@vvsu.ru

Natalia S. Martyshenko, Cand. Sci. (Econ.), Associate Professor, Department of International Marketing and Trade, Vladivostok State University of Economics and Service; natalya.martyshenko@vvsu.ru

Abstract:

The number of researchers using questionnaires in their work has increased significantly after the appearance of special online services for the development of electronic questionnaires in the internet. Methods of designing and analyzing electronic questionnaires are constantly being improved. Among the main problems associated with collecting data on the internet is the problem of improving the quality and reliability of the data collected. The paper presents an analytical review of Russian publications on raising the effectiveness of online surveys. A distinctive feature of the methods proposed in this paper is the use of multivariate statistical analysis, which allows to analyze the quality of all kinds of the data received during a questionnaire.

Among the new elements of online surveys, one can mention the developed metrics for assessing the significance of the relations between different respondents’ answers to the questionnaire questions. Based on the developed methods, the authors have developed a set of software tools with a high level of automation. It allows to quickly monitor the current questionnaire in real time and making a decision in time to manage the survey process.

References:

1. Belikova Yu. V. 2016. “Sravnitel'nyy analiz servisov dlya provedeniya onlayn oprosov” [Comparative Analysis of Services for Conducting Online Surveys]. Aktual'nye nauchnye issledovaniya v sovremennom mire, no. 5-4 (13), pp. 36-41.
2. Bondarenko V. A., Ivanchenko O. V. 2016. “Sovremennye tendentsii v oprosakh potrebiteley s ispol'zovaniem komp'yutero-oposredovannoy kommunikatsii” [Current Trends in Consumer Surveys Using Computer-Mediated Communication]. Ekonomika i predprinimatel'stvo, no 1-1 (66-1), pp. 605-608.
3. Galitskiy E. B., Mal'tseva P. V. 2013. “Potentsial'nye istochniki oshibok v dannykh onlayn-oprosov” [Potential Sources of Errors in Online Survey Data]. Prakticheskiy marketing, no 10 (200), pp. 2-8.
4. Efimova D. M., Ermolaev S. V. 2014. “Sravnitel'nyy analiz servisov dlya prodvizheniya oprosa v seti internet” [Comparative Analysis of Services for Promoting the Survey in the Internet]. Vestnik Rossiyskogo ekonomicheskogo universiteta im. G. V. Plekhanova. Vstuplenie. Put' v nauku, no 1-2 (9), pp. 88-95.
5. Ivanova V. A. 2015. “Osobennosti provedeniya distantsionnykh oprosov onlayn” [Features of Remote Surveys Online]. Marketing v Rossii i za rubezhom, no 1, pp. 11-16.
6. Ked A. P., Agaeva P. M. 2015. “Internet-opros kak metod sotsiologicheskogo issledovaniya” [Internet Survey as a Method of Sociological Research]. Problemy sovremennoy ekonomiki (Novosibirsk), no 27, pp. 112-116.
7. Mavletova A. M., Maloshonok N. G., Terent'ev E. A. 2014. “Vliyanie elementov priglasheniya na uvelichenie doli otklikov v onlayn-oprosakh” [Influence of Elements of the Invitation to Increase the Share of Responses in Online Surveys]. Sotsiologiya: metodologiya, metody, matematicheskoe modelirovanie, no 38, pp. 72-95.
8. Maloshonok N. G., Terent'ev E. A. 2014. “Vliyanie dizayna na kachestvo dannykh v onlayn-oprosakh studentov” [The Influence of Design on the Quality of Data in Online Surveys of Students]. Monitoring obshchestvennogo mneniya: ekonomicheskie i sotsial'nye peremeny, no 6 (124), pp. 15-27.
9. Martyshenko N. S. 2011. “Komp'yuternaya tekhnologiya obrabotki kachestvennykh dannykh oprosov potrebiteley turistskikh uslug” [Computer Technology for Processing Qualitative Survey Data of Consumers of Tourist Services]. Marketing i marketingovye issledovaniya, no 3 (93), pp. 184-192.
10. Martyshenko S. N., Martyshenko N. S. 2008. “Metod obnaruzheniya oshibok v empiricheskikh dannykh” [Method of Error Detection in Empirical Data]. Izvestiya vysshikh uchebnykh zavedeniy. Severo-Kavkazskiy region. Seriya: Tekhnicheskie nauki, no 1, pp. 11-14.
11. Martyshenko S. N., Martyshenko N. S., Kustov D. A. 2006. “Tsenzurirovanie pri obrabotke anketnykh dannykh” [Censoring during the Processing of Personal Data]. Izvestiya vysshikh uchebnykh zavedeniy, Povolzhskiy region. Tekhnicheskie nauki, no 6, pp. 170-177.
12. Moiseev S. P., Savinkova Yu. K. 2014.” Vyborka, napravlyaemaya respondentom, v onlayn-oprose: k voprosu o dinamike i kachestve” [The Sample Sent by the Respondent in the Online Survey: To the Question of Dynamics and Quality]. Monitoring obshchestvennogo mneniya: ekonomicheskie i sotsial'nye peremeny, no 6 (124), pp. 43-50.
13. Nasonova N. A., Kozhevnikova T. V. 2013. “Primer sozdaniya reprezentativnogo internet-oprosa pri sotsiologicheskikh issledovaniyakh” [An Example of Creating a Representative Internet Survey during Sociological Research]. Nauchno-tekhnicheskoe i ekonomicheskoe sotrudnichestvo stran ATR v XXI veke, vol. 2, pp, 311-319.
14. Nasretdinova M. M. 2014. “Aktual'nost' onlayn issledovaniy v Rossii” [The Relevance of Online Research in Russia]. Psikhologiya, sotsiologiya i pedagogika, no 6 (33), p. 24.
15. Nasretdinova M. M. 2015. “Osobennosti organizatsii oprosa v seti internet” [Features of the Organization of the Survey in the Internet]. Psikhologiya, sotsiologiya i pedagogika, no 5 (44), pp. 76-77.
16. Nekrasov S. I. 2011. “Sravnenie rezul'tatov onlayn- i offlayn-oprosov (na primere anket raznoy slozhnosti)” [Comparison of the Results of Online and Offline Surveys (On the Example of Questionnaires of Different Complexity)]. Sotsiologiya: metodologiya, metody, matematicheskoe modelirovanie, no 32, pp. 53-74.
17. Farakhutdinov Sh. F. 2011. “Professional'nye respondenty kamen' predknoveniya onlayn-oprosov v sovremennoy Rossii” [Professional Respondents Are the Stone of the Prediction of Online Surveys in Modern Russia]. Teleskop: zhurnal sotsiologicheskikh i marketingovykh issledovaniy, no 2, pp. 45-47.
18. Fedorovskiy A. M. 2015. “Kachestvo onlayn-oprosov. Metody proverok” [The Quality of Online Surveys. Test Methods]. Monitoring obshchestvennogo mneniya: ekonomicheskie i sotsial'nye peremeny, no 3 (127), pp. 28-35.
19. Shkurin D. V. 2015. “Sravnitel'naya otsenka kachestva dannykh oflayn i onlayn-oprosov” [Comparative Evaluation of the Quality of Offline Data and Online Surveys]. Diskussiya, no 8, pp. 101-105.
20. Alessi E. J., Martin J. I. 2010. “Conducting an Internet-Based Survey: Benefits, Pitfalls, and Lessons Learned”. Social Work Research, no. 34 (2), pp. 122-128. DOI: 10.1093/swr/34.2.122
21. Hohwü L., Lyshol H., Gissler M., Jonsson S. H., Petzold M., Obel C. 2013. “Web-Based versus Traditional Paper Questionnaires: A Mixed-Mode Survey with a Nordic Perspective”. Journal of medical Internet research, no 15 (8). DOI: 10.2196/jmir.2595
22. Hunter L. 2012. “Challenging the Reported Disadvantages of E-Questionnaires and Addressing Methodological Issues of Online Data Collection”. Nurse researcher, no 20(1), pp. 11-20. DOI: 10.7748/nr2012.09.20.1.11.c9303
23. Jiang L., Yang Z., Jun M. 2013. “Measuring Consumer Perceptions of Online Shopping Convenience”. Journal of Service Management, no 24 (2), pp. 191-214. DOI: 10.1108/09564231311323962
24. Leung K. Y. 2016. “Preconception Health and Nutrition Knowledge of Asian-American Women Using an Online Questionnaire and Social Media Recruitment”. Doctoral dissertation. D'Youville College. 
25. Martyshenko S. N., Egorov E. A. 2011. “Information Technology for Increasing Qualitative Information Processing Efficiency”. Journal of Modern Applied Statistical Methods, 10 (1), pp. 207-213. DOI: 10.22237/jmasm/1304223480
26. McPeake J., Bateson M., O’Neill A. 2014. “Electronic Surveys: How to Maximise Success”. Nurse researcher, 21 (3), pp. 24-26. DOI: 10.7748/nr2014.01.21.3.24.e1205
27. Pedersen M. J., Nielsen C. V. 2016. “Improving Survey Response Rates in Online Panels: Effects of Low-Cost Incentives and Cost-Free Text Appeal Interventions”. Social Science Computer Review, 34 (2), pp. 229-243. DOI: 10.1177/0894439314563916
28. Phillips K. Data 2013. “Use: An Evaluation of Quality-Control Questions”. Quirk’s Marketing Research Review, December. http://www.quirks.com/articles/2013/20131205.aspx
    
29. Puleston J., Eggers M. 2012. “Dimensions of Online Survey Data Quality. What Really Matters?”. Paper presented at Congress 2012 Accelerating Excellence Celebrating 65 Years and beyond. Atlanta.
30. Regmi P. R., Waithaka E., Paudyal A., Simkhada P., Van Teijlingen E. 2016. “Guide to the Design and Application of Online Questionnaire Surveys”. Nepal Journal of Epidemiology, 6 (4), p. 640. DOI: 10.3126/nje.v6i4.17258
31. Traina S. B., Mathias S. D., Colwell H. H., Crosby R. D., Abraham C. 2016. “The Diabetes Intention, Attitude, and Behavior Questionnaire: Evaluation of a Brief Questionnaire to Measure Physical Activity, Dietary Control, Maintenance of a Healthy Weight, and Psychological Antecedents”. Patient preference and adherence, no 10, pp. 213. DOI: 10.2147/PPA.S94878
32. Velez P., Buletti J. D., Volz S. 2004. Respondent Differences between Web-Based Surveys and Paper/Pencil Surveys: A Comparision of Response Rates, Respondents, and Responses.
33. Wu M. 2016. “Research on College Students’ Recognition and Practice of Socialist Core Values Based on Online Questionnaire”. International Journal of Smart Home, no 10(4), pp. 221-232. DOI: 10.14257/ijsh.2016.10.4.20